do i have to remove.....

Many people have left the block-to-trans braces off. They probably will interfere, but aren't needed anyway. Plenty of very fast cars without them.