Time to start over and punt on my block?

The short block is already assembled, but was bored, and honed with plates. Is the wall going to be affected after putting in the insert? I'm not trying to ask a stupid question here, just trying to learn.

myself , I doubt it .