Line honing crank journals

If I understand the line honing process, the cap's surface gets ground down a bit and then they are bolted and torqued to the block and honed to the correct diameter. Here is my question. If a few thousandths is honed from both the cap and the block surface, wouldn't that bring the center of the crank a few thousandths closer to the cam? And could that cause the timing chain to get a little loose? Or is it too little to worry about?