Should I make the swap to G3?

Don't take this the wrong way, but the whole numbers/value thing doesn't mean anything to me. If it was a hemi car and I wanted to put in an LS in it, I would without hesitation, nor would I care what others think. I'm completely aware of number matching crap but they don't matter to me, nor do they apply to this car. This car doesn't have any value to a "collector".

The car is a 70 Duster as seen in my profile picture.

I already own a 5.7. If I was wanting to spend $10K on the swap, I would without a doubt buy a 6.4. I feel like I could do this swap "relatively" cheap since I already own the engine and efi controller.

Some goals: No oil leaks. No matter what I do, I still seem to have a very small oil drip after putting some miles on it. Also, V-belts are a *****, they don't like to stay on when you turn the engine 7000RPM. I recently purchased some serpentine pulleys for the 408- we'll see how that works. This point may become moot if they work. I'll likely add a centrifugal supercharger soon. This will make leaks on the 408 even worse. Lastly, I think the 5.7 will offer similar if not more power than the 408 (even in NA form) after changing to the eagle heads, rods/pistons, and cam.
The supercharger changes things drastically. Even at 5-6 psi the 500hp 408 will now be very close to the limits of the block. Trust me it will always be on your mind when you stand on it. If any kind of forced induction is in your future, do the g3 swap and never ever look back.