'64 Dart GT: 273 to 325 swap ?

I'm interested in swapping the 273 in my '64 Dart GT. Would the 4-speed and the engine compartment accept a '57 325 poly / hemi ? Has anyone done this ? If so, what were the snags / concerns. I'm thinking if it did fit, block hugger headers would be needed. Please help. Carey