crazy idea

I don't think it's so much what temp they get to, as much as it is the normal operating temp and the stresses on the strength of aluminum.
Even cold, the stress of the exhaust "flexing " would be enough to crack/break a header.

I think.
Good thought. I have over 30 years experience working for Douglas Aircraft and Boeing as a materials and process engineer. Aluminum has been used in primary aircraft structures for many decades and they experience many types of stresses. Different alloys have different physical and mechanical properties. It really is important to know to what temperature the aluminum would be exposed. The induced stress from having two different metals expanding at different rates (iron head vs aluminum manifold) would be mitigated to some degree by the exhaust gasket material and thickness. I believe that an aluminum exhaust manifold could be designed for the slant six application with enough knowledge of the operating temperature. Fabricating a few might be costly.

Just my two cents.