What would cause this weird bearing wear?

Did you put assembly lube on the bearings?

I just coated them with engine oil as I thought that was sufficient. So what do I coat them with? That red cam lube?