Dust caps not fitting

Just wondering if anyone else has had this problem? I replaced front bearings, races and seals. When I went to put the dust caps back on, they would not go on all the way. One more so than the other; but they both fit flush before. Is it a big deal if they don't go all the way on as long as they don't fall off? Car info: 1972 Dodge Dart Custom 318 v8 10" Drum Brakes. Thanks for any help/input...