Oh Brian... let me tell you a story...
First - check the cap to make sure the metal "can lid" thingie is pointing up. In other words, you want the outside of the lid to be closest to the engine. Then you may want to replace your gasket. After that, you blame the cap. If you really wanna be scared, check out my thread -
White goo...
But since your cap didn't break off but instead rattled, I wouldn't worry too much. If you're careful, you can bend the little tabs to put a bit more tension in, but this will take away some of the metal's structural integrity.
Oh, also - I'd buy a used cap from APE or someone before I got a new one. I put my new one (which failed) next to my old one and it was noticibly thinner metal.