It is your starter, when you removed the key it was stilling spinning due to inertia (**** Newton and his laws of physics!!!). Check your starter to see if it is still bolted in and yes, all bolts are required, also check your flywheel, it could be you have several broken teeth off of it.