Nate beat em to it, but I spent a few minutes typing, so I'm posting it anyway.
That is the special design of the connector. The ground part retracts into the plug. The idea is that when you go to plug in the connector, it will make a contact with ground, thereby avoiding popping noises.
So your assumptions would be correct, but the 'outside' retracts into the connector itself.