Ken,
It's not uncommon for the shorts light to flash during testing. If you get a consistent short that's when there's a problem. The arcing that you witnesses might have something to do with putting a somewhat hot tube back into a live socket, but I'm not an expert about that. I'd try retesting that tube when it's stone cold and see what happens.