I recently picked up a sencore crt tester. Can I do any of the tests with a loose crt? Like test for shorts? Or must the crt be installed in a chassis to do any testing?

CRT tests are always done on the CRT itself, disconnected from the chassis.Chassis should be OFF and UNPLUGGED, and high voltage discharged to be safe.