Do I leave the lights on? Or off?

Definitely leave any outdoor lights off. If you have any motion-sensor lights, disable them. Shy cats don’t like to be exposed, and they’re almost always more comfortable slinking around int he dark.