Thanks guys, it was indeed the ground coming from the camper. I just got a long piece of 2-wire romex and ran it from the camper wiring to my truck's battery to test the lights. No issues when connected directly to battery so I had the ground wrong.
I'm thinking I am just going to install a switch panel in the truck and tie the camper lights into that panel as opposed to the driving lights on the truck. I like the of being able to turn the camper lights on when needed on their own. Will report back!