Though because of weight and the batteries will take longer to charge, maybe I should take them out. But whatever I decide thank you giving me the knowledge!
Just make sure to disconnect the panels before disconnecting the batteries from the controller and reconnect the batteries to the controller before reconnecting the panels.
Regarding the last post, if you don't have one already, you might want to add a disconnect switch between your panels and your charge controller. I'm using one of these, which goes one of two directions or off (a simple on off is 9 cents cheaper). Good for safely disconnecting, and also my charge controller has screw terminals that aren't really intended for repeated use.