I am pretty sure you can just as long as the people that grabbed the monitors don't leave, we had a situation where we wanted to change to our main characters and once we came back in to kill the boss we lost all the monitors except one. So I recommend you let the host pick up all the monitors. Then you can leave and re join until the host leaves and you lose all of them.