I suggest running the wires from the amps to a switch box, and then to the speakers. That way you will avoid having both amps connected to the speakers at the same time.
But, I must ask, why would you want to connect two different amps to the same set of speakers?