USB is made to move stuff easily, if this is a problem I will never buy another USB to midi interface
Can I ask... why do you feel the need to unplug or move USB devices around in the first place? I guess I don't understand - if you've got things working properly, then why are you disconnecting them or moving them to another port?
If it's a question of the number of USB ports you have being limited - multi-port USB extender cards are dirt cheap these days - I've seen 4 port extender cards going for as little as $6 - brand new.
Computer refurbishing /parts stores are damn near giving away external 4 port USB extenders ( the ribbon cable type) ...