I believe higher priority # = first. I use Ninja = 4, Ripper = 3, Slayer/Slasher = 1
Whipping out your weapon is annoying and slow unless you pause LTXI, since it will just flip out and re-equip your previous weapon. For a mage considering they are relatively few and far between it's just easier to vuln and war than to change wands.