Either remove it permanently (aside from the quest for sturm) Or make the boss remain in the arena at all times (only teleporting out to switch from shotgun to swords)
-
Same can be said about the fanatic strike. Any boss that goes immune and/or teleports away is not a boss I care to fight.