Just so everyone is clear, I don't think you need to be in combat "technically" to have him evacuate. I think any form of target lockdown will get him to evacuate.
So if you blow something up near him, he may evacuate even if you're not in combat, just like blowing up a bomb on your room balcony in Hokkaido to get yuki to evacuate right away. I think it will go off the same premise.
Just a guess, so be careful.