And if you were my assistant I would find every way possible to get you to leave. You can't function in a band hall if your standard answer is "you're not my boss". It doesn't work. Nor does it work for you to decide what is and isn't acceptable in your eyes to what you will or won't do.

So you could play that card and if I found it unacceptable I would make your life uncomfortable to where you wanted to leave. Two can play the document or involve "supervisor" card. Sometimes the employee is the problem and not the manager.