We have left them alone. They are big fat bees, but there is not much room in a bird box for them. They queue up waiting for one to come out before the next one can go in.
No..I think in was still only the single Queen. I waited until she was out then sprayed. She came back, but then left again! So I waited to see if she came back again. No sign..sprayed again, just in case, and sealed up the big hole.
