Yes, you do have the right to time alone as well as apart from your boyfriend.
Better to talk to him and explain exactly how you feel then let it bottle up. Its going to affect you both, eventually.
That would be too cool! Just think, now you know what to get him for presents - his own panties and bras.
I would laugh, then give him a slap and tell him to go buy his own!