Inviting myself places?

Lol, I dunno it may get annoying but I do stuff like that. I'll say "oh can I come!?", and he says "Of course I thought it was understood that you were invited..."