The only way to guarantee that no one will jump into your games, uninvited, is to make private (password protected) games. One of you will need a premium membership to do this though.
And I may be underestimating you, but premium means you pay, just making sure you know, I wasnt exactly sure when ...