You need to find out how they are getting in. It may be a hole in the window screen or a crack in the wall. They can even come in riding on your shoulder as you come into the house.

They make "paper" hornets nest decoys that will repel wasps from hanging around. Hang a few around the house outside.

You have to find out where they are getting in and block the opening.

I've had a problem with wasps (I believe paper wasps) getting into my room for a couple of years. They seem to get in once a week and I'm one of those people who is irrationally terrified of them. If I spray some Raid around my windows where I think they're getting in, would it keep them away or just dissipate? Any suggestions for keeping them out of my room? I don't really care about killing them outside of my house if I can avoid that, I just can't deal with them being where I sleep.