If it's your house, then you have a right to set common sense rules. Most civil-minded people won't have an issue with that.
But there might be someone of a rebellious spirit who doesn't like rules; he or she might give you a hard time. My advice is to tell them where the door is. If they don't respect your house, then they shouldn't be there.
Every relationship needs boundaries. It's called respect.
Anyone who thinks you ought to let your guests do whatever they like in your home is a fool.