Indeed.
I'd be pretty pissed off at my neighbors if they came over at 11pm at night, too.
At my house I shoot into the morning hours on weekends while I drink with my friends.
If some crybaby dad complained that his baby couldn't sleep at 11pm while I'm doing mag dumps from my AR - I'd tell him to write his rep so I can get a silencer.
I have the right to enjoy my property 24 hours a day.
That may be true, but in many communities with noise ordinances, it won't be your neighbor visiting you, it will be the boys in blue and they won't be there to play games.