What to do About the Neighbors

SO I'm just looking for a little advice. We have a couple of neighbor kids, that just moved in about 3 months ago. Very nice family. Problem is, the kids 1st grade and maybe 4th grade come over at least 4 times a day. Starting at 4. My kids get home at 4, we do homework, then chores, then it's usually time to eat. After dinner we will run errands or if it's shower days they do that, or we do things as a family. But there is a knock at the door every hr that evening, these kids asking if my kids can play. Even on Monday, we were out working in the yard, and they stood at the edge of the yard trying to play with the kids. Even after the kids explained our Monday FHE, they left and came back 15 minutes later. We finally had to go talk to them. Then yesterday and Tues. my kids were grounded for not making their beds, and coming home 30 minutes late. They came over every hr. until I explained to them that if the kids can't play it's for the whole day, and they would come over when they could play. I noticed that they don't hang out with the other neighbors they used to spend all day at. And them coming to our house is fairly new, like 2 weeks now. I don't want them to be ostracized from the neighbor kids, but I can see this getting really old really fast. And I don't want the parents thinking none of the neighbor kids want to play with their kids. But I think they just send the kids out to play, with out knowing where they are or what they are up to. They really are good kids, and even when I was telling them they didn't need to come over 4-5 times a day, the older one was very respectful, and responsive. Do I go talk to the parents?