My only concern would be theft of small items, and vandalism.
Undocking on an area near other campers seems favorable to being the only rig for miles around. Other campers generally don’t mess with other campers’ stuff.
The worst I’ve ever seen is moving folding chairs to steal your site.
If your camper appears to be part of a group, outsiders stay away.