Neighbors in the ritzy community want him evicted, but they’ve discovered there may be little they can do to get him out, according to NBC.