How bad a human do you have to be to get booted from the sports owners’ club?

To say that Washington Commanders owner Daniel Snyder is not well-liked is a massive understatement. He spent years refusing to change his team’s name despite protests from Native American groups that it was offensive, female former team employees say he oversaw a culture of sexual harassment, a former team vice-president said he kept two sets of books to cheat both season ticket holders and his fellow NFL owners out of money, and he routinely shows up on every single “worst owner in sports” list. Yet as recently as this May, his fellow NFL owners were at most considering suspending Snyder temporarily as owner.

At least some owners’ stance, though, seems to have changed now:

Multiple owners said in recent days they believe serious consideration may be given to attempting to oust Snyder from the league’s ownership ranks, either by convincing him to sell his franchise or by voting to remove him.

“Multiple” still isn’t necessarily enough to win a three-quarters vote of the 32 NFL owners that would be needed to force Snyder out, but it does seem to be more than were willing to speak out against Snyder, even anonymously, four months ago. The growing uproar over the sexual harassment scandal — including an ongoing congressional investigation — can’t be helping Snyder, nor can the revelations that he may have been ripping off his fellow owners on revenue sharing; the Washington Post also notes that the NBA’s successful push to have Phoenix Suns and Mercury owner Robert Sarver sell his teams after revelations he had used racist language and been demeaning to female employees may have emboldened NFL owners who want Snyder gone.

If so, it would add Snyder to a short-though-disturbingly-not-that-short list of sports team owners who have been seen as so toxic that they can’t be allowed to remain in the owners’ club. Los Angeles Clippers owner Donald Sterling was banned by the NBA after asking his mistress not to bring Black people to games; Cincinnati Reds owner Marge Schott was not sanctioned for declaring that “only fruits wear earrings,” but was eventually suspended and pushed into selling the team for saying Adolf Hitler “was good in the beginning, but went too far.” Carolina Panthers owner Jerry Richardson was pushed into selling his team after a series of racist remarks and allegations of running a Snyder-esque culture of sexual harassment; Atlanta Hawks owner Bruce Levenson voluntarily sold that team after revelations that he had sent a memo to one of his execs suggesting that having too many Black fans might drive away white fans.

At the same time, though, plenty of sports team owners have done horrible things and been allowed to stay sports team owners. Minnesota Twins owner Calvin Griffith held onto his team for years after declaring in 1978 that he’d moved the team from Washington to Minneapolis “because you’ve got good, hardworking white people here,” then decades later ended up with a statue outside the Twins’ stadium, though it was eventually taken down. New York Jets owner Woody Johnson reportedly made a habit of making racist and sexist jokes while U.S. ambassador to Britain, but no one is talking, even anonymously to the Washington Post, about kicking Johnson out. Atlanta Braves owner John Malone has refused to change his team’s name or stop encouraging fans to do the team’s “tomahawk chop,” even during appearances by the Native American pitcher who team execs said they would stop playing the chop music when he pitched, and remains an MLB owner in good standing.

If there’s a line being crossed here, it seems to be that sports team owners will defend each other up until the moment when one of them becomes so publicly embarrassing that it might endanger their profits. Snyder has by all accounts been a horrible human being for eons; Richardson went around groping female employees and openly ogling their butts for long enough that it can’t have been a secret in NFL circles. It was only once Congress and ESPN took note that these went from personality quirks to scandals requiring urgent action.

None of which should be any surprise: “You can be as repulsive as you want so long as not too many people notice” has long been a principle for government officials as well. (Andrew Cuomo’s downfall, in fact, has a lot of similarity with what could end up being Snyder’s — nobody was willing to abandon the most powerful man in New York, either, until suddenly everybody was.)

And, of course, there’s tons of more routine malfeasance that is considered perfectly okay: Virtually all of the owners mentioned above shook down their cities for stadium subsidies, including Griffith moving his team right after swearing he would do nothing of the sort. If anything, Snyder is likely running afoul of the NFL less for trying to play two states and one city off against each other in a bidding war to see who’ll throw the most money at him than because his misogyny has created a stumbling block to extracting the most cash. Lots of sports team owners, it seems, have been racist, sexist grifters; it’s only when you’re a racist, sexist grifter under congressional investigation that your fellow owners start to back slowly away from you and look for the trap door button.