Warren Buffett

At annual meeting, some shareholders wish Buffett would put a sock in it on taxes.

Omaha (Fortune) — Warren Buffett says the ‘Buffett Rule’ has been “butchered a bit.” But that hasn’t stopped some shareholders from criticizing him for getting involved in the nation’s debate over taxes and what the richest Americas should pay.

On Saturday, Buffett, fielded dozens of questions from the crowd of shareholders and journalists who packed CenturyLink arena for Berkshire Hathaway’s (BRKA) annual meeting. A number of the questions were on his proposal that the U.S. should institute a rule that would ensure the richest American pay higher tax rates than other Americans. At one point in the meeting, a shareholder was greeted with applause when he said that Buffett’s outspoken stance on taxes was hurting the company’s stock. “My 84-year-old father won’t invest in Berkshire because of your stance on taxes,” said the shareholder.

MORE: Millionaires effective tax rates top most

Even Charlie Munger, Buffett’s long-time partner in running Berkshire Hathaway, seemed to somewhat disagree with Buffett on his stance on taxes. Munger said the focus should not just be on taxes, but how government spends its money as well. “We need more sacrifice and we need more sensible ways of spending money,” says Munger.

At a dinner on Friday night, money manager Mario Gabelli, who has attended Berkshire’s annual meetings for the past decade, told a crowd of attendees that he thought Buffett made a mistake by getting too political. “It’s BS,” said Gabelli. He asked the room to raise their hands if they had wished Buffett hadn’t proposed the tax rule. A few hands went up. “It’s the elephant in the room and we should talk about it,” said Gabelli. “It’s a negative on the stock.”

A feisty Buffett on Saturday responded that he has a right, like every citizen, to free speech and that he didn’t give that up when he became the CEO of a public company. “Sounds like your father should buy stock in Fox,” says Buffett. “When I and Charlie took this job we weren’t required to put our citizenship in a blind trust.”

MORE: What exactly is the Buffett Rule?

Buffett said it was fair to disagree with him, but that he didn’t think that should change anyone’s choice to buy or not buy Berkshire’s stock. He said he didn’t know the political stances of many of the CEOs of the companies that he and Berkshire invests in and didn’t care. Though presumably the reason Buffett doesn’t know their political stances is because those CEOs have chosen not to be as vocal about them as Buffett has recently.

Basically, the Buffett Rule is that the richest Americans should pay a higher tax rate than those that make less than them. Buffett said his rule has somewhat been butchered by others, but he didn’t really say how. “It would affect very few people, and raise a significant amount of cash,” says Buffett.

Buffett said about a third of the 400 richest people in America pay a 15% tax rate or less. He said rates used to be much higher for the top earning Americans and that we should restore that. What’s more, Buffett said he was optimistic some for of his rule would be adopted despite the fact that a version was recently voted down by the Senate. “Not dead,” says Buffett, “People are bothered by inequality. Something will happen.”

Buffett said he employs no fancy tax planning. He said he doesn’t use offshore accounts or other tax strategies. Yet, every year, Buffett says, he compares his tax rate to others in his office, and he routinely pays the lowest rate. “They all are in the 30s, and I am in the range of 17%,” says Buffett. “It’s time we look at that.”

That comment got applause from the Buffett faithful as well.

Leave a Reply