Pandit was replaced immediately by Michael Corbat, 52, a Citigroup lifer who had been CEO of its Europe, Middle East and Africa division. Corbat joined the bank in 1983, just after graduating from Harvard.
The Wall Street Journal and other publications reported that the departures followed a clash between Pandit and the company's board over strategy and business performance, including at the group run by Havens.
In a conference call late Tuesday with financial analysts and reporters, Corbat and Citigroup chairman Michael O'Neill remained vague about the sudden change.
"What happened is that Vikram submitted his resignation and we accepted it," O'Neill said more than once. Corbat said the changes do not reflect any desire to change Citigroup's strategic direction.
Analysts suspected there was more to the story. Pandit's departure from the board is a clear indication that "this was a complete and unexpected break" between Pandit, 55, and Citi directors, said Chris Whalen, a bank analyst and senior managing director of Tangent Capital Partners in New York.
"This shows how dysfunctional this organization is, to have this event unfold this way," Whalen said. "They should have told us yesterday, unless they didn't know."
If Pandit's disagreements with the board were recent, his trouble with shareholders had been brewing far longer. They rejected his 2011 pay package in a non-binding vote this spring.
Since joining the bank in December 2007, Pandit has made at least $56.4 million, according to data compiled for The Associated Press by Equilar, an executive pay research firm.
That includes salary, bonuses, benefits and perks and stock awards. Pandit also made about $165 million from a buyout of his ownership stake in Old Lane Partners, a hedge fund he founded that was acquired by Citi.
Many shareholders were also frustrated by Pandit's failure to boost Citigroup's stock price, which was decimated during the 2008 financial crisis and remains far below where it was when Pandit took over.
The day Pandit was named CEO, Citi's stock closed at $332.30, after adjusting for a reverse stock split last year that reduced the number of shares in circulation. It closed Tuesday at $37.25, up 59 cents for the day.
Citi's stock has mainly kept up with its peers over the last year, but its longer-term record is dismal. It's by far the worst-performing major bank stock over the past five years, having lost 91 percent of its value, versus a 6 percent gain for Wells Fargo and a 2 percent gain for JPMorgan Chase.
Still, on Monday, Citigroup's stock rose to its highest level since April after the bank said it beat analysts' expectations in the third quarter.
In a call with financial analysts that lasted an hour and 40 minutes, and a shorter call with reporters, no one asked bank executives how long Pandit planned to stay, or whether there was a succession plan in place.
During his five-year tenure, Pandit slimmed the bank by selling businesses, sought and then repaid multiple federal bailouts, and helped right its balance sheet after billions in losses on bad mortgage investments made before he took the helm. It was a sharp departure from his predecessors, empire-builders with a hunger for big acquisitions.
Today, Citi is the country's third-largest bank, with $1.9 trillion in assets. It trails only JPMorgan, with $2.3 trillion, and Bank of America, with $2.1 trillion.
Yet the scars of the financial crisis have continued to plague Pandit and the bank he led, and will confront Corbat as he takes over.
Pandit was appointed CEO in December 2007, a period when the crisis was smoldering but had yet to engulf Wall Street. Some in government believed the bank was too slow to address its problems as they emerged in those months before the global financial system froze up in September 2008.
Among Wall Street banks, Citigroup was perhaps the closest to the center of the financial crisis. It participated in every step of the assembly line that transformed shoddy mortgages into complex investments and seeded them through the world financial system. When the housing market turned in 2007, Citigroup's fingerprints were all over the toxic loans it had originated, bundled and resold.
By the time Pandit took charge, Citigroup was considered the weakest of the Wall Street banks. Its stronger peers were forced to take billions in bailout money in October 2008 to divert attention from Citigroup, which needed the money to survive.
Citigroup was the only mega-bank, aside from Bank of America, to receive more than one round of taxpayer bailout money. It received a total of $45 billion in direct cash infusions in three separate transactions. The bank also benefited from billions more in government subsidies and guarantees against losses on bad investments.
As the crisis erupted in September 2008, Pandit suffered a bruising embarrassment. His bank announced it would buy the bulk of Wachovia, which was being crushed by lousy, complex mortgage investments. Citi would get a fire-sale price and emerge from the crisis a rescuer, rather than a victim.
But four days later, Wells Fargo charged in with another offer. It elbowed Citi out of the way and won the approval of shareholders and regulators.
Citi survived those critical months, but its reputation was tattered. In March 2009, as the crisis raged, President Barack Obama ordered the Treasury Department to consider breaking up Citigroup and removing its executives, according to a behind-the-scenes book about the crisis published last year by journalist Ron Suskind.
Treasury Secretary Timothy Geithner ignored Obama's request, according to Suskind's account. Geithner and the White House have disputed his version of events.
Pandit had another powerful opponent in Sheila Bair, an influential bank regulator who ran the Federal Deposit Insurance Corp. during the crisis. Bair wanted the government to fire Pandit after the taxpayer bailouts and government guarantees. Geithner disagreed, and Pandit kept his job.
In an interview with CNBC after Pandit's departure was announced, Bair said Citigroup has lacked "a clear strategic direction and focus" under Pandit, and said shareholders have been unhappy.
She said that the bank would benefit from a CEO like Corbat with commercial banking experience, as opposed to Pandit's background in investment banking, and that the move would be beneficial for shareholders.
In a book published last month, Bair said Pandit had been installed as CEO by Robert Rubin, a former treasury secretary who was the bank's chairman at the time, "to clean up the mess at Citi."
"I thought he had been a poor choice," Bair wrote.
Pandit nursed the bank back to annual profitability in 2010. But Citigroup's troubles continued, even after the Treasury Department sold the last of its stake late that year.
Its stock price plunged 44 percent in 2011. So far in 2012, it has recovered about half that loss.
In March, Citigroup surprised observers by failing an annual financial checkup administered by the Federal Reserve, its main regulator. The Fed refused to let Citi raise its dividend because it said the bank, unlike its peers, did not have enough capital to pay shareholders and still withstand a financial crisis worse than 2008.
Investors voiced their frustration by voting this spring to reject Pandit's pay package for 2011, which was valued at $15 million roughly in line with most of his counterparts and included an additional $10 million in retention pay due to him in 2013 if he stayed on as CEO. Pandit received none of the retention money, a bank spokeswoman said.
He had accepted a token $1 in compensation in 2010. In 2008, Pandit's compensation package was valued at $38.2 million.
It was the first time shareholders dinged a Wall Street bank under a provision of the 2010 financial overhaul law that gives them a non-binding vote on executive pay.
Last month, Citigroup received much less money than it had hoped for when it sold its share of the retail brokerage Morgan Stanley Smith Barney. The bad estimate forced Citigroup to take a heavy write-down.
Along with Bank of America, it is the only mega-bank still paying its shareholders only a token penny dividend each quarter.
Still, said Daniel Alpert, managing partner at the New York investment bank Westwood Capital LLC, Pandit did "pretty much all he can do to turn the bank around."
He said it will be hard for big banks to boost their share prices because of intense pressure from regulators to simplify their businesses. Since the financial crisis, the government's financial watchdogs have encouraged banks like Citigroup to become more manageable by eliminating non-essential business lines and focusing on their strengths. Pandit strived to do that, but some investors wondered if he had run out of tricks.
"There is some meaning to 'quit while you're ahead,'" Alpert said, noting that it's harder for executives to win massive pay packages when a company's stock is flat-lining.
CNBC reported that Pandit said in an interview that he had been thinking about leaving Citigroup for some time and that it was his idea to leave.
After the company's earnings release Monday, it was clear that the company was performing well and had stabilized, Pandit said, according to CNBC. He said he called O'Neill, the chairman, after the analyst call and told him he wanted to leave.
Pandit said the board was ready for this and that the way the situation was handled shows that the company is organized.
Asked whether there were any "bombs" in the horizon, he said, "I would not be leaving if I didn't feel that this company was in good shape," according to CNBC.
Both Pandit and Corbat sent memos to Citi's 262,000 employees early Tuesday. Pandit did not say why he was leaving, but gave the impression that he felt he had completed a mission.
"There is nothing better than our third quarter earnings announcement to demonstrate definitively that we have turned this company around," he wrote.
Corbat said he was humbled and excited, calling himself "a true believer in this company." He praised Pandit for leading Citi "back to its roots as a bank."
Corbat also noted the challenges ahead "regulatory, legislative and economic changes around the world present headwinds as we redefine our relationships with all of our stakeholders."
Gerard Cassidy, a banking analyst at RBC Capital Markets, said he thinks the change of guard will mean more businesses getting sold and more cost-cutting. O'Neill, the chairman, was famous for slashing expenses when he ran Bank of Hawaii Corp.
Other analysts speculated the bank may place less emphasis on Wall Street trading and helping companies sell stocks and bonds to the public, the so-called capital markets businesses in which Pandit had expertise. Instead, the focus could shift to traditional commercial banking, like lending to businesses and consumers, especially overseas.
Corbat will receive an annual base salary of $1.5 million and regular bonuses, Citigroup said Tuesday in a public filing.
Pandit joined Citigroup in 2007 when his hedge fund was acquired by the bank. He quickly rose to CEO in December 2007. Earlier, he had ascended to head of investment banking at Morgan Stanley before leaving in 2005 to form the hedge fund.
A native of India, Pandit attended Columbia University at 16 and completed a bachelor's degree in three years. He earned a doctorate in finance in 1986.
He is a naturalized citizen, and lives in New York with his wife and two children.