Premier David Alward said the caucus unanimously agreed to remove Jim Parrott, who will now sit as an Independent in the provincial legislature.
"This is not about any one statement that the member has said," Alward said as members of the government caucus stood behind him on the front steps of the legislature in Fredericton.
"This has been an ongoing issue for some time."
In a commentary published Saturday in the New Brunswick Telegraph-Journal, Parrott said governments in New Brunswick have not listened to physicians about health care issues over the last 20 years.
"The government, of which I am a member, is not listening either," Parrott wrote, adding that the government never sought his input on health issues in the two years it's been in power.
Parrott, 70, is a former heart surgeon in Saint John and was elected in 2010 to represent the riding of Fundy-River Valley. He has also spoken publicly in opposition to the government's position on other issues, including a decision not to purchase MRI units for certain hospitals.
But Alward said Parrott didn't raise any such concerns during a three-day caucus retreat earlier this month.
"Not once did the member from Fundy-River Valley raise any of the issues that just a few short days later he would go on an attack of government," Alward said during a news conference in which he never referred to Parrott by name.
"I find that very disappointing and regrettable."
He called Parrott's comments "cheap shots" and said his government has been consulting physicians and the health care community on issues such as primary care renewal and the creation of an electronic health record system.
Alward said he needs to have trust in all members of caucus and due to ongoing issues with Parrott, that trust was lost.
Parrott did not respond to interview requests.
Just minutes after Alward's announcement, Liberal health critic Bill Fraser said his party was open to Parrott joining its ranks.
"The Liberal party is a very open party," Fraser said. "We're open to accept anybody who wants to promote Liberal values and to speak up for the betterment of our province."
But shortly after, interim Liberal Leader Victor Boudreau held a news conference dismissing the possibility of Parrott joining the party.
"When Dr. Parrott got into questioning equality between English and French in the health care system, we, the Liberal party, certainly have issues with that," Boudreau said.
"He does not embrace the values of the Liberal party and therefore would not be welcome in our caucus."
Parrott's departure from the Tory caucus means there are 41 Progressive Conservatives, 13 Liberals and one Independent in the legislature.Suggest a correction