A group that includes former Alberta cabinet minister Ron Liepert has already announced it will try to unseat Anders.
Now Dan Morrison, a former president for the board of directors of the Conservative electoral district association in Anders' riding, vows to defeat the controversial Calgary MP.
"It's time for a change," Morrison said.
The teacher and father of eight fought to have an open nomination contest in 2010. The move led the Conservative Party's national council to take over the Calgary West riding association.
"They are a staple to any democratic party and have to be observed prior to every election to maintain the people's rightful place, and the reason governments really exist," Morrison said of open nominations. "[Open nominations] make parties stronger."
Anders has represented the riding of Calgary West since 1997. Changes to riding boundaries are putting the controversial MP in the spotlight again.
In the past, the Conservative backbencher has blamed a car accident for falling asleep inside the House of Commons and apologized to veterans after they criticized him for falling asleep during a veterans affairs committee meeting.
Morrison, who describes himself as a life-long Conservative as well as a supporter of the federal government's economic agenda, says Anders hasn't been present enough in the riding. "Most people wouldn't even know he's a Member of Parliament here," he said.
In an interview with CBC News, Anders rejected the accusation. "I've been door-knocking for one cold month," he said.
Anders claimed the two groups challenging him are working together.
"They are in cahoots," he said. "The same thing happened in 2004."
That's when Anders defeated Alison Redford, now the premier of Alberta. Dan Morrison was also seeking the nomination at the time. He denied collaborating with Anders' other opponents.
"It's the battle that has gone on for decades between Red Tories and Blue Tories," said Anders. "Red Tories are not the base of this party, and that's how they try to have influence," he said.
Also on HuffPost