Harper called the byelections on Sunday for Toronto Centre, the Montreal riding of Bourassa and the Manitoba ridings of Provencher and Brandon-Souris.
Toronto-Centre and Bourassa are longtime Liberal strongholds, left vacant after the resignations of former interim leader Bob Rae and veteran MP Denis Coderre. However, New Democrats are making a concerted effort to snatch the two ridings away or, at least, make significant inroads.
Both the Liberals and NDP are running star candidates in the two ridings.
The Manitoba ridings are longtime Conservative fiefdoms, left vacant after the retirement of former minister Vic Toews and backbencher Merv Tweed, and are widely expected to remain so.
But a raging controversy over the party's alleged interference in the choice of candidate in Brandon-Souris has angered some Tories and given the Liberals some hope of scoring an upset.
The Toronto and Montreal byelections will likely be the most closely watched, with New Democrats intent on proving they're the real alternative to the governing Tories, despite public opinion polls suggesting the NDP has sunk back into its traditional third-place slot since Justin Trudeau took the helm of a rejuvenated Liberal party in April.
The Liberals are running Chrystia Freeland in Toronto Centre. She'll be up against the NDP's Linda McQuaig. Both are former journalists and authors who have written extensively on growing income inequality, a key issue since all three main federal parties are vying to be seen as the champion of the middle class.
Bourassa is one of the few Quebec ridings that didn't fall to the NDP when the so-called orange wave swept the province in 2011.
The Liberals are hoping to keep it that way. They're running Emmanuel Dubourg, a former member of the Quebec legislature, as a candidate. The NDP has chosen its own high-profile candidate: Stephane Moraille, a lawyer and erstwhile singer with Bran Van 3000.
The Green party's chosen contender, former NHL star and deputy party leader Georges Laraque, could have complicated the Liberal-NDP showdown in Bourassa. But he stepped down last week after he was charged with five counts of fraud related to a dispute with a former business partner. He said he wants to focus on clearing his name.
Trudeau has already been campaigning in both Manitoba ridings, although the chances of knocking off the Conservatives seem slim.
Toews won Provencher in 2011 with a whopping 70 per cent of the vote, while Tweed took Brandon-Souris with a similarly impressive 64 per cent. The Liberals ran a distant third in Provencher and fourth in Brandon-Souris.
Still, Liberals are hopeful that controversy over the Tory nomination in Brandon-Souris could herald an upset.
Provincial politician Larry Maguire was acclaimed as the Conservative contender after the party disqualified Chris Kennedy, a former aide to Tweed. That sparked a backlash among some Conservatives in the riding, including one who subsequently ran unsuccessfully for the Liberal nomination.
The Liberals have chosen Rolf Dinsdale, son of former longtime Conservative MP Walter Dinsdale.
In Provencher, the Conservatives have chosen Ted Falk, a business owner and longtime chair of the Steinbach Credit Union. Retired public servant Terry Hayward is running for the Liberals.
Also on HuffPost