In Federal Court court documents filed in Ottawa, Kevin MacAdam alleges the Public Service Commission of Canada was wrong in questioning how the agency made his appointment in February 2011.
The documents dated Aug. 31 and Sept. 20 say the commission ordered MacAdam's appointment as director general of ACOA in Prince Edward Island be revoked.
MacAdam was named to the job last year, provoking opposition criticism from the Liberals that the federal Tories were making patronage appointments at the agency.
MacAdam was a cabinet minister in the Conservative government of former premier Pat Binns and once worked on the staff of Defence Minister Peter MacKay.
The federal Liberals asked the commission to investigate whether the appointment breached provisions of the Public Service Employment Act. The Liberals released the court documents on Thursday.
MacAdam's lawyer Janice Payne said he is declining comment but she confirmed that legal action has started at the Federal Court seeking a judicial review.
She said MacAdam is still being paid by ACOA and is taking French courses in the Ottawa area.
MacAdam wants the Aug. 8 commission order revoking his appointment to be overturned because it is unfair and based on incorrect facts, Payne said.
"He didn't hide anything in his (job) application concerning his previous career," she said in a telephone interview from Ottawa.
"He was the successful candidate. It was only after concerns were raised at a political level that matters took a different turn."
The Public Service Commission declined comment. A spokeswoman said it is still deciding whether to release its decision on its website.
A spokesman for ACOA said it doesn't comment on personnel matters.
The original investigation was started last March after a letter from Liberal MP Roger Cuzner complained about the appointment.
Also on HuffPost