Alberta Premier Alison Redford said the changes, which hit so-called repeat claimants such as seasonal workers the hardest, don't account for a wide variety of economies.
She said while all premiers are focused on improving their economies and ensuring Canadians can live where they want, EI changes aren't the right way to do it.
When the changes were first proposed earlier this year, Human Resources Minister Diane Finley said the intent was get Canadians off EI and into jobs they qualify for.
The new rules, expected to take effect next year, would would force the jobless seeking employment insurance to take lower paying jobs _ for some, in unrelated occupations.
But some provinces say the changes would hit repeat claimants such as seasonal workers the hardest and Ghiz said common sense wasn't used when making the changes.
P.E.I.'s three largest industries are tourism, agriculture and fishing, all of which are seasonal.
"We need seasonal workers to fill those positions. We're not going to grow potatoes or catch lobster in the month of January so therefore we need to make sure we have the workers there," Ghiz said. "That's why the unemployment system has to be adaptable across the country based on different economies."
Finley's director of communications Alyson Queen said the changes are common sense and necessary if the program is going to continue to be flexible and responsive to the economy.
She said the federal government recognizes the importance of seasonal industries in Atlantic Canada and that "individual circumstances will always be taken into account."
Queen said that should job opportunities in their area match their skills then workers unemployed in the off-season are expected to take the jobs.
Ghiz said forcing seasonal workers to go elsewhere for permanent work will just leave a void requiring foreign workers to maintain the industries.
Redford said some changes also don't take into consideration the fact that not everyone is willing to relocate.
"There's no doubt that there are people who live in this country who work in seasonal employment ... who are not going to choose to live in other parts of the province or country and we have to respect that," she said.
The Atlantic premiers have been vocal in their opposition to the changes and how they will affect their province's economies. Ghiz has said he's concerned that if people are encouraged to leave for jobs in other parts of the country, they may not return.