Carol Henke with the city's fire department says it appears several framed walls of the three-storey house fell over in the wind.
One of the workers fell about 4-1/2 metres and was rescued by firefighters before being handed over to EMS personnel.
Fire crews have secured the site because it is no longer considered safe.
Occupational Health and Safety has been called in.
Also on HuffPost