The man was out for a walk with a friend when he slipped on ice on 11 Street and fell.
"You can see his boot marks go down towards the end of the bank and over the side of the cliff falling about 65 to 75 feet into the rocky, watery area," said Fire Chief Jim Taylor.
Taylor said two firefighters who are members of the rappel crew went down the embankment on lines.
They found the victim on the rocks and helped him walk to a stretcher that had also been lowered to the scene.
The man was brought up but Taylor said he suffered some head injuries in the fall.
He's now being treated in hospital.