The abuse took place between 1973 and 1985 when Raymond-Marie Lavoie was a teacher at the now-defunct St-Alphonse Seminary near Quebec City.
He was responsible at the time for overseeing the dormitory.
Lavoie received the sentence in a Quebec City courtroom today.
The Crown had been seeking an eight-year prison term and will appeal the sentence.
Lavoie is in his early 70s.
He pleaded guilty last summer and said he was sorry for the crimes.