Ken Norton frustrated Ali three times in all, including their final bout at Yankee Stadium where he was sure he had beaten him once again.
Norton, who died Wednesday at the age of 70, lost that fight for the heavyweight title. But he was forever linked to Ali for the 39 rounds they fought over three fights, with very little separating one man from the other in the ring.
"Kenny was a good, good fighter. He beat a lot of guys," said Ed Schuyler Jr., who covered many of Norton's fights for The Associated Press. "He gave Ali fits because Ali let him fight coming forward instead of making him back up."
Norton is the only heavyweight champion never to win the title in the ring, and boxing fans still talk about the bruising battle he waged with Larry Holmes for the title in 1978. But it was his first fight with Ali that made the former Marine a big name and the two fights that followed that were his real legacy.
Few gave Norton, who possessed a muscular, sculpted body, much of a chance against Ali in their first meeting, held at the Sports Arena in San Diego, where Norton lived. But his awkward style and close-in pressing tactics confused Ali, who fought in pain after his jaw was broken.
"Ali tore up his ankle while training and we were going to call the fight off but didn't," former Ali business manager Gene Kilroy said. "Ali said it's not going to be that tough."
It was, with Norton breaking Ali's jaw in the early rounds and having his way with the former champion for much of the night. The loss was even more shocking because Ali had only lost to Joe Frazier in their 1971 showdown and was campaigning for the title he would win again the next year against George Foreman in Zaire.
"Norton was unorthodox," Kilroy said. "Instead of jabbing from above like most fighters he would put his hand down and jab up at Ali."
Kilroy said after the fight Norton visited Ali at the hospital where he was getting his broken jaw wired. Ali, he said, told him he was a great fighter and he never wanted to fight him again.
Ken Norton Jr., a coach with the Seattle Seahawks, confirmed his father's death to The Associated Press before handing the phone to his wife, too distraught to talk.
Norton had been in poor health for the last several years after suffering a series of strokes, Kilroy said.
"He's been fighting the battle for two years," he said. "I'm sure he's in heaven now with all the great fighters. I'd like to hear that conversation."
Norton didn't have long to celebrate his big win over Ali. They fought six months later, and Ali won a split decision.
They met for a third time on Sept. 28, 1976, at Yankee Stadium and Ali narrowly won to keep his heavyweight title.
Norton would come back the next year to win a heavyweight title eliminator and was declared champion by the World Boxing Council when Leon Spinks decided to fight Ali in a rematch instead of facing his mandatory challenger. But on June 9, 1978, he lost a brutal 15-round fight to Holmes in what many regard as one of boxing's epic heavyweight bouts and would never be champion again.
Norton finished with a record of 42-7-1 and 33 knockouts. He would later embark on an acting career, appearing in several movies, and was a commentator at fights.
Former heavyweight champion Mike Tyson, who visited Norton at the veteran's hospital in the Las Vegas suburb of Henderson, tweeted: "Ken Norton was always nice to me even when I was just an amateur fighter. He always treated me like I was somebody. Remarkable man."
Ken Norton Jr. was a linebacker for 13 years in the NFL, playing for Dallas and San Francisco, and coaches the position for the Seahawks. He and his father were estranged for a time in the 1990s before finally reconciling.
Norton always gave his father credit for his career, saying he learned how to train hard by watching him go for early morning runs when he was a child.
"It's been noted that my father and I are on speaking terms and everything's back together now," Norton Jr. said in 1995. "It's part of what I do. No matter what I do, I can't get away from boxing."
Norton, born Aug. 9, 1943, in Jacksonville, Ill., started boxing when he was in the Marines, and began his pro career after his release from duty in 1967. He lost only once in his early fights but had fought few fighters of any note when he was selected to meet Ali.
At the time, Ali was campaigning to try to win back the heavyweight crown he lost to Joe Frazier in 1973.
After that bruising first bout, they faced off two more times, including the final fight at Yankee Stadium on a night when police were on strike and many in the crowd feared for their safety. The fight went 15 rounds and Ali won a decision.
Kilroy said Ali and Norton never had any animosity toward each other and became good friends over the years. Still, Norton always thought he had won all three fights.
Norton would come back in 1977 to win an eliminator against Jimmy Young and was declared champion by the WBC when Spinks was stripped of the title.
His fight against Holmes in 1978 at Caesars Palace was his last big hurrah, with the two heavyweights going back and forth, trading huge blows inside a steamy pavilion in the hotel's back lot. The fight was still up for grabs in the 15th round and both fighters reached inside themselves to deliver one of the more memorable final rounds in heavyweight history.
When the decision was announced, two ringside judges favoured Holmes by one point while the third favoured Norton by a point.
Norton was badly injured in a near fatal car accident in 1986. He recovered but never regained his full physical mobility.
"The doctors said I would never walk or talk," Norton said at an autograph session in 2011 in Las Vegas, lifting his trademark fedora to show long surgical scars on his bald head.
Kilroy said Norton was visited at the hospital by former fighters, including Tyson, Earnie Shavers and Thomas Hearns.
Norton fought only five more times after losing his title to Holmes. His final fight came Nov. 5, 1981, when he was knocked out in the first round by Gerry Cooney at Madison Square Garden.
Information on services and other survivors was not immediately released by the family.Suggest a correction