"You never pull your hair out after a win," he told reporters after Bobby Ryan scored 46 seconds into overtime to give Ottawa a 3-2 victory over the Bruins on Saturday.
Kyle Turris also scored for the Senators, and Mike Hoffman deflected one in with 4:15 left in the third period to force overtime.
Craig Anderson made 26 saves for Ottawa, which has won two in a row but hasn't scored on a power play in 19 tries over six games since Dec. 19.
Brad Marchand and Torey Krug scored for Boston, and David Krejci assisted on both goals. Tuukka Rask stopped 23 shots for the Bruins.
Marchand gave Boston a 2-1 lead midway through the third period, then Boston killed its second 5-on-3 of the game. But Gryba's slap shot deflected off Hoffman's skate and past Rask to tie it.
"You kill a big one and then you come back and get a bad bounce," Krejci said. "So you've got to make sure those bad bounces don't happen. You got to make sure the puck is 100 feet away from our net."
Ryan, who had a hat trick in Monday's win over Buffalo, scored the game-winner when Erik Karlsson attracted the attention of the defence before sliding it into the slot.
"I just tried to beat my guy to the net and hope that something kind of came off of (Rask)," said Ryan, who also scored the game-winner in a shootout on Dec. 13 in Ottawa's last visit to Boston. "Karl did one better and put it in my feet. ... I just luckily enough looked down and it was there and was able to find a way to get it in."
It was the second straight overtime game for the Bruins. On Wednesday, they scored two late second-period goals to tie Toronto before falling in a shootout.
This time, Boston blew the lead and the game despite killing a pair of 5-on-3 advantages early and getting a power play of its own in the final three minutes.
The game was scoreless for 32 minutes until Clarke MacArthur occupied a couple of Bruins behind the Boston net and left the puck free for Turris. He swooped in, slid toward the goal and wristed it into the tight spot over Rask's right shoulder to make it 1-0.
Boston tied it four minutes later when Zdeno Chara screened Anderson and Krug's slap shot from the point found the net. Marchand gave Boston a 2-1 lead midway through the third when he skated around and into the slot before putting a wrist shot past Anderson.
Boston then killed off a second two-man disadvantage, but Hoffman tied it when he deflected Gryba's slap shot past Rask. The Senators killed off a power play when Milan Michalek tripped Adam McQuaid with 2:47 left.
NOTES: Both teams are on the front end of a back-to-back. The Bruins play at Carolina on Sunday, and the Senators return home to play the Tampa Bay Lightning. ... The Senators recalled D Chris Wideman from Binghamton of the AHL. ... Bruins D Dougie Hamilton had six shots, matching a career high.Suggest a correction