The Bulls have suffered through difficult campaigns in the United Rugby Championship and Champions Cup so far but there have been notable improvements in recent weeks despite results not going their way.
Head coach Johan Ackermann hopes that the staff changes will lead to positive results, and Nortje says one win can is all the side needs to get their confidence back.
"We've struggled to find continuity, but January is about settling down and finding our feet," Nortje said.
"We are definitely climbing the ladder, and we are really excited for the weekend.
"There's nothing like winning; a win can change anything overnight. We just have to get over that hurdle."
The Springbok lock also defended Willie Le Roux's all-or-nothing cross-kick in the dying moments of the South African derby against the Stormers.
Replacement prop Ntuthuko Mchunu scored in the final two minutes of the United Rugby Championship clash in Cape Town to hand the hosts a 13-8 lead in the final knockings of the match.
However, the Bulls manufactured one more opportunity as winger Seb de Klerk was able to reclaim Handre Pollard's ensuing restart.
The visitors attacked from there before the veteran full-back pulled the trigger with an attempted cross-field kick for Stravino Jacobs. Le Roux did so without a penalty advantage, with the kick ending the game as it sailed over the touchline.
The experienced Springboks' gamble has been largely criticised in the aftermath of the defeat as the Bulls fell to their sixth successive loss in all competitions.
Speaking ahead of the Pretoria-based outfit's Investec Champions Cup meeting with Bristol Bears at Loftus Versfeld this weekend, Nortje defended Le Roux's actions.
"There's no certain way we do things in that position," the captain told reporters on Tuesday.
"I think, for us, our drivers have to take control there, and we back each player. If Willie thought it was on, we back him all the way, and we still back him all the way."
He further explained that fine margins decide the big games, and while Le Roux came out as the villain on this occasion, he quite easily could have been the hero.
"If that ball bounced right and we score under the poles, it would have been 'Willie is the most amazing player'," he continued.
"At the end of the day, it's just about the bounce of the ball. We will always back the decisions players make."
The Bulls could not recover from conceding three tries in the opening nine minutes as the South African side went down 61-49 in their Champions Cup encounter against Bristol Bears at Loftus.
Vodacom Bulls coach Johan Ackermann has provided an update on the expected return dates of Springbok stars Kurt-Lee Arendse, Canan Moodie and Cameron Hanekom.
Vodacom Bulls coach Johan Ackermann has named a starting XV stacked with Springbok pedigree for Saturday's Investec Champions Cup clash against Bristol Bears at Loftus Versfeld.
With just two rounds of the Champions Cup pool stage remaining, every point is crucial as South Africa's teams look to secure their place in the last 16 of Europe's premier Club competition.
