Kamogelo Sebelebele scored the only goal of the game in the 44th minute at the Mbombela Stadium.
The result saw Galaxy move into fourth place on the league standings with 25 points from 17 games and extended their unbeaten run to 12 matches.
Under Beganovic, the Rockets have won seven matches and drawn five in all competitions.
Reflecting on the encounter, a delighted Beganovic said in the Citizen: "This is unbelievable. Sundowns have so many great players and we beat them.
"I am so proud of my players and all credit to them. This was their third league match in seven days and yet they were full of energy and passion throughout."
Galaxy are next in action against Durban City in the Nedbank Cup last 16 on Friday.