Chiefs suffered a demoralising 3-1 loss to Pirates in the League on the weekend.
However, Steve Komphela's men responded on Tuesday with a 3-1 defeat of Abafana Bes'thende, who beat Pirates 2-0 in their previous outing.
The Glamour Boys have a chance to gain revenge over Bucs when they revive hostilities in the Telkom Knockout semi-finals at FNB Stadium on Saturday.
Lebese, who struck twice against Arrows, said: "It was a much-needed three points. We needed to get back on the horse and ja, we got the three points which was the most important thing.
"It was a bright start. We obviously would not to concede so it is back to the drawing board.
"We have got a big one again on Saturday. It was a good result for us in terms of getting our confidence back."
The left-footed midfielder appealed to the Amakhosi faithful to make their presence felt again at Soccer City.
"You know we really appreciate them. They are the 12th man. Every time they come to the stadium it is a morale booster for the team."