The Rockets sent Chiefs crashing out of the Cup competition at the first hurdle through a solitary strike by Augustine Kwem.
Ramovic has urged his side to move on quickly from their impressive win and turn their attention to their battle against relegation.
"It is nice we have won but it is the past now," Ramovic said.
"If we don't win our next game then we are still in trouble.
"We just have to continue because we have a tough time in front of us. We have 13 games in front of us and we are at the bottom.
"We are on the right path but we have a huge gap and we have to keep improving, to keep the ball better, not rush things.
"We also still need to improve our technical abilities but I am happy with our progress. We look much better and we keep the ball better but we have to show it every day."