Die Mannschaft welcomed back Manuel Neuer in goal while Serge Gnabry lead the line after getting a recall.
Gnabry gave the hosts an early scare as a snap-shot from close-range brought Ukraine goalkeeper Heorhiy Bushchan into sixes and sevens before eventually scooping the attempt.
Die Mannschaft found the breakthrough soon before 20 minutes after a low ball from the right by Antonio Rudiger picked out an unmarked Matthias Ginter, who tapped into an empty net.
Just as the four-time world champions spotted openings for a second, a number of possession turnovers gave Ukraine options with Andriy Yarmolenko the vocal point but nothing materialised.
A stunning piece of goalkeeping from Bushchan in the closing minutes to halftime helped Gnabry's diving header in the area for a corner-kick.
Bushchan didn't cover himself in the same light four minutes from the break as a mistimed handle from Lukas Klostermann's cross ricochet off Leon Goretzka and into the net.
Ukraine were on the ropes afterwards with a thumping drive from point-blank range by Julian Draxler had Bushchan in a spot of bother though parried the same player's volley later on.
Yarmolenko's race was run as well as Viktor Tsygankov towards the final 20 minutes, with Oleksandr Zubkov and Marlos Bonfim entering the pitch in search of a goal for the home side.
Germany were given a nervy end to the match as Ruslan Malinovskiy drilled into the bottom-corner from the penalty spot 15 minutes from time after Niklas Sule upended Roman Yaremchuk.
Die Mannschaft looked to settle the tie once and for all thereafter, but Gnabry was unable to beat Bushchan as it ended 2-1 in Kiev.