Anfield debutant Curtis Jones scored the winning spot-kick as Liverpool beat Arsenal on penalties after an astonishing 5-5 draw to reach the League Cup quarter-finals on Wednesday.
The 18-year-old substitute kept his cool in front of the Kop to send Liverpool through after the hosts had trailed 3-1, 4-2 and 5-4 before a stoppage-time equaliser by Divock Origi.
On a crazy evening it looked as though Joesph Willock's screamer had earned Arsenal a memorable victory, but Liverpool proved irrepressible as their barnstorming season continued.
It was only the second time Liverpool had conceded five at home in the last 66 years. The other occasion was a 6-3 League Cup loss to Arsenal in 2007.
"We can talk about tactics but who cares on a night like this?" Klopp, whose side have dropped only two points in their opening 10 Premier League games, said.
"I hoped for the boys they would have a game to remember. What they did tonight, I lost it really.
"If you don't win nobody remembers it in three years, if it works out the boys will remember it forever."
Defeat was a bitter one for Arsenal manager Unai Emery whose decision to give Mesut Ozil only his third start of the season paid off with the German playmaker in dazzling form.
Willock's long-range effort appeared to have sealed a morale-boosting win for Arsenal after a difficult few days since squandering a two-goal lead to draw 2-2 with Crystal Palace.
"A crazy match. I am very proud of their work, we had a high rhythm in the first 45 minutes," Emery said.
"At the end we were winning until the last action. Penalties are 50/50 and we lost. We are sad but our work, we deserve to have more. There are lots of positives to take."
Klopp and Emery changed their entire lineups from the weekend's Premier League action with winger Harvey Elliott becoming the youngest Liverpool player (16 years, 209 days) to start at Anfield.
Brazilian teenager Gabriel Martinelli scored his first goal of the night seven minutes later to put Arsenal ahead, scooping in from close range after a save by Kelleher.
Liverpool self-destructed as Elliott's poor pass went to Ozil who played in Saka to square for Martinelli to score his seventh of the season and make it 3-1, but in the 43rd minute Elliott tumbled in the box at the other end and James Milner tucked away a penalty.
Milner's dreadful back pass allowed Ainsley Maitland-Niles to make it 4-2 after Ozil had performed wonders to recycle the ball but Arsenal old boy Oxlade-Chamberlain's spectacular effort reduced the arrears soon afterwards.
Liverpool equalised in the 62nd minute when Jones played in Origi who turned superbly before unleashing a shot too powerful for Arsenal keeper Emiliano Martinez.
Willock's goal arguably topped the lot though as he advanced forward before launching an unstoppable right-foot shot into the top corner from 30 metres.
But Liverpool have forgotten how to lose and Origi's shot on the turn, after a cross from 18-year-old Neco Williams, redeemed them at the death.