Robert Lewandowski scored twice off the bench to send 10-man Bayern Munich into the German Cup semifinals as his late penalty secured a 5-4 win.
RB Leipzig recovered from conceding a stoppage-time equaliser to score a winner in the last minute of extra time as they beat Augsburg 2-1.
Robert Lewandowski has hit back at criticism from former Bayern Munich player Didi Hamann, labelling criticism of his performances "stupid."
Kingsley Coman scored an extra-time winner to give Bayern Munich a 3-2 victory at Hertha Berlin on Wednesday and a spot in the German Cup quarters.
Pulisic, 20, told ESPN FC after the game: "We shouldn't have let this game gone to penalty kicks because once you get there anything can happen."
Borussia Dortmund were knocked out of the German Cup by Werder Bremen following a penalty shootout after a thrilling 3-3 draw at home on Tuesday.
Bayern Munich went four matches without a win recently and, on Tuesday, just edged past fourth-tier Rodinghausen in the German Cup.
Borussia Dortmund needed a Marco Reus penalty late in extra time to beat second division Union Berlin 3-2 on Wednesday to advance in the DFB Pokal.
Champions Bayern Munich were made to work hard before edging amateurs SV Roedinghausen 2-1 on Tuesday to advance to the DFB Pokal third round.
Marco Reus was happy about a dirty win after scoring the dramatic 121st-minute extra-time winner against Greuther Furth in the German Cup on Monday.
Dortmund's defence was suspect as they nearly flamed out of the DFB Pokal, but late goals from Marco Reus and Axel Witsel bailed them out.
Borussia Dortmund scored a pair of dramatic late goals to overcome a major scare and advance in the DFB Pokal with a 2-1 extra-time win.
DFB Pokal holders Eintracht Frankfurt crashed out of the German cup in the first round on Saturday with a 2-1 defeat away to amateurs Ulm.
Bayern Munich were embarrassed by fourth-tier Drochtersen/Assel as they only managed a 1-0 win in the German Cup on Saturday.