There were plenty of chances during regulation but the goalkeepers, one questionable offside call and the woodwork all combined to keep the match at 0-0.
After 30 minutes of extra time produced even more chances, with Atlanta defender Michael Parkhurst coming up with a massive clearance off the goal line in the final minutes, the match was decided from the spot.
Steffen, who was outstanding throughout the match, opened the shootout with an athletic save on Julian Gressel. After Federico Higuain scored for Columbus with a Panenka, Steffen followed up with a second straight stop to give the visiting side a lead it would never relinquish.
Brad Guzan made a save of his own to try and keep the home side in it, but when Atlanta’s fourth shooter, Jeff Larentowicz, hit the post it was all but over for the expansion side.
Adam Jahn smashed home the Crew’s fourth spot kick, handing the club a 3-1 win on penalties and setting up a showdown with New York City FC in the Eastern Conference semifinals.