Handwavey reasons, Matt never comes across Fisk's bombs or the scenario plays out different that leads to bombings latter. So while Karen and Foggy are with Elena, Matt is trying to reach them too (but the phone lines are jammed from traffic) and get to his apartment to get dressed to help as the Man in the Mask. He's injured by one of the explosions.