It's also an extremely important strategic part of the game. The ease of the 1 point play is what makes the decision to go for 2 so difficult. How many times have we seen a team go for 2 early and miss it only to end up losing the game by 1 point?
The speed of the game wouldn't change any. Whatever play replaced the extra point would still be followed by commercials and thus would take just as long. Your issue doesn't seem to be so much with the play itself as it is with the station bordering it with commercial breaks.
Does anyone remember Tony Romo fumbling a hold on a FG years ago. That was essentially extra point distance. Yeah, it is almost a given that it should be made every time, but that isn't always the case. I watch red zone and there was a week this year where there were almost 3-4 botched extra points within an hour. Its not always a sure thing.