The problem most certainly isn't the damage, the problem is that it stops you from recovering. If the firebolt did all its damage at once, or maybe twice as fast, it would be much more balanced.