He's the budget scorekeeper for Congress. Lately, it's been a tough job