Norquist: Midterms did not go as expected