Sounds speculative, but Lois Lerner was targeting the Tea Party specifically to have this effect.

So, the burden should be on the side that disagrees with this thesis to prove their claim.

Did the IRS Tea Party allegations help Obama’s presidency?