Harris's latest flip-flop has these swing state voters 'very nervous,' congressman says