‘I’m Labour’s number one enemy’