Why men are leaving the left — and not coming back.