Eric Swalwell says "our only shot" in the coming elections is if Republicans "unite with Democrats"