Cosmic Drift in the Galactic Glow