Was Everything Larger Before Us?