Kanye knew the price of speaking out