One of Diddy's lawyers quit on him