When Diversity BACKFIRES