Protesters, library board clash over building