Is hate speech simply something you do not agree with

When people say hate speech. Often what they mean is people say things they do not agree with and call it hate speech. The old saying is I may not agree with what you say but I will defend your right to say it.