Should AI be making medical decision?

This clip is from the Bunker Project SuperHuman AI episode.

Would you want an AI medical device implanted in your body with the ability to make decisions that could kill you (or save you)?

Should AI models have to pass medical exams?