Confident Answers, Missed Risks: A Medical AI Safety Failure
Medical AI can provide useful advice for common symptoms and still miss the moment when a seemingly ordinary problem becomes serious. A user with a cold was taking medicine to relieve a blocked nose and asked the AI for some tips to ease the congestion. The AI suggested saline sprays,