Thursday, 24 April 2025
26.8 C
Singapore
29.9 C
Thailand
19.5 C
Indonesia
28.8 C
Philippines

An AI-powered health chatbot struggles with accuracy

Explore the challenges and developments of WHO's new AI health assistant, SARAH, which provides health information but may not always be accurate.

The World Health Organisation (WHO) has embarked on an innovative project using artificial intelligence to disseminate basic health information via a human-like avatar. This venture introduces SARAH, a virtual health assistant designed to offer 24/7 support in eight languages on topics such as mental health and nutrition. However, the WHO cautions on its website that this early prototype, launched on April 2, might not always deliver precise answers.

Challenges with current AI technology

SARAH, or Smart AI Resource Assistant for Health, cannot diagnose, similar to platforms like WebMD or Google. Instead, it directs users to WHO resources or advises consulting with healthcare providers. Despite its empathetic design, SARAH’s responses can sometimes be misleading due to its outdated training data and the inherent limitations of its AI model, which include generating incorrect or “hallucinated” answers.

Ramin Javan, a radiologist and researcher at George Washington University, remarked, “It lacks depth, but I think it’s because they just don’t want to overstep their boundaries, and this is just the first step.” WHO asserts that SARAH is meant to complement the work of human health professionals rather than replace them.

AI’s potential and pitfalls

Image credit: AI Business

Trained on OpenAI’s ChatGPT 3.5 with data up to September 2021, SARAH does not have information on more recent medical developments or advisories. For example, it incorrectly stated that the Alzheimer’s drug Lecanemab was still in clinical trials, although it was approved in January 2023 for early disease treatment. Even WHO’s latest statistics can confound SARAH, requiring multiple prompts to fetch the correct information.

In its efforts to simulate empathy, SARAH analyses users’ facial expressions for 30 seconds before deleting this data, ensuring anonymity. WHO’s communications director, Jaimie Guerra, highlights the privacy measures in place to secure these interactions, stating that all sessions are unlinked from any identifiable data to prevent cybersecurity risks.

Future directions and ethical considerations

The development of SARAH builds on WHO’s previous virtual health worker, Florence, and involves the same New Zealand-based company, Soul Machines, for the creation of the avatars. While the current avatar appears white, there is potential for users to select from a variety of avatars in future iterations to enhance personalisation.

WHO recently issued ethical guidelines for the use of AI in health care, emphasising data transparency and user safety. As AI continues to evolve, the integration of these technologies in public health remains a delicate balance between innovation and accuracy.

Hot this week

OpenAI’s Stargate project eyes global expansion after US launch

OpenAI’s US$500B Stargate project, which aims to build AI data centres across the US, may expand to the UK and Europe after it launches.

Intel prepares for major layoffs ahead of Q1 earnings

Intel plans to cut over 21,000 jobs this week, aiming to rebuild its focus and engineering culture under new CEO Lip-Bu Tan.

Rivian adds Cohere CEO to its board, showing confidence in AI direction

Rivian welcomes Cohere CEO Aidan Gomez to its board, marking a big move into AI and advanced tech for future vehicle innovation.

Judge says Google broke antitrust laws in adtech market

A judge ruled that Google broke antitrust laws in the ad tech market, possibly leading to a breakup or new restrictions on its advertising business.

Bethesda releases The Elder Scrolls IV: Oblivion Remastered – and you can play it now

Bethesda released Oblivion Remastered, which features full visual upgrades and quality-of-life improvements and is now available across major platforms.

POCO launches entry-level C71 smartphone in Singapore with premium features

POCO launches the budget-friendly C71 smartphone in Singapore, offering premium design, enhanced cameras, and smooth performance at S$109.

NVIDIA uses AI to address climate, wildlife and disaster risks

NVIDIA’s AI tools support climate action, wildlife monitoring, and disaster risk mitigation, with uses spanning sea, land, sky and space.

Netflix raises subscription prices in Singapore again

Netflix again raises subscription prices in Singapore, with new rates for all plans and extra member slots.

GameMax unveils Blade Concept ATX case with bold design and powerful features

GameMax launches the Blade Concept ATX case, which features a striking blade design, RGB lighting, and support for high-end liquid-cooled PC builds.

Related Articles

Popular Categories