Friday, 4 April 2025
27.2 C
Singapore
30.2 C
Thailand
20.3 C
Indonesia
27.2 C
Philippines

An AI-powered health chatbot struggles with accuracy

Explore the challenges and developments of WHO's new AI health assistant, SARAH, which provides health information but may not always be accurate.

The World Health Organisation (WHO) has embarked on an innovative project using artificial intelligence to disseminate basic health information via a human-like avatar. This venture introduces SARAH, a virtual health assistant designed to offer 24/7 support in eight languages on topics such as mental health and nutrition. However, the WHO cautions on its website that this early prototype, launched on April 2, might not always deliver precise answers.

Challenges with current AI technology

SARAH, or Smart AI Resource Assistant for Health, cannot diagnose, similar to platforms like WebMD or Google. Instead, it directs users to WHO resources or advises consulting with healthcare providers. Despite its empathetic design, SARAH’s responses can sometimes be misleading due to its outdated training data and the inherent limitations of its AI model, which include generating incorrect or “hallucinated” answers.

Ramin Javan, a radiologist and researcher at George Washington University, remarked, “It lacks depth, but I think it’s because they just don’t want to overstep their boundaries, and this is just the first step.” WHO asserts that SARAH is meant to complement the work of human health professionals rather than replace them.

AI’s potential and pitfalls

Image credit: AI Business

Trained on OpenAI’s ChatGPT 3.5 with data up to September 2021, SARAH does not have information on more recent medical developments or advisories. For example, it incorrectly stated that the Alzheimer’s drug Lecanemab was still in clinical trials, although it was approved in January 2023 for early disease treatment. Even WHO’s latest statistics can confound SARAH, requiring multiple prompts to fetch the correct information.

In its efforts to simulate empathy, SARAH analyses users’ facial expressions for 30 seconds before deleting this data, ensuring anonymity. WHO’s communications director, Jaimie Guerra, highlights the privacy measures in place to secure these interactions, stating that all sessions are unlinked from any identifiable data to prevent cybersecurity risks.

Future directions and ethical considerations

The development of SARAH builds on WHO’s previous virtual health worker, Florence, and involves the same New Zealand-based company, Soul Machines, for the creation of the avatars. While the current avatar appears white, there is potential for users to select from a variety of avatars in future iterations to enhance personalisation.

WHO recently issued ethical guidelines for the use of AI in health care, emphasising data transparency and user safety. As AI continues to evolve, the integration of these technologies in public health remains a delicate balance between innovation and accuracy.

Hot this week

This tiny and affordable device upgrades any speaker with Wi-Fi streaming and hi-res audio

The Atonemo Streamplayer is a tiny, affordable device that adds Wi-Fi streaming and hi-res audio support to any speaker with a 3.5mm aux port.

Apple may launch an AI-powered Health app with a coaching feature next year

Apple may introduce an AI-powered Health app with coaching, food tracking, and fitness guidance in 2026, possibly as a new subscription service.

Elon Musk’s xAI acquires X for US$33 billion in an all-stock deal

Elon Musk’s xAI acquires X in a US$33 billion all-stock deal, merging AI with social media for smarter user experiences.

Krafton strengthens presence in India with Nautilus Mobile acquisition

Krafton acquires a controlling stake in Indian gaming studio Nautilus Mobile for US$14M, strengthening its foothold in India’s growing gaming market.

NVIDIA Blackwell platform sets new performance benchmark in MLPerf Inference v5.0

NVIDIA’s GB200 NVL72 sets a new benchmark in MLPerf Inference v5.0 with 30x token throughput, leading AI factory performance.

Spotify introduces AI-powered ads and programmatic ad buying

Spotify unveils AI-powered ads and the Spotify Ad Exchange, making it easier for advertisers to reach Gen Z listeners with real-time bidding.

YouTube expands shopping affiliate programme in Singapore through Shopee partnership

YouTube teams up with Shopee to launch its Shopping affiliate programme in Singapore, giving creators new ways to monetise their content.

Misconceptions about STEM careers continue to deter young women in Singapore

New research shows stereotypes and lack of support are deterring young women from STEM careers, posing a risk to Singapore’s innovation goals.

Synagie and HKT launch ShopHK to help Hong Kong brands expand into Southeast Asia

Synagie and HKT launch ShopHK, helping Hong Kong SMEs tap into Southeast Asia's booming US$600 billion e-commerce market.

Related Articles