Can You Spot the Bot? Study Finds ChatGPT Almost Undetectable in Medical Advice

the
health strategy
institute

the knowledge portal of “the health strategist — institute”
for in-person health strategy
and digital health strategy

Joaquim Cardoso MSc

Chief Researcher and Strategy Officer (CRSO)
for “the health strategist ” — research unit
Chief Editor for“the health strategist” — knowledge portal 
Senior Advisor — for “the health strategist” — advisory consulting

SOURCE: FeaturedNeuroscience

Summary: 

A new study suggests that ChatGPT’s healthcare-related responses are hard to distinguish from those provided by human healthcare providers.

The study, involving 392 participants, presented a mix of responses from both ChatGPT and humans, finding participants correctly identified the chatbot and provider responses with similar accuracy.

However, the level of trust varied based on the complexity of the health-related task, with administrative tasks and preventive care being more trusted than diagnostic and treatment advice.

Key Facts:

1. In the study, participants correctly identified ChatGPT’s healthcare-related responses 65.5% of the time and human healthcare provider responses 65.1% of the time.
2. Trust in ChatGPT’s responses overall averaged a 3.4 out of 5 score, with higher trust for logistical questions and preventative care, but less for diagnostic and treatment advice.
3. The researchers suggest that chatbots could assist in patient-provider communication, particularly with administrative tasks and chronic disease management.

Source: NYU

·July 14, 2023

TO CONTINUE READING: