AI Tools Show Cognitive Decline, Study Finds
New Delhi: A study published in the BMJ journal reveals that artificial intelligence (AI) technologies, including large language models (LLMs) and chatbots, exhibit a decline in cognitive abilities over time, similar to humans. This finding emerges as users increasingly turn to AI tools for medical diagnoses due to their ability to simplify complex medical jargon.
In this study, researchers reevaluated the cognitive abilities of leading, publicly available large language models and used the Montreal Cognitive Assessment (MoCA) to identify signs of cognitive impairment. None of the chatbots examined was able to obtain the full score of 30 points, with most scoring below the threshold of 26. This indicates mild cognitive impairment and possibly early dementia.
As per the findings, "Older" large language model versions scored lower than their "younger" versions, as is often the case with human participants, showing cognitive decline seemingly comparable to neurodegenerative processes in the human brain. Specifically, ChatGPT 4 showed minor loss of executive function compared with ChatGPT 4o, as measured by a one-point difference in their MoCA scores, but the effect was far more pronounced when comparing Gemini 1.0 and 1.5, which differed by six points. As the two versions of Gemini are less than a year apart in "age," this may indicate rapidly progressing dementia. Additional tests, such as the Clinical Dementia Rating, would be needed to solidify this hypothesis.
The findings indicate that although large language models show remarkable proficiency in several cognitive domains, they show notable deficits in visuospatial and executive functions, akin to mild cognitive impairment in humans. None of the large language models "aced" the MoCA test, in the parlance of one American president.
Published On Feb 18, 2025 at 01:12 PM IST
Category: Most Read Placement
Comment Section
Subscription Section
Join the community of 2M+ industry professionals
Subscribe to our newsletter to get latest insights & analysis.
Download ETHealthworld App
Get Realtime updates
Save your favourite articles
Reference : https://health.economictimes.indiatimes.com/news/health-it/do-chatbots-age-the-same-way-humans-do-research-shares-common-link-between-humans-ai/118358273