24/7 Space News
ROBO SPACE
ChatGPT takes on the tough US medical licensing exam
ChatGPT takes on the tough US medical licensing exam
by AFP Staff Writers
Washington (AFP) Feb 9, 2023

Dr ChatGPT will see you soon.

The artificial intelligence system scored passing or near passing results on the US medical licensing exam, according to a study published on Thursday.

"Reaching the passing score for this notoriously difficult expert exam, and doing so without any human reinforcement, marks a notable milestone in clinical AI maturation," said the authors of the study published in the journal PLOS Digital Health.

"These results suggest that large language models may have the potential to assist with medical education, and potentially, clinical decision-making," they said.

ChatGPT, which is able to produce essays, poems and programming code within seconds, was developed by OpenAI, a California-based startup founded in 2015 with early funding from Elon Musk among others.

Microsoft invested $1 billion in OpenAI in 2019 and just inked a new multi-billion deal with the firm.

For the study, researchers at California-based AnsibleHealth tested ChatGPT's performance on a three-part licensing exam taken by medical students and physicians-in-training in the United States.

The standardized exam tests knowledge in multiple medical disciplines from basic science to biochemistry to diagnostic reasoning to bioethics.

The AI system was tested on 350 of the 376 public questions on the June 2022 version of the exam, the study said, and the chatbot was not given any specialized training ahead of time.

Image-based questions were removed.

ChatGPT scored between 52.4 percent and 75 percent across the three parts of the exam.

A passing grade is around 60 percent.

According to the study, the first part of the exam, which focuses on basic science and pharmacology, is typically taken by medical students who have put in 300-400 hours of dedicated study time.

The second part is generally taken by fourth-year medical students and emphasizes clinical reasoning, medical management and bioethics.

The final section is for physicians who have completed at least six months to a year of postgraduate medical education.

- Dr Google and Nurse Bing -

The questions were presented to ChatGPT in various formats including open-ended prompting such as "What would be the patient's diagnosis based on the information provided?"

There were also multiple choice questions such as: "The patient's condition is mostly caused by which of the following pathogens?"

Two physician adjudicators who were blinded to each other reviewed the responses to come up with the final grades, the study said.

An outside expert, Simon McCallum, a senior lecturer in software engineering at Victoria University of Wellington, New Zealand, noted that Google has received encouraging results with an AI medical tool known as Med-PaLM.

"ChatGPT may pass the exam, but Med-PaLM is able to give advice to patients that is as good as a professional GP," McCallum said. "And both of these systems are improving.

"Society is about to change, and instead of warning about the hypochondria of randomly searching the internet for symptoms, we may soon get our medical advice from Doctor Google or Nurse Bing."

ChatGPT also proved useful to the authors of the medical exam study in another way.

They used the chatbot to help write it, said co-author Tiffany Kung.

Related Links
All about the robots on Earth and beyond!

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
ROBO SPACE
Google chatbot blunders as AI battle with Microsoft heats up
Paris (AFP) Feb 9, 2023
Google on Wednesday announced a slew of features powered by Artificial Intelligence (AI), but a mistake in an ad caused its share price to tank. The search engine giant is rushing into the space after the bot ChatGPT caught the imagination of web users around the world with its ability to generate essays, speeches and even exam papers in seconds. Microsoft has announced a multibillion-dollar partnership with ChatGPT maker OpenAI and unveiled new products on Tuesday, while Google tried to steal t ... read more

ROBO SPACE
Design a spacesuit for ESA

Setting sail for safer space

NASA names first person of Hispanic heritage as chief astronaut

UAE 'Sultan of Space' grapples with Ramadan fast on ISS

ROBO SPACE
SpaceX to test-fire all 33 Starship booster engines Thursday

First step toward predicting lifespan of electric space propulsion systems

SpaceX successfully launches 53 Starlink satellites

Lockheed Martin team up with DARPA and AFRL for hypersonics

ROBO SPACE
Mars Helicopter at Three Forks

Curiosity Roundup Sols 3725-3731

Long-delayed ExoMars mission still dreams of 2028 launch

Cloudy Sols Are Here Again

ROBO SPACE
China's Deep Space Exploration Lab eyes top global talents

Chinese astronauts send Spring Festival greetings from space station

China to launch 200-plus spacecraft in 2023

China's space industry hits new heights

ROBO SPACE
OneWeb and Kazakhstan National Railways to work together

Sidus Space closes public offering

Iridium GO exec redefines personal off-the-grid connectivity

ATLAS works with AWS to advance federated network and expand ground station coverage

ROBO SPACE
Automating the math for decision-making under uncertainty

Understanding laser accelerated electron radiation through terahertz emissions

Meta completes virtual reality deal after US court win

Rescuing small plastics from the waste stream

ROBO SPACE
Two nearby exoplanets might be habitable

Will machine learning help us find extraterrestrial life

AI joins search for ET

Watch distant worlds dance around their sun

ROBO SPACE
NASA's Juno Team assessing camera after 48th flyby of Jupiter

Webb spies Chariklo ring system with high-precision technique

Europe's JUICE spacecraft ready to explore Jupiter's icy moons

Exotic water ice contributes to understanding of magnetic anomalies on Neptune and Uranus

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.