ChatGPT Barely Passes USMLE

Share on facebook
Share on twitter
Share on linkedin
Share on whatsapp
Share on email

As per Moneycontrol, ChatGPT, a big language model built by OpenAI, barely passed all three sections of the United States Medical Licensing Examination (USMLE) in a research trial.

The United States Medical Licensing Examination (USMLE) is a standardized exam that evaluates the knowledge and skills of medical students and graduates and is required for licensing to practice medicine in the United States.

The examination consists of three distinct sections: Part 1, Part 2 Clinical Knowledge, and Part 2 Clinical Skills. Typically, second-year medical students spend hundreds of hours preparing for Part 1, while medical school graduates take Part 3.

Ansible Health, a Silicon Valley firm specializing in the treatment of Chronic Obstructive Pulmonary Disease (COPD), had been investigating various AI and machine learning techniques to enhance its care before deciding to test ChatGPT, the latest AI craze.

According to them, ChatGPT was trained on a massive amount of medical material and exhibited a profound understanding of the topic. It was capable of providing precise responses to a vast array of medical concerns, including those pertaining to the diagnosis, therapy, and medical ethics.

Prior to administering the test, the staff confirmed that “none of the answers, explanations, or related content were indexed by Google.” This has major ramifications for the future of medical education and healthcare as people continue to consult Google for health-related inquiries.

ChatGPT and other similar models could potentially be used to assist medical students in their preparation for the USMLE and other medical examinations, as well as to aid physicians and other healthcare workers in their daily job.

However, the research is still in its infancy, and additional study is required to determine the full potential of the technology. However, ChatGPT is not (yet) capable of replacing human physicians, and traditional medical education and practice will continue to play a crucial role in the diagnosis and treatment of patients.

Leave a Reply


Free CME credits

Both our subscription plans include Free CME/CPD AMA PRA Category 1 credits.

Digital Certificate PDF

On course completion, you will receive a full-sized presentation quality digital certificate.

medtigo Simulation

A dynamic medical simulation platform designed to train healthcare professionals and students to effectively run code situations through an immersive hands-on experience in a live, interactive 3D environment.

medtigo Points

medtigo points is our unique point redemption system created to award users for interacting on our site. These points can be redeemed for special discounts on the medtigo marketplace as well as towards the membership cost itself.
  • Registration with medtigo = 10 points
  • 1 visit to medtigo’s website = 1 point
  • Interacting with medtigo posts (through comments/clinical cases etc.) = 5 points
  • Attempting a game = 1 point
  • Community Forum post/reply = 5 points

    *Redemption of points can occur only through the medtigo marketplace, courses, or simulation system. Money will not be credited to your bank account. 10 points = $1.

All Your Certificates in One Place

When you have your licenses, certificates and CMEs in one place, it's easier to track your career growth. You can easily share these with hospitals as well, using your medtigo app.

Our Certificate Courses