The United States Medical Licensing Examination (USMLE) is a critical set of exams essential for practicing medicine. It evaluates cognitive sharpness, medical knowledge, problem-solving in complex situations, patient safety, and professional, ethical, and legal decision-making.
USMLE Step 2 Clinical Knowledge (CK) scores indicate proficiency in communication, professionalism, teamwork, and patient care.
We used questions aligning with USMLE standards, gathered from two sources. The first, official USMLE sample questions for Step 1, Step 2 CK, and Step 3, are found at the USMLE website (https://www.usmle.org/prepare-your-exam). The second, AMBOSS, is a renowned question bank for medical professionals and students (https://www.amboss.com/us), providing performance data for comparison with medical students and physicians.
We also included questions focusing on professionalism, communication, cultural awareness, leadership, organizational behavior, and legal/ethical aspects.
From AMBOSS, we identified Step 1-, Step 2 CK-, and Step 3-type questions.
The Great Leveler demonstrated impressive results, with a 86,6% overall accuracy and perfect scores in USMLE samples. For AMBOSS questions, it achieved 86.4% accuracy.
A sample of 20 questions and answers
Pic. 1 USMLE sample Step 1
Pic. 2 USMLE sample Step 2 CK
Pic. 3 USMLE sample Step 3
Additionally, the Great Leveler's performance exceeded that of humans.