Understanding OITE Score Reports: A Comprehensive Guide for Orthopaedic Surgeons
Learn how to interpret OITE score reports provided by the American Academy of Orthopaedic Surgeons. Explore comparison guidelines, ABOS Part I linking outcomes, terms and definitions, and overall program performance reports to gain valuable insights into your performance and benchmark against industry standards.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
How to Read OITE Score Reports December 2022 American Academy of Orthopaedic Surgeons
Overview Overview - - Reports Reports Program Coordinators will receive login information to access the Program and Individual reports Each of these is a link to a downloadable report
Comparison Guidelines Comparison Guidelines Reference group for all data comparisons is composed of ACGME-accredited programs All score comparisons and percentiles point to this group ABOS Part I Linking used a set of common items to determine the OITE score that corresponds to minimum passing score on ABOS Part I Common items were written and reviewed by subject matter experts, then analyzed using statistical specifications after being pre-tested on the ABOS Part I exam
ABOS Part I Linking Outcomes ABOS Part I Linking Outcomes For the 2022 OITE: The approximated passing score based on ABOS Part I data is 181 or 68.6% correct *Keep in mind that this is a rough benchmark to help guide education and studying and does not guarantee any scores on future OITE or ABOS exams.
Terms and Definitions Terms and Definitions Mean: average score (Sum of scores/number of scores) Standard Deviation: how far the data spreads from the mean; shows how variable the data is ACGME mean: mean score among all ACGME-accredited Residency programs (Shown as full group or broken down by program year) Program Percentile: Rank of program s mean among all ACGME- accredited programs (percent of scores lower than or equal to that programs mean) Resident Percentile: Rank of individual resident s score among all ACGME-accredited scores in that PGY (percent of scores in that PGY lower than or equal to that resident s score)
Overall Program Performance Reports Overall Program Performance Reports
Overall Program Performance Overall Program Performance Percent of program averages lower than or equal to your program average These two numbers show the average score of your program and the ACGME average Indicates if your program average was above or below the ACGME average Counts of residents in each PGY year
Overall Program Performance Overall Program Performance PGY Breakdown PGY Breakdown Two ways of showing how each of your PGY groups perform compared with all ACGME programs. Based on average score.
Overall Program Performance Overall Program Performance Individual Residents Individual Residents How far above or below the mean this resident s score was Percent of questions resident answered correctly *Note PGY are NOT in order
PGY Performance Reports for your Program PGY Performance Reports for your Program
PGY Performance Reports PGY Performance Reports Indicates if your program s PGY average was above or below the ACGME average for that PGY. Shown in # correct and % correct. *Note the exam is 275 questions, but 5-8 items are removed each year for a variety of reasons
PGY Performance Reports PGY Performance Reports Performance of this PGY in each content area. Great data to compare curriculum.
PGY Performance Reports PGY Performance Reports More detailed breakdown of content area performance for this PGY compared to ACGME performance.
Individual Resident Reports Individual Resident Reports
Percentile rank = percent of scores lower than or equal to this resident s score within their PGY Individual Reports Individual Reports Number correct and percent correct for this resident
Performance of this resident in each content area. Great data for them to know what to study.
Please contact AAOS with any questions. Please contact AAOS with any questions. Exams@aaos.org Exams@aaos.org
