OITE Score Reports: A Comprehensive Guide for Orthopaedic Surgeons
How to Read OITE Score
Reports
December 2022
American Academy of Orthopaedic Surgeons
O
v
e
r
v
i
e
w
-
R
e
p
o
r
t
s
•
Program
Coordinators will
receive login
information to
access the
Program and
Individual reports
•
Each of these is a
link to a
downloadable
report
C
o
m
p
a
r
i
s
o
n
G
u
i
d
e
l
i
n
e
s
•
Reference group
for all data comparisons is composed of
ACGME-accredited programs
•
All score comparisons and percentiles point to this group
•
ABOS Part I Linking
used a set of common items to
determine the OITE score that corresponds to minimum
passing score on ABOS Part I
•
Common items were written and reviewed by subject matter
experts, then analyzed using statistical specifications after being
pre-tested on the ABOS Part I exam
A
B
O
S
P
a
r
t
I
L
i
n
k
i
n
g
O
u
t
c
o
m
e
s
For the 2022 OITE:
The approximated passing score based on ABOS Part I data is
181
or
68.6%
correct
*Keep in mind that this is a rough benchmark to help guide education
and studying and does not guarantee any scores on future OITE or
ABOS exams.
T
e
r
m
s
a
n
d
D
e
f
i
n
i
t
i
o
n
s
•
Mean
: average score
(Sum of scores/number of scores)
•
Standard Deviation
: how far the data spreads from the mean;
shows how variable the data is
•
ACGME mean
: mean score among all ACGME-accredited
Residency programs
(Shown as full group or broken down by
program year)
•
Program Percentile
: Rank of program’s mean among all ACGME-
accredited programs
(percent of scores lower than or equal to
that programs’ mean)
•
Resident Percentile
: Rank of individual resident’s score among all
ACGME-accredited scores in that PGY
(percent of scores in that
PGY lower than or equal to that resident’s score)
O
v
e
r
a
l
l
P
r
o
g
r
a
m
P
e
r
f
o
r
m
a
n
c
e
R
e
p
o
r
t
s
O
v
e
r
a
l
l
P
r
o
g
r
a
m
P
e
r
f
o
r
m
a
n
c
e
Indicates if your
program average was
above or below the
ACGME average
These two numbers
show the average
score of your
program and the
ACGME average
Percent of program
averages lower than
or equal to your
program average
Counts of residents
in each PGY year
O
v
e
r
a
l
l
P
r
o
g
r
a
m
P
e
r
f
o
r
m
a
n
c
e
–
P
G
Y
B
r
e
a
k
d
o
w
n
Two ways of showing how each of your PGY groups perform
compared with all ACGME programs. Based on average
score.
O
v
e
r
a
l
l
P
r
o
g
r
a
m
P
e
r
f
o
r
m
a
n
c
e
–
I
n
d
i
v
i
d
u
a
l
R
e
s
i
d
e
n
t
s
How far above or
below the mean this
resident’s score was
*Note PGY are
NOT in order
Percent of questions
resident answered
correctly
P
G
Y
P
e
r
f
o
r
m
a
n
c
e
R
e
p
o
r
t
s
f
o
r
y
o
u
r
P
r
o
g
r
a
m
P
G
Y
P
e
r
f
o
r
m
a
n
c
e
R
e
p
o
r
t
s
Indicates if your program’s PGY average was above or
below the ACGME average for that PGY. Shown in # correct
and % correct.
*Note the exam is 275 questions,
but 5-8 items are removed each
year for a variety of reasons
P
G
Y
P
e
r
f
o
r
m
a
n
c
e
R
e
p
o
r
t
s
Performance of this PGY in each content area.
Great data to compare curriculum.
P
G
Y
P
e
r
f
o
r
m
a
n
c
e
R
e
p
o
r
t
s
More detailed breakdown of content area
performance for this PGY compared to
ACGME performance.
I
n
d
i
v
i
d
u
a
l
R
e
s
i
d
e
n
t
R
e
p
o
r
t
s
I
n
d
i
v
i
d
u
a
l
R
e
p
o
r
t
s
Percentile rank = percent of
scores lower than or equal to this
resident’s score within their PGY
Number correct and percent
correct for this resident
Performance of this resident in each
content area. Great data for them to
know what to study.
P
l
e
a
s
e
c
o
n
t
a
c
t
A
A
O
S
w
i
t
h
a
n
y
q
u
e
s
t
i
o
n
s
.
E
x
a
m
s
@
a
a
o
s
.
o
r
g
Learn how to interpret OITE score reports provided by the American Academy of Orthopaedic Surgeons. Explore comparison guidelines, ABOS Part I linking outcomes, terms and definitions, and overall program performance reports to gain valuable insights into your performance and benchmark against industry standards.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
How to Read OITE Score Reports December 2022 American Academy of Orthopaedic Surgeons
Overview Overview - - Reports Reports Program Coordinators will receive login information to access the Program and Individual reports Each of these is a link to a downloadable report
Comparison Guidelines Comparison Guidelines Reference group for all data comparisons is composed of ACGME-accredited programs All score comparisons and percentiles point to this group ABOS Part I Linking used a set of common items to determine the OITE score that corresponds to minimum passing score on ABOS Part I Common items were written and reviewed by subject matter experts, then analyzed using statistical specifications after being pre-tested on the ABOS Part I exam
ABOS Part I Linking Outcomes ABOS Part I Linking Outcomes For the 2022 OITE: The approximated passing score based on ABOS Part I data is 181 or 68.6% correct *Keep in mind that this is a rough benchmark to help guide education and studying and does not guarantee any scores on future OITE or ABOS exams.
Terms and Definitions Terms and Definitions Mean: average score (Sum of scores/number of scores) Standard Deviation: how far the data spreads from the mean; shows how variable the data is ACGME mean: mean score among all ACGME-accredited Residency programs (Shown as full group or broken down by program year) Program Percentile: Rank of program s mean among all ACGME- accredited programs (percent of scores lower than or equal to that programs mean) Resident Percentile: Rank of individual resident s score among all ACGME-accredited scores in that PGY (percent of scores in that PGY lower than or equal to that resident s score)
Overall Program Performance Reports Overall Program Performance Reports
Overall Program Performance Overall Program Performance Percent of program averages lower than or equal to your program average These two numbers show the average score of your program and the ACGME average Indicates if your program average was above or below the ACGME average Counts of residents in each PGY year
Overall Program Performance Overall Program Performance PGY Breakdown PGY Breakdown Two ways of showing how each of your PGY groups perform compared with all ACGME programs. Based on average score.
Overall Program Performance Overall Program Performance Individual Residents Individual Residents How far above or below the mean this resident s score was Percent of questions resident answered correctly *Note PGY are NOT in order
PGY Performance Reports for your Program PGY Performance Reports for your Program
PGY Performance Reports PGY Performance Reports Indicates if your program s PGY average was above or below the ACGME average for that PGY. Shown in # correct and % correct. *Note the exam is 275 questions, but 5-8 items are removed each year for a variety of reasons
PGY Performance Reports PGY Performance Reports Performance of this PGY in each content area. Great data to compare curriculum.
PGY Performance Reports PGY Performance Reports More detailed breakdown of content area performance for this PGY compared to ACGME performance.
Individual Resident Reports Individual Resident Reports
Percentile rank = percent of scores lower than or equal to this resident s score within their PGY Individual Reports Individual Reports Number correct and percent correct for this resident
Performance of this resident in each content area. Great data for them to know what to study.
Please contact AAOS with any questions. Please contact AAOS with any questions. Exams@aaos.org Exams@aaos.org
