Student Growth Percentiles in Education Evaluation

 
Using Student Growth Percentiles
 in Educator Evaluations
 
 
Warm Up
 
The 
median
 is the middle number in a
sequence of numbers
 
On your table is a ½ sheet of paper that lists
the heights of students in a teacher’s class
 
Write the students’ heights in order from
shortest to tallest
 
Identify the median height and circle it
 
Norms
 
Share your expertise
Equity of voice
Active listening
Respect the current speaker – no side
conversations
Safety to share different opinions and
perspectives
Respectful use of technology
 
Connector
 
On an index card please complete the
following sentence stem
 
“One of the most important learnings that I
hope to take away today is…”
 
 
Give One, Get One!
 
You will have 5 minutes to:
Circulate around the room
Introduce yourself to a colleague
 
  (name, position & district)
Share the information on your card
Start the process over again
 
Outcomes for Today
 
To increase knowledge of Student Growth
Percentiles (SGPs) and Median Student
Growth Percentiles (MSGPs)
 
Clarify the connection between SGPs and
SLGs for the 2015-16 SY
 
 
 
Waiver Update
 
On July 23, 2015,the USDOE approved
Oregon’s ESEA flexibility waiver renewal
request for three years through the 2017-
2018 school year
 
In other words…
 
Oregon met the condition placed on our
waiver the previous year to provide evidence
of a statewide approach for how teachers
and principals set their student learning and
growth goals in tested grades and subjects to
ensure rigor and consistency across the state
 
As a result…
 
Beginning in the 2015-16 school year, as a
requirement of the ESEA waiver, 
all
 districts
will begin using Student Growth Percentiles
(SGPs) to meet the state assessment
requirement for Student Learning and Growth
(SLG) in grades 4-8 in English/Language arts
(ELA) and math
 
Request to USED for 2015-16
 
ODE has requested a modification to the
waiver
Districts will determine MSGPs, but not
incorporate them in educator summative
evaluations for SY 2015-2016
Districts required to provide SGP training to staff
 
ODE recommends that all educators set two
goals that use Category 2 measures
 
 
 
Student Growth Percentiles
(SGPs)
 
Normative growth measure
 
One year of growth
 
Growth is relative to students
with a similar score history
What do we mean by
normative growth?
Percentiles
 
35th
Level 1
Level 2
Level 3
Level 4
 
2367
ELA/Literacy Scale Score Thresholds
 
2432
 
2490
Oregon
Score Distribution
 
3
rd
 Grade Reading
Grade 3
 
 
Grade 4
 
4
th
 Grade
2398
3
rd
 Grade
2262
 
  2398
- 2262
 
136 points
 
Anthony’s Comparison Group
19
All 3
rd
 grade test takers in 
Oregon
…with Anthony’s Prior Score ~2262
 
Anthony’s prior
score ~2262
 
Anthony’s Comparison Group
Anthony’s Comparison Group
 
High score
 
Middle score
4
th
 Grade Score
Distribution
 
Anthony’s prior
score ~2262
 
Anthony’s Comparison Group
4
th
 Grade Score
Distribution
 
80% of students
in Anthony’s
comparison
group scored
below him
2398
SGP = 80
Anthony’s Comparison Group
4
th
 Grade Score
Distribution
 
Processing Time
 
With the colleagues at your table:
 
Talk about what you’ve heard so far
Identify a question your group still has about
SGPs
 
(Up Next: Determining Median SGPs)
 
Term Clarification
 
A Student Growth Percentiles 
(SGP)
measures growth for an individual
student
 
A Median Student Growth Percentile
(MSGP) represents the exact middle of a
group of students’ SGPs
Median Student Growth Percentiles
Students in Mr. Waters class
 
 
Student
   
SGP
 
Sheryl
   
3
 
Hector 
   
22
 
Robert
   
36
 
Miranda
  
38
 
Tre
   
51
 
Anna
   
54
 
Eric
   
71
 
Anthony
  
80
 
Amina
   
93
 
Making a Determination of Student
Growth
 
The Median Student Growth Percentile (SGP)
determines the educator’s 
Category 1 SLG Rating
 
X-Axis = SLG Rating
 
SLG performance level based on two
goals
Two-year cycle select two of four goals
Score SLG goals
Get a rating between 1 and 4;
Use X-Axis thresholds to determine
SLG level:
4 = both goals 4s
3 = both goals 3s; one goal 3 & one
 
goal 4; one goal 2 & one 4
2 = both goals 2s; one goal 2 & one
 
3; one goal 1 & one 3; one goal 4
 
& one 1
1= both goals 1s; one goal 1 &  one 2
 
Mr. Waters
MSGP was rated 3
Second SLG was rated 3
 
X-Axis Rating = Level 3
SLG Rating
 
Y-Axis = PP/PR Rating
 
Add up all component scores for total
points possible;
Divide by number of components in
your rubric;
Get a rating between 1 and 4;
Use Y-Axis threshold to determine
PP/PR level:
3.6 - 4.0 = 4
2.81-3.59 =3
1.99 – 2.8 = 2 *
< 1.99 = 1
*PP/PR Scoring Rule
: If the educator scores two
1’s in any PP/PR component and  his/her average
score falls between 1.99-2.499, the educator’s
performance level cannot be rated above a 1.
 
 
Mr. Waters
District rubric with  20
components
Component ratings:
17 components were rated
3; and 3 were rated 2 = 57
points possible
57/20=2.85
 
2.85 = Level 3 PP/PR Rating
 
*Inquiry
Process
 
Mr. Waters: Y-axis = 3 & X-axis = 3
 
Questions?
 
Your Turn!
 
Use the data packet provided to:
Calculate Mr. Hendrick’s Y-axis rating
Determine Mr. Hendrick’s median SGP
Calculate Mr. Hendrick’s X-axis rating
 
Share Out
 
 
*Inquiry
Process
 
Timeline and Responsibilities
 
Impact on Evaluation Cycles
 
Fall to Fall
Summative conversation and evaluation takes
place at the beginning of the following year
 
Spring to Spring
Preliminary summative evaluation conducted
with the data available, verified in the fall
 
How do SGPs change the goal
setting and scoring processes?
 
Teachers and principals in 
grades 4- 8
in ELA and math
 
All other educators
 
All Other Educators
 
Minimum of 2 SLG goals 
each year
Quality Review Checklist used for goal setting
Goals can use either:
Category 1 (statewide assessments) 
OR
Category 2 (school or district-wide assessments)
measures
Goals scored using the statewide SLG Scoring
Rubric
Oregon Matrix used to identify summative scores
 
Student Learning and Growth Guidance
 
Teachers and Principals in
Grades 4 – 8 ELA and Math
 
Minimum of 2 SLG goals 
each year
Quality Review Checklist used for goal setting
One goal must use Category 1 measure (Smarter)
Method for scoring Category 1 goal depends on
whether the district uses Option A or Option B
Second goal can use either Category 1 or
Category 2 measures
Category 2 goals scored using the statewide SLG
Scoring Rubric
Oregon Matrix used to identify summative scores
 
 
Special Education/ Interventionists
 
Only applies to teachers who are the primary
providers of instruction
 
Only the SGPs of students who take the
statewide assessment (Smarter) in ELA or math
are used in identifying an educator’s MSGP
 
Teachers for whom the majority of students take
the Extended Assessment write a goal using the
EA as the measure and score it using the
statewide rubric
 
What do districts need to do?
 
Select Option A or B
 
Establish procedures
 
Create rosters
 
Select Option A or Option B
 
Collaboration is key!
 
OPTION  A
 
OPTION  B
 
FOCUSED COLLABORATION
Learning Exercise
 
Discuss with colleagues at your table how your
district might go about making the decision as to
which option the district will choose
 
Remember
Districts are advised to have a collaborative team
of teachers, administrators, and association
representatives work collaboratively to choose
between Options A and B
 
Before using Student Growth Percentiles,
districts will need to establish procedures
and a process for using Median Student
Growth Percentiles district-wide.
 
This process should be established
Fall 2015
 
Starting to Plan…
 
Establish Procedures…
 
Teacher of Record: 
which teachers and
principals are responsible for content
covered by Smarter Balanced assessments
in grades 4-8 for ELA and math
Roster creation and verification
Provide rosters to teachers and principals in
the fall for planning purposes
Verify rosters in the spring for evaluation
 
Create rosters…
 
Determine who is on each roster
Elementary: 
Every student in a class that
takes Smarter in ELA or math
Middle: 
All students within a particular
course who take Smarter in either ELA or
math
Principals: 
All students in a particular
grade who take Smarter in either ELA or
math
 
Impact of Attendance
 
Districts must use the state’s definition of
“full academic year” when including
students on rosters
“…consecutive enrollment in a school or
district for more than one-half of the
instructional days prior to the first school day
in May”
 
Impact of Class Size on SGPs
 
Districts are required to use Median
Student Growth Percentiles for educators
who have at least 20 students
 
Teachers and principals in grades 4-8 (ELA
and math only) who fall below 20 students
must use other measures that are valid,
reliable, and comparable across the school
or district (Category 2 measures)
 
Resources
 
ODE Webpage for SGPs 
has been added to
the EE Toolkit
 
ESD Regional Workshops
Contact your ESD to find out when a
regional training might be available in your
area
 
Remaining questions?
 
Using an index card at your table, please
identify:
One learning from today; and
Two questions you still have about SGPs
 
Feedback
 
ODE Contacts
 
Educator Effectiveness Team:
 
Tanya Frisendahl 
tanya.frisendahl@state.or.us
 
Sarah Martin 
sarah.martin@state.or.us
 
Sarah Phillips 
sarah.phillips@state.or.us
 
Brian Putnam 
brian.putnam@state.or.us
Slide Note

Welcome and introductions

Embed
Share

This collection of resources covers topics such as using student growth percentiles in educator evaluations, identifying median heights of students, establishing norms for collaborative environments, and discussing outcomes related to student growth percentiles in education reform. It touches on updates regarding waivers and requirements for using growth percentiles in assessing student learning and growth in schools.

  • Education
  • Student Growth Percentiles
  • Educator Evaluations
  • Collaboration
  • Norms

Uploaded on Sep 19, 2024 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript


  1. Using Student Growth Percentiles in Educator Evaluations

  2. Warm Up The median is the middle number in a sequence of numbers On your table is a sheet of paper that lists the heights of students in a teacher s class Write the students heights in order from shortest to tallest Identify the median height and circle it

  3. Norms Share your expertise Equity of voice Active listening Respect the current speaker no side conversations Safety to share different opinions and perspectives Respectful use of technology

  4. Connector On an index card please complete the following sentence stem One of the most important learnings that I hope to take away today is

  5. Give One, Get One! You will have 5 minutes to: Circulate around the room Introduce yourself to a colleague (name, position & district) Share the information on your card Start the process over again

  6. Outcomes for Today To increase knowledge of Student Growth Percentiles (SGPs) and Median Student Growth Percentiles (MSGPs) Clarify the connection between SGPs and SLGs for the 2015-16 SY

  7. Waiver Update On July 23, 2015,the USDOE approved Oregon s ESEA flexibility waiver renewal request for three years through the 2017- 2018 school year

  8. In other words Oregon met the condition placed on our waiver the previous year to provide evidence of a statewide approach for how teachers and principals set their student learning and growth goals in tested grades and subjects to ensure rigor and consistency across the state

  9. As a result Beginning in the 2015-16 school year, as a requirement of the ESEA waiver, all districts will begin using Student Growth Percentiles (SGPs) to meet the state assessment requirement for Student Learning and Growth (SLG) in grades 4-8 in English/Language arts (ELA) and math

  10. Request to USED for 2015-16 ODE has requested a modification to the waiver Districts will determine MSGPs, but not incorporate them in educator summative evaluations for SY 2015-2016 Districts required to provide SGP training to staff ODE recommends that all educators set two goals that use Category 2 measures

  11. Student Growth Percentiles (SGPs) Normative growth measure One year of growth Growth is relative to students with a similar score history

  12. What do we mean by normative growth?

  13. Percentiles 65% 35% 35th

  14. Anthony 4th Grade 3rd Grade 2398 2262 Level 1 Level 2

  15. Oregon Score Distribution 3rd Grade Reading Level 4 Level 3 Level 2 Level 1 2432 2367 2490 ELA/Literacy Scale Score Thresholds

  16. Grade 4 Grade 3 Level 2 Level 3 Level 1 Level 4 4th Grade 2398 3rd Grade 2262

  17. 2398 - 2262 136 points

  18. Anthonys Comparison Group

  19. Level 2 Level 3 Level 1 Level 4 All 3rd grade test takers in Oregon with Anthony s Prior Score ~2262 19 Anthony

  20. Lev el 2 Level 3 Level 1 Level 4 Anthony s Comparison Group Anthony s prior score ~2262 Anthony

  21. 4th Grade Score Distribution Level 2 Level 3 Level 1 Level 4 Middle score High score Anthony s Comparison Group Anthony s prior score ~2262

  22. 4th Grade Score Distribution 80% of students in Anthony s comparison group scored below him Level 2 Level 3 Level 1 Level 4 2398 Anthony s Comparison Group

  23. 4th Grade Score Distribution Level 2 Level 3 Level 1 SGP = 80 Level 4 Anthony s Comparison Group

  24. Processing Time With the colleagues at your table: Talk about what you ve heard so far Identify a question your group still has about SGPs (Up Next: Determining Median SGPs)

  25. Term Clarification A Student Growth Percentiles (SGP) measures growth for an individual student A Median Student Growth Percentile (MSGP) represents the exact middle of a group of students SGPs

  26. Median Student Growth Percentiles Students in Mr. Waters class Student Sheryl Hector Robert Miranda Tre Anna Eric Anthony Amina SGP 3 22 36 38 51 54 71 80 93

  27. Making a Determination of Student Growth The Median Student Growth Percentile (SGP) determines the educator s Category 1 SLG Rating Category 1 SLG Rating 1 2 3 4 65to 99 percentile Median SGP Criteria 1 to 34 percentile 35 to 49 percentile 50 to 64 percentile Interpretation Low growth Below average growth Above average growth High growth

  28. X-Axis = SLG Rating SLG performance level based on two goals Two-year cycle select two of four goals Score SLG goals Get a rating between 1 and 4; Use X-Axis thresholds to determine SLG level: 4 = both goals 4s 3 = both goals 3s; one goal 3 & one goal 4; one goal 2 & one 4 2 = both goals 2s; one goal 2 & one 3; one goal 1 & one 3; one goal 4 & one 1 1= both goals 1s; one goal 1 & one 2 Mr. Waters MSGP was rated 3 Second SLG was rated 3 X-Axis Rating = Level 3 SLG Rating

  29. Y-Axis = PP/PR Rating Mr. Waters Add up all component scores for total points possible; Divide by number of components in your rubric; Get a rating between 1 and 4; Use Y-Axis threshold to determine PP/PR level: 3.6 - 4.0 = 4 2.81-3.59 =3 1.99 2.8 = 2 * < 1.99 = 1 District rubric with 20 components Component ratings: 17 components were rated 3; and 3 were rated 2 = 57 points possible 57/20=2.85 2.85 = Level 3 PP/PR Rating *PP/PR Scoring Rule: If the educator scores two 1 s in any PP/PR component and his/her average score falls between 1.99-2.499, the educator s performance level cannot be rated above a 1.

  30. Mr. Waters: Y-axis = 3 & X-axis = 3 Facilitative or Collegial * SLG Inquiry Collegial *SLG Inquiry Facilitative 4 Facilitative 4 LEVEL 4 3 3 or 4 Collegial 3 Consulting 2 Directed 1 Collegial or Consulting *SLG Inquiry 2 or 3 Consulting 2 Collegial 3 Consulting 2 Consulting or Directed * PP/PR Inquiry 1 or 2 Collegial 3 Collegial or Consulting * PP/PR Inquiry 2 or 3 Consulting * PP/PR Inquiry 2 LEVEL 4 Y-Axis: PP / PR LEVEL 3 LEVEL 2 Directed 1 LEVEL 1 *Inquiry Process LEVEL 1 LEVEL 2 LEVEL 3 X-Axis: SLG

  31. Questions?

  32. Your Turn! Use the data packet provided to: Calculate Mr. Hendrick s Y-axis rating Determine Mr. Hendrick s median SGP Calculate Mr. Hendrick s X-axis rating Share Out

  33. Facilitative or Collegial * SLG Inquiry Collegial *SLG Inquiry Facilitative 4 Facilitative 4 LEVEL 4 3 3 or 4 Collegial 3 Consulting 2 Directed 1 Collegial or Consulting *SLG Inquiry 2 or 3 Consulting 2 Collegial 3 Consulting 2 Consulting or Directed * PP/PR Inquiry 1 or 2 Collegial 3 Collegial or Consulting * PP/PR Inquiry 2 or 3 Consulting * PP/PR Inquiry 2 LEVEL 4 Y-Axis: PP / PR LEVEL 3 LEVEL 2 Directed 1 LEVEL 1 LEVEL 1 LEVEL 2 LEVEL 3 X-Axis: SLG *Inquiry Process

  34. Timeline and Responsibilities 2015-16 SY ODE RESPONSIBILITIES DISTRICT RESPONSIBILITIES Provide districts state criteria for determining Median Student Growth Percentiles (see Table 3 on page 5 in this guidance). Select Option A or Option B to be used district-wide. Establish a process for determining the teacher of record. Fall 2015 Fall 2015 Provide districts with communications and guidance. Provide districts with professional development and technical support. Create class rosters and establish a roster verification process. Provide training in the district to educators, evaluators, and coordinating staff. 2015 2015- -16 School School Year Year 16 Administer Smarter Balanced Assessment Administer Smarter Balanced Assessment Educators verify class rosters. February February - - June June 2016 2016 Calculate Student Growth Percentiles for all students. Receive Student Growth Percentiles and Smarter Balanced results from ODE. Summer Summer 2016 2016 Send districts Student Growth Percentiles and Smarter Balanced achievement data in August. Provide guidance and support to districts. Determine the Median Student Growth Percentile ratings using the state criteria. Fall 2016 Fall 2016 Incorporate median Student Growth Percentile ratings into educator summative evaluations.

  35. Impact on Evaluation Cycles Fall to Fall Summative conversation and evaluation takes place at the beginning of the following year Spring to Spring Preliminary summative evaluation conducted with the data available, verified in the fall

  36. How do SGPs change the goal setting and scoring processes? Teachers and principals in grades 4- 8 in ELA and math All other educators

  37. All Other Educators Minimum of 2 SLG goals each year Quality Review Checklist used for goal setting Goals can use either: Category 1 (statewide assessments) OR Category 2 (school or district-wide assessments) measures Goals scored using the statewide SLG Scoring Rubric Oregon Matrix used to identify summative scores Student Learning and Growth Guidance

  38. Teachers and Principals in Grades 4 8 ELA and Math Minimum of 2 SLG goals each year Quality Review Checklist used for goal setting One goal must use Category 1 measure (Smarter) Method for scoring Category 1 goal depends on whether the district uses Option A or Option B Second goal can use either Category 1 or Category 2 measures Category 2 goals scored using the statewide SLG Scoring Rubric Oregon Matrix used to identify summative scores

  39. Special Education/ Interventionists Only applies to teachers who are the primary providers of instruction Only the SGPs of students who take the statewide assessment (Smarter) in ELA or math are used in identifying an educator s MSGP Teachers for whom the majority of students take the Extended Assessment write a goal using the EA as the measure and score it using the statewide rubric

  40. What do districts need to do? Select Option A or B Establish procedures Create rosters

  41. Select Option A or Option B Option A Option B Educators are not required to set a Category 1 SLG goal. There is no required goal setting process for Category 1. Educators are required to set one Category 1 SLG goal using Smarter Balanced and rate their goal using the SLG scoring rubric. Educators are required to set one Category 2 SLG goal using the SLG goal template and rate their goal using the SLG scoring rubric Educators are required to set one Category 2 SLG goal using the SLG goal template and rate their goal using the SLG scoring rubric . Student Growth Percentiles are used exclusively to determine the Category 1 SLG rating. Educators SLG goal rating is then compared with their Median Student Growth Percentile rating to determine their final Category 1 SLG rating. Collaboration is key!

  42. 1. Districts determine which educators are required to use Median Student Growth Percentiles and create the educators class rosters for teachers and principals in grades 4-8, ELA/math. Fall 2. Educators set a Category 2 SLG goal following the SLG goal setting template. (They do not set a Category 1 SLG goal.) Spring 3. In May educators verify their class roster through a district-determined process. 4. Districts receive Student Growth Percentiles from ODE in August following the spring test administration. 5. Using the Student Growth Percentiles data from ODE, districts calculate the Median Student Growth Percentiles for the educator s class roster as follows: a. Rank the students scores in the class roster from highest to lowest. b. Locate the middle score (median) in the range to find the Median Student Growth Percentile. If the educator has an even number of students, average the two middle scores. c. Using the state criteria identify the corresponding Median Student Growth Percentile Category 1 SLG rating (1-4). Summer/ Fall 6. The educator and evaluator use the X-axis table to determine the educator s SLG performance level for the Oregon Matrix based on the Median Student Growth Percentile and Category 2 SLG goal ratings. OPTION A

  43. 1. Districts determine which educators are required to use median Student Growth Percentiles and create the educators class rosters for teachers and principals in grades 4-8, ELA/math. Fall 2. Educators set two goals: Category 1 SLG goal and Category 2 SLG goal following the SLG goal setting template. Spring 3. In May, educators verify their class roster through a district-determined process. 4. Districts receive Student Growth Percentiles from ODE in August following the spring test administration. 5. Using the Student Growth Percentiles data from ODE, districts calculate the Median Student Growth Percentiles for the educator s class roster as follows: Rank the students scores in the class roster from highest to lowest. Locate the middle score (median) in the range to find the Median Student Growth Percentile. If the educator has an even number of students, average the two middle scores. Using the state criteria identify the corresponding Median Student Growth Percentile Category 1 SLG rating (1-4). Summer/ Fall 6. Using the state assessment results, the educator and evaluator score the Category 1 SLG goal using the state SLG Goal Scoring Rubric. 7. The evaluator uses the decision table to compare the educator s Category 1 SLG goal rating with the Median Student Growth Percentile rating to determine the combined Category 1 SLG rating (X- and Y-axes intersect). 8. The educator and evaluator use the X-axis tableto determine the educator s SLG performance level for the Oregon Matrix based on the Median Student Growth Percentile and Category 2 SLG goal ratings. 9. If the ratings differ by more than two, use the inquiry process below to determine the final rating. OPTION B

  44. FOCUSED COLLABORATION Learning Exercise Discuss with colleagues at your table how your district might go about making the decision as to which option the district will choose Remember Districts are advised to have a collaborative team of teachers, administrators, and association representatives work collaboratively to choose between Options A and B

  45. Starting to Plan Before using Student Growth Percentiles, districts will need to establish procedures and a process for using Median Student Growth Percentiles district-wide. This process should be established Fall 2015

  46. Establish Procedures Teacher of Record: which teachers and principals are responsible for content covered by Smarter Balanced assessments in grades 4-8 for ELA and math Roster creation and verification Provide rosters to teachers and principals in the fall for planning purposes Verify rosters in the spring for evaluation

  47. Create rosters Determine who is on each roster Elementary: Every student in a class that takes Smarter in ELA or math Middle: All students within a particular course who take Smarter in either ELA or math Principals: All students in a particular grade who take Smarter in either ELA or math

  48. Impact of Attendance Districts must use the state s definition of full academic year when including students on rosters consecutive enrollment in a school or district for more than one-half of the instructional days prior to the first school day in May

More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#