Evaluator Training Progress Update
As online evaluator training progresses, modules are being accessed, certificates earned, and participant satisfaction remains high. The curriculum for Level 2 training is complete, focusing on feedback, interrater reliability, and assessments. Survey research is ongoing, with results expected in the spring. Development of modules for superintendents and multi-year research analysis are also underway. A multidisciplinary research team has been assembled to analyze data on educator plans. Various challenges like changes in methodologies, assessment timeliness, and policy interpretation have been highlighted, impacting accountability and evaluations tied to assessments.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
UPDATE: ON-LINE EVALUATOR TRAINING TOTAL NUMBER ACCESSING ONE OR MORE MODULES THROUGH FALL 2016: 1104 NUMBER CERTIFICATES EARNED: 630 AVERAGE SATISFACTION OF PARTICIPANTS: 4 OUT OF 5 (5 BEING HIGHEST)
UPDATE: LEVEL 2 TRAINING CURRICULUM COMPLETED FOR SESSIONS ON 1) PROVIDING FEEDBACK 2) INTERRATER RELIABILITY AND 3) ASSESSMENTS ESC OFFERINGS THROUGH THE FALL WILL REPEAT OFFERINGS DURING SPRING SEMESTER
UPDATE: SURVEY RESEARCH 2016 SURVEY SENT MID-OCTOBER DISSEMINATED THROUGH ISPA, IPSSA, ISTA, AFT, INTASS, DOE DIALOGUE, LEARNING CONNECTIONS REPORT EARLY SPRING
UPDATE: OTHER MODULE IN DEVELOPMENT FOR SUPERINTENDENTS: CREATING AND IMPLEMENTING HIGH QUALITY EVALUATION PLANS RECOGNITION OF HIGH QUALITY DISTRICT WILL CONTINUE IN SPRING
UPDATE: INTASS RESEARCH DEVELOPED MULTI-YEAR DESIGN 2013-14 THROUGH 2015-16 ANALYSES OF RESEARCH RELATIONSHIPS BETWEEN DISTRICT, SCHOOL, EDUCATOR AND STUDENT DEMOGRAPHICS, AND PLAN CHARACTERISTICS WITH EDUCATOR RATINGS AND STUDENT OUTCOMES.
ASSEMBLED A MULTI-DISCIPLINARY RESEARCH TEAM HANNAH BOLTE, STATISTICAL CONSULTANT/LECTURER, IU DEPARTMENT OF STATISTICS MICHAEL FRISBY, STATISTICAL CONSULTANT, IU DEPARTMENT OF STATISTICS DEMETREES L. HUTCHINS, MANAGEMENT ANALYST, IUPUI SCHOOL OF EDUCATION GARY PIKE, EXECUTIVE DIRECTOR OF INFORMATION MANAGEMENT AND INSTITUTIONAL RESEARCH AT IUPUI, ASSOCIATE PROFESSOR OF HIGHER EDUCATION SARAH PIES, RESEARCH ASSOCIATE, INTASS PROJECT, INDIANA UNIVERSITY HARDY MURPHY, CLINICAL FACULTY IUPUI, CO DIRECTOR OF INTASS SANDI COLE, DIRECTOR CENTER ON EDUCATION AND LIFELONG LEARNING IUB, CO DIRECTOR INTASS
CONTEXT: DATA CHARACTERISTICS AND EDUCATOR PLAN ENVIRONMENT ACROSS THE YEARS TEST CHANGES IN THREE OF THE FOUR YEARS INTRODUCTION OF NEW METHODOLOGIES, E.G., TECHNOLOGY AND OPEN-ENDED RESPONSE DATA PROBLEMS IN ISTEP SCORING PERVASIVE ISSUES WITH TIMELINESS OF RESULTS INCONSISTENCY IN INTERPRETATION OF POLICY AND GUIDANCE LATE RELEASE OF ASSESSMENT RESULTS---TRIGGERS HOLD HARMLESS ON ACCOUNTABILITY AND EVALUATIONS TIED TO ISTEP+ HOLD HARMLESS PROVISION TAKEN FOR A-F LETTER GRADES AND TEACHER EVALUATIONS DUE TO NEW ASSESSMENT/STANDARDS LACK OF FIDELITY IN PLAN IMPLEMENTATION CHANGES IN INCENTIVES FOR EDUCATOR PERFORMANCE, E.G., COMPETITIVE GRANTS CHANGES IN STATE STANDARDS EVALUATION PLANS NOT MONITORED UNTIL 2014-15 CHANGES IN STATE ACCOUNTABILITY MODEL
BASIC RESEARCH MODELS IN ADDITION TO DISTRICT, SCHOOL, EDUCATOR, AND STUDENT DEMOGRAPHICS, RESEARCH MODELS ACCOUNT FOR STUDENT DAYS OF ATTENDANCE, YEARS OF PLAN IMPLEMENTATION, AND METHODS TO ACCOUNT FOR ANOMALIES ALL RESEARCH MODELS INCLUDE A VARIETY OF STUDENT AND EDUCATOR OUTCOME MEASURES RANGING FROM STUDENT SCALE SCORES, STUDENT PROFICIENCY LEVELS, STUDENT GROWTH PERCENTILES AND BOTH IGM AND SUMMATIVE RATINGS
QUESTIONS BEING RESEARCHED EDUCATOR CHARACTERISTICS, EVALUATION RATINGS AND STUDENT OUTCOMES: YEARS OF EXPERIENCE, EVALUATION RATINGS AND STUDENT OUTCOMES GRADE LEVEL DESIGNATION AND EVALUATION RATINGS AND STUDENT OUTCOMES SUBJECT TAUGHT AND EVALUATION RATINGS WHETHER OR NOT A TEACHER IS IN AN ACCOUNTABILITY GRADE AND OR SUBJECT AND EVALUATION RATINGS EDUCATOR GENDER, EVALUATION RATINGS AND STUDENT OUTCOMES EDUCATOR RACE/ETHNICITY AND EVALUATION RATINGS EDUCATOR SALARY, STUDENT OUTCOME AND EVALUATION RATINGS
QUESTIONS BEING RESEARCHED STUDENT CHARACTERISTICS, STUDENT OUTCOMES AND EDUCATOR EVALUATION RATINGS MEDIAN STUDENT GROWTH PERCENTILES AND EDUCATOR EVALUATION RATINGS PRIOR YEAR ISTEP SCORES AND EDUCATOR EVALUATION RATINGS AVERAGE CLASS ISTEP SCORES AND EDUCATOR EVALUATION RATINGS PRIOR YEAR GROWTH AND EDUCATOR EVALUATION RATINGS STUDENT HISTORICAL ISTEP PERFORMANCE AND EDUCATOR EVALUATION RATINGS STUDENTS RECEIVING FREE AND REDUCED LUNCH, STUDENT RACIAL/ETHNIC MEMBERSHIP, STUDENTS ON IEP S/ELL STATUS AND EDUCATOR EVALUATION RATINGS DISTRICT PLAN WEIGHTS AND EDUCATOR EVALUATION RATINGS CLASSROOM RACIAL/ETHNIC/DISABILITY/FREE AND REDUCED LUNCH COMPOSITION AND EDUCATOR EVALUATION RATINGS STUDENT ATTENDANCE, STUDENT OUTCOMES AND EDUCATOR EVALUATION RATINGS
QUESTIONS BEING RESEARCHED DISTRICT, SCHOOL AND CLASSROOM CHARACTERISTICS, STUDENT OUTCOMES AND EVALUATION RATINGS DISTRICT PLAN LEARNING OUTCOMES WEIGHT, EDUCATOR IGM RATING, STUDENT OUTCOMES DISTRICT PLAN LEARNING OUTCOMES WEIGHT, EDUCATOR SUMMATIVE RATING, STUDENT OUTCOMES DISTRICT AVERAGE ISTEP PERFORMANCE, EDUCATOR SUMMATIVE RATING SCHOOL CHARACTERISTICS, STUDENT OUTCOMES, EVALUATION RATINGS CLASSROOM DEMOGRAPHICS, STUDENT OUTCOMES, EVALUATION RATINGS
QUESTIONS BEING RESEARCHED PLAN COMPONENTS AND ATTRIBUTES PLAN RUBRIC RATINGS AND THEIR RELATIONSHIP WITH EDUCATOR EVALUATION RATINGS PLAN RUBRIC RATINGS AND STUDENT OUTCOMES PLAN RUBRIC RATINGS AND THEIR RELATIONSHIP WITH EDUCATOR IGM RATINGS RELATIONSHIPS BETWEEN STUDENTS ASSIGNED AND NOT ASSIGNED TO EDUCATORS AND STUDENT DEMOGRAPHICS OTHER ITEMS OF INTEREST SUMMATIVE RATINGS AND THEIR RELATIONSHIP WITH IGM RATINGS RELATIONSHIPS BETWEEN DEMOGRAPHICS OF STUDENTS ASSIGNED AND NOT ASSIGNED TO TEACHERS
NEXT STEPS WAITING ON RELEASE OF ISTEP AND IGM DATA FOR 2015-16 COMPLETE FINAL ANALYSES USING 2015-16 DATA FINAL REPORT TO THE SBOE JANUARY, 2017
