Oregon Department of Education Assessment and Accountability Resources
Access important information on assessments, accountability, and reporting from the Oregon Department of Education. Find resources on updating assessment records, accessing student scores, and staying informed about assessment requirements for the 2023-24 academic year. Explore links for assessment administration, online user guides, testing schedules, and more. Connect with key contacts for assessment data and reporting. Stay up-to-date with the latest news and tools to support assessment processes in education.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
Assessment Record Updating Application (ARUA), Accountability Warehouse Extract (AWE), and Secure Assessment Reports February 15, 2024 2:00 3:30 PM (to participate, get handouts and recorded webinars) ODE District Training page Welcome! Oregon Department of Education 1
Assessment Contacts Assessment Data Owners Cindy Barrick (971-208-0480) Research Analyst, Accountability Reporting Bianca Llamas (971-208-0437) Research Analyst, Accountability Reporting Regional ESD Partners Oregon Department of Education 2
Todays Agenda 1 Assessments and Accountability Accessing Student Scores Online Oregon Department of Education 3
Assessments and Accountability 1 Links for Information Assessments Load Schedule for 2023-24 Assessment Data Validation & Accountability Reporting Participation Requirements Changes for 2023-24 Things that Did Not Change for 2023-24 Oregon Department of Education 4
Links for Information Assessment Administration page on the ODE public website OSAS Online User Guides Test Administration Manual 2023-24 Oregon Accessibility Manual for 2023-24 Testing Schedule for 2023-24 Assessment & Accountability Checklist for 2023-24 Assessment & Accountability Update Newsletter Weekly newsletter, goes to DTCs and other interested parties Anyone can subscribe to the listserve Oregon Department of Education 5
Links for Information (contd) Assessment Applications on the ODE district website Accountability Warehouse Extract (AWE) Consolidated Collections (contains ARUA) Secure Assessment Reports (SAR) Collection File Formats on the ODE district website Layout: Assessment Reporting File Format (for AWE) Layout: Assessment Transactional File Format (for ARUA) Oregon Department of Education 6
Assessments and Accountability 2 Links for Information Assessments Load Schedule for 2023-24 Assessment Data Validation & Accountability Reporting Participation Requirements Changes for 2023-24 Things that Did Not Change for 2023-24 Oregon Department of Education 7
Assessments Load Schedule - High School English Language Arts (ELA), Mathematics, and Science High School Includes Braille for English only, and English-Spanish tests SCIENCE: loaded daily, 1-2 days after tests completed, beginning on February 8, 2024 ELA and Math: loaded daily, up to 10 days after both parts completed, beginning on March 19, 2024 Oregon Department of Education 8
Assessments Load Schedule Grades 3 - 8 English Language Arts (ELA), Mathematics, and Science Grades 3 - 8 Includes Braille for English only, and English-Spanish tests SCIENCE: loaded daily, 1-2 days after tests completed, beginning on March 7, 2024 ELA and Math: loaded daily, up to 10 days after tests completed and scored, beginning on March 19, 2024 Oregon Extended Assessments in ELA, Mathematics, and Science Loaded in one batch: tests data-entered by June 14 will be loaded by June 28 Oregon Department of Education 9
Assessments Load Schedule (contd) English Language Proficiency Assessment (ELPA) Summative Loaded monthly in batches (March 11, April 3, May 7, May 31) last batch includes Remote administration Alt ELPA (Alternate ELPA) Not loaded in the ARUA for 23-24, but data and reports delivered to districts by May 31 Science Partials Loaded by June 28, 2024 ELA and Mathematics Partials Loaded by July 12, 2024 Oregon Department of Education 10
Assessments and Accountability 3 Links for Information Assessments Load Schedule for 2023-24 Assessment Data Validation & Accountability Reporting Participation Requirements Changes for 2023-24 Things that Did Not Change for 2023-24 Oregon Department of Education 11
Assessment Data Validation Typically, done at the same time as district validation of preliminary accountability reports in Achievement Data Insight (mid-June through mid-August) Dates listed in Assessment & Accountability Checklist are final Achievement Data Insight data refreshed periodically during the summer (weekly or every two weeks) For announcements, subscribe to this listserve to get weekly issues of the A&A Update newsletter NOTE: Assessment data fields indicating record inclusion in the school and district accountability reports will be populated starting the first weekend in June, 2024. Oregon Department of Education 12
At-A-Glance Profiles & Accountability Details At-A-Glance School and District Profiles Two-page summary for parents Includes assessment data on Elementary/Middle and District profiles Accountability Details reports to meet requirements of ESSA Includes Indicator levels for all students and each student group Comprehensive and Targeted schools were identified in 2021-22. Targeted schools may be identified in 2023-24. Some schools may be exited in 2023-24. Oregon Department of Education 13
Accountability Details Elementary/Middle Indicator and Student Group Indicator Levels Academic Achievement (ELA and Math) Growth Replacement (ELA and Math) Regular Attenders On Track to English Language Proficiency (ELP) Participation (ELA and Math) Target: 94.5 % ESSA participation denominator will be used (95% of students) Oregon Department of Education 14
Accountability Details High School Indicator and Student Group Indicator Levels Academic Achievement (ELA and Math) Regular Attenders On Track to English Language Proficiency (ELP) Ninth Grade On-Track Cohort Graduation Rate Five-year Completer Rate Participation (ELA and Math) Target: 94.5% ESSA participation denominator will be used (95% of students) Oregon Department of Education 15
Other Accountability Reports Public Assessment Group Reports Reports posted on the Oregon Department of Education public website in MS Excel spreadsheet format, aggregated to school, district, and state levels, and disaggregated by student groups Special Education District Profiles Reports display performance of Students with Disabilities compared to Oregon state targets. Oregon Department of Education 16
Assessments and Accountability 4 Links for Information Assessments Load Schedule for 2023-24 Assessment Data Validation & Accountability Reporting Participation Requirements Changes for 2023-24 Things that Did Not Change for 2023-24 Oregon Department of Education 17
Participation Requirements English Language Arts (ELA) and Mathematics are required for grades 3-8 and 11. EXCEPT: First-year English Learners may waive the ELA summative test if they take the ELPA Summative. First-year English Learners must take the Mathematics summative test. Science is required for grades 5, 8, and 11. First-year English Learners must take the Science summative test. (see ESEA, Title I Part A, sec. 1111(b)(2)(B)(v)(II)) Oregon Department of Education 18
Participation Requirements (contd) English Language Arts (ELA) and Mathematics are optional for grades 10 and 12. The English Language Proficiency Assessment (ELPA) is required for all English Learner (EL) students in grades K-12. SSID record must be uploaded in TIDE with English Learner Flag (ELFg) set to Y for students to be eligible to take ELPA Summative. SSID record must be uploaded in TIDE with English Learner Flag (ELFg) and Alt ELPA Tester Flag set to Y for students to be eligible to take Alt ELPA. NOTE: Non-participation virtual records are created beginning the first weekend in June for accountability. ODE creates a virtual record in ELA, Math, and Science where a valid test is expected (based on Spring Membership) but is not found. Oregon Department of Education 19
Participation Exceptions See Test Administration Manual, Appendices B & C First-year English Learners may waive English Language Arts test if they take ELPA (identified by English Learner code = B ; does not require district entry on the test record) Students in home school, private school, or out of state allowed but not required to test (Administration code = 6 ;) Parent request for exemption due to religion or disability included in accountability reports as non-participants (Administration code = 7 on non- participation virtual record) Oregon Department of Education 20
Participation Exceptions (contd) See Test Administration Manual, Appendices B & C Not enrolled during entire testing window (Administration code = 8 on non- participation virtual record) applies only to ELPA Summative Not able to test due to medical emergency (Administration code = 9 on non- participation virtual record) Parent request for exemption from English Language Arts or Mathematics test for any reason included in accountability reports as non-participants if test was not taken (Administration code = X on non-participation virtual record) Oregon Department of Education 21
Assessments and Accountability 5 Links for Information Assessments Load Schedule for 2023-24 Assessment Data Validation & Accountability Reporting Participation Requirements Changes for 2023-24 Things that Did Not Change for 2023-24 Oregon Department of Education 22
Changes for 2023-24 Accountability Warehouse Extract (AWE) Assessment Student tab Select Student(s) search screen Gender section add checkbox for Non-Binary Male Female Non-Binary Oregon Department of Education 23
Changes for 2023-24 (contd) Secure Assessment Reports (SAR) Individual Student Report (ISR) or Combined ISR Download files will be zipped with one separate PDF file for each student report. Class Roster Option to hide SSID numbers and/or student names on Class Rosters before printing them Asserted Name on ISR and Combined ISR See Using a Student s Asserted Name on Assessment Score Reports guidance document for instructions Oregon Department of Education 24
Assessments and Accountability 6 Links for Information Assessments Load Schedule for 2023-24 Assessment Data Validation & Accountability Reporting Participation Requirements Changes for 2023-24 Things that Did Not Change for 2023-24 Oregon Department of Education 25
Not Changed in 2023-24 Achievement Standards for ELA, Mathematics, and Science Assessments remain the same as for 2022-23 Performance Standards for ELPA Summative remain the same as for 2022-23 Banked test records from this year s 11th graders who met the high school standard in a prior year Identify previous years records by test year (field R in Production Download) or by test date (field S in Production Download) Oregon Department of Education 26
Not Changed in 2023-24 (contd) Merged SSIDs If test record is already posted, then merged SSID automatically changes assessment record If test record is not yet posted, then loaded with error, and district can confirm SSID (and save record to post) Student demographics and District/School filled with information from SSID record Be sure SSID System has correct demographics at least two days prior to start of student testing; can get help from Regional ESD Partners How to Edit Demographic and Program Fields document Oregon Department of Education 27
Not Changed in 2023-24 File Formats Transactional (ARUA) Student & Institution info (Institution IDs, Student name, grade, etc.) Test Identification info (Subject, PADMID, Test Type, Benchmark, Total Test Score & Perf Levels) Administration & Accommodation Codes (editable fields) Reporting (AWE) Student & Institution info (Institution IDs, Student name, grade, etc.) Test Identification info (Subject, PADMID, Test Type, Benchmark, Total Test Score & Perf Levels) Administration & Accommodation Codes Claim Scores & Perf Levels Reporting Flags Remote Flag Oregon Department of Education 28
Questions? 1 Oregon Department of Education 29
Todays Agenda 2 Assessments and Accountability Accessing Student Scores Online Oregon Department of Education 30
Accessing Student Scores Online 1 Overview of Applications OSAS Portal ODE Applications Accountability Warehouse Extract (AWE) Consolidation Collections (contains ARUA) Secure Assessment Reports 2.0 (SAR) Oregon Department of Education 31
Overview of Applications BRT s Data Entry App (for Extended Assessments) OSAS Online Database OSAS Tests Taken ODE Transactional Database Daily loading ODE Data Warehouse ARUA (fix errors and edits) OSAS Portal Nightly Centralized Reporting System (CRS) TIDE Accountability Warehouse Extract App (Tests used for Acctby Reports) Secure Assessment Reports App (student and class reports) Oregon Department of Education 32
Accessing Student Scores Online 2 Overview of Applications OSAS Portal ODE Applications Accountability Warehouse Extract (AWE) Consolidated Collections (contains ARUA) Secure Assessment Reports 2.0 (SAR) Oregon Department of Education 33
OSAS Portal Link to log in to the OSAS Portal: https://osasportal.org/ TIDE User Guide (on ODE website) TIDE trainings were in November; recording is posted on Training Materials page Reporting System User Guide CRS Webinar Training: Tuesday, March 12 (9-10 AM) Oregon Department of Education 34
OSAS Portal - TIDE Test Management Center options in TIDE Oregon Department of Education 35
OSAS Portal TIDE (contd) Test Management Center options Test Completion Rates download spreadsheet(s) Total Student column: Number of students with an active relationship to the school in TIDE. NOTE: This may include students with end-dated SSIDs. (Students with end-dated SSIDs are inactive but still associated with the school in which they were most recently enrolled.) Oregon Department of Education 36
Centralized Reporting System (CRS) CRS landing page Oregon Department of Education 37
CRS Score Reports Score Reports Oregon Department of Education 38
Accessing Student Scores Online 3 Overview of Applications OSAS Portal ODE Applications Accountability Warehouse Extract (AWE) Consolidated Collections (contains the ARUA) Secure Assessment Reports 2.0 (SAR) Oregon Department of Education 39
ODE Applications Link to log in to ODE District website: https://district.ode.state.or.us Request access to applications from District Security Administrator Oregon Department of Education 40
Accountability Warehouse Extract (AWE) Assessment Student Extract Look up students by name, SSID, or other attributes Reporting File Format Oregon Department of Education 41
Secure Assessment Reports (SAR) Individual Student Report (ISR) Combined ISR Class Roster Class Summary (Click one radio button) Oregon Department of Education 42
Assessment Record Updating Application (ARUA) Editing Test Records Quality Checking of Test Records Error Management Reports Reference Participation Test Lookup Regional ESD Partners Oregon Department of Education 43
Record Management Edit one record (Edit Posted Records) Download file (Production Download) Upload file (File Upload) Lookup records (Lookup Posted Records) ARUA User Guide Oregon Department of Education 44
Edit Posted Records Editing individual records online Oregon Department of Education 45
Quality Checking Are these my students? Check Resident District/School Contact Regional ESD Partner if Resident District ID needs to be changed Administration Codes See Test Administration Manual, Appendix C for complete list Administration Code should be on ELPA Summative records for students on IEPs to indicate exclusion of ELPA domain(s) Accommodation Codes See 2023-24 Oregon Accessibility Manual for complete list Any codes not listed in the Accessibility Manual are no longer available as Accommodation Codes (may be Designated Supports) Oregon Department of Education 46
Quality Checking (contd) Demographic and Program fields are read-only in the ARUA (Ethnic Code, Special Ed Flag, Migrant Ed Flag, Indian Ed Flag, TAG Ed Flag) Filled from SSID record through May 31 (edit in SSID System) Filled from Third Period Cumulative ADM after May 31 (except Migrant Ed Flag, which is filled from OMSIS Reporting) Special Ed Flag must be Y on Extended records (Test Type X ) How to Edit Demographic and Program Fields Oregon Department of Education 47
Error Management ARUA User Guide Error Management Review District Errors (from district-uploaded files) Review Vendor Errors (from vendor files) Fix Online (one at a time) Download/Upload File (in Transactional Format) If none listed, then no errors to fix Oregon Department of Education 48
Error Management (contd) Most Common Types of Errors Student ID Match (incorrect or merged SSID) Special Ed Flag not Y (Extended or Challenge Down) Invalid Accommodation Code 1-6 (must match subject, and flag must be Y) Oregon Department of Education 49
Reports Reference Report Oregon Department of Education 50