Impact of Matura Exam on Classroom Reading Tests

Matura washback 
on the classroom testing of reading
Doris Frötscher
BMBWF, III/6
Klagenfurt, 19. Oktober 2018
The
 
study
 
RQ: What is the washback of the new Matura exam on the characteristics of
         Grade 12 classroom-test reading tasks?
Data: 173 classroom test reading tasks from 19 EFL teachers
31% of tasks 2001-2008
69% of tasks 2009-2013
Instrument for Analysis of Reading test tasks
Contribution: addresses research gap in terms of focus and method
Matura washback on the classroom testing of reading
3
Findings
 
Alignment with Matura test methods post-2008
Use of past paper tasks
Other changes in task characteristics:
Fewer distressing topics
Example items
Number of items
Presence/ clarity of instructions
Clarity of items
Quality of distracters
Sequence of items
Construct relevance
Matura washback on the classroom testing of reading
3
Characterising
 
the
 
washback
 
found
 
positive
use of good quality tasks - “usefulness“ (Bachman & Palmer, 1996)
student familiarity with Matura test methods
reduced pressure to develop tests
 
negative
standardized test as model for classroom tests
narrowing of the classroom test construct
excludes other valid task types
 
partly intended
 (Ministry guidelines + regulations)
 
 
Matura washback on the classroom testing of reading
4
 
Standardized exam
-
Curriculum & CEFR
-
Constructs and competences
-
Test methods
 
Classroom teaching and testing
-
Curriculum & CEFR
-
Constructs and competences
-
Methods
 
Assessment literacy
awareness
commitment
A balancing act
Matura washback on the classroom testing of reading
5
Slide Note
Embed
Share

The study explores the washback effect of the new Matura exam on Grade 12 classroom reading tasks. Analysis of 173 classroom test reading tasks revealed changes in task characteristics post-2008, including reduced presence of distressing topics and improvements in instructions and item quality. Positive outcomes were found such as familiarity with Matura test methods and reduced pressure in test development, though some concerns were raised about narrowing the classroom test construct. Overall, the study highlights the balancing act involved in aligning standardized exams with classroom teaching and testing practices.

  • Matura Exam
  • Reading Tasks
  • Classroom Testing
  • Washback Effect
  • Task Characteristics

Uploaded on Oct 08, 2024 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.

E N D

Presentation Transcript


  1. bmbwf.gv.at Matura washback on the classroom testing of reading Doris Fr tscher BMBWF, III/6 Klagenfurt, 19. Oktober 2018

  2. bmbwf.gv.at Thestudy RQ: What is the washback of the new Matura exam on the characteristics of Grade 12 classroom-test reading tasks? Data: 173 classroom test reading tasks from 19 EFL teachers 31% of tasks 2001-2008 69% of tasks 2009-2013 Instrument for Analysis of Reading test tasks Contribution: addresses research gap in terms of focus and method Matura washback on the classroom testing of reading 3

  3. bmbwf.gv.at Findings Alignment with Matura test methods post-2008 Use of past paper tasks Other changes in task characteristics: Fewer distressing topics Example items Number of items Presence/ clarity of instructions Clarity of items Quality of distracters Sequence of items Construct relevance pre 67% post 45% 28% 18% 17% 11% 8% 4% 3% 2% 0% 0% longer answer matching summary multiple- short- answer true/false types choice Matura washback on the classroom testing of reading 3

  4. bmbwf.gv.at Characterisingthewashbackfound positive use of good quality tasks - usefulness (Bachman & Palmer, 1996) student familiarity with Matura test methods reduced pressure to develop tests negative standardized test as model for classroom tests narrowing of the classroom test construct excludes other valid task types partly intended (Ministry guidelines + regulations) Matura washback on the classroom testing of reading 4

  5. bmbwf.gv.at A balancing act Standardized exam - Curriculum & CEFR - Constructs and competences - Test methods Assessment literacy awareness commitment Classroom teaching and testing - Curriculum & CEFR - Constructs and competences - Methods Matura washback on the classroom testing of reading 5

More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#