Comparative Study of Mobile Device Testing in English Grammar Assessment of Slovak EFL Students

Effectiveness of Mobile
Device Testing (MDT) in
testing English grammar of
Slovak EFL students
Róbert Majzlík, 
Department of Foreign languages, Church
grammar school, Vranov nad Top
ľou, Slovakia,
 
Rita Rafajlovičová, 
Faculty of Arts, University of Prešov, Slovakia
majzlik@mail.t-com.sk
Abstract
Technology has become an inseparable part of our everyday
life. Mobile devices are becoming increasingly widespread
especially among young people. The present study aims at
investigating whether mobile devices are as capable of
measuring and assessing grammatical competence as
traditional paper and pencil tests. Although a considerable
amount of literature has been published on this issue abroad,
there is still significant lack of researches carried out in this field
within the Slovak educational system. Therefore, the purpose
of this study is to investigate whether there is a difference
between students’ performance in Mobile Device Testing
(MDT) and Paper Based Testing (PBT). The research was
carried out on 40 students from a secondary school in Vranov
nad Topľou, divided into two groups based on the method of
testing. Upon completion of both tests, the participants
completed a survey evaluating both testing media. The study
also provides recommendations towards the use of mobile
applications in testing English grammar.
The aim of the study
The main goal of this study is to evaluate the use of
mobile devices in assessment of the English
grammar and find out whether testing English
grammar via mobile application will bring better
results compared to traditional paper and pencil-
based tests.
Research questions
The present study attempts to answer the following
research questions:
Is there a statistically significant difference in the
performance of Slovak EFL learners between paper
and pencil-based tests (PBT) vs. mobile device tests
(MDT)?
Are grammar tests designed for the use with mobile
applications more favourite among Slovak EFL
learners than traditional versions of paper and
pencil-based testing methods?
Characteristics of the
research sample
40 third-year students of the secondary grammar
school (Cirkevná spojená škola) in Vranov nad
Topľou,
2 individual groups of students from two different
classes on intermediate level of English (B1+) aged
from 17 to 18,
the participants were divided into two groups
randomly;
the control group  (PBT) consisted of 9 boys and 11
girls (n=20) and the experimental group (MDT)
consisted of 14 girls and 6 boys (n=20).
Data collection
4 sets of English grammar tests in both electronic
and traditional paper-based format. 
e
ach test consisted of 20 multiple choice questions
(
B1+ level according to CEFR
)
.
the assessment period 
= 4
 weeks. 
t
he testing session was always carried out on the
same day of the week, namely Wednesday
,
Final results 
 - PBT
Final results 
 - MDT
S
tudents’ attitude towards
the 
ways of testing
Q1: 
Which test type did you prefer.
 
Pencil-based tests (PBT) or mobile
device tests (MDT)?
Q2: 
Did the test type change also the difficulty of the test in general?
Yes/No
.
Contact
PaedDr. R
óbert Majzlík
Church grammar school,
Department of Freign languages,
Skolska 650, Vranov nad Toplou,
093 03, Slovakia
majzlik@mail.t-com.sk
assoc. prof. Rita Rafajlovičová, PhD.   
Institute of British and American studies
Faculty of Arts
Presov University
ul. 17. novembra 1, 08078 Presov
Slovakia
rita.rafajlovicova@unipo.sk
Slide Note
Embed
Share

This research investigates the effectiveness of Mobile Device Testing (MDT) in assessing English grammar skills of Slovak EFL students compared to traditional Paper-Based Testing (PBT). Conducted on 40 secondary school students, the study aims to determine any performance differences between the two testing methods and the preference of students towards mobile applications for English grammar testing. Insights and recommendations for integrating mobile devices in grammar assessment are provided.

  • English grammar
  • Mobile Device Testing
  • Slovak EFL students
  • Comparative study
  • Educational technology

Uploaded on Sep 19, 2024 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript


  1. Effectiveness of Mobile Device Testing (MDT) in testing English grammar of Slovak EFL students R bert Majzl k, Department of Foreign languages, Church grammar school, Vranov nad Top ou, Slovakia, majzlik@mail.t-com.sk Rita Rafajlovi ov , Faculty of Arts, University of Pre ov, Slovakia

  2. Abstract Technology has become an inseparable part of our everyday life. Mobile devices are becoming increasingly widespread especially among young people. The present study aims at investigating whether mobile devices are as capable of measuring and assessing grammatical competence as traditional paper and pencil tests. Although a considerable amount of literature has been published on this issue abroad, there is still significant lack of researches carried out in this field within the Slovak educational system. Therefore, the purpose of this study is to investigate whether there is a difference between students performance in Mobile Device Testing (MDT) and Paper Based Testing (PBT). The research was carried out on 40 students from a secondary school in Vranov nad Top ou, divided into two groups based on the method of testing. Upon completion of both tests, the participants completed a survey evaluating both testing media. The study also provides recommendations towards the use of mobile applications in testing English grammar.

  3. The aim of the study The main goal of this study is to evaluate the use of mobile devices in assessment of the English grammar and find out whether testing English grammar via mobile application will bring better results compared to traditional paper and pencil- based tests.

  4. Research questions The present study attempts to answer the following research questions: Is there a statistically significant difference in the performance of Slovak EFL learners between paper and pencil-based tests (PBT) vs. mobile device tests (MDT)? Are grammar tests designed for the use with mobile applications more favourite among Slovak EFL learners than traditional versions of paper and pencil-based testing methods?

  5. Characteristics of the research sample 40 third-year students of the secondary grammar school (Cirkevn spojen kola) in Vranov nad Top ou, 2 individual groups of students from two different classes on intermediate level of English (B1+) aged from 17 to 18, the participants were divided into two groups randomly; the control group (PBT) consisted of 9 boys and 11 girls (n=20) and the experimental group (MDT) consisted of 14 girls and 6 boys (n=20).

  6. Data collection 4 sets of English grammar tests in both electronic and traditional paper-based format. each test consisted of 20 multiple choice questions (B1+ level according to CEFR). the assessment period = 4 weeks. the testing session was always carried out on the same day of the week, namely Wednesday,

  7. Final results - PBT Week 1 Week 2 Week 3 Week 4 Mean 15 15,4 14,3 14,35 Median 15 15,5 15 14 Minimum 10 12 9 11 Maximum 19 19 18 18 Standard deviation 2,43 1,70 2,27 1,93 Skewness -0,17 0,01 -0,65 0,28 Overall performance in % 75 77 71,5 71,75

  8. Final results - MDT Week 1 Week 2 Week 3 Week 4 Mean 15,8 15,45 13,25 15,7 Median 16 16 13 16 Minimum 13 12 9 10 Maximum 20 19 18 20 Standard deviation 1,88 1,85 2,15 2,71 Skewness 0,11 -0,13 0,35 -0,47 Overall performance in % 79 77,25 66,25 78,5

  9. Students attitude towards the ways of testing Q1: Which test type did you prefer. Pencil-based tests (PBT) or mobile device tests (MDT)? Q2: Did the test type change also the difficulty of the test in general? Yes/No. Q1 Q2 5 15 25 70 85 PBT MDT No difference Yes No

  10. Contact PaedDr. R bert Majzl k Church grammar school, Department of Freign languages, Skolska 650, Vranov nad Toplou, 093 03, Slovakia majzlik@mail.t-com.sk assoc. prof. Rita Rafajlovi ov , PhD. Institute of British and American studies Faculty of Arts Presov University ul. 17. novembra 1, 08078 Presov Slovakia rita.rafajlovicova@unipo.sk

More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#