HYMN 397 ARA E BA WA YO Evangelical Church of Yahweh

undefined
 
MODULE EVALUATION USING QR CODES
AND ONLINE SURVEYING: TRIALLING,
TRANSITIONING AND TRACKING STUDENT
PERSPECTIVES
.
 
Andrew James Davies
& Laura McSweeney
 
School of Education and
Lifelong Learning -  Ysgol
Addysg a Dysgu Gydol Oes
 
THE ‘ISSUE’ -  
Y ‘CONSYRN’
 
Advantages
 
Well-established, and staff
comfortable with method
(Dommeyer 
et al
., 2002).
Good response rates (Nulty,
2008).
Easy and quick to
administer, face-to-face.
 
 
 
 
Disadvantages
 
Cumbersome’ (Morris and Smith, 2012).
Manual processing can mean delays in
feeding back to students and introduce
human error (
Ibid
.).
High resource cost both in terms of
inputting and processing hours, and
paper wastage.
‘Students prefer online methods’ (Layne,
DeCristoforo, & McGinty 1999;
Donovan, Mader, & Shinsky, 2007).
 
Paper-based
 system of Module Evaluation well-embedded
across the School.
 
USING ONLINE SURVEYS – DEFNYDDIO
AROLYGON ARLEIN
 
Advantages
 
Providing students with a
seamless digital experience
(e-mail, web, primo, Aspire,
e-books and journals,
BlackBoard etc.).
Students prefer it (Layne,
DeCristoforo, & McGinty
1999; Donovan, Mader, &
Shinsky, 2007)
Accuracy of data, and lower
processing time and cost
(
Ibid
., Dillman, 2000).
 
 
 
 
 
Disadvantages
 
Initial development time (Sax 
et
al
., 2003).
Transition: training staff /
students to use the method.
Accessibility / availability of
technology (Gjestland, 1996).
Security and data integrity
(Smith, 1997).
Response rates . . .
 
RESPONSE RATES – 
CYFRADDAU YMATEB
 
Nulty, 2008: 303.
 
PAPER OR ONLINE / 
PAPUR NEU ARLEIN
?
 
 
 
“We moved to online surveys, but the response was
dreadful, so last year we introduced mid-module
surveys and went back to paper. The response was
super, and we are now able to turn around feedback in
two weeks maximum.”  - Professor Ian Marshall, Deputy
Vice-Chancellor, Coventry University (quoted in Morris
and Smith, 2012).
undefined
 
RANGE OF ONLINE METHODS AND BOOSTING STRATEGIES
YSTOD O DDULLIAU AR-LEIN A STRATEGAETHAU HYBU
 
Emailing an online link to students.
Embedding a link into lectures slides.
Lead in time and participants preparation / notice.
Repeat reminder messages (Nulty, 2008).
Incentives. (
Ibid
.)
‘Ease of distribution does not guarantee effectiveness, nor do multiple e-mail
reminders always appeal to students’  (Sax 
et al
., 2003).
 
Most research on on-line completion has been based on students completing
surveys in their own time.
Not necessarily the online method that leads to the response rate being lower, but
the lack of a completion ‘occasion’.
‘Take away’ paper survey can have as low a response rate as  ‘take away’ online.
Nub of the issue is 
in situ 
versus ‘take-away’, rather than paper vs. online.
 
PILOTING MODELS – 
ARBROFI GYDA
MODELAU
 
 Mechanism for online 
in situ 
completion.
Set up of online survey fairly straightforward (via BoS).
Access mechanism more challenging.
Tried URLs on lecture slides – errors in inputting, even with Tiny URLs.
Links in email, and asking students to open the email in the lecture. Two
cumbersome – added a stage.
QR Codes – the most promising, instant access.
BUT:  students needed a device, a reader and to be guided through
the process.
 
THE MODEL – Y MODEL
undefined
 
HOW DID IT GO AND WHAT DID
STUDENTS THINK? 
SUT AETH HI A
BETH OEDD BARN MYFYRWYR?
 
 
HOW DID IT GO? 
SUT AETH HI?
 
Response rates comparable with paper-based system.
Non-response was typically small: 1-3 at the most (groups sizes
ranged from 7-40), but no larger than paper.
Non-response slightly higher for first time groups, but improved
with familiarity.
Informal feedback suggests students liked the process, and some
groups made good-natured informal complaints when they were
not involved in the pilot.
Accessibility concerns regarding mobile technology were overcome
through using SELL tablets for students without devices.
 
THE PROCESS OF DOWNLOADING A QR CODE
READER TO MY DEVICE WAS:
 
THE PROCESS OF SCANNING THE QR CODE TO
ACCESS THE SURVEY WAS:
 
THE PROCESS OF COMPLETING THE MODULE
EVALUATION QUESTIONNAIRE ONLINE WAS:
 
THINK ABOUT THE METHOD OF ONLINE MODULE
EVALUATION YOU USED TODAY COMPARED WITH THE
PAPER-BASED SYSTEM. WHICH DO YOU PREFER?
 
THINKING ABOUT THIS QR AND ONLINE METHOD AS A
WHOLE, PLEASE RATE THE WHOLE PROCESS OUT OF 10,
WHERE 10 IS 'EXCELLENT' AND 0 IS 'VERY POOR
'.
 
FURTHER COMMENTS – SYLWADAU PELLACH.
 
‘Easier for everybody’; ‘Online is much quicker’; ‘Less hassle’.
‘People are less likely to see my answers’; ‘More comfortable
as less people are able to tell it was me and due to this I felt I
could be more honest;’ ‘More accurate.’
‘Saves paper’; ‘Environmentally friendly’.
‘Just prefer paper’.
‘The app takes up storage on the phone so have to delete and
re-download.’
‘No need to print out the QR code – just put it in the slides.’
 
WHAT HAPPENED NEXT?
BETH DIGWYDDODD NESAF?
 
Following pilot, the method was implemented across the School’s first- and
second-year Undergraduate provision.
Staff briefing and training event at Undergraduate Away Day.
Worked alongside the Tell Us Now (TUN) team to share practice.
Small scale  TUN pilot undertaken in Semester 2 2016.
 Proposals to upscale this approach for TUN Module Evaluation.
 
TUN consulting with  Departments and Institutes.
Significant reduction in processing time.
Need to investigate the accessibility of technology.
Method will evolve 
mutatis mutandis
.
Step forward in normalising online module evaluation.
Student experience – better evaluation interface, preferred method, quicker
turnaround of results,  greater responsiveness in enhancing teaching and
learning.
undefined
 
MODULE FINAL EVALUATION
 
Paper-based copies are available. OR if you have a smart phone or tablet . . . you can do this
online . . . First connect to Eduroam or the Cloud.
 
If you do not have a QR code reader (Neo-reader, i-nigma etc.) on your phone or tablet, you
can download 
i-nigma
 from Play Store or AppStore now (It’s free, and will only take a
minute or so to download).
 
Then, scan this QR code, and your browser will take you to the final evaluation questionnaire.
 
I
f you want to take part 
in this part of the survey please do so. But 
you don’t have to 
do this
– it’s 
completely optional
, and if you do take part you 
can withdraw 
your response later.
undefined
 
GWERTHUSIAD TERFYNOL Y MODIWL
 
Mae copïau papur ar gael, OND os oes gennych ffôn clyfar neu dabled. . . . Gallwch wneud
hyn ar-lein. Yn gyntaf oll, cysylltwch ag Euduroam, neu’r Cloud.
 
Os nad oes gennych ddarllenydd QR, (Neo-reader, i-nigma etc.) ar eich ffôn neu dabled
gallwch lawr-lwytho i-nigma o’r Play Store neu’r AppStore nawr (mae e am ddim a dim ond
munud bydd e’n cymryd i chi ei lawr-lwytho).
 
Wedyn sganiwch y cod QR hwn a fydd yn mynd â chi at yr arolwg barn gwerthuso ar-lein.
 
Os ydych am gymryd rhan
, mae croeso i chi wneud hynny, ond, 
nid yw’n orfodol 
i wneud
hynny -  mae’n 
hollol opsiynol
, ac os ydych yn cymryd rhan, 
mae modd tynnu eich ymateb
nôl
 yn hwyrach.
Slide Note
Embed
Share

This collection of hymns from the Evangelical Church of Yahweh on 28th February 2025 includes beautiful verses, praise, and worship songs. The images depict slides with hymns sung on various occasions, reflecting the spiritual essence and devotion within the church community.

  • Hymns
  • Evangelical Church
  • Worship
  • Yahweh
  • Spiritual

Uploaded on Feb 28, 2025 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript


  1. MODULE EVALUATION USING QR CODES AND ONLINE SURVEYING: TRIALLING, TRANSITIONING AND TRACKING STUDENT PERSPECTIVES. Andrew James Davies & Laura McSweeney School Lifelong Learning - Addysg a Dysgu Gydol Oes of Education and Ysgol

  2. THE ISSUE - Y CONSYRN Paper-based system of Module Evaluation well-embedded across the School. Disadvantages Cumbersome (Morris and Smith, 2012). Advantages Well-established, and staff comfortable with method (Dommeyer et al., 2002). Manual processing can mean delays in feeding back to students and introduce human error (Ibid.). Good response rates (Nulty, 2008). High resource cost both in terms of inputting and processing hours, and paper wastage. Easy and quick to administer, face-to-face. Students prefer online methods (Layne, DeCristoforo, & McGinty 1999; Donovan, Mader, & Shinsky, 2007).

  3. USING ONLINE SURVEYS DEFNYDDIO AROLYGON ARLEIN Advantages Providing students with a seamless digital experience (e-mail, web, primo, Aspire, e-books and journals, BlackBoard etc.). Accessibility / availability of Disadvantages Initial development time (Sax et al., 2003). Transition: training staff / students to use the method. Students prefer it (Layne, DeCristoforo, & McGinty 1999; Donovan, Mader, & Shinsky, 2007) technology (Gjestland, 1996). Security and data integrity (Smith, 1997). Response rates . . . Accuracy of data, and lower processing time and cost (Ibid., Dillman, 2000).

  4. RESPONSE RATES CYFRADDAU YMATEB Nulty, 2008: 303.

  5. PAPER OR ONLINE / PAPUR NEU ARLEIN? We moved to online surveys, but the response was dreadful, so last year we introduced mid-module surveys and went back to paper. The response was super, and we are now able to turn around feedback in two weeks maximum. - Professor Ian Marshall, Deputy Vice-Chancellor, Coventry University (quoted in Morris and Smith, 2012).

  6. RANGE OF ONLINE METHODS AND BOOSTING STRATEGIES YSTOD O DDULLIAU AR-LEIN A STRATEGAETHAU HYBU Emailing an online link to students. Embedding a link into lectures slides. Lead in time and participants preparation / notice. Repeat reminder messages (Nulty, 2008). Incentives. (Ibid.) Ease of distribution does not guarantee effectiveness, nor do multiple e-mail reminders always appeal to students (Sax et al., 2003). Most research on on-line completion has been based on students completing surveys in their own time. Not necessarily the online method that leads to the response rate being lower, but the lack of a completion occasion . Take away paper survey can have as low a response rate as take away online. Nub of the issue is in situ versus take-away , rather than paper vs. online.

  7. PILOTING MODELS ARBROFI GYDA MODELAU Mechanism for online in situ completion. Set up of online survey fairly straightforward (via BoS). Access mechanism more challenging. Tried URLs on lecture slides errors in inputting, even with Tiny URLs. Links in email, and asking students to open the email in the lecture. Two cumbersome added a stage. QR Codes the most promising, instant access. BUT: students needed a device, a reader and to be guided through the process.

  8. THE MODEL Y MODEL Week prior to the Module Evaluation Lecture Asked to download QR reader and bring their mobile devices. Students given notice During the Lecture: QR Code embedded in lecture slide Tablets provided to students without mobile devices (and paper) Lecturer facilitates and troubleshoots Data uploaded and available immediately Report produced by Academic Operations Officer Can respond quickly (in the session?).

  9. HOW DID IT GO AND WHAT DID STUDENTS THINK? SUT AETH HI A BETH OEDD BARN MYFYRWYR?

  10. HOW DID IT GO? SUT AETH HI? Response rates comparable with paper-based system. Non-response was typically small: 1-3 at the most (groups sizes ranged from 7-40), but no larger than paper. Non-response slightly higher for first time groups, but improved with familiarity. Informal feedback suggests students liked the process, and some groups made good-natured informal complaints when they were not involved in the pilot. Accessibility concerns regarding mobile technology were overcome through using SELL tablets for students without devices.

  11. THE PROCESS OF DOWNLOADING A QR CODE READER TO MY DEVICE WAS: 60 50 40 30 Year 2 Year 1 20 10 0 Very Easy Easy Neither Easy nor Difficult Difficult Very difficult I already had one

  12. THE PROCESS OF SCANNING THE QR CODE TO ACCESS THE SURVEY WAS: 60 50 40 30 Year 2 Year 1 20 10 0 Very Easy Easy Neither Easy nor Difficult Difficult Very difficult I already had one

  13. THE PROCESS OF COMPLETING THE MODULE EVALUATION QUESTIONNAIRE ONLINE WAS: 60 50 40 30 Year 2 Year 1 20 10 0 Very Easy Easy Neither Easy nor Difficult Difficult Very difficult I already had one

  14. THINK ABOUT THE METHOD OF ONLINE MODULE EVALUATION YOU USED TODAY COMPARED WITH THE PAPER-BASED SYSTEM. WHICH DO YOU PREFER? 80 70 60 50 Year 2 Year 1 40 30 20 10 0 Online survey Method Paper-based Method

  15. THINKING ABOUT THIS QR AND ONLINE METHOD AS A WHOLE, PLEASE RATE THE WHOLE PROCESS OUT OF 10, WHERE 10 IS 'EXCELLENT' AND 0 IS 'VERY POOR'. 35 30 25 20 Year 2 Year 1 15 10 5 0 10 9 8 7 6 5 4 3 2 1

  16. FURTHER COMMENTS SYLWADAU PELLACH. Easier for everybody ; Online is much quicker ; Less hassle . People are less likely to see my answers ; More comfortable as less people are able to tell it was me and due to this I felt I could be more honest; More accurate. Saves paper ; Environmentally friendly . Just prefer paper . The app takes up storage on the phone so have to delete and re-download. No need to print out the QR code just put it in the slides.

  17. WHAT HAPPENED NEXT? BETH DIGWYDDODD NESAF? Following pilot, the method was implemented across the School s first- and second-year Undergraduate provision. Staff briefing and training event at Undergraduate Away Day. Worked alongside the Tell Us Now (TUN) team to share practice. Small scale TUN pilot undertaken in Semester 2 2016. Proposals to upscale this approach for TUN Module Evaluation. TUN consulting with Departments and Institutes. Significant reduction in processing time. Need to investigate the accessibility of technology. Method will evolve mutatis mutandis. Step forward in normalising online module evaluation. Student experience better evaluation interface, preferred method, quicker turnaround of results, greater responsiveness in enhancing teaching and learning.

  18. MODULE FINAL EVALUATION Paper-based copies are available. OR if you have a smart phone or tablet . . . you can do this online . . . First connect to Eduroam or the Cloud. If you do not have a QR code reader (Neo-reader, i-nigma etc.) on your phone or tablet, you can download i-nigma from Play Store or AppStore now (It s free, and will only take a minute or so to download). Then, scan this QR code, and your browser will take you to the final evaluation questionnaire. If you want to take part in this part of the survey please do so. But you don t have to do this it s completely optional, and if you do take part you can withdraw your response later.

  19. GWERTHUSIAD TERFYNOL Y MODIWL Mae cop au papur ar gael, OND os oes gennych ff n clyfar neu dabled. . . . Gallwch wneud hyn ar-lein. Yn gyntaf oll, cysylltwch ag Euduroam, neu r Cloud. Os nad oes gennych ddarllenydd QR, (Neo-reader, i-nigma etc.) ar eich ff n neu dabled gallwch lawr-lwytho i-nigma o r Play Store neu r AppStore nawr (mae e am ddim a dim ond munud bydd e n cymryd i chi ei lawr-lwytho). Wedyn sganiwch y cod QR hwn a fydd yn mynd chi at yr arolwg barn gwerthuso ar-lein. Os ydych am gymryd rhan, mae croeso i chi wneud hynny, ond, nid yw n orfodol i wneud hynny - mae n hollol opsiynol, ac os ydych yn cymryd rhan, mae modd tynnu eich ymateb n l yn hwyrach.

More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#