Test Security Guidelines for 2015-16 CAASPP Administration
California Assessment of Student
Performance and Progress (CAASPP)
2015–16 Test Security Guidelines
2015–16 Test Security Guidelines
March 9, 2016
1 – 2:30 p.m.
Agenda
•
Introductions
•
Requirements in the Testing Regulations
•
General Test Security Guidelines
•
Specific
Test Security Guidelines
•
Social Media Breaches
•
Procedures for Reporting Testing Incidents
•
Test Security Auditor Activities
Purpose and Goal
•
By the end of this Webcast, local educational
agency (LEA) CAASPP coordinators will be
able to train their staff on test security
guidelines and procedures for the 2015–16
administration of computer-based tests as well
as the paper-pencil tests.
Requirements in the Testing
Regulations
Requirements in the Testing
Regulations
T
e
s
t
S
e
c
u
r
i
t
y
A
g
r
e
e
m
e
n
t
:
*
•
New form for 2015–16 testing is available.
•
A
g
r
e
e
m
e
n
t
m
u
s
t
b
e
r
e
a
d
a
n
d
s
i
g
n
e
d
A
N
N
U
A
L
L
Y
.
•
Applies to both computer-based and paper-pencil testing.
•
All LEA CAASPP coordinators must electronically submit a
signed copy to the California Technical Assistance Center
(CalTAC)
−
100% of all LEAs have already submitted their new signed
agreement to CalTAC
•
All CAASPP test site coordinators must electronically submit a
signed copy of the form; the LEA CAASPP coordinator
receives a notification.
* Pursuant to California Code of Regulations
(
CCR
),
Title 5, Section 859(a)
Requirements in the Testing
Regulations
T
e
s
t
S
e
c
u
r
i
t
y
A
f
f
i
d
a
v
i
t
:
•
New form for 2015–16 is available
•
Applies for the 2015–16 school year
•
A
f
f
i
d
a
v
i
t
m
u
s
t
b
e
r
e
a
d
a
n
d
s
i
g
n
e
d
A
N
N
U
A
L
L
Y
•
Applies to both computer-based and paper-pencil testing
•
Must be signed by:
−
A
l
l
t
e
s
t
a
d
m
i
n
i
s
t
r
a
t
o
r
s
,
t
e
s
t
e
x
a
m
i
n
e
r
s
,
p
r
o
c
t
o
r
s
,
t
r
a
n
s
l
a
t
o
r
s
,
s
c
r
i
b
e
s
,
L
E
A
C
A
A
S
P
P
c
o
o
r
d
i
n
a
t
o
r
s
,
a
n
d
C
A
A
S
P
P
t
e
s
t
s
i
t
e
c
o
o
r
d
i
n
a
t
o
r
s
,
a
n
d
a
n
y
o
t
h
e
r
p
e
r
s
o
n
s
h
a
v
i
n
g
a
c
c
e
s
s
t
o
a
n
y
o
f
t
h
e
s
u
m
m
a
t
i
v
e
t
e
s
t
s
a
n
d
t
e
s
t
m
a
t
e
r
i
a
l
s
,
a
s
s
e
s
s
m
e
n
t
t
e
c
h
n
o
l
o
g
y
p
l
a
t
f
o
r
m
,
r
e
g
i
s
t
r
a
t
i
o
n
s
y
s
t
e
m
,
o
r
a
d
a
p
t
i
v
e
e
n
g
i
n
e
•
LEA CAASPP coordinators keep affidavits on file at the
LEA; should not be submitted to CalTAC
* Pursuant to
5
CCR
Section 859(c)
General Test Security
Guidelines
General Test Security Guidelines
•
All secure test materials must be handled and stored
securely.
−
For computer-based tests, lock any printed rosters in
secure storage with limited access; train staff on
procedures.
−
For paper-pencil tests, lock in secure storage with limited
access; count test booklets upon receipt as well as
before and after a testing session; and train staff on the
procedures.
•
All authorized electronic devices (e.g., assistive device)
can be used by students as long as the wireless
connectivity has been turned off.
•
Seat students so that they cannot easily view each
other’s work.
General Test Security Guidelines
(cont.)
•
Cover or remove materials on the classroom
walls that may provide information to students
during testing.
•
Actively monitor students during testing.
•
Report only summative testing incidents using
the
STAIRS
form.
•
Test administrators and test examiners report to the
CAASPP test site coordinator and/or to the LEA
CAASPP coordinator.
•
Securely destroy secure test materials that do not
need to be returned to Educational Testing Service
(ETS).
–
For computer-based summative assessments:
Student logon information (tickets)
Administrator logon information to the test delivery
system
Rosters of students scheduled to take the test
Scratch paper with students’ work
Print-on-demand passages, items, and stimulus cards
General Test Security Guidelines
(cont.)
•
For paper-pencil tests:
–
Test booklets
–
Answer documents (blank with Pre-ID labels and
any with student responses recorded)
–
California Alternate Performance Assessment
(CAPA) Examiner’s Manuals
–
Standards-based Tests in Spanish (STS) Grade 2
Directions for Administration (DFA)
–
Scratch paper with student’s work
General Test Security Guidelines
(cont.)
•
Printed materials must be kept in a securely locked
room or locked cabinet that can be opened only with a
key or keycard by staff responsible for test
administration who have signed a CAASPP Test
Security Affidavit.
–
Printed materials from the print-on-demand
accommodation
–
Scratch paper
–
Documents with student information
Student logon tickets
Pre-ID labels
General Test Security Guidelines
(cont.)
Print-On-Demand Test Security
Guidelines
•
Test administrators and test examiners are responsible for
maintaining the security of printers used for printing
CAASPP test content.
–
Before approving or printing an item or stimulus, the test
administrator or test examiner must ensure that the printer is on
and is monitored by staff.
•
Immediately after printing a print-on-demand
item/stimulus, the file should be deleted from the test
administrator’s or test examiner’s computer. It must be
deleted in such a way that the file does not remain in the
“recycle bin” to be undeleted.
–
See page 20 of the
Online Test Administration Manual
for
instructions.
Print-On-Demand Test Security
Guidelines (cont.)
•
Printed test items/passages, including embossed braille
printouts, and scratch paper must be collected and
inventoried at the end of each test session and then
securely destroyed according to LEA and/or California
policies or procedures.
But….
•
Scratch paper must be collected after the first part of the
Full Write performance task and stored securely until
returned to the student during the second part. Scratch
paper must be shred according to LEA and/or California
policies or procedures after the second part of the Full
Write has been completed.
Braille Online Fixed Form
•
If a test administrator selects the braille online
fixed form (for mathematics only), he or she can
pre-order a graphic package that includes pre-
embossed graphics to be used while accessing
the online fixed form.
•
These graphic packages must be ordered
through CalTAC and returned to CalTAC after
the student has completed testing.
Specific Test Security
Guidelines
Preventing Security Violations
•
LEA staff, school staff, test administrators and
test examiners play a critical role in monitoring
the testing session and adhering to directions
for standardized administration.
–
Be familiar with test security protocols outlined in
the CAASPP Online Test Administration Manual
(
http://www.caaspp.org/rsc/pdfs/CAASPP.online
_tam.2016.pdf
)
▪
Section 3.0
▪
Appendix F
Before and During Testing
•
All test items and test materials must remain
secure and must be appropriately handled.
–
Includes creating a secure testing environment
for what students can see, hear, or access
•
The test administrator is ultimately responsible
for monitoring and reporting test security issues.
–
Inappropriate Internet access
–
Any other improper display, printing,
photographing, duplicating, or sharing of test
questions
As Testing Starts and
During Testing
•
Including first and last name and a picture to logon
ticket will help ensure students are logged on to the
correct test.
–
Before handing out tickets, use the Test Administrator Interface
or the Test Operations Management System to verify that the
Statewide Student Identifiers (SSIDs) on the ticket are correct.
•
Ensure that students have properly logged on and are
taking the test for which they are scheduled.
•
Monitor students taking the test for any breach of the
secure browser and that it has not allowed students to
access external sites or other resources on their testing
device during the assessment.
Student Logon for the Computer-
based Tests
•
Student logon information is considered secure
material, so it must be provided to, and viewable only
by, the student to whom the logon information pertains.
•
Student logon information must be returned to the
CAASPP test site coordinator, stored in a secure
location between testing sessions, and securely
destroyed immediately after testing has been
completed.
“
(
4
)
(
A
)
I
w
i
l
l
k
e
e
p
a
l
l
a
s
s
i
g
n
e
d
,
g
e
n
e
r
a
t
e
d
,
o
r
c
r
e
a
t
e
d
u
s
e
r
n
a
m
e
s
,
p
a
s
s
w
o
r
d
s
,
a
n
d
l
o
g
i
n
s
s
e
c
u
r
e
a
n
d
n
o
t
d
i
v
u
l
g
e
p
u
p
i
l
p
e
r
s
o
n
a
l
i
n
f
o
r
m
a
t
i
o
n
t
o
a
n
y
o
n
e
o
t
h
e
r
t
h
a
n
t
h
e
p
u
p
i
l
t
o
w
h
o
m
t
h
e
i
n
f
o
r
m
a
t
i
o
n
p
e
r
t
a
i
n
s
f
o
r
t
h
e
p
u
r
p
o
s
e
o
f
l
o
g
g
i
n
g
o
n
t
o
t
h
e
t
e
s
t
d
e
l
i
v
e
r
y
s
y
s
t
e
m
.
”
C
A
A
S
P
P
T
E
S
T
S
E
C
U
R
I
T
Y
A
F
F
I
D
A
V
I
T
“
(
4
)
I
w
i
l
l
s
e
c
u
r
e
l
y
d
e
s
t
r
o
y
a
l
l
p
r
i
n
t
-
o
n
-
d
e
m
a
n
d
p
a
p
e
r
s
,
s
c
r
a
t
c
h
p
a
p
e
r
,
a
n
d
o
t
h
e
r
d
o
c
u
m
e
n
t
s
a
s
p
r
e
s
c
r
i
b
e
d
w
i
t
h
i
n
t
h
e
c
o
n
t
r
a
c
t
o
r
’
s
(
s
’
)
o
r
c
o
n
s
o
r
t
i
u
m
’
s
a
d
m
i
n
i
s
t
r
a
t
i
v
e
m
a
n
u
a
l
s
a
n
d
d
o
c
u
m
e
n
t
a
t
i
o
n
.
”
C
A
A
S
P
P
T
E
S
T
S
E
C
U
R
I
T
Y
A
G
R
E
E
M
E
N
T
Test Security Guidelines for
Computer-based Tests
•
Ensure there is adequate space between students
so that they cannot see each other’s work.
−
If using a computer lab, consider using temporary
dividers (e.g., folders taped to the sides of the
monitors).
•
Test the equipment and network to be used during
testing.
−
Report any workarounds to the secure browser to
CalTAC.
−
Some software (e.g., teacher-monitoring software,
Apple AirPlay) may need to be disabled or monitored
locally.
Test Security Guidelines
for the Paper-Pencil Tests—Test
Administrators and Test Examiners
•
Receive and return materials to CAASPP test site
coordinator.
•
Make sure test booklets and answer documents are
distributed to the correct student.
•
Allow no unauthorized electronic devices (e.g., cell
phones) to be used in classroom during testing.
Test Security Guidelines
for the Paper-Pencil Tests—
CAASPP Test Site Coordinators
•
Before testing: Receive, count, store, and track
materials. Materials should be stored in secure
storage with limited access, by key or cardkey.
•
During testing: Distribute and collect materials from
test administrators and test examiners.
•
After testing: Count and return materials promptly
to the LEA CAASPP coordinator.
•
Handle the secure test materials according to the
instructions.
Social Media Breaches
Social Media Breaches
•
Social media and other Web sites will be
monitored daily for postings of secure material.
•
A process is in place to ensure the review and
investigation of all test security incidents related
to social media to determine what action will
need to be taken.
Procedures for Reporting
Testing Incidents
CAASPP Security and Test
Administration Incident Reporting
System (STAIRS) Process
•
STAIRS and appeals are used for the summative assessments only.
•
The online
CAASPP STAIRS
form is the starting point for LEA
CAASPP coordinators and CAASPP test site coordinators to report a
test security incident or other testing issue that interferes with the
administration and completion of the summative assessment.
•
C
o
o
r
d
i
n
a
t
o
r
s
a
c
c
e
s
s
t
h
e
C
A
A
S
P
P
S
T
A
I
R
S
f
o
r
m
i
n
t
h
e
T
e
s
t
O
p
e
r
a
t
i
o
n
s
M
a
n
a
g
e
m
e
n
t
S
y
s
t
e
m
b
y
s
e
l
e
c
t
i
n
g
t
h
e
[
S
T
A
I
R
S
/
A
p
p
e
a
l
s
]
b
u
t
t
o
n
.
•
You cannot submit an appeal request without first submitting the
CAASPP STAIRS
form.
•
See
Table 8: Incident types, descriptions, and actions in the CAASPP
STAIRS
form
starting on page 25 of the
Online Test Administration
Manual
for details about incident types and actions.
Procedures for Reporting Testing
Incidents—Impropriety
•
Unusual circumstance that has a low impact on the
testing individual or group of students
•
Low risk of affecting student performance, test
security, or test validity
•
Correctable and containable at local level
•
Must be reported to LEA CAASPP coordinator or
CAASPP test site coordinator
•
E
x
a
m
p
l
e
:
S
t
u
d
e
n
t
s
t
a
l
k
i
n
g
d
u
r
i
n
g
t
e
s
t
i
n
g
Test Security Chart—Improprieties
Process Flow for Reporting an
Impropriety
Procedures for Reporting Testing
Incidents—Irregularity
•
Unusual circumstance that impacts the testing individual or
group of students
•
May affect student performance, test security, or test validity
•
Correctable and containable at the local level
•
L
E
A
C
A
A
S
P
P
c
o
o
r
d
i
n
a
t
o
r
o
r
C
A
A
S
P
P
t
e
s
t
s
i
t
e
c
o
o
r
d
i
n
a
t
o
r
m
u
s
t
e
n
t
e
r
t
e
s
t
i
n
c
i
d
e
n
t
i
n
t
o
S
T
A
I
R
S
w
i
t
h
i
n
2
4
h
o
u
r
s
–
California regulations require that irregularities be reported to
the CDE within 24 hours (5
CCR
Section 859[e]).
•
E
x
a
m
p
l
e
:
S
t
u
d
e
n
t
a
c
c
e
s
s
i
n
g
o
r
u
s
i
n
g
u
n
a
u
t
h
o
r
i
z
e
d
e
l
e
c
t
r
o
n
i
c
d
e
v
i
c
e
(
e
.
g
.
,
c
e
l
l
p
h
o
n
e
)
Test Security Chart—Irregularity
Test Security Chart—Irregularity
(cont.)
Process Flow for Reporting a
Testing Irregularity
Procedures for Reporting Testing
Incidents—Breach
•
Event that poses a threat to the validity of the test
•
LEA CAASPP coordinator or CAASPP test site
coordinator must coordinator must immediately
telephone the CDE and then submit a report in STAIRS
within 24 hours.
–
California regulations require that irregularities be reported
to the CDE within 24 hours (5
CCR
Section 859[e]).
•
E
x
a
m
p
l
e
:
R
e
l
e
a
s
e
o
f
s
e
c
u
r
e
m
a
t
e
r
i
a
l
s
o
r
a
s
e
c
u
r
i
t
y
/
s
y
s
t
e
m
r
i
s
k
•
Circumstances have an external implication to the
Smarter Balanced Assessment Consortium
–
May result in decision to remove an item from scoring
Test Security Chart—Breach
Process Flow for Reporting a
Testing Breach
Test Security Webcast:
STAIRS Live Demo
Chang Yi
ETS
3/09/16
Test Security Auditor
Activities
Test Security Audits
•
Audits are conducted throughout the state
.
•
Auditors will:
−
observe test security processes being used.
−
interview the CAASPP test site coordinator or
designee before, during, and after testing.
•
Summary reports will be provided to the CDE
and will be shared with the LEA CAASPP
coordinator.
Questions
Questions
Help Desk Support
•
The CalTAC is there to support all LEA
CAASPP Coordinators!
A
v
a
i
l
a
b
l
e
M
o
n
d
a
y
–
F
r
i
d
a
y
f
r
o
m
7
a
.
m
.
–
5
p
.
m
.
P
T
E
-
m
a
i
l
:
c
a
l
t
a
c
@
e
t
s
.
o
r
g
P
h
o
n
e
:
8
0
0
-
9
5
5
-
2
9
5
4
W
e
b
s
i
t
e
:
h
t
t
p
:
/
/
w
w
w
.
c
a
a
s
p
p
.
o
r
g
/
This content provides detailed information on the test security guidelines and procedures for the California Assessment of Student Performance and Progress (CAASPP) 2015-16 administration. It covers requirements in the testing regulations, test security agreements, affidavits, and the purpose and goals of the CAASPP test security guidelines. The guidelines aim to ensure the integrity and security of both computer-based and paper-pencil tests, emphasizing the roles and responsibilities of key personnel involved in test administration.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
Measuring the Power of Learning. California Assessment of Student Performance and Progress (CAASPP) 2015 16 Test Security Guidelines March 9, 2016 1 2:30 p.m.
Measuring the Power of Learning. Agenda Introductions Requirements in the Testing Regulations General Test Security Guidelines Specific Test Security Guidelines Social Media Breaches Procedures for Reporting Testing Incidents Test Security Auditor Activities 2015 16 CAASPP Test Security Guidelines 2
Measuring the Power of Learning. Purpose and Goal By the end of this Webcast, local educational agency (LEA) CAASPP coordinators will be able to train their staff on test security guidelines and procedures for the 2015 16 administration of computer-based tests as well as the paper-pencil tests. 2015 16 CAASPP Test Security Guidelines 3
Measuring the Power of Learning. Requirements in the Testing Regulations
Measuring the Power of Learning. Requirements in the Testing Regulations Test Security Agreement:* New form for 2015 16 testing is available. Agreement must be read and signed ANNUALLY. Applies to both computer-based and paper-pencil testing. All LEA CAASPP coordinators must electronically submit a signed copy to the California Technical Assistance Center (CalTAC) 100% of all LEAs have already submitted their new signed agreement to CalTAC All CAASPP test site coordinators must electronically submit a signed copy of the form; the LEA CAASPP coordinator receives a notification. * Pursuant to California Code of Regulations (CCR),Title 5, Section 859(a) 2015 16 CAASPP Test Security Guidelines 5
Measuring the Power of Learning. Requirements in the Testing Regulations Test Security Affidavit: New form for 2015 16 is available Applies for the 2015 16 school year Affidavit must be read and signed ANNUALLY Applies to both computer-based and paper-pencil testing Must be signed by: All test administrators, test examiners, proctors, translators, scribes, LEA CAASPP coordinators, and CAASPP test site coordinators, and any other persons having access to any of the summative tests and test materials, assessment technology platform, registration system, or adaptive engine LEA CAASPP coordinators keep affidavits on file at the LEA; should not be submitted to CalTAC * Pursuant to 5 CCR Section 859(c) 2015 16 CAASPP Test Security Guidelines 6
Measuring the Power of Learning. General Test Security Guidelines Guideline-review
Measuring the Power of Learning. General Test Security Guidelines All secure test materials must be handled and stored securely. For computer-based tests, lock any printed rosters in secure storage with limited access; train staff on procedures. For paper-pencil tests, lock in secure storage with limited access; count test booklets upon receipt as well as before and after a testing session; and train staff on the procedures. All authorized electronic devices (e.g., assistive device) can be used by students as long as the wireless connectivity has been turned off. Seat students so that they cannot easily view each other s work. 2015 16 CAASPP Test Security Guidelines 8
Measuring the Power of Learning. General Test Security Guidelines (cont.) Cover or remove materials on the classroom walls that may provide information to students during testing. Actively monitor students during testing. Report only summative testing incidents using the STAIRS form. Test administrators and test examiners report to the CAASPP test site coordinator and/or to the LEA CAASPP coordinator. 2015 16 CAASPP Test Security Guidelines 9
Measuring the Power of Learning. General Test Security Guidelines (cont.) Securely destroy secure test materials that do not need to be returned to Educational Testing Service (ETS). For computer-based summative assessments: Student logon information (tickets) Administrator logon information to the test delivery system Rosters of students scheduled to take the test Scratch paper with students work Print-on-demand passages, items, and stimulus cards 2015 16 CAASPP Test Security Guidelines 10
Measuring the Power of Learning. General Test Security Guidelines (cont.) For paper-pencil tests: Test booklets Answer documents (blank with Pre-ID labels and any with student responses recorded) California Alternate Performance Assessment (CAPA) Examiner s Manuals Standards-based Tests in Spanish (STS) Grade 2 Directions for Administration (DFA) Scratch paper with student s work 2015 16 CAASPP Test Security Guidelines 11
Measuring the Power of Learning. General Test Security Guidelines (cont.) Printed materials must be kept in a securely locked room or locked cabinet that can be opened only with a key or keycard by staff responsible for test administration who have signed a CAASPP Test Security Affidavit. Printed materials from the print-on-demand accommodation Scratch paper Documents with student information Student logon tickets Pre-ID labels 2015 16 CAASPP Test Security Guidelines 12
Measuring the Power of Learning. Print-On-Demand Test Security Guidelines Test administrators and test examiners are responsible for maintaining the security of printers used for printing CAASPP test content. Before approving or printing an item or stimulus, the test administrator or test examiner must ensure that the printer is on and is monitored by staff. Immediately after printing a print-on-demand item/stimulus, the file should be deleted from the test administrator s or test examiner s computer. It must be deleted in such a way that the file does not remain in the recycle bin to be undeleted. See page 20 of the Online Test Administration Manual for instructions. 2015 16 CAASPP Test Security Guidelines 13
Measuring the Power of Learning. Print-On-Demand Test Security Guidelines (cont.) Printed test items/passages, including embossed braille printouts, and scratch paper must be collected and inventoried at the end of each test session and then securely destroyed according to LEA and/or California policies or procedures. But . Scratch paper must be collected after the first part of the Full Write performance task and stored securely until returned to the student during the second part. Scratch paper must be shred according to LEA and/or California policies or procedures after the second part of the Full Write has been completed. 2015 16 CAASPP Test Security Guidelines 14
Measuring the Power of Learning. Braille Online Fixed Form If a test administrator selects the braille online fixed form (for mathematics only), he or she can pre-order a graphic package that includes pre- embossed graphics to be used while accessing the online fixed form. These graphic packages must be ordered through CalTAC and returned to CalTAC after the student has completed testing. 2015 16 CAASPP Test Security Guidelines 15
Measuring the Power of Learning. Specific Test Security Guidelines
Measuring the Power of Learning. Preventing Security Violations LEA staff, school staff, test administrators and test examiners play a critical role in monitoring the testing session and adhering to directions for standardized administration. Be familiar with test security protocols outlined in the CAASPP Online Test Administration Manual (http://www.caaspp.org/rsc/pdfs/CAASPP.online _tam.2016.pdf) Section 3.0 Appendix F 2015 16 CAASPP Test Security Guidelines 17
Measuring the Power of Learning. Before and During Testing All test items and test materials must remain secure and must be appropriately handled. Includes creating a secure testing environment for what students can see, hear, or access The test administrator is ultimately responsible for monitoring and reporting test security issues. Inappropriate Internet access Any other improper display, printing, photographing, duplicating, or sharing of test questions 2015 16 CAASPP Test Security Guidelines 18
Measuring the Power of Learning. As Testing Starts and During Testing Including first and last name and a picture to logon ticket will help ensure students are logged on to the correct test. Before handing out tickets, use the Test Administrator Interface or the Test Operations Management System to verify that the Statewide Student Identifiers (SSIDs) on the ticket are correct. Ensure that students have properly logged on and are taking the test for which they are scheduled. Monitor students taking the test for any breach of the secure browser and that it has not allowed students to access external sites or other resources on their testing device during the assessment. 2015 16 CAASPP Test Security Guidelines 19
Measuring the Power of Learning. Student Logon for the Computer- based Tests Student logon information is considered secure material, so it must be provided to, and viewable only by, the student to whom the logon information pertains. Student logon information must be returned to the CAASPP test site coordinator, stored in a secure location between testing sessions, and securely destroyed immediately after testing has been completed. (4) (A) I will keep all assigned, generated, or created usernames, passwords, and logins secure and not divulge pupil personal information to anyone other than the pupil to whom the information pertains for the purpose of logging on to the test delivery system. CAASPP TEST SECURITY AFFIDAVIT (4) I will securely destroy all print-on-demand papers, scratch paper, and other documents as prescribed within the contractor s(s ) or consortium s administrative manuals and documentation. CAASPP TEST SECURITY AGREEMENT 2015 16 CAASPP Test Security Guidelines 20
Measuring the Power of Learning. Test Security Guidelines for Computer-based Tests Ensure there is adequate space between students so that they cannot see each other s work. If using a computer lab, consider using temporary dividers (e.g., folders taped to the sides of the monitors). Test the equipment and network to be used during testing. Report any workarounds to the secure browser to CalTAC. Some software (e.g., teacher-monitoring software, Apple AirPlay) may need to be disabled or monitored locally. 2015 16 CAASPP Test Security Guidelines 21
Measuring the Power of Learning. Test Security Guidelines for the Paper-Pencil Tests Test Administrators and Test Examiners Receive and return materials to CAASPP test site coordinator. Make sure test booklets and answer documents are distributed to the correct student. Allow no unauthorized electronic devices (e.g., cell phones) to be used in classroom during testing. 2015 16 CAASPP Test Security Guidelines 22
Measuring the Power of Learning. Test Security Guidelines for the Paper-Pencil Tests CAASPP Test Site Coordinators Before testing: Receive, count, store, and track materials. Materials should be stored in secure storage with limited access, by key or cardkey. During testing: Distribute and collect materials from test administrators and test examiners. After testing: Count and return materials promptly to the LEA CAASPP coordinator. Handle the secure test materials according to the instructions. 2015 16 CAASPP Test Security Guidelines 23
Measuring the Power of Learning. Social Media Breaches
Measuring the Power of Learning. Social Media Breaches Social media and other Web sites will be monitored daily for postings of secure material. A process is in place to ensure the review and investigation of all test security incidents related to social media to determine what action will need to be taken. 2015 16 CAASPP Test Security Guidelines 25
Measuring the Power of Learning. Procedures for Reporting Testing Incidents
Measuring the Power of Learning. CAASPP Security and Test Administration Incident Reporting System (STAIRS) Process STAIRS and appeals are used for the summative assessments only. The online CAASPP STAIRS form is the starting point for LEA CAASPP coordinators and CAASPP test site coordinators to report a test security incident or other testing issue that interferes with the administration and completion of the summative assessment. Coordinators access the CAASPP STAIRS form in the Test Operations Management System by selecting the [STAIRS/Appeals] button. You cannot submit an appeal request without first submitting the CAASPP STAIRS form. See Table 8: Incident types, descriptions, and actions in the CAASPP STAIRS form starting on page 25 of the Online Test Administration Manual for details about incident types and actions. 2015 16 CAASPP Test Security Guidelines 27
Measuring the Power of Learning. Procedures for Reporting Testing Incidents Impropriety Unusual circumstance that has a low impact on the testing individual or group of students Low risk of affecting student performance, test security, or test validity Correctable and containable at local level Must be reported to LEA CAASPP coordinator or CAASPP test site coordinator Example: Students talking during testing 2015 16 CAASPP Test Security Guidelines 28
Measuring the Power of Learning. Test Security Chart Improprieties There is a testing session in which a student deliberately does not attempt to respond appropriately to items. A student is unable to complete the test before it expires due to an unanticipated excused absence or unanticipated school closure. A student starts a performance task (PT) unintentionally for example, selects a PT instead of a computer adaptive test, or selects a mathematics PT instead of an English language arts/literacy PT and the student is unable to complete the test before it expires. Student(s) making distracting gestures/sounds or talking during the test session that creates a disruption in the test session for other students. Student(s) leave the test room without authorization. Administrator or coordinator leaving related instructional materials on the walls in the testing room. None Administration Incident LOW Impropriety 2015 16 CAASPP Test Security Guidelines 29
Measuring the Power of Learning. Process Flow for Reporting an Impropriety Incident is mitigated as necessary by school staff, and LEA CAASPP coordinator is notified for assistance with mitigation as necessary. The CAASPP test site coordinator or LEA CAASPP coordinator records the impropriety using the online CAASPP STAIRS form within 24 hours. Local administrators/staff take corrective action and notifies the CAASPP test site coordinator. 2015 16 CAASPP Test Security Guidelines 30
Measuring the Power of Learning. Procedures for Reporting Testing Incidents Irregularity Unusual circumstance that impacts the testing individual or group of students May affect student performance, test security, or test validity Correctable and containable at the local level LEA CAASPP coordinator or CAASPP test site coordinator must enter test incident into STAIRS within 24 hours California regulations require that irregularities be reported to the CDE within 24 hours (5 CCR Section 859[e]). Example: Student accessing or using unauthorized electronic device (e.g., cell phone) 2015 16 CAASPP Test Security Guidelines 31
Measuring the Power of Learning. Test Security Chart Irregularity Student(s) cheating or providing answers to each other, including passing notes, giving help to other students during testing, or using hand-held electronic devices to exchange information. Student(s) accessing the Internet or any unauthorized software or applications during a testing event. Student(s) accessing or using unauthorized electronic equipment (e.g., cell phones, PDAs, iPods, or electronic translators) during testing. Disruptions to a test session such as a fire drill, school-wide power outage, earthquake, or other acts. Administrator or coordinator failing to ensure administration and supervision of the Smarter Balanced assessments by qualified, trained personnel. Administrator giving incorrect instructions that are not corrected prior to testing. Administrator or coordinator giving out his or her username/password (via e-mail or otherwise), including to other authorized users. Administrator allowing students to continue testing beyond the close of the testing window. For the performance task (PT), this is 10 calendar days. For the computer adaptive test (CAT), this is 45 calendar days. For a paper-pencil assessment, this is three weeks. Administrator providing a student access to another student s work/responses (unintentional access granted). Student not getting accessibility support or accommodation as required by individualized education program (IEP) or Section 504 plan. MEDIUM Irregularity 2015 16 CAASPP Test Security Guidelines 32
Measuring the Power of Learning. Test Security Chart Irregularity (cont.) Student without IEP or Section 504 plan did not get a designated support. Administrator or teacher coaching or providing any other type of assistance to students that may affect their responses. This includes both verbal cues (e.g., interpreting, explaining, or paraphrasing the test items or prompts) and nonverbal cues (e.g., voice inflection, pointing, or nodding head) to the correct answer. This also includes leading students through instructional strategies such as think-aloud, asking students to point to the correct answer or otherwise identify the source of their answer, or requiring students to show their work. Administrator providing students with nonallowable materials or devices during test administration or allowing inappropriate designated supports and/or accommodations during test administration. Administrator allowing designated supports not indicated by an educator (or team of educators with parent/guardian and student input) and that are not in the student's IEP or Section 504 plan. Administrator allowing inappropriate accommodations (which are not in the student's IEP or Section 504 plan) during test administration. Administrator allowing anyone other than a student to log on to the test unless prescribed as an allowable accommodation in the student s IEP. This includes test administrators or other staff using student information to log on or allowing a student to log on using another student s information. Administrator providing a student access to another student s work/responses (intentional access granted). MEDIUM Irregularity 2015 16 CAASPP Test Security Guidelines 33
Measuring the Power of Learning. Process Flow for Reporting a Testing Irregularity Local Incident is mitigated as necessary by school staff, and the LEA CAASPP coordinator is notified for assistance with mitigation. The CAASPP test site coordinator or LEA CAASPP coordinator reports the irregularity using the online CAASPP STAIRS form by the end of the day of the incident. administrators/ staff take corrective action and notifies the site coordinator The coordinator takes the next steps described in the STAIRS response e- mail, which may include filing an appeal request that includes the STAIRS case number. The CDE approves the appeal, if applicable, and the coordinator retains the STAIRS response e-mail for his or her records. The submitter (and the LEA CAASPP coordinator, if the submitter was a CAASPP test site coordinator) receives an e- mail summarizing the submittal and a description of the next steps. 2015 16 CAASPP Test Security Guidelines 34
Measuring the Power of Learning. Procedures for Reporting Testing Incidents Breach Event that poses a threat to the validity of the test LEA CAASPP coordinator or CAASPP test site coordinator must coordinator must immediately telephone the CDE and then submit a report in STAIRS within 24 hours. California regulations require that irregularities be reported to the CDE within 24 hours (5 CCR Section 859[e]). Example: Release of secure materials or a security/ system risk Circumstances have an external implication to the Smarter Balanced Assessment Consortium May result in decision to remove an item from scoring 2015 16 CAASPP Test Security Guidelines 35
Measuring the Power of Learning. Test Security Chart Breach Administrator or coordinator modifying student responses or records at any time. The live Student Interface or Test Administrator Interface being used for practice instead of the training or practice tests. Adult or student posting items or test materials on social media (Twitter, Facebook, etc.). Administrator allowing students to take home printed test items, reading passages, writing prompts, or scratch paper that was used during the test or failing to otherwise securely store test materials. Adult or student copying, discussing, or otherwise retaining test items, reading passages, writing prompts, or answers for any reason. This includes the use of photocopiers or digital, electronic, or manual devices to record or communicate a test item. This also includes using secure test items, modified secure test items, reading passages, writing prompts, or answer keys for instructional purposes. HIGH BREACH Secure test materials being shared with the media (such as the writing prompts, test items, or reading passages), or allowing media to observe a secure test administration. Adult or student improperly removing secure testing materials such as test items, stimuli, reading passages, writing prompts, or scratch paper from the testing environment. Lost or missing student logon information. 2015 16 CAASPP Test Security Guidelines 36
Measuring the Power of Learning. Process Flow for Reporting a Testing Breach LEA staff investigate the security risk and alerts CalTAC for social media breaches and the CDE for all other breaches, and stand ready to receive further guidance on the dispensation of the event. Local administrators/staff mitigate the incident as necessary and report the breach to the CAASPP test site coordinator and/or LEA CAASPP coordinator by phone immediately. The CAASPP test site coordinator or LEA CAASPP coordinator reports the breach using the online CAASPP STAIRS form by the end of the day of the incident. The submitter (and the LEA CAASPP coordinator, if the submitter was a CAASPP test site coordinator) receives an e-mail summarizing the submittal and a description of next steps. The coordinator takes the next steps described in the STAIRS response e-mail, which may include filing an appeal request that includes the STAIRS case number. The CDE approves the appeal, if applicable, and the coordinator retains the STAIRS response e-mail for their records. 2015 16 CAASPP Test Security Guidelines 37
Measuring the Power of Learning. Test Security Webcast: STAIRS Live Demo Chang Yi ETS 3/09/16
Measuring the Power of Learning. Test Security Auditor Activities
Measuring the Power of Learning. Test Security Audits Audits are conducted throughout the state. Auditors will: observe test security processes being used. interview the CAASPP test site coordinator or designee before, during, and after testing. Summary reports will be provided to the CDE and will be shared with the LEA CAASPP coordinator. 2015 16 CAASPP Test Security Guidelines 40
Measuring the Power of Learning. Questions
Measuring the Power of Learning. Help Desk Support The CalTAC is there to support all LEA CAASPP Coordinators! Available Monday Friday from 7 a.m. 5 p.m. PT E-mail: caltac@ets.org Phone: 800-955-2954 Web site: http://www.caaspp.org/ 2015 16 CAASPP Test Security Guidelines 42
