Long-Term Sustainability of PBIS in Secure Care Settings
B
8
-
P
B
I
S
i
n
S
e
c
u
r
e
C
a
r
e
:
C
o
n
s
i
d
e
r
a
t
i
o
n
s
f
o
r
E
f
f
e
c
t
i
v
e
L
o
n
g
-
t
e
r
m
S
u
s
t
a
i
n
a
b
i
l
i
t
y
–
“
W
h
a
t
A
r
e
W
e
G
e
t
t
i
n
g
I
n
t
o
?
”
National PBIS Leadership Forum | October 3-4, 2019, Chicago, IL
Presenter: Michael Turner
Key Words: Juvenile Justice,
Alternative Settings, Tier I
For more information,
visit:
conference.apbs.org
Miami, FL
Hyatt Regency Miami
March 11-14, 2020
4
What’s Up with Long-Term
Sustainability in Secure Care?
What Leads a Program to Lose
its Previous Gains?
5
Approaches to this session:
1.
Draw on PBIS experts
–
Facility visits/relationships
–
Follow up
–
Tools developed for PBIS in secure care
2.
Draw upon the field of organizational culture
3. Share historical user experience
6
Sustainability: Planning for Long-
Term Implementation
“Sustaining PBIS in Secure Care for Juveniles”
–
Brenda K. Scheuermann, Texas State University
–
C. Michael Nelson, University of Kentucky (emeritus)
Indicates sustainability challenges despite good outcomes
Recognizes significant differences in secure care from
public schools
Finds 3 general categories of practices predictive of
sustainability
–
Exploration and Early Implementation
–
Monitoring and Enhancing Implementation Fidelity
–
Data Collection and Evaluation
7
Education and Treatment of
Children
(
Vol. 42, No. 4, 2019
)
What is “Sustainability?”
8
Implementation Blueprint
School-Wide Evaluation Tool (SET)
Team Implementation Checklist (TIC)
Benchmarks of Quality (BoQ)
School-Wide PBIS Tiered Fidelity Inventory (TFI)
SWPBIS Tiered Fidelity Inventory Walk Through Tool
9
Secure Care Largely Has Used Public
Schools’ Tools for Guidelines
(including culturally relevant enhancements)
10
Differences in Operating Cultures
Abound, e.g., . . .
Huge Treatment Focus
New Lenses Related to Child
Development
11
Add to Differences in Secure Care
FW-PBIS Tiered Fidelity Inventory (version 2 draft)
Recently posted at PBIS Center website,
www.pbis.org
In draft form ready for market testing
Want feedback from users (comments, usability,
suggestions, etc.)
–
brenda@txstate.edu
and/or
mrt109@txstate.edu
12
One Tool Specifically for Secure
Care PBIS is Available
13
A Few Organizational
Culture Fundamentals
(ala Edgar Schein, Ph.D.)
Behavior
change
≠
culture
change
Sum total of everything learned in an
organization’s history related to the . . .
–
Right way to operate (to solve problems, with habits of
perception, thought and feeling)
•
externally (mission, goals, strategies, working with
public, boards, etc.)
•
and internally (org charts, controls, rewards and
incentives, how we relate to one another, etc.)
Culture is always learned, never imposed.
15
What is
Organizational Culture?
16
For “Young” Organizations, Change Primarily Moves
Outward from Assumptions
For “Mature” Organizations, Change Primarily Moves
Inward from Practices
20
Exploration and Early
Implementation
PBIS Team Composition
Tiered Fidelity Inventory
(v2 draft)
•
6-8 reps from youth care
disciplines who can provide
•
B
e
h
a
v
i
o
r
e
x
p
e
r
t
i
s
e
•
I
n
d
e
p
t
h
k
n
o
w
l
e
d
g
e
o
f
y
o
u
t
h
•
K
n
o
w
l
e
d
g
e
/
a
u
t
h
o
r
i
t
y
i
n
v
o
l
v
i
n
g
f
a
c
i
l
i
t
y
o
p
e
r
a
t
i
o
n
s
•
S
a
f
e
t
y
/
S
e
c
u
r
i
t
y
e
x
p
e
r
t
i
s
e
•
Y
o
u
t
h
v
o
i
c
e
Lessons Learned
•
T
e
a
m
s
i
z
e
s
f
o
r
e
f
f
e
c
t
i
v
e
n
e
s
s
•
“
S
a
c
r
e
d
c
o
w
s
”
d
i
s
c
u
s
s
i
o
n
s
•
E
g
a
l
i
t
a
r
i
a
n
v
s
.
t
o
p
-
d
o
w
n
c
u
l
t
u
r
e
s
•
W
h
o
a
r
e
t
h
e
m
o
s
t
e
f
f
e
c
t
i
v
e
t
w
o
-
w
a
y
c
o
m
m
u
n
i
c
a
t
o
r
s
w
i
t
h
i
n
a
n
d
a
c
r
o
s
s
d
i
s
c
i
p
l
i
n
e
s
?
•
W
e
l
l
-
i
n
t
e
n
t
i
o
n
e
d
i
s
i
n
s
u
f
f
i
c
i
e
n
t
•
P
B
I
S
t
e
a
m
n
e
e
d
s
a
u
t
h
o
r
i
t
y
o
r
r
e
a
d
y
a
c
c
e
s
s
t
o
r
e
s
p
o
n
s
i
v
e
a
u
t
h
o
r
i
t
y
21
Exploration and Early Implementation
Behavioral Expectations
Tiered Fidelity Inventory
(v2 draft)
•
6 or fewer overarching general
expectations
•
Expectations stated positively
•
Specific behaviors defined for
specific locations/activities in
matrix
•
Matrices posted in all relevant
locations
Lessons Learned
•
U
s
e
a
m
e
m
o
r
a
b
l
e
a
c
r
o
n
y
m
f
o
r
g
e
n
e
r
a
l
e
x
p
e
c
t
a
t
i
o
n
s
•
P
r
o
c
e
s
s
t
o
d
e
v
e
l
o
p
e
x
p
e
c
t
a
t
i
o
n
s
n
e
e
d
s
b
r
o
a
d
i
n
p
u
t
a
n
d
s
k
i
l
l
t
o
b
r
i
n
g
a
b
o
u
t
c
o
n
s
e
n
s
u
s
•
S
o
m
e
t
h
i
n
g
e
v
e
r
y
o
n
e
c
a
n
l
i
v
e
w
i
t
h
•
G
e
t
c
o
n
s
e
n
s
u
s
o
n
t
h
e
l
a
n
g
u
a
g
e
u
s
e
d
i
n
m
a
t
r
i
x
•
E
x
p
e
c
t
s
t
a
f
f
t
o
u
s
e
t
h
a
t
l
a
n
g
u
a
g
e
w
h
e
n
i
n
s
t
r
u
c
t
i
n
g
/
r
e
m
i
n
d
i
n
g
y
o
u
t
h
•
Y
o
u
t
h
g
e
n
e
r
a
l
l
y
m
e
e
t
e
x
p
e
c
t
a
t
i
o
n
s
,
w
h
e
t
h
e
r
h
i
g
h
o
r
l
o
w
22
Exploration and Early Implementation
Staff Involvement
Tiered Fidelity Inventory
(v2 draft)
•
Broad input on
•
E
x
p
e
c
t
a
t
i
o
n
s
•
R
e
i
n
f
o
r
c
e
m
e
n
t
s
•
D
e
f
i
n
i
t
i
o
n
s
•
C
o
n
s
e
q
u
e
n
c
e
s
•
Data analyses shared widely and
regularly
•
Input into problem-solving
•
Broad participation in
celebrations
Lessons Learned
•
I
m
p
o
r
t
a
n
t
n
u
a
n
c
e
b
e
t
w
e
e
n
b
r
o
a
d
i
n
p
u
t
a
n
d
P
B
I
S
t
e
a
m
m
e
m
b
e
r
s
h
i
p
•
N
e
e
d
b
r
o
a
d
d
i
s
c
u
s
s
i
o
n
s
o
n
p
r
o
b
l
e
m
-
s
o
l
v
i
n
g
a
n
d
f
i
d
e
l
i
t
y
o
f
p
r
a
c
t
i
c
e
•
P
a
y
a
t
t
e
n
t
i
o
n
t
o
l
a
n
g
u
a
g
e
•
M
a
k
e
l
a
n
g
u
a
g
e
d
e
l
i
b
e
r
a
t
e
•
C
o
n
s
i
s
t
e
n
t
w
i
t
h
m
a
t
r
i
c
e
s
•
G
r
e
a
t
b
r
a
i
n
s
t
o
r
m
i
n
g
w
i
t
h
b
r
o
a
d
i
n
p
u
t
(
r
e
w
a
r
d
s
,
i
n
c
e
n
t
i
v
e
s
,
e
t
c
.
)
•
M
e
t
r
i
c
s
d
e
v
e
l
o
p
m
e
n
t
•
Q
u
a
l
i
t
y
o
f
l
i
f
e
a
n
d
o
t
h
e
r
g
o
o
d
t
h
i
n
g
s
•
N
o
t
j
u
s
t
r
e
d
u
c
t
i
o
n
o
f
b
a
d
t
h
i
n
g
s
23
Exploration and Early Implementation
24
More Staff Involvement: Use
Formal Processes for Input
W
h
o
?
W
h
e
r
e
?
H
o
w
?
Exploration and Early Implementation
More Staff Involvement:
Integration of Work Approaches
Underlying philosophy of what
makes youth better?
•
How do youth grow and change?
Do diverse activities cohere
with the underlying
philosophy?
Focus Areas for Integration
•
Policies and procedures
•
Behavioral accountabililty
•
Curriculum development and
training
•
Job descriptions and evaluations
•
Treatment
25
Exploration and Early Implementation
26
Risks of Unintegrated Approaches
Exploration and Early Implementation
Critically review existing curricula for messages
inconsistent with PBIS
Involve trainers to check for understanding
Be sensitive to areas of “unlearning” that need to occur
–
Know your best advocates of traditional approaches
–
Help them to identify contrasts in new approach and understand reasons
–
Enlist their talents as leaders
–
If they can’t get on board, help them to be conscious and wary of undermining
•
Encourage state of “open mind”
–
If this isn’t for them, assist them into other roles positively
27
Integration: Curriculum
Development and Training
Exploration and Early Implementation
Integration: Treatment
28
Exploration and Early Implementation
Low expectations
Confusion about proper
behavior or expectations
Not knowing how to meet
expectations
Underdeveloped locus of
control, whether internal or
external, in face of stimuli
prompting a response
Symbolic use of behavior to
communicate non-verbally,
whether conscious or not
Testing limits to assess safety
and/or supervisory staff
–
What are staff skills/expectations?
–
Do they care? Do they walk the talk?
–
What’s real?
Functional perspective: to get or to
avoid
In service of meeting
developmental milestones for
autonomy, agency, voice, etc.
Depressive or manic reactions with
a biochemical basis
29
Example Reasons for Behavioral
Acting Out
Exploration and Early Implementation
Low expectations
Confusion about proper
behavior or expectations
Not knowing how to meet
expectations
Underdeveloped locus of
control, whether internal or
external, in face of stimuli
prompting a response
Intentional symbolic use of
behavior to communicate non-
verbally
In service of meeting
developmental milestones for
autonomy, agency, voice, etc.
Functional perspective: to get or to
avoid
Testing limits to assess safety
and/or supervisory staff
–
What are staff skills/expectations?
–
Do they care? Do they walk the talk?
–
What’s real?
Depressive or manic reactions with
a biochemical basis
30
Tier I Helps to Isolate Underlying
Issues
Exploration and Early Implementation
Underdeveloped locus of
control, whether internal or
external, in face of stimuli
prompting a response
Intentional symbolic use of
behavior to communicate non-
verbally
In service of meeting
developmental milestones for
autonomy, agency, voice, etc.
Functional perspective: to get or to
avoid
Testing limits to assess safety
and/or supervisory staff
–
What are staff skills/expectations?
–
Do they care? Do they walk the talk?
–
What’s real?
Depressive or manic reactions with
a biochemical basis
31
Takes Some Behavioral
Components Off the Table
Exploration and Early Implementation
Low expectations
Confusion about proper
behavior or expectations
Not knowing how to meet
expectations
PBIS facilities reduce behavioral
incidents by addressing these
elements
Raises bar on treatment program
quality by
–
Reducing distractions
–
Helping teams to respond and
intervene more effectively
32
Incident Reduction Belies
Reasons for Many Infractions
Exploration and Early Implementation
Teaching Expectations
Tiered Fidelity Inventory
(v2 draft)
•
Expected academic and social
behaviors taught directly to youth
•
New admissions as well as long-
standing residents
•
Addresses all locations/activities
on expectations matrix
Lessons Learned
•
T
h
i
n
k
t
h
r
o
u
g
h
p
r
o
c
e
s
s
e
s
f
o
r
n
e
w
a
d
m
i
s
s
i
o
n
s
v
s
.
r
e
v
i
e
w
s
a
n
d
r
e
m
i
n
d
e
r
s
f
o
r
o
t
h
e
r
s
•
U
s
e
e
x
a
m
p
l
e
s
a
n
d
n
o
n
-
e
x
a
m
p
l
e
s
•
U
s
e
g
r
a
p
h
i
c
p
o
s
t
e
r
s
f
o
r
r
e
f
e
r
e
n
c
e
a
s
a
p
p
l
i
c
a
b
l
e
•
C
a
u
t
i
o
n
r
e
“
c
o
n
s
i
s
t
e
n
c
y
”
•
C
a
u
t
i
o
n
r
e
f
r
e
q
u
e
n
t
v
s
.
u
s
e
f
u
l
r
e
m
i
n
d
e
r
s
33
Exploration and Early Implementation
Youth Feedback and
Acknowledgement
Tiered Fidelity Inventory
(v2 draft)
•
One or more formal
acknowledgement systems for
rule following behavior
•
Tied to overarching behavioral
expectations
•
Implemented across locations
and activities
Lessons Learned
•
D
a
n
g
e
r
o
f
m
i
s
i
n
t
e
r
p
r
e
t
i
n
g
P
B
I
S
a
s
a
b
e
h
a
v
i
o
r
m
o
d
i
f
i
c
a
t
i
o
n
p
r
o
g
r
a
m
•
H
e
a
l
t
h
y
r
e
l
a
t
i
o
n
s
h
i
p
s
a
r
e
c
r
i
t
i
c
a
l
•
S
t
a
f
f
c
r
e
a
t
i
v
i
t
y
f
o
r
p
r
o
b
l
e
m
-
s
o
l
v
i
n
g
c
a
n
b
e
r
e
a
l
l
y
h
e
l
p
f
u
l
•
“
T
o
k
e
n
s
”
a
r
e
m
o
r
e
s
a
l
i
e
n
t
i
f
y
o
u
t
h
p
h
y
s
i
c
a
l
l
y
h
a
n
d
l
e
t
h
e
m
•
T
a
n
g
i
b
l
e
r
e
m
i
n
d
e
r
s
o
f
s
t
a
f
f
’
s
p
e
r
s
o
n
a
l
v
a
l
u
e
a
n
d
a
p
p
r
e
c
i
a
t
i
o
n
f
o
r
b
e
h
a
v
i
o
r
•
S
t
a
f
f
a
b
i
l
i
t
y
t
o
s
e
e
b
e
h
a
v
i
o
r
s
a
s
f
u
n
c
t
i
o
n
s
a
n
d
s
y
m
b
o
l
i
c
h
e
l
p
s
t
h
e
m
t
o
t
e
a
c
h
r
e
p
l
a
c
e
m
e
n
t
b
e
h
a
v
i
o
r
s
34
Exploration and Early Implementation
35
Monitoring and
Enhancing
Implementation
Fidelity
PBIS Team Operating Procedures
Tiered Fidelity Inventory
(v2 draft)
•
Meet at least monthly
•
Use regular meeting
format/agenda
•
Keep meeting minutes
•
Maintain current action plan
•
Share meeting minutes with
youth care staff
•
Team members attend regularly
and stay for entire meeting
Lessons Learned
•
H
o
w
t
o
t
a
k
e
m
i
n
u
t
e
s
m
a
t
t
e
r
s
•
S
h
a
r
e
d
r
a
f
t
s
q
u
i
c
k
l
y
,
t
h
e
n
p
o
s
t
w
i
t
h
c
o
r
r
e
c
t
i
o
n
s
•
T
r
a
c
k
f
o
l
l
o
w
u
p
a
c
t
i
v
i
t
i
e
s
i
n
t
h
e
m
i
n
u
t
e
s
•
B
e
c
l
e
a
r
a
b
o
u
t
w
h
o
d
o
e
s
w
h
a
t
,
w
h
e
n
,
w
h
e
r
e
,
e
t
c
.
•
A
g
e
n
d
a
s
a
r
e
h
e
l
p
f
u
l
•
B
a
s
i
c
s
c
r
i
p
t
s
a
r
e
h
e
l
p
f
u
l
t
o
s
t
a
r
t
•
R
e
v
i
e
w
d
a
t
a
p
r
i
o
r
t
o
m
e
e
t
i
n
g
•
A
n
a
l
y
z
e
f
o
r
p
a
t
t
e
r
n
s
,
t
r
e
n
d
s
•
O
p
e
n
A
N
D
a
s
s
i
g
n
e
d
r
e
s
p
o
n
s
i
b
i
l
i
t
y
36
Monitoring and Enhancing Implementation Fidelity
Staff Professional Development
Tiered Fidelity Inventory
(v2 draft)
•
On-going, formally written and
delivered processes
•
Orient all staff on core PBIS
principles
•
T
e
a
c
h
i
n
g
f
a
c
i
l
i
t
y
w
i
d
e
e
x
p
e
c
t
a
t
i
o
n
s
•
A
c
k
n
o
w
l
e
d
g
i
n
g
a
p
p
r
o
p
r
i
a
t
e
b
e
h
a
v
i
o
r
•
R
e
s
p
o
n
d
i
n
g
t
o
m
a
j
o
r
v
s
.
m
i
n
o
r
i
n
f
r
a
c
t
i
o
n
s
•
R
e
q
u
e
s
t
i
n
g
a
s
s
i
s
t
a
n
c
e
Lessons Learned
•
N
e
w
h
i
r
e
t
r
a
i
n
i
n
g
A
N
D
o
n
-
g
o
i
n
g
t
r
a
i
n
i
n
g
n
e
e
d
e
d
.
T
h
e
y
a
r
e
d
i
f
f
e
r
e
n
t
.
•
B
u
i
l
d
c
a
p
a
c
i
t
y
o
v
e
r
t
i
m
e
b
y
t
e
a
c
h
i
n
g
m
o
r
e
a
b
o
u
t
k
e
y
b
e
h
a
v
i
o
r
a
l
p
r
i
n
c
i
p
l
e
s
•
C
r
i
t
i
c
a
l
l
y
r
e
v
i
e
w
p
r
e
-
e
x
i
s
t
i
n
g
c
u
r
r
i
c
u
l
u
m
f
o
r
f
i
t
•
I
n
t
e
g
r
a
t
i
o
n
o
f
n
e
w
a
n
d
o
l
d
p
h
i
l
o
s
o
p
h
i
e
s
t
a
k
e
s
p
r
o
a
c
t
i
v
e
a
t
t
e
n
t
i
o
n
•
T
o
p
l
e
a
d
e
r
s
h
i
p
m
u
s
t
u
n
d
e
r
s
t
a
n
d
•
N
e
e
d
f
o
r
i
n
t
e
g
r
a
t
i
o
n
•
B
e
h
a
v
i
o
r
s
m
u
s
t
b
e
“
u
n
l
e
a
r
n
e
d
”
•
R
e
a
l
i
s
t
i
c
t
i
m
e
l
i
n
e
f
o
r
n
e
w
c
u
r
r
i
c
u
l
u
m
37
Monitoring and Enhancing Implementation Fidelity
Staff Feedback and
Acknowledgement
Tiered Fidelity Inventory
(v2 draft)
•
Formal acknowledgement
systems to recognize staff who
•
T
e
a
c
h
a
n
d
m
o
d
e
l
e
x
p
e
c
t
e
d
b
e
h
a
v
i
o
r
s
•
U
s
e
r
u
l
e
m
a
t
r
i
c
e
s
•
U
s
e
y
o
u
t
h
a
c
k
n
o
w
l
e
d
g
e
m
e
n
t
s
y
s
t
e
m
s
•
U
s
e
c
o
n
s
e
q
u
e
n
c
e
s
f
o
r
r
u
l
e
v
i
o
l
a
t
i
o
n
s
Lessons Learned
•
O
n
e
f
a
c
i
l
i
t
y
a
p
p
l
i
e
d
v
a
r
i
a
t
i
o
n
o
f
t
h
e
r
e
c
o
m
m
e
n
d
e
d
a
p
p
r
o
a
c
h
•
U
s
e
d
P
B
I
S
a
s
a
t
e
a
c
h
i
n
g
t
e
c
h
n
i
q
u
e
t
o
r
o
l
e
m
o
d
e
l
f
o
r
s
t
a
f
f
h
o
w
i
t
w
o
r
k
s
•
A
p
p
l
i
e
d
“
l
i
v
e
”
•
S
t
a
f
f
s
e
l
e
c
t
e
d
v
a
l
u
e
s
t
h
a
t
b
r
i
n
g
t
h
e
m
t
o
w
o
r
k
•
C
r
e
a
t
e
d
b
e
h
a
v
i
o
r
a
l
e
x
p
e
c
t
a
t
i
o
n
s
a
r
o
u
n
d
v
a
l
u
e
s
•
M
a
n
a
g
e
r
s
g
a
v
e
m
o
n
t
h
l
y
f
e
e
d
b
a
c
k
•
T
r
a
c
k
e
d
p
r
o
g
r
e
s
s
w
i
t
h
d
a
t
a
38
Monitoring and Enhancing Implementation Fidelity
Access to Training, Coaching and
Technical Assistance
Tiered Fidelity Inventory
(v2 draft)
•
Sources to assist with building
capacity are available in forms of
•
T
r
a
i
n
e
r
s
•
C
o
a
c
h
e
s
•
T
e
c
h
n
i
c
a
l
a
s
s
i
s
t
a
n
c
e
p
r
o
v
i
d
e
r
s
•
Sources are available
•
I
n
s
i
d
e
t
h
e
f
a
c
i
l
i
t
y
•
O
u
t
s
i
d
e
t
h
e
f
a
c
i
l
i
t
y
Lessons Learned
•
B
e
w
a
r
e
o
f
“
b
e
h
a
v
i
o
r
t
r
a
i
n
e
r
s
”
i
n
t
h
e
m
a
r
k
e
t
w
h
o
e
s
p
o
u
s
e
m
a
r
k
e
d
l
y
d
i
f
f
e
r
e
n
t
a
p
p
r
o
a
c
h
e
s
f
r
o
m
p
o
s
i
t
i
v
e
o
n
e
s
w
i
t
h
m
u
l
t
i
p
l
e
t
i
e
r
s
o
f
s
u
p
p
o
r
t
•
P
r
o
g
r
a
m
s
t
h
a
t
d
e
v
e
l
o
p
i
n
t
e
r
n
a
l
c
o
a
c
h
e
s
o
v
e
r
t
i
m
e
g
e
t
b
e
t
t
e
r
o
u
t
c
o
m
e
s
•
B
e
c
l
e
a
r
a
b
o
u
t
s
t
a
f
f
c
o
m
p
e
t
e
n
c
i
e
s
t
h
a
t
c
o
a
c
h
e
s
a
r
e
t
r
y
i
n
g
t
o
d
e
v
e
l
o
p
•
B
e
c
l
e
a
r
a
b
o
u
t
c
o
m
p
e
t
e
n
c
i
e
s
n
e
c
e
s
s
a
r
y
t
o
b
e
c
o
m
e
a
t
a
l
e
n
t
e
d
c
o
a
c
h
•
S
u
p
p
o
r
t
w
i
t
h
a
c
l
e
a
r
p
l
a
n
39
Monitoring and Enhancing Implementation Fidelity
40
Data Collection and
Evaluation
Data Collection and Data-based
Decision Making
Tiered Fidelity Inventory
(v2 draft)
•
Ready access to graphed
behavior reports
•
Analyses review data by
•
I
n
c
i
d
e
n
t
r
a
t
e
s
•
D
a
y
s
•
T
i
m
e
s
•
L
o
c
a
t
i
o
n
s
•
P
e
o
p
l
e
(
Y
o
u
t
h
a
n
d
S
t
a
f
f
)
–
G
r
o
u
p
s
(
e
.
g
.
,
d
o
r
m
s
)
Lessons Learned
•
B
e
c
l
e
a
r
a
b
o
u
t
t
w
o
-
f
o
l
d
p
u
r
p
o
s
e
s
o
f
d
a
t
a
•
F
i
d
e
l
i
t
y
a
s
s
e
s
s
m
e
n
t
•
M
e
a
s
u
r
i
n
g
p
r
o
g
r
e
s
s
t
o
w
a
r
d
d
e
s
i
r
e
d
o
u
t
c
o
m
e
s
•
S
e
e
k
o
u
t
o
p
p
o
r
t
u
n
i
t
i
e
s
t
o
p
r
a
c
t
i
c
e
d
a
t
a
-
b
a
s
e
d
d
e
c
i
s
i
o
n
m
a
k
i
n
g
•
C
o
l
l
e
c
t
i
n
g
d
a
t
a
i
s
m
u
c
h
d
i
f
f
e
r
e
n
t
f
r
o
m
d
a
t
a
-
b
a
s
e
d
d
e
c
i
s
i
o
n
m
a
k
i
n
g
•
C
u
l
t
i
v
a
t
e
a
n
d
d
i
s
t
r
i
b
u
t
e
t
h
i
s
s
k
i
l
l
s
e
t
41
Data Collection and Evaluation
42
Map Opportunities to Practice
Using Data
Creating “time and space” for the work to flourish
–
Tasks of embedding practices into organizational infrastructure
–
Who?, What?, Where?, When?, How? . . . .
–
Embedded practices, in turn, give opportunity to shape culture
–
Fidelity is key for PBIS
Culture driven by how leadership reacts to critical events
Culture driven by what leadership does NOT say or react to
43
Leadership (broadly speaking)
as Strategy
Michael Turner
mrt109@txstate.edu
44
Contact Info
Exploring the challenges and strategies for sustaining Positive Behavioral Interventions and Supports (PBIS) in secure care environments, this content delves into the importance of fidelity, outcomes, and the influence of organizational culture. Key insights include sustaining practices, predictive categories for sustainability, and the essential aspects of implementation for long-term effectiveness.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
National PBIS Leadership Forum | October 3-4, 2019, Chicago, IL B8 - PBIS in Secure Care: Considerations for Effective Long-term Sustainability What Are We Getting Into? Presenter: Michael Turner Key Words: Juvenile Justice, Alternative Settings, Tier I
Whats Up with Long-Term Sustainability in Secure Care? We know PBIS can be implemented successfully, sometimes for years Secure care settings/Alternative settings Facility-wide models/School-wide models Implementation with fidelity is tied to favorable outcomes Fewer behavioral challenges Higher quality of life Yet sustainability doesn t happen automatically 4
What Leads a Program to Lose its Previous Gains? PBIS is still early in moving from traditional public schools to alternative settings Learning lessons along the way for long-term increased effectiveness Edgar Schein, Ph.D. Society of Sloan Fellows Professor of Management Emeritus, MIT Sloan School of Management Behavioral change is not culture change 5
Sustainability: Planning for Long- Term Implementation Approaches to this session: 1. Draw on PBIS experts Facility visits/relationships Follow up Tools developed for PBIS in secure care 2. Draw upon the field of organizational culture 3. Share historical user experience 6
Education and Treatment of Children (Vol. 42, No. 4, 2019) Sustaining PBIS in Secure Care for Juveniles Brenda K. Scheuermann, Texas State University C. Michael Nelson, University of Kentucky (emeritus) Indicates sustainability challenges despite good outcomes Recognizes significant differences in secure care from public schools Finds 3 general categories of practices predictive of sustainability Exploration and Early Implementation Monitoring and Enhancing Implementation Fidelity Data Collection and Evaluation 7
What is Sustainability? Important criteria offered by Hans and Weiss (2005) On-going implementation of an intervention, practice or program With fidelity to the core principles of the intervention Even after initial resources used to support training and implementation have been withdrawn Generally accepted standard in public schools (Corey and Horner, 2012) 3 to 5 years of successful implementation 8
Secure Care Largely Has Used Public Schools Tools for Guidelines Implementation Blueprint (including culturally relevant enhancements) School-Wide Evaluation Tool (SET) Team Implementation Checklist (TIC) Benchmarks of Quality (BoQ) School-Wide PBIS Tiered Fidelity Inventory (TFI) SWPBIS Tiered Fidelity Inventory Walk Through Tool 9
Differences in Operating Cultures Abound, e.g., . . . Cultural Theme/Artifact Hours of Operation Security Focus Types of youth Public Schools School Days; one shift Medium Normal range Secure Care Facilities 24*7*365; year round High Complex treatment and educational needs High Low to medium Narrow range Direct Supervision Social Interaction Allowable Activities/Materials Incentives/Rewards Authority Planning norms Low to medium High Wide range Wide range Relatively egalitarian Relatively proactive Narrow range Top down Relatively reactive 10
Add to Differences in Secure Care Huge Treatment Focus New Lenses Related to Child Development 11
One Tool Specifically for Secure Care PBIS is Available FW-PBIS Tiered Fidelity Inventory (version 2 draft) Recently posted at PBIS Center website, www.pbis.org In draft form ready for market testing Want feedback from users (comments, usability, suggestions, etc.) brenda@txstate.edu and/or mrt109@txstate.edu 12
A Few Organizational Culture Fundamentals (ala Edgar Schein, Ph.D.) 13
IF behavioral change produces better results Behavior change culture change AND IF lots of people share that perception AND IF people genuinely come to believe in their hearts and minds this is a better way of doing things AND IF that becomes sustainable over time THEN one can begin to speak about culture change
What is Organizational Culture? Sum total of everything learned in an organization s history related to the . . . Right way to operate (to solve problems, with habits of perception, thought and feeling) externally (mission, goals, strategies, working with public, boards, etc.) and internally (org charts, controls, rewards and incentives, how we relate to one another, etc.) Culture is always learned, never imposed. 15
~ Reality (External and Internal), If Culture 16
For Young Organizations, Change Primarily Moves Outward from Assumptions
For Mature Organizations, Change Primarily Moves Inward from Practices
Exploration and Early Implementation 20
Exploration and Early Implementation PBIS Team Composition Tiered Fidelity Inventory (v2 draft) 6-8 reps from youth care disciplines who can provide Behavior expertise In depth knowledge of youth Knowledge/authority involving facility operations Safety/Security expertise Youth voice Lessons Learned Team sizes for effectiveness Sacred cows discussions Egalitarian vs. top-down cultures Who are the most effective two-way communicators within and across disciplines? Well-intentioned is insufficient PBIS team needs authority or ready access to responsive authority 21
Exploration and Early Implementation Behavioral Expectations Tiered Fidelity Inventory (v2 draft) 6 or fewer overarching general expectations Expectations stated positively Specific behaviors defined for specific locations/activities in matrix Matrices posted in all relevant locations Lessons Learned Use a memorable acronym for general expectations Process to develop expectations needs broad input and skill to bring about consensus Something everyone can live with Get consensus on the language used in matrix Expect staff to use that language when instructing/reminding youth Youth generally meet expectations, whether high or low 22
Exploration and Early Implementation Staff Involvement Tiered Fidelity Inventory (v2 draft) Broad input on Expectations Reinforcements Definitions Consequences Lessons Learned Important nuance between broad input and PBIS team membership Need broad discussions on problem- solving and fidelity of practice Pay attention to language Make language deliberate Consistent with matrices Great brainstorming with broad input (rewards, incentives, etc.) Metrics development Quality of life and other good things Not just reduction of bad things Data analyses shared widely and regularly Input into problem-solving Broad participation in celebrations 23
Exploration and Early Implementation More Staff Involvement: Use Formal Processes for Input Weekly Monthly Quarterly Annually Behaviors of Focus Behavioral Matrices Language Assessment Ideas for Incentives and Consequences Data Metrics Data Results & Analyses Problem-solving Fidelity Assessments Other? Who? Where? How? 24
Exploration and Early Implementation More Staff Involvement: Integration of Work Approaches Underlying philosophy of what makes youth better? Focus Areas for Integration Policies and procedures Behavioral accountabililty How do youth grow and change? Curriculum development and training Do diverse activities cohere with the underlying philosophy? Job descriptions and evaluations Treatment 25
Exploration and Early Implementation Risks of Unintegrated Approaches Default becomes belief that curriculum is the change agent Undervalues relationships that offer context for change Unaligned belief systems within the agency (hodge-podge) Underdeveloped sense of collective meaning PBIS is experienced as yet another add-on responsibility Practices hinder fidelity and effectiveness of one another 26
Exploration and Early Implementation Integration: Curriculum Development and Training Critically review existing curricula for messages inconsistent with PBIS Involve trainers to check for understanding Be sensitive to areas of unlearning that need to occur Know your best advocates of traditional approaches Help them to identify contrasts in new approach and understand reasons Enlist their talents as leaders If they can t get on board, help them to be conscious and wary of undermining Encourage state of open mind If this isn t for them, assist them into other roles positively 27
Exploration and Early Implementation Integration: Treatment Treatment staff inclined to see PBIS as an unrelated add on unless framed helpfully Encourage holistic view of youth, i.e., everything s connected Consider spectrum of meaning behind behavioral infractions 28
Exploration and Early Implementation Example Reasons for Behavioral Acting Out Low expectations Confusion about proper behavior or expectations Not knowing how to meet expectations Underdeveloped locus of control, whether internal or external, in face of stimuli prompting a response Symbolic use of behavior to communicate non-verbally, whether conscious or not Testing limits to assess safety and/or supervisory staff What are staff skills/expectations? Do they care? Do they walk the talk? What s real? Functional perspective: to get or to avoid In service of meeting developmental milestones for autonomy, agency, voice, etc. Depressive or manic reactions with a biochemical basis 29
Exploration and Early Implementation Tier I Helps to Isolate Underlying Issues Low expectations Confusion about proper behavior or expectations Not knowing how to meet expectations Underdeveloped locus of control, whether internal or external, in face of stimuli prompting a response Intentional symbolic use of behavior to communicate non- verbally In service of meeting developmental milestones for autonomy, agency, voice, etc. Functional perspective: to get or to avoid Testing limits to assess safety and/or supervisory staff What are staff skills/expectations? Do they care? Do they walk the talk? What s real? Depressive or manic reactions with a biochemical basis 30
Exploration and Early Implementation Takes Some Behavioral Components Off the Table In service of meeting developmental milestones for autonomy, agency, voice, etc. Functional perspective: to get or to avoid Testing limits to assess safety and/or supervisory staff What are staff skills/expectations? Do they care? Do they walk the talk? What s real? Depressive or manic reactions with a biochemical basis Underdeveloped locus of control, whether internal or external, in face of stimuli prompting a response Intentional symbolic use of behavior to communicate non- verbally 31
Exploration and Early Implementation Incident Reduction Belies Reasons for Many Infractions Low expectations Confusion about proper behavior or expectations Not knowing how to meet expectations PBIS facilities reduce behavioral incidents by addressing these elements Raises bar on treatment program quality by Reducing distractions Helping teams to respond and intervene more effectively 32
Exploration and Early Implementation Teaching Expectations Tiered Fidelity Inventory (v2 draft) Expected academic and social behaviors taught directly to youth New admissions as well as long- standing residents Addresses all locations/activities on expectations matrix Lessons Learned Think through processes for new admissions vs. reviews and reminders for others Use examples and non-examples Use graphic posters for reference as applicable Caution re consistency Caution re frequent vs. useful reminders 33
Exploration and Early Implementation Youth Feedback and Acknowledgement Tiered Fidelity Inventory (v2 draft) One or more formal acknowledgement systems for rule following behavior Tied to overarching behavioral expectations Implemented across locations and activities Lessons Learned Danger of misinterpreting PBIS as a behavior modification program Healthy relationships are critical Staff creativity for problem-solving can be really helpful Tokens are more salient if youth physically handle them Tangible reminders of staff s personal value and appreciation for behavior Staff ability to see behaviors as functions and symbolic helps them to teach replacement behaviors 34
Monitoring and Enhancing Implementation Fidelity 35
Monitoring and Enhancing Implementation Fidelity PBIS Team Operating Procedures Tiered Fidelity Inventory (v2 draft) Meet at least monthly Use regular meeting format/agenda Keep meeting minutes Maintain current action plan Share meeting minutes with youth care staff Team members attend regularly and stay for entire meeting Lessons Learned How to take minutes matters Share drafts quickly, then post with corrections Track follow up activities in the minutes Be clear about who does what, when, where, etc. Agendas are helpful Basic scripts are helpful to start Review data prior to meeting Analyze for patterns, trends Open AND assigned responsibility 36
Monitoring and Enhancing Implementation Fidelity Staff Professional Development Tiered Fidelity Inventory (v2 draft) On-going, formally written and delivered processes Orient all staff on core PBIS principles Teaching facility wide expectations Acknowledging appropriate behavior Responding to major vs. minor infractions Requesting assistance Lessons Learned New hire training AND on-going training needed. They are different. Build capacity over time by teaching more about key behavioral principles Critically review pre-existing curriculum for fit Integration of new and old philosophies takes proactive attention Top leadership must understand Need for integration Behaviors must be unlearned Realistic timeline for new curriculum 37
Monitoring and Enhancing Implementation Fidelity Staff Feedback and Acknowledgement Tiered Fidelity Inventory (v2 draft) Formal acknowledgement systems to recognize staff who Teach and model expected behaviors Use rule matrices Use youth acknowledgement systems Use consequences for rule violations Lessons Learned One facility applied variation of the recommended approach Used PBIS as a teaching technique to role model for staff how it works Applied live Staff selected values that bring them to work Created behavioral expectations around values Managers gave monthly feedback Tracked progress with data 38
Monitoring and Enhancing Implementation Fidelity Access to Training, Coaching and Technical Assistance Tiered Fidelity Inventory (v2 draft) Sources to assist with building capacity are available in forms of Trainers Coaches Technical assistance providers Sources are available Inside the facility Outside the facility Lessons Learned Beware of behavior trainers in the market who espouse markedly different approaches from positive ones with multiple tiers of support Programs that develop internal coaches over time get better outcomes Be clear about staff competencies that coaches are trying to develop Be clear about competencies necessary to become a talented coach Support with a clear plan 39
Data Collection and Evaluation 40
Data Collection and Evaluation Data Collection and Data-based Decision Making Tiered Fidelity Inventory (v2 draft) Ready access to graphed behavior reports Analyses review data by Incident rates Days Times Locations People (Youth and Staff) Groups (e.g., dorms) Lessons Learned Be clear about two-fold purposes of data Fidelity assessment Measuring progress toward desired outcomes Seek out opportunities to practice data- based decision making Collecting data is much different from data-based decision making Cultivate and distribute this skill set 41
Map Opportunities to Practice Using Data 42
Leadership (broadly speaking) as Strategy Creating time and space for the work to flourish Tasks of embedding practices into organizational infrastructure Who?, What?, Where?, When?, How? . . . . Embedded practices, in turn, give opportunity to shape culture Fidelity is key for PBIS Culture driven by how leadership reacts to critical events Culture driven by what leadership does NOT say or react to 43
Contact Info Michael Turner mrt109@txstate.edu 44
