Risk in Audit and Certification of Digital Repositories
U
n
c
e
r
t
a
i
n
t
y
&
O
r
g
a
n
i
z
a
t
i
o
n
s
:
The Social Construction of Risk in the Audit and
Certification of Trustworthy Digital Repositories
R
e
b
e
c
c
a
D
.
F
r
a
n
k
Ph.D. Candidate
University of Michigan School of Information
frankrd
[ at]
umich
[dot]
edu
@frankrd
SAA Research Forum
Portland, OR
25
July 2017
B
a
c
k
g
r
o
u
n
d
2
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
D
i
g
i
t
a
l
P
r
e
s
e
r
v
a
t
i
o
n
&
R
i
s
k
“risk is defined as the combination of the
probability of an event and its consequences”
3
Barateiro, J., Antunes, G., Freitas, F., & Borbinha, J. (2010). Designing Digital Preservation
Solutions: A Risk Management-Based Approach.
International Journal of Digital Curation
,
5
(1), 4–17. https://doi.org/10.2218/ijdc.v5i1.140
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
T
h
e
o
r
e
t
i
c
a
l
F
r
a
m
e
w
o
r
k
4
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
R
e
s
e
a
r
c
h
Q
u
e
s
t
i
o
n
s
•
How do standards developers and auditors conceptualize risk in the
context of ISO 16363?
•
What are the differences and similarities by which standards
developers and auditors understand risk as it has been communicated
by ISO 16363?
•
To what degree do the following seven factors come into play in the
assessment of risk for digital repositor
ies
: communication, complexity,
expertise, organizations, trust, uncertainty, and vulnerability?
5
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
M
e
t
h
o
d
s
6
https://flic.kr/p/ovj778
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
D
a
t
a
C
o
l
l
e
c
t
i
o
n
7
(*Note: 9/10 participants from the PTAB group
were asked this question during the interview.)
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
P
a
r
t
i
c
i
p
a
n
t
s
8
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
F
i
n
d
i
n
g
s
9
https://flic.kr/p/ovj778
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
10
S
o
u
r
c
e
s
o
f
R
i
s
k
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
S
o
u
r
c
e
s
o
f
R
i
s
k
:
F
i
n
a
n
c
i
a
l
“
Financial
. It seems like storage always seems to
be an issue. I think staff expertise has to be hired
and as repositories grow more people are required
and with greater realms of expertise. So
it's all
finance
.” (CRL_04)
11
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
S
o
u
r
c
e
s
o
f
R
i
s
k
:
T
e
c
h
n
o
l
o
g
y
“A
change in technology
. The idea that you really
have to have somebody watching what's going on
all the time.” (PTAB_01)
Rebecca D. Frank
12
SAA Research Forum
Portland, OR
25
July 2017
F
a
c
t
o
r
s
i
n
t
h
e
S
o
c
i
a
l
C
o
n
s
t
r
u
c
t
i
o
n
o
f
R
i
s
k
13
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
U
n
c
e
r
t
a
i
n
t
y
“It is almost
impossible to prove success
…
you
really cannot prove the long term digital
preservation success to the satisfaction of your
donors or your financial supporters.” (PTAB_06)
14
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
O
r
g
a
n
i
z
a
t
i
o
n
s
“It would be
organizational support
. Bottom line is
it's a tremendous amount of resources required to
do long-term preservation. Organizational
commitment to those types of resources often
waxes and wanes
.” (CRL_06)
Rebecca D. Frank
15
SAA Research Forum
Portland, OR
25
July 2017
T
h
e
o
r
e
t
i
c
a
l
F
r
a
m
e
w
o
r
k
16
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
N
e
x
t
S
t
e
p
s
17
https://flic.kr/p/ovj778
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
N
e
x
t
S
t
e
p
s
•
Additional risks identified across
interviews
•
Combine with data from interviews with repository staff
–
(n=21)
•
Explore additional factors
–
e.g. Political Culture
•
Look for co-occurring factors
18
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
A
c
k
n
o
w
l
e
d
g
m
e
n
t
s
•
Advisor:
–
E
l
i
z
a
b
e
t
h
Y
a
k
e
l
,
P
h
.
D
.
,
U
n
i
v
e
r
s
i
t
y
o
f
M
i
c
h
i
g
a
n
S
c
h
o
o
l
o
f
I
n
f
o
r
m
a
t
i
o
n
•
Committee:
–
P
a
u
l
C
o
n
w
a
y
,
P
h
.
D
.
,
U
n
i
v
e
r
s
i
t
y
o
f
M
i
c
h
i
g
a
n
S
c
h
o
o
l
o
f
I
n
f
o
r
m
a
t
i
o
n
–
P
a
u
l
C
o
u
r
a
n
t
,
P
h
.
D
.
,
U
n
i
v
e
r
s
i
t
y
o
f
M
i
c
h
i
g
a
n
F
o
r
d
S
c
h
o
o
l
o
f
P
u
b
l
i
c
P
o
l
i
c
y
&
S
c
h
o
o
l
o
f
I
n
f
o
r
m
a
t
i
o
n
–
S
h
o
b
i
t
a
P
a
r
t
h
a
s
a
r
a
t
h
y
,
P
h
.
D
.
,
U
n
i
v
e
r
s
i
t
y
o
f
M
i
c
h
i
g
a
n
F
o
r
d
S
c
h
o
o
l
o
f
P
u
b
l
i
c
P
o
l
i
c
y
19
Rebecca D. Frank
SAA Research Forum
Portland, OR
25
July 2017
U
n
c
e
r
t
a
i
n
t
y
&
O
r
g
a
n
i
z
a
t
i
o
n
s
:
The Social Construction of Risk in the Audit and
Certification of Trustworthy Digital Repositories
Rebecca D. Frank
@frankrd
frankrd
[ at]
umich
[dot]
edu
SAA Research Forum
Portland, OR
25
July 2017
This research explores the social construction of risk in the audit and certification of trustworthy digital repositories, focusing on the context of ISO 16363. It examines how standards developers and auditors conceptualize risk, differences and similarities in understanding risk based on ISO 16363, and the factors influencing risk assessment in digital repositories.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
SAA Research Forum Portland, OR 25 July 2017 Uncertainty & Organizations: The Social Construction of Risk in the Audit and Certification of Trustworthy Digital Repositories Rebecca D. Frank Ph.D. Candidate University of Michigan School of Information frankrd [ at] umich [dot] edu @frankrd
SAA Research Forum Portland, OR 25 July 2017 Background Rebecca D. Frank 2
SAA Research Forum Portland, OR 25 July 2017 Digital Preservation & Risk risk is defined as the combination of the probability of an event and its consequences Barateiro, J., Antunes, G., Freitas, F., & Borbinha, J. (2010). Designing Digital Preservation Solutions: A Risk Management-Based Approach. International Journal of Digital Curation, 5(1), 4 17. https://doi.org/10.2218/ijdc.v5i1.140 Rebecca D. Frank 3
SAA Research Forum Portland, OR 25 July 2017 Theoretical Framework 4 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Research Questions How do standards developers and auditors conceptualize risk in the context of ISO 16363? What are the differences and similarities by which standards developers and auditors understand risk as it has been communicated by ISO 16363? To what degree do the following seven factors come into play in the assessment of risk for digital repositories: communication, complexity, expertise, organizations, trust, uncertainty, and vulnerability? 5 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Methods https://flic.kr/p/ovj778 6 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Data Collection Interviews n CRL: TRAC Auditors, Audit Advisory Panel Members 10 PTAB: Standards Developers, PTAB Board Members (now accredited to conduct ISO 16363 audits) 10* (*Note: 9/10 participants from the PTAB group were asked this question during the interview.) 7 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Participants CRL PTAB Total 4 0 4 Administration 6 6 12 Role Digital Preservation 0 3 3 IT 10 9 19 Total 8 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Findings https://flic.kr/p/ovj778 9 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Sources of Risk Risk Sources CRL PTAB Number of Interviewees (total) 8 5 13 Financial 6 8 14 Technology 7 2 9 Governance 3 5 8 Processes 2 1 3 People 1 1 2 Legal 10 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Sources of Risk: Financial Financial. It seems like storage always seems to be an issue. I think staff expertise has to be hired and as repositories grow more people are required and with greater realms of expertise. So it's all finance. (CRL_04) 11 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Sources of Risk: Technology A change in technology. The idea that you really have to have somebody watching what's going on all the time. (PTAB_01) 12 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Factors in the Social Construction of Risk Risk Factors TRAC PTAB Number of interviewees (total) Uncertainty 4 7 11 Organizations 7 0 7 Vulnerability 3 2 5 Communication 1 3 4 Expertise 1 2 3 Trust 2 1 3 Complexity 0 0 0 13 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Uncertainty It is almost impossible to prove success you really cannot prove the long term digital preservation success to the satisfaction of your donors or your financial supporters. (PTAB_06) Rebecca D. Frank 14
SAA Research Forum Portland, OR 25 July 2017 Organizations It would be organizational support. Bottom line is it's a tremendous amount of resources required to do long-term preservation. Organizational commitment to those types of resources often waxes and wanes. (CRL_06) 15 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Theoretical Framework 16 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Next Steps https://flic.kr/p/ovj778 17 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Next Steps Additional risks identified across interviews Combine with data from interviews with repository staff (n=21) Explore additional factors e.g. Political Culture Look for co-occurring factors 18 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Acknowledgments Advisor: Elizabeth Yakel, Ph.D., University of Michigan School of Information Committee: Paul Conway, Ph.D., University of Michigan School of Information Paul Courant, Ph.D., University of Michigan Ford School of Public Policy & School of Information Shobita Parthasarathy, Ph.D., University of Michigan Ford School of Public Policy 19 Rebecca D. Frank
SAA Research Forum Portland, OR 25 July 2017 Uncertainty & Organizations: The Social Construction of Risk in the Audit and Certification of Trustworthy Digital Repositories Rebecca D. Frank @frankrd frankrd [ at] umich [dot] edu
