Do we need a feminist bibliometrics? Gendered practices in academia
undefined
D
r
C
l
a
i
r
e
D
o
n
o
v
a
n
R
e
a
d
e
r
i
n
S
c
i
e
n
c
e
P
o
l
i
c
y
&
R
e
s
e
a
r
c
h
G
o
v
e
r
n
a
n
c
e
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
O
v
e
r
v
i
e
w
:
t
h
e
G
E
S
S
p
r
o
j
e
c
t
•
Australian Research Council Discovery Grant, ‘Gendered Excellence in the Social
Sciences’, AUD $397,500http://genderinstitute.anu.edu.au/gess/about-the-project
•
Fiona Jenkins, Helen Keane, Marian Sawer (ANU), Claire Donovan (International Partner)
•
critical account of excellence: how far are social sciences hamstrung by the same obstacles to
gender equality that affect the wider public sphere?
•
excellence of social science research integrally involves an equity component
•
intellectual and structural obstacles to women’s advancement in academia affects our capacity to
produce gendered understandings of the social and political world
•
understanding how gender inequality is perpetuated within socially critical academic fields has wide
repercussions for evaluating the kinds of knowledge produced within mainstream social science and
in assessing likely gaps
•
ANU Gender Institute Signature Event:
Excellence and Gender Equality: Critical
Perspectives on Gender and Knowledge in the Humanities and Social Sciences
, 26-28
June 2019perspectives-gender-and-knowledge-humanities-and-socialhttp://genderinstitute.anu.edu.au/excellence-and-gender-equality-critical-
30 May 2019
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
2
C
o
n
t
e
x
t
:
‘
e
x
c
e
l
l
e
n
c
e
’
a
n
d
g
e
n
d
e
r
i
n
e
q
u
i
t
y
•
Extensive evidence of gendered practices in Higher Education affecting
women’s career progression in STEM and HASS fields:
•
recruitment (Nielsen 2015; O’Connor & O’Hagan, 2015; Moss-Racusin
et al.
, 2012;
Castilla & Bernard, 2010)
•
gaining promotion / tenure (Weisshaar, 2017; Fox, 2005)
•
‘excellence’ (Rees, 2011)
•
teaching evaluations (Mengel, 2018; MacNell
et al.
, 2015)
•
winning research grants (Bornmann
et al.
, 2007)
•
impact on society (Savigny, 2019)
•
publication
30 May 2019
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
3
P
u
b
l
i
c
a
t
i
o
n
a
n
d
g
e
n
d
e
r
i
n
e
q
u
i
t
y
•
Evidence of gendered practices in Higher Education affecting publication:
•
productivity (Aiston & Jung, 2015; West
et al
., 2013)
•
peer review (Roberts
et al.
, 2016; Budden
et al.
, 2008)
“Of course, female academics do get published, but that’s only half the battle”
Criado-Perez (2019: 96)
•
Evidence of gendered practices affecting citation numbers:
•
Gender citation gap (Dion
et al.
2018)
•
lower visibility of feminist research and gender studies (Criado-Perez, 2019; Pearse
et al.
, 2019)
30 May 2019
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
4
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
5
Source: Strumia (2018)
https://www.slideshare.net/telescoper/theory-gender-talk/15
Example of bad practice
B
i
b
l
i
o
m
e
t
r
i
c
s
a
n
d
g
e
n
d
e
r
i
n
e
q
u
i
t
y
•
Bibliometrics (scientific analysis of ‘quality’ of academic publications using
data on publication productivity and citation numbers) challenged as objective
basis for decision making
•
high profile egregious use of citation data (Strumia, 2018) and public outcry
•
yet routine use of citation data for hiring, promotion / tenure, performance review
•
Design of bibliometric indicators can produce negative effects
•
unreflexive use of data (not adjusting for field-specific context)
•
example of CABS journal rankings and gender studies (Tourish & Wilmott, 2015)
•
Use of bibliometric data can challenge gendered assumptions about
academic practice
•
Pearse
et al.,
2019;
van Arensbergen
et al.
(2012); Halsey (2004)
30 May 2019
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
6
B
e
s
t
p
r
a
c
t
i
c
e
•
11 REF2021 panels will use citation data in the assessment of ‘quality’
•
The Metric Tide (2015) no recommendations regarding gender
•
The Leiden Manifesto (2015) no mention of gender
•
ISRIA (2016) call for research institutions, funders and evaluators to integrate
gender equity into research funding, research design, and impact
assessment:
•
who guards the guardians?
•
what is ‘feminist’ scholarship
30 May 2019
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
7
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
•
Following the example of feminist economics
•
Accepting that bibliometric data are socially constructed, and the need for
indicator design to be gender sensitive
•
A fresh approach to bibliometrics and research evaluation that
•
exposes and removes gendered assumptions and biases
•
gives visibility to feminist research and gender studies
•
What would a feminist bibliometrics look like?
•
transparency
•
liberal feminism vs. cultural feminism
30 May 2019
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
8
T
r
a
n
s
p
a
r
e
n
c
y
•
Data on gender is not routinely collected by publishers
•
e.g. ORCID provides a unique person identifier but does not collect personal data
•
Sophisticated data analysis relies on processing large datasets using gender
assignment algorithms and even facial analysis algorithms
•
Mihaljevic
et al.
(2019):
•
lack of data transparency and reproducibility
•
binary data approach excludes transgender authors (‘misgendering’)
•
error rate in assigning gender unknown
•
caution needed to minimise objectification and not reinforce existing inequalities
30 May 2019
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
9
F
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
•
Liberal feminism
•
improve bibliometrics within the existing system so that there is equitable treatment
for all
•
ensure bibliometric data is contextualised and gender inclusive
•
ensure gender diversity on panels using bibliometric data to arrive at judgements
about research quality
•
Cultural feminism
•
eschew bibliometrics and rankings as manifestations of NPM / neoliberalism…
•
…or create new indicators based on feminist values (inclusivity, compassion)
•
use women-led panels using contextualised bibliometric data to arrive at judgements
about academic research quality
30 May 2019
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
10
C
o
n
c
l
u
s
i
o
n
•
extensive evidence of gender bias affecting women’s academic career
progression
•
current collection of gender data not transparent or replicable, has unknown
error rates, and ‘misgenders’ authors
•
bibliometrics a ‘technology of governance’ as unreflexive use may objectify
data and reinforce existing inequalities
•
a (liberal) feminist bibliometrics could lead to best practice in data collection
and analysis
•
a (liberal) feminist bibliometrics could make feminist research and gender
studies more visible
•
a good start would be to collect data from authors who autonomously define
their gender
30 May 2019
D
o
w
e
n
e
e
d
a
f
e
m
i
n
i
s
t
b
i
b
l
i
o
m
e
t
r
i
c
s
?
11
Gendered practices in academia affecting women's career progression, research output, and citation numbers are explored in the context of feminist bibliometrics. Issues of gender equality, excellence, and equity in social science research are raised, highlighting the importance of evaluating knowledge production through a feminist lens.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
Do we need a feminist bibliometrics? Dr Claire Donovan Reader in Science Policy & Research Governance
Overview: the GESS project 30 May 2019 Australian Research Council Discovery Grant, Gendered Excellence in the Social Sciences , AUD $397,500 http://genderinstitute.anu.edu.au/gess/about-the-project Fiona Jenkins, Helen Keane, Marian Sawer (ANU), Claire Donovan (International Partner) critical account of excellence: how far are social sciences hamstrung by the same obstacles to gender equality that affect the wider public sphere? excellence of social science research integrally involves an equity component intellectual and structural obstacles to women s advancement in academia affects our capacity to produce gendered understandings of the social and political world understanding how gender inequality is perpetuated within socially critical academic fields has wide repercussions for evaluating the kinds of knowledge produced within mainstream social science and in assessing likely gaps ANU Gender Institute Signature Event: Excellence and Gender Equality: Critical Perspectives on Gender and Knowledge in the Humanities and Social Sciences, 26-28 June 2019 http://genderinstitute.anu.edu.au/excellence-and-gender-equality-critical- perspectives-gender-and-knowledge-humanities-and-social 2 Do we need a feminist bibliometrics? Brunel University London
Context: excellence and gender inequity 30 May 2019 Extensive evidence of gendered practices in Higher Education affecting women s career progression in STEM and HASS fields: recruitment (Nielsen 2015; O Connor & O Hagan, 2015; Moss-Racusin et al., 2012; Castilla & Bernard, 2010) gaining promotion / tenure (Weisshaar, 2017; Fox, 2005) excellence (Rees, 2011) teaching evaluations (Mengel, 2018; MacNell et al., 2015) winning research grants (Bornmann et al., 2007) impact on society (Savigny, 2019) publication 3 Do we need a feminist bibliometrics? Brunel University London
Publication and gender inequity 30 May 2019 Evidence of gendered practices in Higher Education affecting publication: productivity (Aiston & Jung, 2015; West et al., 2013) peer review (Roberts et al., 2016; Budden et al., 2008) Of course, female academics do get published, but that s only half the battle Criado-Perez (2019: 96) Evidence of gendered practices affecting citation numbers: Gender citation gap (Dion et al. 2018) lower visibility of feminist research and gender studies (Criado-Perez, 2019; Pearse et al., 2019) 4 Do we need a feminist bibliometrics? Brunel University London
Source: Strumia (2018) https://www.slideshare.net/telescoper/theory-gender-talk/15 5 Do we need a feminist bibliometrics? Brunel University London
Bibliometrics and gender inequity 30 May 2019 Bibliometrics (scientific analysis of quality of academic publications using data on publication productivity and citation numbers) challenged as objective basis for decision making high profile egregious use of citation data (Strumia, 2018) and public outcry yet routine use of citation data for hiring, promotion / tenure, performance review Design of bibliometric indicators can produce negative effects unreflexive use of data (not adjusting for field-specific context) example of CABS journal rankings and gender studies (Tourish & Wilmott, 2015) Use of bibliometric data can challenge gendered assumptions about academic practice Pearse et al., 2019; van Arensbergen et al. (2012); Halsey (2004) 6 Do we need a feminist bibliometrics? Brunel University London
Best practice 30 May 2019 11 REF2021 panels will use citation data in the assessment of quality The Metric Tide (2015) no recommendations regarding gender The Leiden Manifesto (2015) no mention of gender ISRIA (2016) call for research institutions, funders and evaluators to integrate gender equity into research funding, research design, and impact assessment: who guards the guardians? what is feminist scholarship 7 Do we need a feminist bibliometrics? Brunel University London
Do we need a feminist bibliometrics? 30 May 2019 Following the example of feminist economics Accepting that bibliometric data are socially constructed, and the need for indicator design to be gender sensitive A fresh approach to bibliometrics and research evaluation that exposes and removes gendered assumptions and biases gives visibility to feminist research and gender studies What would a feminist bibliometrics look like? transparency liberal feminism vs. cultural feminism 8 Do we need a feminist bibliometrics? Brunel University London
Transparency 30 May 2019 Data on gender is not routinely collected by publishers e.g. ORCID provides a unique person identifier but does not collect personal data Sophisticated data analysis relies on processing large datasets using gender assignment algorithms and even facial analysis algorithms Mihaljevic et al. (2019): lack of data transparency and reproducibility binary data approach excludes transgender authors ( misgendering ) error rate in assigning gender unknown caution needed to minimise objectification and not reinforce existing inequalities 9 Do we need a feminist bibliometrics? Brunel University London
Feminist bibliometrics 30 May 2019 Liberal feminism improve bibliometrics within the existing system so that there is equitable treatment for all ensure bibliometric data is contextualised and gender inclusive ensure gender diversity on panels using bibliometric data to arrive at judgements about research quality Cultural feminism eschew bibliometrics and rankings as manifestations of NPM / neoliberalism or create new indicators based on feminist values (inclusivity, compassion) use women-led panels using contextualised bibliometric data to arrive at judgements about academic research quality 10 Do we need a feminist bibliometrics? Brunel University London
Conclusion 30 May 2019 extensive evidence of gender bias affecting women s academic career progression current collection of gender data not transparent or replicable, has unknown error rates, and misgenders authors bibliometrics a technology of governance as unreflexive use may objectify data and reinforce existing inequalities a (liberal) feminist bibliometrics could lead to best practice in data collection and analysis a (liberal) feminist bibliometrics could make feminist research and gender studies more visible a good start would be to collect data from authors who autonomously define their gender 11 Do we need a feminist bibliometrics? Brunel University London
