VQR 2015-2019: Assessing Third Mission and Impact Case Studies
Evaluation of the third mission and impact case studies in VQR 2015-2019, focusing on Italian national research assessment exercise results, third mission activities, and innovative evaluation approaches utilizing case studies. The quality profiles of third mission activities at institution and department levels are assessed through submitted case studies. The process involves disciplinary panels and the GEV.TM's public call for panelist recruitment.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
Assessing Third mission and impact case studies in VQR 2015-2019 Brigida Blasi Head of Evaluation Unit Third Mission & Societal Impact
VQR 2015-2019 Third round of the Italian national research assessment exercise Period: 2015-2019 Object: 1. the results of the scientific research achieved in the ev. period 2. Third Mission activities generating impact in the ev. period Targets: Universities PROs other research institutions (also private) upon request Units of Assessment: whole institution and internal divisions (departments)
VQR main innovations VQR 2015-2019 Call: Number of research outputs to be submitted per institution Panel recruitment process and eligibility criteria Open Access Rating not ranking: quality profiles Third mission and impact evaluation: case study Case study approach (previous round: indicator-based peer review)
Third Mission Each evaluated institution submits a set of Third mission case studies, as a selection of the impacts generated by the department/institution s activities. The number of required case studies has been established in the VQR Call The quality of the submitted case studies will be assessed and expressed into a 5-point rating scale Results: quality profile of Third Mission at institution and department level
VQR Panels Mathematics and Computer Sciences Physics Chemistry Earth Sciences Biology Medicine Agricultural and veterinary sciences Architecture Civil Engineering Industrial and Information Engineering Ancient History, Philology, Literature and Art History History, Philosophy, Pedagogy Psychology Law Economics and Statistics Economics and Management Political and Social Sciences Third mission Group of Evaluation (GEV TM) 17 Disciplinary panels 1 Interdisciplinary panel
GEV TM Public call n. 1/2020 for disciplinary panels and first half of the TM panel > high scientific qualification and international experience in the field of research and its evaluation + third mission experience Eligibility: Italian and foreign researchers in service in an Italian or foreign University or research institute (EPR), with at least 3 scientific publications with ISBN / ISSN / ISMN or indexed in WOS or Scopus in the period 1st January 2015 31st December 2019. Candidates should also possess at least two of the following qualifications: Full professor, Research Director of research institutes or equivalent in Italy or OECD Countries Associate Professor or researcher working in possess of the Italian scientific qualification for the role of full professor; Awarded with the Research programme Rita Levi Montalcini or SIR; Membership in the lists for the role of National Scientific Habilitation Commissioner; For Full and Associate Professors: Director of a PhD Programme in Italy or equivalent abroad for at least one cycle, starting from the XXXI cycle; For Associate Professors: Phd academic staff for four cycles in an Italian University or equivalent abroad; For University and EPR researchers: Phd academic staff for two cycles in an Italian University or equivalent abroad Principal Investigator (PI) or local coordinator for ERC or Marie Curie or FP7 or Horizon 2020 or PRIN project in the period 2009- 2019; Member of international assessment committees for ERC projects or in exercises with purposes similar to the VQR (for instance REF, ERA, ANECA, HCERES) For the TM panel, in addition to these requirements: experience of at least 5 years of work in a technology transfer office or in an office of valorisation of research results in the society and/or managerial position regarding Third Mission activities experience of at least 3 years with specific appointments in areas related to technology transfer or in any case to the valorisation of research results in the society
GEV TM Public call n. 2/2020 for the second half of the TM panel > third mission professionals Eligibility: experts who are in possession of at least one of the following qualifications: Manager of public or private administrations, expert in the areas of valorisation of research results in the society; National and international expert, engaged in the dissemination of the open science approach with respect to research data and results; Expert from independent national authorities or international organizations involved in programs for impact assessment of activities of valorisation of research results in the society; Responsible for structured collaboration programs between companies and/or public administrations and research institutions and /or open innovation programs, with at least 3 years of experience; President or director of incubators connected to research institutions, with at least 3 years of experience; President/CEO/partner of asset management companies or investment companies/funds, with documented collaboration activities with research institutions; President or director of foundations operating in the field of valorisation of research results, with at least 3 years of experience; President or director of structures (e.g. science or technology parks, museums, 'science centres ) operating in the field of valorisation of research results, with at least 3 years of experience; President or director of associations/bodies operating in the field of valorisation of research results (e.g. NETVAL, PNI, UIBM)
GEV TM Composition Call 1/2020 LONGHI Sauro Universit Politecnica delle Marche ADINOLFI Paola Universit di Salerno AIME Silvio Universit di Torino CAPIETTO Anna Universit di Torino MATTEI Paola Universit di Milano GRIMALDI Rosa Universit di Bologna LISSONI Francesco Universit de Bordeaux LOMBARDI Patrizia Politecnico di Torino OROFINO Giulia Universit di Cassino PIPAN Michele Universit di Trieste RUGGIERI Alessandro Universit della Tuscia SERRA* Pier Andrea Universit di Sassari STRIANO Maura Universit di Napoli Federico II SVELTO Maria Universit di Bari ZENO ZENCOVICH Vincenzo Universit di Roma Tre Call 2/2020 Puglia Region Confindustria Bologna University Museum System Materias S.R.L. Research and Third Mission Office - Sapienza University of Roma Public Engagement Office - Istituto Nazionale di Fisica Nucleare APENET-Italian network of the Universities and Research Institutes for Public Engagement Balab - Contamination Lab Bic Incubatori Friuli Venezia Giulia IMAST Technological district for the engineering of polymeric and composite materials and structures Communication Office - Universit del Piemonte Orientale CAP Centre for Lifelong Learning Pordenone Technological Pole Ministry of Cultural Heritage and Activities Turin Egyptian Museum AGRIMI AMODIO BALZANI CAMMARANO CAMMISA CHIARELLI DE BORTOLI DE GENNARO GEROMETTA MILELLA POMATI SCARDIGNO SCOLARI TARASCO TOEPFER Adriana Nicoletta Roberto Aniello Antonella Giorgio Andrea Maurilio Gianluigi Giorgio Evelina Paolo Anna Fausta Giovanni Francesco Antonio Susanne
Timetable revised due to COVID-19 2020: January 3st: Publication of the VQR Call for Participation January 31st: Publication of the public calls for the panel recruitment September 25: Announcement of revised timetable October 8: Appointment of panel members 2021: January 22: publication of the document on the evaluation panel criteria January 29: publication of the document on submission procedures February 22- April 23/May 7: submission of case studies by Universities and Research Organizations June 1 December 31, - May 31st, 2021: case studies evaluation by GEV TM 2022: June 30, 2022: Publication of results and list of assessed case studies
Case study selection Specific examples of Third Mission with impacts in period 2015-19 set out in case studies The definition of impact is totally open but the case studies should be related to 10 areas of impact (fields of action) The impact described should be corroborated through a set of indicators and evidences chosen by each institutions, pertinent and meaningful to demonstrate the differences compared to the starting situation Expected case studies: ~700 (130 institutions)
10 areas of impact Intellectual and industrial property valorisation (patents, plant varieties and other products); Academic entrepreneurship (e.g. spin-off and start-up companies); Technology transfer structures and other Third mission intermediaries (e.g. technology transfer offices, incubators, science and technology parks, consortia and associations for Third mission); Production and management of artistic and cultural heritage (e.g. museum poles, archaeological excavations, music activities, historical buildings and archives, historical libraries, theatres and sports facilities); (next slide)
10 areas of impact Clinical experimentations and health protection (e.g. clinical trials, studies on medical devices, non- interventional studies, patients empowerment initiatives, biobanks, veterinary clinics, information and prevention days, screening and awareness campaigns); Lifelong learning and open education (e.g. continuous education courses, Continuing Medical Education courses, MOOCs); Public Engagement (community events, science popularization, citizen science interaction with schools) Production of public goods and policy instruments for inclusion (e.g. public policy making/formulation, local development and urban regeneration programs, participatory democracy initiatives, consensus conferences, citizen panels); Innovative tools to support Open Science; Activities related to the UN 2030 Agenda for Sustainable Development Goals.
Criteria a) Social, economic and cultural dimension of the impact; b) Relevance in relation to the context; c) Added value for the beneficiaries; d) Contribution of the department or similar structure, highlighting the scientific linkage if relevant The relation with research results is not taken for granted and involved in the evaluation only if relevant for the type of initiative and impact The GEV TM will qualify and assign weights for each according to the areas of impact (document on the evaluation panel criteria, to be published by January 22, 2021)
Ratings A. B. C. D. E. Excellent and extremely relevant Excellent Standard Sufficiently relevant Scarcely relevant or not acceptable
Ratings A. B. C. D. E. Excellent and extremely relevant Excellent Standard Sufficiently relevant Scarcely relevant or not acceptable Excellent and extremely relevant: the case study is clearly described and the impact achieved in its field of action is evident and very substantial. The contribution of the submitting institution has been crucial in generating the impact. Where relevant, a strong link with the institutions scientific results is also evident. The results achieved are also corroborated by the set of proposed indicators that are completely pertinent. The impact is highly significant in social, economic and cultural terms and the intervention has created a high added value for a large and diverse audience of beneficiaries.
ANVUR VQR-Third Mission Working Group Governing Board Prof. Antonio Uricchio (President); Prof. Alessandra Celletti (Vice-President of the Board of Directors and VQR Delegate); Prof. Marilena Maniaci (Delegate for Internationalisation); Prof. Menico Rizzi; Prof. Massimo Tronci Director Daniele Livon Research Evaluation Manager Marco Malgarini Third Mission/Impact Evaluation Unit Brigida Blasi Sandra Romagnosi VQR - GEV TM Coordinator Sauro Longhi VQR - GEV TM Assistants Virginia Zambrano Renata Adami name.surname@anvur.it
