Understanding Mixed Methods Research
Mixed methods research combines qualitative and quantitative data collection and analysis techniques to gain a more comprehensive understanding of a research topic. This approach allows researchers to triangulate data, enrich their findings, and provide a more nuanced interpretation of results.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
What are Mixed Methods? Donna M. Mertens, Ph.D., Professor Emeritus, Gallaudet University Economic and Social Research Council National Centre for Research Methods Research Methods Festival Bath, England July 2018
Definition of Mixed Methods 2 Collect and analyze qualitative and quantitative data Integrate the data at various levels and stages of the study In a single study or a sequence of studies Methodologically eclectic Synergy between quantitative and qualitative aspects of the study (Mertens, 2015) July 2018 Mertens What is MM Bath July 2018
Quantitative and Qualitative Design Options that can be combined in mixed methods designs Quantitative approaches such as experimental, quasi-experimental, causal-comparative, correlational, survey, and single-case designs Qualitative approaches such as group processes (e.g., focus groups or some indigenous methods), case studies, ethnography, phenomenological approaches, and PAR Mixed methods are most likely to be the approach of choice when you need to integrate community perspectives into the inquiry process, thus necessitating collection of qualitative data during the evaluation process. (Mertens, 2009, TRE) 3 July 2018 Mertens What is MM Bath July 2018
Frameworks for MM research Anti-paradigm war 4 Post- positivism Pragmatic Constructivist Transformative July 2018 Mertens What is MM Bath July 2018
Post-Positivism and MM 5 Quantitative; Randomized controlled trials (RCTs); MM that emphasis quantitative data Methodology July 2018 Mertens What is MM Bath July 2018
Figure 6.1 An RCT theory of change 6 The causal chain is a black box which we do not need to look inside to establish the causal link between intervention outcome White (2014) In Mertens & Hesse Biber (Eds.), New Directions in Evaluation: Mixed Methods Contribution to Credibility in Evaluation July 2018 Mertens What is MM Bath July 2018
RCTs and research 7 What difference did the intervention make to the state of the world? This question is best answered with a quantitative experimental or quasi-experimental design. A randomized control trial is very likely to be the best available method for addressing this attribution question if it is feasible. White (2014) July 2018 Mertens What is MM Bath July 2018
8 Mixed Methods and Impact research Mixed methods combine the counterfactual analysis from a RCT with factual analysis using quantitative and qualitative data to analyze the causal chain The factual analysis will address such issues as the quality of implementation, targeting, barriers to participation or adoption by intended beneficiaries. White (2014) In Mertens & Hesse Biber (Eds.), New Directions in Evaluation: Mixed Methods Contribution to Credibility in Evaluation July 2018 Mertens What is MM Bath July 2018
Issue: Gender based violence (GBV) and sexual harassment (SH) in schools 9 What can be done to reduce GBV and SH in middle school? How effective is the treatment? How was the treatment implemented? Were appropriate students included? What barriers to participation occurred? July 2018 Mertens What is MM Bath July 2018
Post-Positivist Mixed Methods Design Qual Quant MM Review literature; select intervention Pretest GBV & SH knowledge and attitudes Demographic survey Random assignment to treatment and control conditions Interview re: barriers to participation Implementation evaluation (observation and interviews and document reviews) Post-test of GBV & SH knowledge and attitudes Compare treatment and control 10
Pragmatic Paradigm 11 Match methods to questions; mixed methods Methodology July 2018 Mertens What is MM Bath July 2018
Concurrent Design Quantitative and Qualitative occur more or less simultaneously 12 Quantitative Qualitative Sequential Design: Quantitative Followed by Qualitative OR Sequential Design: Qualitative Followed by Quantitative Qualitative Quantitative July 2018 Mertens What is MM Bath July 2018 Mertens, 2009, TRE, p. 167
research Questions 13 Does the intervention change attitudes of middle school students towards GBV and SH? Do the students gain knowledge about GBV and SH? Was the program implemented according to plan? How willing are teachers to participate? How can the program be improved? July 2018 Mertens What is MM Bath July 2018
Pragmatic Mixed Methods Design Qual Sequential Concurrent Review literature; select intervention Demographic survey Give pre-test to students on knowledge and attitudes Interview teachers to assess willingness to participate Interview re: barriers to participation Implementation evaluation (observation and interviews and document reviews) Post-test of GBV & SH knowledge and attitudes Compare pre to post-test results Interview students and teachers to determine strengths and weaknesses of program 14
Constructivist MM Design 15 Primarily qualitative but with quantitative data added to make a MM design Methodology July 2018 Mertens What is MM Bath July 2018
Sample Constructivist Questions 16 Questions about effectiveness and implementation are still used in this design. Constructivists add questions such as: How well do recruitment procedures work? How well does the intervention respond to the culture and context of the target population? To what extent does the target population reflect the range of diversity with regard to the overall goals of the project? Who is left out? Why? How well does the target population understand what they are consenting to? To what extent do participants accept the outcome/s of randomization? Are participants willing to be randomized? Hesse Biber (2010) July 2018 Mertens What is MM Bath July 2018
Constructivist Mixed Methods Design Qual Concurrent Sequential Interview students re: cultural responsiveness of treatment and implementation processes Interview re: barriers to participation; strategies used to overcome barriers Implementation evaluation (observation and interviews and document reviews) Post-test of GBV & SH knowledge and attitudes Compare pre to post- test results Interview students and teachers to determine strengths and weaknesses of program; ask about cultural responsiveness Interview students about their experiences with GBV and SH Review literature; select intervention Interview staff and students re: recruitment strategies & experiences with GBV and SH Demographic survey; diversity; excluded? Give pre-test to students on knowledge and attitudes Interview teachers to assess willingness to participate Interview students re: consent to be randomized and understanding of concept Randomize willing students to treatments 17
Transformative MM Design 18 Transformative lens; focus on human rights and social justice; culturally responsive; action oriented; mixed methods Methodology July 2018 Mertens What is MM Bath July 2018
19 Cyclical research: Putting it into a transformative mixed methods design Build relationships Context analysis and needs assessment Pilot intervention Process or implementation research Effectiveness: Outcomes or impacts Utilization July 2018 Mertens What is MM Bath July 2018
Generic Transformative Mixed Methods Design Implement intervention Similar data collection as for pilot Add process evaluation of implementa- tion Collect data on unexpected outcomes Use Use findings for transformative purposes Use for policy change Use to refine intervention Use to improve and expand relationships Determine effectiveness Post data collection (indicators, art work, poetry, photos, mapping) Examine relationship quality Build relationships Review literature Individual and group consultation Develop working strategies Contextual analysis Focus groups, surveys, extant data, literature, GIS mapping Identify value positions Develop intervention Pilot intervention Observations, interviews, photo voice, focus groups, surveys, pre/post data collection, team meetings July 2018 Mertens What is MM Bath July 2018
Transformative research Questions: Building Relationships 21 How could you use transformative mixed methods to: identify the cultural norms and beliefs that might be operating in the community? identify dimensions of diversity associated with discrimination and oppression and associated power structures? How would you: take into account the expertise, knowledge, and strengths of the community in order to provide a platform for authentic engagement between the researcher and the community? July 2018 Mertens What is MM Bath July 2018
Transformative MM Context Questions 22 1.What is relevant in this context in terms of history, politics, organizations, cultural groups, power structures, community resilience 2.What issues of discrimination and oppression are relevant in this context? 3.What is the organizational capacity and history with research; what needs to be done in terms of capacity building? 4.What interventions appear to be responsive to the culture and values in this context? July 2018 Mertens What is MM Bath July 2018
Transformative Use Questions 23 What methods can we use to insure: 1.Use findings for transformative purposes (action orientation) 2.Use for policy change 3.Use to refine intervention 4.Use to improve and expand relationships July 2018 Mertens What is MM Bath July 2018
Resources Mertens, D.M. (2018). Mixed Methods Design in Evaluation. Thousand Oaks, CA: SAGE. Mertens, D. M. & Wilson, A. (2012). Program Evaluation Theory and Practice: A Comprehensive Guide. NY: Guilford. Mertens, D. M. (2015). Research and evaluation in education and psychology: Integrating diversity with qual, quant and mixed methods. 4th ed. Thousand Oaks, CA: Sage. Mertens, D. M. (2009). Transformative research & evaluation. NY: Guilford. Mertens, D. M. & Ginsberg, P. (2009).(Eds.) Handbook of Social Research Ethics. Thousand Oaks, CA: Sage. Mertens, D.M., Cram, F., & Chilisa, B. (Eds.) (2013). Indigenous pathways. Walnut Creek, CA: Left Coast Press. 24 July 2018 Mertens What is MM Bath July 2018
Contact information 25 Donna M. Mertens, PhD Independent Consultant Donna.Mertens@Gallaudet.edu July 2018 Mertens What is MM Bath July 2018
