Conducting an Outcomes Review Meeting for Program Analysis

Slide Note

This document discusses the process of conducting an outcomes review meeting as a method for program analysis in the context of a CME program. It outlines the objectives, program analysis criteria, and self-study questions related to evaluating the effectiveness of CME activities in meeting the provider's mission. The review covers aspects such as data collection, analysis, drawing conclusions, and assessing the degree of meeting expected results based on learner change data.

rayden Follow

Uploaded on Mar 26, 2024 | 3 Views

Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript

CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANALYSIS

OBJECTIVES Apply the closure process of project management to analyzing the CME program. Establish a purposeful, reflective process to evaluate the CME program. 2023 CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2

PROGRAM ANALYSIS CRITERION The provider gathers data and conducts a program-based analysis on the degree to which the CME mission of the provider has been met through the conduct of CME activities/educational interventions. CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 20XX 3

PROGRAM ANALYSIS CRITERION The provider gathers data and conducts a program-based analysis on the degree to which the CME mission of the provider has been met through the conduct of CME activities/educational interventions. CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 20XX 4

PROGRAM ANALYSIS CRITERION The provider gathers data and conducts a program-based analysis on the degree to which the CME mission of the provider has been met through the conduct of CME activities/educational interventions. CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 20XX 5

PROGRAM ANALYSIS CRITERION The provider gathers data and conducts a program-based analysis on the degree to which the CME mission of the provider has been met through the conduct of CME activities/educational interventions. Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 20XX 6

PROGRAM ANALYSIS CRITERION 1.Collect Data 2.Analyze Data 3.Draw Conclusions CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 20XX 7

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM THE COMPLIANCE LIBRARY Every year we send a survey to the participants in our CME program. Over the course of our accreditation, these surveys have indicated an 87% satisfaction rate with the CME program. Is this example compliant or noncompliant with the criterion? Green Card: YES: Compliant Orange Card: Maybe Red Card: NO: Noncompliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 8 This Photo by Unknown Author is licensed under CC BY-SA

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM THE COMPLIANCE LIBRARY Every year we send a survey to the participants in our CME program. Over the course of our accreditation, these surveys have indicated an 87% satisfaction rate with the CME program. Is this example compliant or noncompliant with the criterion? Answer: No: Noncompliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 9 This Photo by Unknown Author is licensed under CC BY-SA

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM THE COMPLIANCE LIBRARY Every year we send a survey to the participants in our CME program. Over the course of our accreditation, these surveys have indicated an 87% satisfaction rate with the CME program. Is this example compliant or noncompliant with the criterion? Answer: No: Noncompliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 10 This Photo by Unknown Author is licensed under CC BY-SA

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM REACCREDITATION MATERIALS Providers are meeting our quality metric goals for data by answering yes activities are influencing knowledge, skills, practice, and competence. In addition, the CME committee collaborates with the Quality and Risk department to improve quality of care and our patient outcomes, particularly those addressed by educational offerings. Is this example compliant or noncompliant with the criterion? Green Card: YES: Compliant Orange Card: Maybe Red Card: NO: Noncompliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 11 This Photo by Unknown Author is licensed under CC BY-SA

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM REACCREDITATION MATERIALS Providers are meeting our quality metric goals for data by answering yes activities are influencing knowledge, skills, practice, and competence. In addition, the CME committee collaborates with the Quality and Risk department to improve quality of care and our patient outcomes, particularly those addressed by educational offerings. Is this example compliant or noncompliant with the criterion? Answer: YES: Compliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 12 This Photo by Unknown Author is licensed under CC BY-SA

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM REACCREDITATION MATERIALS The data collected from our accreditation term indicates that 91% of learners on average believed that the CME activities in which they participated enhanced their competence. Based on the accumulated data, we believe that we have been successful in our mission to enhance learner competence. Is this example compliant or noncompliant with the criterion? Green Card: YES: Compliant Orange Card: Maybe Red Card: NO: Noncompliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 13 This Photo by Unknown Author is licensed under CC BY-SA

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM REACCREDITATION MATERIALS The data collected from our accreditation term indicates that 91% of learners on average believed that the CME activities in which they participated enhanced their competence. Based on the accumulated data, we believe that we have been successful in our mission to enhance learner competence. Is this example compliant or noncompliant with the criterion? Answer: YES: Compliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 14 This Photo by Unknown Author is licensed under CC BY-SA

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM REACCREDITATION MATERIALS The data collected from our accreditation term indicates that 91% of learners on average believed that the CME activities in which they participated enhanced their competence. Based on the accumulated data, we believe that we have been successful in our mission to enhance learner competence. Is this example compliant or noncompliant with the criterion? Answer: YES: Compliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 15 This Photo by Unknown Author is licensed under CC BY-SA

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM REACCREDITATION MATERIALS The data collected from our accreditation term indicates that 91% of learners on average believed that the CME activities in which they participated enhanced their competence. Based on the accumulated data, we believe that we have been successful in our mission to enhance learner competence. Is this example compliant or noncompliant with the criterion? Answer: YES: Compliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 16 This Photo by Unknown Author is licensed under CC BY-SA

Self-Study Question: Describe your conclusions on the degree to which you have met the expected results of your mission. These conclusions should be based on the data you have obtained in your analysis of learner change across your overall program of accredited activities. FROM REACCREDITATION MATERIALS The data collected from our accreditation term indicates that 91% of learners on average believed that the CME activities in which they participated enhanced their competence. Based on the accumulated data, we believe that we have been successful in our mission to enhance learner competence. Is this example compliant or noncompliant with the criterion? Answer: YES: Compliant CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 17 This Photo by Unknown Author is licensed under CC BY-SA

MEETING THE PROGRAM ANALYSIS CRITERION The provider gathers data and conducts a program-based analysis on the degree to which the CME mission of the provider has been met through the conduct of CME activities/educational interventions. DEPENDENT ON ANALYZES CHANGE Collect data on changes in learner s competence or performance or patient outcomes Draw conclusions as to whether individual activities were effective in causing change TIED TO MISSION Improving Competence, Performance, and/or Patient Outcomes Has the CME Program met its mission? Provide data to support your conclusion PROGRAM ANALYSIS ANALYZES CHANGE MISSION 2023 CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 18

HOW DOES YOUR ORGANIZATION PERFORM A PROGRAM ANALYSIS?

PROJECT MANAGEMENT METHODOLOGY: OUTCOMES REVIEW MEETING

PROJECT MANAGEMENT PHASES CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 2023 21

OUTCOMES REVIEW MEETING PROJECT RETROSPECTIVE MEETING Goal: Allow the team to review the project as a whole and resolve any remaining issues before moving on to future projects. LESSONS LEARNED TIMEFRAME PARTICIPANTS AGENDA ACTION STEPS Develop a Plan of Action for future projects. After a project is completed Everyone who contributed to the project. Review project objectives Evaluation performance Discuss what did and didn t go well What did our roadblocks teach us? What can be done differently next time? 2023 CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 22

OUTCOMES REVIEW MEETING FOR PROGRAM ANALYSIS Goal: Review activity data to determine if the CME Program is meeting its mission and to discuss improvements for the program. LESSONS LEARNED TIMEFRAME PARTICIPANTS ANALYSIS ACTION STEPS Determine what needs to be modified for future activities Regular meeting as organization determines CME Committee Planners Presenters Staff Members Examine activity data and draw conclusions including whether activities are meeting the CME mission Honestly discuss what went well and what could be improved Are activities upholding CME requirements? 2023 CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 23

What type of data would you want your organization to review? DISCUSS AGGREGATED DATA DISCLOSURES PRIOR TO START IMPROVE COMPETENCE BIAS PRESENT NUMBER OF PARTICIPANTS PERCENT OF RESPONDENTS ACTIVITY 1 93% 95% 0% 25 68% ACTIVITY 2 94% 89% 3% 56 75% ACTIVITY 3 100% 97% 5% 45 51% MEAN 95.7% 93.7% 2.7% 42 64.7% 2023 CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 24

OUTCOMES REVIEW MEETING Program Improvements Goal: Review activity data to determine if the CME Program is meeting its mission and to discuss improvements for the program. Program Analysis LESSONS LEARNED TIMEFRAME PARTICIPANTS ANALYSIS ACTION STEPS Determine what needs to be modified for future activities Mandatory, regular meeting as organization determines CME Committee Planners Presenters Staff Members Examine activity data, including whether activities are meeting the CME mission Honestly discuss what went well and what could be improved 2023 CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 25

HOW CAN YOU CHANGE YOUR REVIEW METHODS TO INCLUDE PURPOSEFUL REFLECTION OF YOUR PROGRAM?

OUTCOMES REVIEW MEETING STAFF PRIDE AND EMPOWERMENT IMPROVED AWARENESS AND LEARNING FOSTERING TEAM BUILDING LINKING WORK TO MISSION 2023 CONDUCTING AN OUTCOMES REVIEW MEETING AS A METHOD FOR PROGRAM ANLAYSIS 27