Best Practices in Assessment Group Agenda
The agenda includes meeting objectives, institutional learning outcomes, APAIR planning phase update, information sharing, and review of ILOs mapping exercise results. The meeting aims to discuss issues, determine next steps, review UMB ILOs initiative, and recommend descriptions for what UMB students are expected to know, do, and care about.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Best Practices in Assessment Group Gregory Spengler, MPA Karen D Matthews, DM, MPA Office of Institutional Effectiveness, Strategic Planning, & Assessment (IESPA) April 6, 2021 1
Agenda Announcements Meeting Objectives Institutional Learning Outcomes (ILOs) APAIR Planning Phase Update 2
Information-Sharing New member: Courtney Resnick, Director, Academic Administration FY2022 2026 Strategic Plan development- April 1 Town hall Core Values Discussion April 29 Town hall Themes Discussion MSCHE Mid-Term Review: 2021 Other? 3
Meeting Objectives Review ILOs mapping exercise results Discuss issues arising during the completion of the mapping exercise Determine next steps for completing ILOs 4
UMB ILOs Initiative Review 2022 2026 Strategic Plan planning process commenced January 2021; A strategic outcome will be the identification of institutional learning outcomes for all UMB students and devising a plan to develop and implement a process to assess their attainment; Suggested institutional learning outcomes include the demonstration of competencies in these areas: Inter-Professional Education Community Engagement Global Health Leadership Cultural Competency (Diversity, Equity, and Inclusion) Ethics and Integrity The APAIR could be expanded to facilitate and document assessment of institutional learning outcomes 5
UMB ILOs Review ILOs are the outcomes that describes the qualities students should demonstrate after completing their respective program, and the unique characteristics that describe a [UMB] graduate (Collins, 2008) Values-based (conceptual and relevant to all disciplines) Skills-based(tend to align with the discipline s learning outcomes). What is expected from the BPAG? Recommend and describe what all UMB students are expected to know, do, and care about by program completion for the 6 ILO focus areas of graduate competence. Inform a process to assess attainment of the ILOs. Inform a process to evaluate the implementation of the ILOs. Inform a process for closing the loop. 6
Preliminary Mapping Exercise Results (SLO Exists) SOD BS - Dental Hygiene Academic Affairs * Program Area JD CSL SOD DDS SOM MGC SOM MPH SOM MD SOM DMRT SOM DPT SON/GS PhD SON DNP MSN SON SON BSN SOP SSW MSW PharmD (1) Community Engagement (2) Cultural Competency (3) Ethics & Integrity (4) Global Health (5) IPE (6) Leadership *Non-degree or certificate program 7
Preliminary Mapping Exercise Results (# SLOs for Focus Area) SOD BS - Dental Hygiene Academic Affairs * Program Area JD CSL SOD DDS SOM MGC SOM MPH SOM MD SOM DMRT SOM DPT SON/GS PhD SON DNP MSN SON SON BSN SOP SSW MSW PharmD (1) 3 1 1 1 1 1 2 1 1 1 1 Community Engagement (2) 8 1 1 1 1 5 4 1 1 1 2 1 1 3 Cultural Competency (3) 4 1 1 1 1 1 4 1 1 1 1 1 1 Ethics & Integrity (4) 3 1 3 1 1 1 Global Health (5) IPE 9 1 1 1 1 4 1 2 1 1 1 1 (6) 8 1 1 2 4 1 2 1 2 1 1 Leadership *Non-degree or certificate program 8
Preliminary Mapping Exercise Results (Shares Same SLO) SOD Academic Affairs * Program Area JD CSL SOD DDS BS - Dental Hygiene SOM MGC SOM MPH SOM MD SOM DMRT SOM DPT SON/GS PhD SON DNP MSN SON SON BSN SOP SSW MSW PharmD (1) AB Community Engagement (2) ABC BDF A AB Cultural Competency (3) AB CDEF A B Ethics & Integrity (4) D Global Health (5) IPE ABCD BCEF A (6) ABC ACE A A Leadership *Non-degree or certificate program 9
Mapping Exercise Summary Findings Mapped programs have direct or indirect measures for the SLOs related to the focus area; Mapped programs assess competency at scheduled times; Cultural Competency Most number of SLOs Global Health Fewest number of SLOs 10
Goals for ILOs Aligns with UMB s mission, core values, and strategic goals (CI, Compliance); Aligns with professional and institutional accreditors standards (CI, Compliance); Measurable and attainable; Faculty-endorsed and supported; Supports employer preferences/workforce demand; and Sets UMB apart from our competitors. 11
Questions Arising During the Mapping Exercise Is UMB requiring all schools on campus to teach to these objectives? Who developed these focus areas? Are we wed to them? Should there be other SLOs? Who will be responsible for reviewing these data? Were these learning objectives mandated by Middle States? Are the suggested learning objectives applicable across all schools? What are the plans to use outcomes data to compare across programs/schools? How are joint programs managed? Other? 12
Institutional Learning Outcomes (ILO) Confirm Objectives (i.e., Focus Areas) SLOs Align with Mission Program Goals* Continuous Improvement for Student Success SLOs Review & Improvement Dialogue & Plan SLOs Align with Core Values SLOs Data Collection & Analysis SLOs are SMART 13
Preliminary Timeline Activity Date UMB 2022-2026 Strategic Planning (Plan) period launches Core Values determined Themes determined January 2021 June 30, 2021 Provost assigns IESPA with recommending ILOs in collaboration with the BPAG Mapping February 2021 December 31, 2021 2022 2026 Strategic Plan unit alignment begins July 1, 2021 2022 2026 Strategic Plan Implementation begins January 1, 2022 ILOs Implementation begins (assumes using the APAIR goal development and assessment process). July 1, 2022 14
Next steps? Framing the content areas What do the content areas mean? Professional accreditor s standards Hear from subject matter experts Develop an inclusive strategy to engage stakeholders Who are they? Determine ARCI framework 15
REMINDER APAIR Reporting Schedule FY 2021 Activity Dates Assessment Period Fiscal Year (July 1 June 30) Current to November 15, 2020 Planning Period (i.e., report on areas of improvement and up to three (3) improvement-based goals with associated metrics (Note: after November 15, goals are locked for future editing) JANUARY 15, 2021 Performance period ends June 30, 2021 December 31, 2021 (6 months after beginning of reporting period) APAIR due 16
BPAG Assessment Initiative Inventory UMB Program Assessment Priority Status Map program assessment activities across the academic enterprise Determine the evidence to periodically collect and assess to demonstrate compliance with MSCHE and establish an institutional continuous improvement process for academic programming. Identify and establish Institutional Learning Outcomes (ILOs) Pending Identify and establish Key Performance Indicators (KPIs) and benchmarks Document annual assessment plans centrally to facilitate internal and external reporting Pending Evaluate progress of institutional assessment implementation In process Adjust assessment process as needed Pending Create process for administrative units assessment Planning 17 Last modified: February 2021
Meeting Recap Review decisions reached Review upcoming deadlines Next meeting date June 8, 2021: 11:00AM 18
For More Information Assessment reporting will be available on the Institutional Effectiveness, Strategic Planning, and Assessment website: www.umaryland.edu/iespa Contacts: Karen Matthews karen.matthews@umaryland.edu 6-2422 Greg Spengler gspengler@umaryland.edu 6-1264 19
