Competency-Based Assessment Tools and Strategies
STFM compiled recommendations, tools, strategies, and templates for designing meaningful assessments that align with competencies, support programmatic assessment, and drive learner growth in CBME.
Quick Access for Other CBME Toolkit Pages
Recommendations for Integrating CBME Assessment Tools
CBME emphasizes frequent, low-stakes assessments incorporating direct observation, the use of entrustment rating scales and assessment of Outcomes. This shift in paradigm will require many programs to make adjustments to their assessment process.
- We recommend assessing progress toward competency in the Core Outcomes of Family Medicine Education quarterly, semi-annually or at least annually during CCC meetings.
- Programs should incorporate entrustment scales into existing assessment forms for rating progress toward performing skills independently, without assistance.
Recommended Direct Observation Tools
1. Active Assessment Using Direct Observation (New):
- Assessment form available in both New Innovations and MedHub to address the Core Outcomes of Family Medicine Education.
- Designed to be used when directly observing a resident’s performance in a patient encounter.
- Can be used for only a portion of an encounter “snapshot” such as History, PE, etc.
- Questions only need to be completed for the portion of the encounter that was directly observed.
- An entrustment type of scale is used for rating progressive competence to perform basic skills independently.
- It can be used in both the inpatient and outpatient settings.
- It is recommended to be completed by faculty who are trained in assessment, such as family medicine core faculty.
- The first section regarding curricular areas addressed automatically maps the remaining questions to one of the Core Outcomes of Family Medicine Education.
- The remaining questions are also mapped to ACGME Family Medicine Subcompetencies. This has been done for you in MedHub and New Innovations.
2. Other Competency Based Assessment Tools
- Utilize the Outcome Assessment Starter Pack for ideas (button link below)
Information on How to Do Competency-Based Assessments
Resources
Entrustment Scale
As residents progress through their training toward independent practice, entrustment scales can be used to assess resident performance. The STFM CBME task force recommends the following entrustment scale:
- Participated only as an observer or required faculty to do
- Required significant faculty assistance
- Required minimal faculty assistance
- Completed independently, without need for assistance
- Demonstrated the ability to role model or teach others
Papers
- Humphrey-Murto S, Wood TJ, Ross S, Tavares W, Kvern B, Sidhu R, Sargeant J, Touchie C. Assessment Pearls for Competency-Based Medical Education. J Grad Med Educ. 2017 Dec;9(6):688-691. doi: 10.4300/JGME-D-17-00365.1. PMID: 29270255; PMCID: PMC5734320.
- Newton W, Rode K. What Assessments Are Being Used in Family Medicine Residencies? The Journal of the American Board of Family Medicine. November 2023, jabfm.2023.230391R0; doi: https://doi.org/10.3122/jabfm.2023.230391R0
Mobile Apps for Real-Time Assessment of Residents
The STFM CBME Task Force has worked with MedHub and New Innovations to integrate standardized, family medicine direct observation assessments into their mobile apps. These assessments, which are available now, are linked to the Core Outcomes of Family Medicine Residency Education and the ACGME Family Medicine Sub-competencies.
For New Innovations
- Instructions for administrators/coordinators on how to set up the Active Assessment Using Direct Observation Evaluation Form in New Innovations (pdf)
- Instructions for faculty on how to complete the Active Assessment Using Direct Observation Evaluation Form in New Innovations (pdf)
- Instructions for pulling reports for mobile app assessments in New Innovations (pdf)
- Instructions for Resident-Initiated Assessments in New Innovations (pdf)
For MedHub
- Instructions for administrators/coordinators on how to set up the Active Assessment Using Direct Observation Evaluation Form in MedHub (pdf)
- Instructions for faculty on how to complete the Active Assessment Using Direct Observation Evaluation Form in MedHub (pdf)
- MedHub Core Outcome Reporting Options (pdf)
- Video About How to Use App (recommend viewing in full screen)
For assistance, email support@medhub.com.
Assessments for Competency-Based Medical Education
- Outcomes Assessment Starter Pack (pdf): This table includes suggestions for tools that could be used to assess resident performance on each of the Core Outcomes of Family Medicine Residency Education.
- Family Medicine Core Outcomes Summative Evaluation (doc)
- Introduction to the Resident Portfolio (pdf)
- Summative Portfolio Template (xls)
