PUBLICATIONS

STFM Podcast July 2026 Episode

The July 2026 episode of the STFM Podcast is titled “The Promises and Pitfalls of AI in Residency Assessment" and features John Hayes, DO, and Karim Hanna, MD. Listen on this page below or through a streaming platform.

SUBSCRIBE ON APPLE SUBSCRIBE ON SPOTIFY

How is artificial intelligence reshaping the way we train and assess the next generation of family physicians? In this episode, Dr John Hayes and Dr Karim Hanna explore the promises and pitfalls of AI in residency assessment, from automating milestone tracking and grading robust essay exams to getting started with your first automated workflow. They also discuss how when AI takes on more of the data analysis and synthesis tasks, faculty will need to increase their coaching skills. On the other side, our guests offer an honest look at the risks of over-reliance on technology, cautioning educators to guard against "un-skilling" learners who may already lean too heavily on AI for clinical reasoning. Learn how to incorporate AI as a powerful supplemental tool while preserving the human connection that lies at the heart of family medicine. Hosted by Omari A. Hodge, MD, FAAFP and Jay-Sheree Allen Akambase, MDCopyright © Society of Teachers of Family Medicine, 2026

Listen to All Episodes

Resources

John Hayes DO

Prior to his current roles, Dr Hayes served as a Family Medicine Clerkship Director, where he led a major curriculum modernization effort that enhanced the clerkship experience for medical students. Dr Hayes is now pioneering the integration of Artificial Intelligence in medical assessments, specifically in Objective Structured Clinical Exams (OSCEs). Additionally, he is developing a summative clinical reasoning examination designed to move away from traditional multiple-choice testing and into essay prompts with AI assisted grading. He is also exploring the use of ambient AI to enhance residency education and improve communication skills for both residents and faculty, aiming to foster a collaborative learning environment. He definitely used AI to help generate this blurb.

Karim Hanna, MD

Dr Karim Hanna is an Associate Professor at the University of South Florida Morsani College of Medicine and the founding Program Director for the USF TGH Family Medicine Residency. His work integrates primary care education and AI advancements. Dr Hanna's interests in health tech spurred his writing of a blog - MedEd+AI - with a focus on AI's role in medical education and clinical implications. His scholarly work includes research on LLMs for clinical applications and improving education through AI.

11400 Tomahawk Creek Parkway

Leawood, KS 66211

(800) 274-7928

stfmoffice@stfm.org

Tips for Using STFM's AI Assistant

STFM's AI Assistant is designed to help you find information and answers about Family Medicine education. While it's a powerful tool, getting the best results depends on how you phrase your questions. Here's how to make the most of your interactions:

1. Avoid Ambiguous Language

Be Clear and Specific: Use precise terms and avoid vague words like "it" or "that" without clear references.

Example:

Instead of: "Can you help me with that?"

Try: "Can you help me update our Family Medicine clerkship curriculum?"

Why this is important: Ambiguous language can confuse the AI, leading to irrelevant or unclear responses. Clear references help the chatbot understand exactly what you're asking.

2. Use Specific Terms

Identify the Subject Clearly: Clearly state the subject or area you need information about.

Example:

Instead of: "What resources does STFM provide?"

Try: "I'm a new program coordinator for a Family Medicine clerkship. What STFM resources are available to help me design or update clerkship curricula?"

Why this is better: Providing details about your role ("program coordinator") and your goal ("design or update clerkship curricula") gives the chatbot enough context to offer more targeted information.

3. Don't Assume the AI Knows Everything

Provide Necessary Details:The STFM AI Assistant has been trained on STFM's business and resources. The AI can only use the information you provide or that it has been trained on.

Example:

Instead of: "How can I improve my program?"

Try: "As a program coordinator for a Family Medicine clerkship, what resources does STFM provide to help me improve student engagement and learning outcomes?"

Why this is important: Including relevant details helps the AI understand your specific situation, leading to more accurate and useful responses.

4. Reset if You Change Topics

Clear Chat History When Switching Topics:

If you move to a completely new topic and the chatbot doesn't recognize the change, click the Clear Chat History button and restate your question.

Note: Clearing your chat history removes all previous context from the chatbot's memory.

Why this is important: Resetting ensures the AI does not carry over irrelevant information, which could lead to confusion or inaccurate answers.

5. Provide Enough Context

Include Background Information: The more context you provide, the better the chatbot can understand and respond to your question.

Example:

Instead of: "What are the best practices?"

Try: "In the context of Family Medicine education, what are the best practices for integrating clinical simulations into the curriculum?"

Why this is important: Specific goals, constraints, or preferences allow the AI to tailor its responses to your unique needs.

6. Ask One Question at a Time

Break Down Complex Queries: If you have multiple questions, ask them separately.

Example:

Instead of: "What are the requirements for faculty development, how do I register for conferences, and what grants are available?"

Try: Start with "What are the faculty development requirements for Family Medicine educators?" Then follow up with your other questions after receiving the response.

Why this is important: This approach ensures each question gets full attention and a complete answer.

Examples of Good vs. Bad Prompts

Bad Prompt

"What type of membership is best for me?"

Why it's bad: The AI Chat Assistant has no information about your background or needs.

Good Prompt

"I'm the chair of the Department of Family Medicine at a major university, and I plan to retire next year. I'd like to stay involved with Family Medicine education. What type of membership is best for me?"

Why it's good: The AI Chat Assistant knows your role, your future plans, and your interest in staying involved, enabling it to provide more relevant advice.

Double Check Important Information

While the AI Chat Assistant is a helpful tool, it can still produce inaccurate or incomplete responses. Always verify critical information with reliable sources or colleagues before taking action.

Technical Limitations

The Chat Assistant:

Cannot access external websites or open links
Cannot process or view images
Cannot make changes to STFM systems or process transactions
Cannot access real-time information (like your STFM Member Profile information)

Membership

Community

About

Advocacy

Governance

Key Initiatives

Journals

Other Publications

CAFM Educational Research Alliance (CERA)

Research Resources

Annual Spring Conference

Conference on Medical Student Education

Conference on Practice & Quality Improvement

General Information

Certificate Programs

Webinars

Online Courses

Fellowships

Other Faculty Training

STFM Curriculum

More Curriculum Resources

Resources Fundamental to Family Medicine Education

Topic-Specific Aggregated Resources

Preceptor Recruitment and Retention Resources

Resources For

Awards

Scholarships

STFM Project Fund

STFM Podcast July 2026 Episode

Listen to All Episodes

Resources

John Hayes DO

Karim Hanna, MD

Contact Us

Events

Deadlines

Useful Links

AI Chatbot Tips

Tips for Using STFM's AI Assistant

1. Avoid Ambiguous Language

Example:

2. Use Specific Terms

Example:

3. Don't Assume the AI Knows Everything

Example:

4. Reset if You Change Topics

5. Provide Enough Context

Example:

6. Ask One Question at a Time

Example:

Examples of Good vs. Bad Prompts

Bad Prompt

Good Prompt

Double Check Important Information

Technical Limitations

STFM AI Assistant