Research

CAFM Educational Research Alliance

How to Apply

What You Need to Know

How are proposals scored?
Proposals are reviewed by at least two researchers. They are assessed for logistical considerations, as well as:

  • Interest of topic to medical educators
  • Background and significance
  • Strength of hypothesis (PDF)
  • Quality of questions 
  • Whether the results are likely to yield a high-quality peer-reviewed publication
  • Overall quality of submission

Applicants receive brief feedback from reviewers.

What are components of a "good" proposal?

Reviewers will look at:

  • Is the Introduction well cited? Is the need for this study well argued?
  • Has CERA done this study before
  • Are the aims/hypotheses clearly stated? Are they measurable? Are they merely descriptive, or do they address correlations/associations between variables? 
  • Do the authors make good use of CERA’s recurring (demographic) questions?
  • Do the survey questions answer the study aims/hypotheses?
  • Do the authors use valid and reliable survey instruments?
  • Are the survey questions easy to read and answer? Are the response options appropriate?

What type of hypotheses is CERA looking for?
CERA is looking for hypotheses that go beyond describing the current state of something in family medicine education (e.g. How many ___ do ___?). The best research hypotheses make predictions about the association between at least two phenomena. Consider one of these types of hypothesis:

  • Group comparisons
  • Change over time
  • Correlations

Learn more about writing hypotheses for educational research (PDF).

How many questions can I submit?
To keep surveys a manageable length and to keep response rates up, CERA limits the number of questions per research proposal to about 10, in addition to the recurring demographic questions. Here is how CERA counts various question types:

Each subquestion is counted. For example, the following counts as four questions:

  1. How important do you feel each of the following procedures are for your residents to learn (1=least important; 5=most important):
  • Shave biopsy 1 2 3 4 5
  • Excisional biopsy 1 2 3 4 5
  • Vasectomy 1 2 3 4 5
  • IUD insertion 1 2 3 4 5

For "check all that apply" questions, each possible answer is counted. For example, the following counts as six questions:

  1. Which of the following procedures are residents required to become competent to perform in order to graduate (check all that apply)?
  • Shave biopsy
  • Excisional biopsy
  • Vasectomy
  • IUD insertion
  • Colposcopy
  • Limited OB ultrasound

Questions that call for the respondent to rank order have each option counted. For example, the following would count as three questions:

  1. Rank, from 1 to 3, which of the following procedures you feel are the most important for graduating residents to be competent to perform:
    ___ Shave biopsy
    ___ Excisional biopsy
    ___ Vasectomy
    ___ IUD insertion
    ___ Colposcopy
    ___ Limited OB ultrasound

What types of questions are not allowed in CERA surveys?
The following are generally not allowed in CERA surveys:

  • Open-ended questions 
  • Matrix formats 

"Chose all that apply” questions are discouraged. When allowed, each item will be counted as a “question” (see above).

Consider these tips from Qualtrics for writing good survey questions:

What About IRB Approval?
CERA surveys use the American Academy of Family Physicians Institutional Review Board, a federally approved IRB. Investigators should follow their local IRB policies regarding use of the data.

How Likely Is My CERA Proposal to Be Accepted?

The acceptance rate for CERA survey proposals varies by survey type. Below are historical average acceptance rates through 2024, by type:

  • Program Director Survey: 25% 
  • Clerkship Director: 57%
  • Department Chair Survey: 60%
  • General Membership Survey: 46%

How to Submit a Proposal for a CERA Survey

Watch for an open call for proposals, which is sent to members of ADFM, AFMRD, NAPCRG, and STFM.

You need to be a member of ADFM, AFMRD, NAPCRG, or STFM to apply.

CERA Survey Schedule

2025 Survey Dates

Program Directors
Call for Proposals: 12/9/24-1/7/25
Survey Dates: 4/22/25-5/23/25

Clerkship Directors
Call for Proposals: 1/27/25-2/25/25
Survey Dates: 6/10/25-7/11/25

Department Chairs
Call for Proposals: 3/24/25-4/22/25
Survey Dates: 8/5/25-9/5/25

General Membership
Call for Proposals: 5/19/25-6/17/25
Survey Dates: 9/30/25-10/31/25

Program Directors
Call for Proposals: 6/23/25-7/22/25
Survey Dates: 11/4/25-12/5/25

Ask a Question
AI Chatbot Tips

Tips for Using STFM's AI Assistant

STFM's AI Assistant is designed to help you find information and answers about Family Medicine education. While it's a powerful tool, getting the best results depends on how you phrase your questions. Here's how to make the most of your interactions:

1. Avoid Ambiguous Language

Be Clear and Specific: Use precise terms and avoid vague words like "it" or "that" without clear references.

Example:

Instead of: "Can you help me with that?"
Try: "Can you help me update our Family Medicine clerkship curriculum?"
Why this is important: Ambiguous language can confuse the AI, leading to irrelevant or unclear responses. Clear references help the chatbot understand exactly what you're asking.

2. Use Specific Terms

Identify the Subject Clearly: Clearly state the subject or area you need information about.

Example:

Instead of: "What resources does STFM provide?"
Try: "I'm a new program coordinator for a Family Medicine clerkship. What STFM resources are available to help me design or update clerkship curricula?"
Why this is better: Providing details about your role ("program coordinator") and your goal ("design or update clerkship curricula") gives the chatbot enough context to offer more targeted information.

3. Don't Assume the AI Knows Everything

Provide Necessary Details:The STFM AI Assistant has been trained on STFM's business and resources. The AI can only use the information you provide or that it has been trained on.

Example:

Instead of: "How can I improve my program?"
Try: "As a program coordinator for a Family Medicine clerkship, what resources does STFM provide to help me improve student engagement and learning outcomes?"
Why this is important: Including relevant details helps the AI understand your specific situation, leading to more accurate and useful responses.

4. Reset if You Change Topics

Clear Chat History When Switching Topics:

If you move to a completely new topic and the chatbot doesn't recognize the change, click the Clear Chat History button and restate your question.
Note: Clearing your chat history removes all previous context from the chatbot's memory.
Why this is important: Resetting ensures the AI does not carry over irrelevant information, which could lead to confusion or inaccurate answers.

5. Provide Enough Context

Include Background Information: The more context you provide, the better the chatbot can understand and respond to your question.

Example:

Instead of: "What are the best practices?"
Try: "In the context of Family Medicine education, what are the best practices for integrating clinical simulations into the curriculum?"
Why this is important: Specific goals, constraints, or preferences allow the AI to tailor its responses to your unique needs.

6. Ask One Question at a Time

Break Down Complex Queries: If you have multiple questions, ask them separately.

Example:

Instead of: "What are the requirements for faculty development, how do I register for conferences, and what grants are available?"
Try: Start with "What are the faculty development requirements for Family Medicine educators?" Then follow up with your other questions after receiving the response.
Why this is important: This approach ensures each question gets full attention and a complete answer.

Examples of Good vs. Bad Prompts

Bad Prompt

"What type of membership is best for me?"

Why it's bad: The AI Chat Assistant has no information about your background or needs.

Good Prompt

"I'm the chair of the Department of Family Medicine at a major university, and I plan to retire next year. I'd like to stay involved with Family Medicine education. What type of membership is best for me?"

Why it's good: The AI Chat Assistant knows your role, your future plans, and your interest in staying involved, enabling it to provide more relevant advice.

Double Check Important Information

While the AI Chat Assistant is a helpful tool, it can still produce inaccurate or incomplete responses. Always verify critical information with reliable sources or colleagues before taking action.

Technical Limitations

The Chat Assistant:

  • Cannot access external websites or open links
  • Cannot process or view images
  • Cannot make changes to STFM systems or process transactions
  • Cannot access real-time information (like your STFM Member Profile information)

STFM AI Assistant
Disclaimer: The STFM Assistant can make mistakes. Check important information.