Commitment to change (CTC) evaluation

I like this evaluation approach for large CME conferences.  A large CME conference = multiple topics + multiple speakers + multiple participating specialties (not unlike the annual Alliance meeting).

 

Here are the three steps:

 

Step #1. One week after the CME conference, contact participants and ask them to identify up to 3 changes they are considering to implement in their practice (as a result of participating).  I like to use SurveyMonkey.com for this step.  Click here for an example email invitation and here for an example survey.

 

Step #2. Four weeks after the CME conference, send a reminder of intended changes to each participant who responded to Step #1 (also include a summary of the other attendees intended changes).  Click here for an example.

 

Step #3. Three months after the CME conference, contact every participant who responded to Step #1 to see if their intended changes were realized (and if not, why).  Again, I like to use SurveyMonkey.com for this step. Click here for an example email invitation and here for an example survey.

 

Step #1 assesses “competence” changes.  Step #3 assesses “performance” change.  Step #2 is an adjunct non-educational strategy to enhance change (ACCME criteria 17).

 

When you’re ready to put it all together in a report…click here for an example.

 

 

Advertisements

7 Comments

Filed under Commitment to Change, Methodology, Outcomes

7 responses to “Commitment to change (CTC) evaluation

  1. Sallie

    Hi, Jason- do you ask permission of the participants to send follow up emails to measure their competence and performance changes at the conference? If so, do you have a sample script?

    • assesscme

      No, I don’t ask permission to send follow-up emails…but I do typically ask the conference director(s) to announce that participants may be contacted for follow-up. Also, all follow-up emails include an opt-out link. Once a respondent opts-out, they are never contacted again (for any program follow-up).

  2. Pingback: Perceived self-efficacy evaluations « assessCME

  3. Jason, I truly appreciate this blog post as we are attempting to do a similar commitment to change at our medical school. When I click on the report, I am taken to the CME Measure page. Would you be able to email a sample report to me at email below? Thanks!

  4. Hi Jason,

    We are also looking at possibly doing this at my place of work and have a question for you. If you had 40 respondants for example with 3 commitments to change for each, do you then send an email to each of the 40 respondants listing each of their commitments individually in an email? Would this not be time consuming?

    Also, do we have your permission in using similar emails and surveys to the one listed above?

    Thank you.
    Sally

    • assesscme

      Hi Sally,

      I use SurveyMonkey to assess compliance with intended practice changes. An example of which you can find here. Using your example, I would send a unique survey to each of the 40 respondents containing their intended practice changes. Yes, this can get tedious (but this example shouldn’t take more than couple hours). I’ve looked for an online survey tool with the capability to send a customized survey to each respondent (like, doing a mail merge), but haven’t had any luck. That being said, you could use mail merge (I use MS Outlook for this) to send out a customized email to each respondent with their intended practice changes (as you indicate in your question) – but I suspect that response rate would be pretty low. There’s likely a clever way to combine mail merge and surveymonkey to save time and maintain a decent (>20%) response rate: any ideas – let me know.

      And, yes, you can use/adapt any resource you find on this blog in your work – I just ask that you don’t use it for commercial endeavors (i.e., selling the methods as your own).

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s