Here are three tools for assessing participant satisfaction with CME that have gone through some validity testing:
- Wood TJ, et al. The development of a participant questionnaire to assess continuing medical education presentations. Medical Education 2005;39:568-72. (abstract)
- Rothman AI, Sibbald G. Evaluating Medical Grand Rounds. Journal of Continuing Education in the Health Professions 2002;22:77-83. (abstract)
- Shewchuk RM, et al. A Standardized Approach to Assessing Physician Expectations and Perceptions of Continuing Medical Education. Journal of Continuing Education in the Health Professions 2007;27:173-82. (abstract)
I expect there’s a few more, but not many (post a comment if you have other examples).
Just because satisfaction outcome isn’t one of the ACCME big three (i.e., competency, performance, or patient outcome) doesn’t mean it isn’t useful. The original Kirkpatrick scale (1) later adapted by Moore (2) both say that assessing satisfaction is a necessary precursor to such higher level outcomes. Satisfaction data makes it easier to tease out what elements of a CME activity are to praise or blame when interpreting competency, performance or patient level outcomes. And with so few validated instruments for assessing satisfaction, this is hardly an area that we’ve adequately covered.
1. Kirkpatrick, D.L. (1994). Evaluating Training Programs: The Four Levels. San Francisco, CA: Berrett-Koehler.
2. Moore DE. A framework for outcomes evaluation in the continuing professional development of physicians. In: Davis D, Barnes BE, Fox R (eds). The Continuing Professional Development of Physicians: from Research to Practice. Chicago: American Medical Association, 2003.