Skip to main content

Main menu

  • Home
  • Articles
    • Current
    • Published Ahead of Print
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About Mainpro+
    • Member Login
    • Instructions
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums

User menu

  • My alerts

Search

  • Advanced search
The College of Family Physicians of Canada
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums
  • My alerts
The College of Family Physicians of Canada

Advanced Search

  • Home
  • Articles
    • Current
    • Published Ahead of Print
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About Mainpro+
    • Member Login
    • Instructions
  • RSS feeds
  • Follow cfp Template on Twitter
Research ArticleProgram Description

Role of graduate courses in promoting educational scholarship of health care professionals

Savithiri Ratnapalan and Abbas Ghavam-Rassoul
Canadian Family Physician September 2020, 66 (9) 676-681;
Savithiri Ratnapalan
Professor in the Department of Pediatrics and the Dalla Lana School of Public Health at the University of Toronto in Ontario, and a consultant staff physician in the Division of Paediatric Emergency Medicine at the Hospital for Sick Children in Toronto.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: savithiri.ratnapalan@utoronto.ca
Abbas Ghavam-Rassoul
Program Director of the Medical Education Fellowship and Clinical Teacher Certificate Programs in the Department of Family and Community Medicine and the Dalla Lana School of Public Health at the University of Toronto.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Abstract

Problem addressed Many courses are offered to health care professionals to improve educational scholarship and scholarly teaching. The literature on the effect of such courses on promoting educational scholarship and scholarly teaching is currently suboptimal.

Objective of program To evaluate scholarly productivity of health care professional learners participating in 2 graduate courses in which curricula and assignments facilitated experiential learning.

Program description A retrospective analysis of course assignments and publications of learners from 2007 to 2014 was conducted. Learners’ current positions were identified through Google Scholar searches, and publication of course work was identified through PubMed or EMBASE author searches. There were 137 learners, with a male to female ratio of 3:7, consisting of physicians (73%) and other health care professionals (27%). During the 7 years, 50% completed both courses, 42% only the first course, and 8% only the second course. Of the learners whose current positions could be identified, 66% worked at academic centres, 20% at community hospitals or office practices, and 5% were in senior leadership positions. Current positions were unidentifiable through public records for 9% of learners. Sixty-eight percent of learners (93 of 137) published 1050 articles in peer-reviewed journals. Twenty-six percent of learners (35 of 137) published 1 or more articles based on their course assignments, for a total of 49 peer-reviewed articles; 80% of articles were published within 3 years of completing the course.

Conclusion Experiential learning facilitated by curricular design and assignments coupled with mentorship stimulated scholarly publications. Educational courses should design curricula to promote scholarship in learners and evaluate their effect.

Educational scholarship leads to knowledge generation in medical education and promotes the delivery of high-quality training through evidence-based practices. Scholarly productivity facilitates academic promotion and career satisfaction of clinician educators.1 Scholarly educational productivity of medical educators has generally been suboptimal, with physicians reporting limited involvement and a need for training in medical education research, as many clinician educators are interested.2–4 Barriers to scholarship include a lack of time, skills, and mentors, and unclear academic expectations.5 A recent article attributes suboptimal academic productivity to a lack of clarity in research questions, inadequate methodology to assess study questions, loss of momentum, lack of follow-through, and lack of expertise.6 To address this, several institutions have created faculty development programs to foster educational scholarship skills. A few studies examining the outcomes of such programs reveal promising results in terms of participant satisfaction and scholarly productivity.7–10

Many universities have created master’s degree programs as part of their faculty development efforts for health educators.11 The content of these master’s programs usually consists of curriculum development, instructional methods or teaching, learning, assessment strategies, program evaluation, research design, and sometimes leadership and management.12 There have been calls to establish criteria and mechanisms for the evaluation of these programs and to explore their effects beyond teaching effectiveness by examining interventions targeting other faculty roles such as educational scholarship.12,13 There is currently limited literature evaluating master’s programs in health professional education.

Program description

Continuing Education in Health Professions (CEHP) and Continuing Education Planning, Management and Evaluation (CEPME) are 2 graduate courses that are part of the Health Practitioner Teacher Education program leading to a master’s degree at the University of Toronto in Ontario. Both courses provide a half-credit individually and complement each other. They are delivered in a modular fashion over 5 days to provide 40 hours of face-to-face learning. The primary author (S.R.) assumed teaching responsibilities for the CEHP course in 2007 and developed the CEPME course in 2008, assuming responsibility for curriculum development, assessment, and grading. Both courses subscribe to the theoretical model of “experiential learning” and are grounded in a constructivist perspective, proposing that experience plays a critical role in knowledge construction and acquisition, where learning occurs when someone creates knowledge through experiential transformations.14,15 All learners were working health professionals. The learners were asked to choose topics that were relevant to their practices or an educational activity they were involved in to work on during the courses.

Before 2007, the CEHP course included several individual and group assignments that tested knowledge of key concepts of health professional education, and the final assignment was to write a scholarly essay on an important concept related to health professional education. The essay instructions did not specify a word count, but essays were generally between 3000 and 4000 words. The curriculum for the CEHP course was modified in 2007 to incorporate workshops on knowledge synthesis and systematic reviews. A librarian facilitated a literature search workshop and provided assistance with literature searches for learners who requested it. The main modification was the final assignment, which was updated to have learners write a systematic or scoping review. All group assignments were completed in class and individual assignments built on each other to create the final article. The final assignment had a weight of 65% of the final course grade; requirements were to write about 2000 to 2500 words (with an absolute maximum of 3000 words) and to include 20 to 25 references. Learners were allowed to choose any clinical or educational topic and received feedback on their work from the course instructor and other learners when they presented their abstracts in class. Learners were also provided examples of good writing in the form of published previous assignments.

The CEPME course provided a theoretical basis and practical strategies for conducting educational research. The learners were expected to submit an educational research proposal as the course assignment. All learners completed a needs assessment survey before the course began and were asked to identify an educational project they would like to complete as part of the course. Learners participated in workshops on both quantitative and qualitative research protocol developments in addition to a writing workshop during the course. In this course, all group assignments were also completed in class, and individual assignments built on each other to create the final article. The first individual assignment was a summary of a proposal for an educational project or program (500 to 600 words); learners then presented their protocols in class for evaluation and feedback and submitted their education research proposal as the final assignment. Learners were strongly advised to obtain ethics approval, apply for funding, and complete their research projects.

All learners were offered mentorship during and after course completion to publish their work. At the time of writing, the program did not formally collect information on learners applying their knowledge to create scholarly publications, and it was not known whether any graduates of the program had published anything.

The objective of the study was to evaluate scholarly productivity of health care professional learners participating in 2 graduate courses teaching continuing education in health professions at the University of Toronto. Scholarly publications were chosen to evaluate scholarly productivity. The study was approved by the Research Ethics Board of the Hospital for Sick Children in Toronto.

Program evaluation

A retrospective analysis of course assignments and publications of learners from 2 graduate courses (CEHP and CEPME) during 2007 to 2014 was conducted. Class lists and their course assignment topics were obtained after institutional ethics approval was received. All learners who participated in 1 or both courses during the study period of 7 years were identified and tabulated with the topic of their course assignments. Learners’ current positions were identified through Google Scholar searches and publication of course work was identified through PubMed or EMBASE author searches. Searches for published articles for each learner were conducted and tabulated by year. The following information was extracted: program of study, number of years between publication of course assignment and course completion, number of publications to date, occupation, gender, current position, and working environment (eg, academic centre, community hospital). Descriptive statistics were used as appropriate, and inferential statistics were used for identified variables.

Results

There were 137 learners, with a male to female ratio of 3:7 during the 7-year study period. Most were physicians (73%), and 73% of these were family physicians. Other health professionals represented 27% of learners. Most learners were from Canada (75%), followed by Saudi Arabia (16%) and other Middle East countries (7%). Approximately 50% of the students completed both graduate courses, 42% completed only the CEHP course, and 8% completed only the CEPME course. Public record searches of those who completed 1 or more courses identified 66% of learners working at academic centres, 20% at community hospitals or office practices, and 5% in senior leadership positions. Current positions were unidentifiable through public records in 9% of cases.

Sixty-eight percent of learners (93 of 137) published a total of 1050 articles in peer-reviewed journals during the study period. Topic and abstract review identified that 26% of learners (35 of 137) published 1 or more papers based on their course assignments, for a total of 49 peer-reviewed papers. Of these 35 learners, 66% (n = 23) published 1 article, 29% (n = 10) published 2 articles, and 5% (n = 2) published 3 articles. There were 6 other publications (4 conference abstracts and 2 non–peer-reviewed publications) for a total of 55 publications based on course assignments. Physicians had a higher number of publications of their assignments compared with other health professionals (29% vs 16%, respectively). There was no significant difference between learners working in academic centres and those working in community or office practices in publication rates of course assignments. Nine percent published their course assignments within a year of course completion, 34% were published within 2 years, and 80% were published within 3 years. Table 1 provides the complete list of health care professional learners who participated in master’s degree courses and the number of publications based on course assignments.

View this table:
  • View inline
  • View popup
Table 1.

Learners’ occupations and publications based on course assignments

Discussion

Almost all doctoral programs in medical education are research based and result in some published work.16 Although publication rates have been used by faculty development courses that aim to improve educational scholarship to show effectiveness,17 most master’s programs that focus on theoretical frameworks to prepare learners for ongoing scholarship and research have not published their effects. This is the first report that evaluates the effects of master’s-level courses on medical education using publication of course assignments as a surrogate marker for course effectiveness in promoting educational scholarship.

Although course work might have contributed to publication, other learner-related factors such as self-selection of learners to the master’s degree program probably influenced academic productivity.

Results of a study evaluating effectiveness of a faculty development course in promoting educational scholarship showed the following contributed to the students’ success: “content (the ‘how’, not just the ‘what’); format (project-based, forced protected time); social network (group work promoting group synergy); and the role of the Course facilitator (functional mentor, coaching).”18 Scholarly publication by learners who completed these graduate courses might have been facilitated by similar factors, such as curriculum design to provide theoretical frameworks and practical strategies including experiential learning; assignments designed to promote and evaluate knowledge synthesis (ie, writing up a systematic or scoping review for CEHP and an educational research protocol for CEPME); and ongoing mentorship. A follow-up qualitative study might be needed to provide more understanding of how these courses foster productivity.

There have been calls for caution that minimal guidance or unguided instructional approaches have been less effective and less efficient than instructional approaches that emphasize guidance in teaching novice learners.19 This caution is probably also applicable for master’s courses where learners who might be experienced health care professionals with excellent teaching skills have no publication record and lack the skills to improve their scholarly productivity without guidance.

A Canadian study examining graduate writing assignments across 12 faculties in a university found that the commonest assignment format was the scholarly essay, accounting for 23% of assignments across all faculties.20 This study showed that writing a literature review as an assignment was most common in applied sciences (32%) and the least common in education (3%), with an overall rate of 14% across all faculties, whereas proposal writing was the most common in medicine (16%), with an overall rate of 9% across all faculties.20 It has been shown that graduate students value learning scientific writing skills and value courses that teach them.21 We argue that having a course where the goal is for the students to generate a review article that is submitted for publication in a peer-reviewed journal not only allows students to learn a new topic and build scientific reading and writing skills, but also enhances their resumes while concurrently contributing knowledge to the broader scientific community.21

The results of this study show that graduate courses in education have to not only focus on content but also pay attention to the design of assessments and evaluate their effects on scholarship. Further studies should evaluate other graduate courses and master’s programs in education to explore how and why educational scholarship is promoted or not promoted.

Limitations

This study is limited by its retrospective design and data extraction process confined to information available in the public domain. This study only captured publication data as a marker for educational scholarship and did not attempt to identify other scholarly, teaching, or leadership activities. As such, conference presentation, grants, curriculum development, program development, teaching activities, policy development, and leadership activities that were unpublished were not captured. Future studies can prospectively collect such information to provide a holistic view of the effect of graduate courses and programs on medical education.

Conclusion

Curricular design and assessment strategies for experiential learning coupled with mentorship might stimulate scholarly publication from course assignments. Medical educators should pay attention to curricula and assignments of educational courses to encourage learners to increase scholarly productivity. Evaluating the effect on learners’ educational scholarship is an important aspect of program evaluation and will help the program focus on facilitating scholarship in education.

Acknowledgments

We acknowledge Elizabeth Uleryk for her support in performing the literature searches. This work was funded by an Art of Possible Grant from the Department of Family and Community Medicine at the University of Toronto.

Notes

Editor’s key points

  • ▸ This study found that 68% of learners (93 of 137) published a total of 1050 articles in peer-reviewed journals during the study period. Topic and abstract review identified that 26% of learners (35 of 137) published 1 or more papers based on their course assignments, for a total of 49 peer-reviewed papers. Physicians had a higher number of publications of their assignments compared with other health professionals.

  • ▸ Scholarly publication by learners who completed the graduate courses might have been facilitated by factors such as curriculum design to provide theoretical frameworks and practical strategies including experiential learning; assignments designed to promote and evaluate knowledge synthesis; and ongoing mentorship.

  • ▸ Master’s degree programs in health professional education should ensure curricula provide instructional guidance for health professional learners to increase their scholarly productivity.

Points de repère du rédacteur

  • ▸ Dans cette étude, on a constaté que 68 % des apprenants (93 sur 137) ont publié au total 1050 articles dans des revues révisées par des pairs durant la période à l’étude. Une revue des sujets et des résumés a permis de déterminer que 26 % des apprenants (35 sur 137) ont publié 1 article ou plus basés sur leurs travaux de cours, pour un total de 49 articles révisés par des pairs. Les médecins comptaient un plus grand nombre de publications de leurs travaux par rapport à d’autres professionnels de la santé.

  • ▸ Les publications scientifiques des apprenants qui ont suivi les cours d’enseignement supérieur pourraient avoir été facilitées par des facteurs tels qu’un cursus conçu pour offrir des structures théoriques et des stratégies pratiques, y compris l’apprentissage par l’expérience; des travaux de cours visant à promouvoir et à évaluer la synthèse des connaissances; et le mentorat continu.

  • ▸ Les programmes de maîtrise de haut niveau en éducation des professionnels de la santé devraient faire en sorte que le cursus offre des conseils pédagogiques afin que les professionnels de la santé apprenants augmentent leur productivité en matière de publications scientifiques.

Footnotes

  • Contributors

    Both authors contributed to the concept and design of the study; data gathering, analysis, and interpretation; and preparing the manuscript for submission.

  • Competing interests

    None declared

  • This article has been peer reviewed.

  • Cet article a fait l’objet d’une révision par des pairs.

  • Copyright© the College of Family Physicians of Canada

References

  1. 1.↵
    1. Levinson W,
    2. Rubenstein A
    . Integrating clinician-educators into academic medical centers: challenges and potential solutions. Acad Med 2000;75(9):906-12.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Christiaanse ME,
    2. Russell EL,
    3. Crandall SJ,
    4. Lambros A,
    5. Manuel JC,
    6. Kirk JK
    . Development of an asset map of medical education research activity. J Contin Educ Health Prof 2008;28(3):186-93.
    OpenUrlPubMed
  3. 3.
    1. Huwendiek S,
    2. Mennin S,
    3. Dern P,
    4. Ben-David MF,
    5. Van Der Vleuten C,
    6. Tönshoff B,
    7. et al
    . Expertise, needs and challenges of medical educators: results of an international Web survey. Med Teach 2010;32(11):912-8.
    OpenUrlPubMed
  4. 4.↵
    1. Goldszmidt MA,
    2. Zibrowski EM,
    3. Weston WW
    . Education scholarship: it’s not just a question of ‘degree’. Med Teach 2008;30(1):34-9.
    OpenUrlPubMed
  5. 5.↵
    1. Smesny AL,
    2. Williams JS,
    3. Brazeau GA,
    4. Weber RJ,
    5. Matthews HW,
    6. Das SK
    . Barriers to scholarship in dentistry, medicine, nursing, and pharmacy practice faculty. Am J Pharm Educ 2007;71(5):91.
    OpenUrlCrossRefPubMed
  6. 6.↵
    1. Gottlieb M,
    2. Dehon E,
    3. Jordan J,
    4. Bentley S,
    5. Ranney ML,
    6. Lee S,
    7. et al
    . Getting published in medical education: overcoming barriers to scholarly production. West J Emerg Med 2018;19(1):1-6. Epub 2017 Dec 22.
    OpenUrl
  7. 7.↵
    1. Steinert Y,
    2. McLeod PJ
    . From novice to informed educator: the Teaching Scholars Program for educators in the health sciences. Acad Med 2006;81(11):969-74.
    OpenUrlCrossRefPubMed
  8. 8.
    1. Fidler DC,
    2. Khakoo R,
    3. Miller LA
    . Teaching Scholars Programs: faculty development for educators in the health professions. Acad Psychiatry 2007;31(6):472-8.
    OpenUrlCrossRefPubMed
  9. 9.
    1. Martimianakis MT,
    2. McNaughton N,
    3. Tait GR,
    4. Waddell AE,
    5. Lieff S,
    6. Silver I,
    7. et al
    . The research innovation and scholarship in education program: an innovative way to nurture education. Acad Psychiatry 2009;33(5):364-9.
    OpenUrlCrossRefPubMed
  10. 10.↵
    1. Gruppen LD,
    2. Yoder E,
    3. Frye A,
    4. Perkowski LC,
    5. Mavis B
    . Supporting medical education research quality: the Association of American Medical Colleges’ Medical Education Research Certificate program. Acad Med 2011;86(1):122-6.
    OpenUrlPubMed
  11. 11.↵
    1. Cohen R,
    2. Murnaghan L,
    3. Collins J,
    4. Pratt D
    . An update on master’s degrees in medical education. Med Teach 2005;27(8):686-92.
    OpenUrlCrossRefPubMed
  12. 12.↵
    1. Tekian A,
    2. Harris I
    . Preparing health professions education leaders worldwide: a description of masters-level programs. Med Teach 2012;34(1):52-8.
    OpenUrlPubMed
  13. 13.↵
    1. Steinert Y,
    2. Mann K,
    3. Anderson B,
    4. Barnett BM,
    5. Centeno A,
    6. Naismith L,
    7. et al
    . A systematic review of faculty development initiatives designed to enhance teaching effectiveness: a 10-year update: BEME Guide No. 40. Med Teach 2016;38(8):769-86. Epub 2016 Jul 15.
    OpenUrl
  14. 14.↵
    1. Kolb DA.
    , editor. Experiential learning. Experience as the source of learning and development. 1st ed. Upper Saddle River, NJ: Prentice Hall; 1984. The process of experiential learning; p. 20-38.
  15. 15.↵
    1. Kolb DA
    . Experiential learning. Experience as the source of learning and development. 2nd ed. Upper Saddle River, NJ: Pearson Education; 2015.
  16. 16.↵
    1. Tekian A
    . Doctoral programs in health professions education. Med Teach 2014;36(1):73-81. Epub 2013 Oct 28.
    OpenUrl
  17. 17.↵
    1. Ratnapalan S
    . Knowledge to action: scholarship for faculty and staff. J Contin Educ Health Prof 2009;29(1):32-8.
    OpenUrlPubMed
  18. 18.↵
    1. Wadhwa A,
    2. Das L,
    3. Ratnapalan S
    . Faculty development effectiveness: insights from a program evaluation. J Biomed Educ 2014;2014:286081.
    OpenUrl
  19. 19.↵
    1. Kirschner PA,
    2. Sweller J,
    3. Clark RE
    . Why minimal guidance during instruction does not work: an analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educ Psychol 2006;41(2):75-86. Epub 2010 Jun 8.
    OpenUrlCrossRef
  20. 20.↵
    1. Shi L,
    2. Dong Y
    . Graduate writing assignments across faculties in a Canadian university. Can J High Educ 2015;45(4):123-42.
    OpenUrl
  21. 21.↵
    1. Ogunsolu OO,
    2. Wang JC,
    3. Hanson K
    . Writing a review article: a graduate level writing class. J Chem Educ 2018;95(5):810-6.
    OpenUrl
PreviousNext
Back to top

In this issue

Canadian Family Physician: 66 (9)
Canadian Family Physician
Vol. 66, Issue 9
1 Sep 2020
  • Table of Contents
  • About the Cover
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on The College of Family Physicians of Canada.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Role of graduate courses in promoting educational scholarship of health care professionals
(Your Name) has sent you a message from The College of Family Physicians of Canada
(Your Name) thought you would like to see the The College of Family Physicians of Canada web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Role of graduate courses in promoting educational scholarship of health care professionals
Savithiri Ratnapalan, Abbas Ghavam-Rassoul
Canadian Family Physician Sep 2020, 66 (9) 676-681;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Share
Role of graduate courses in promoting educational scholarship of health care professionals
Savithiri Ratnapalan, Abbas Ghavam-Rassoul
Canadian Family Physician Sep 2020, 66 (9) 676-681;
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Program description
    • Program evaluation
    • Results
    • Discussion
    • Limitations
    • Conclusion
    • Acknowledgments
    • Notes
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Mainpro+® evaluation
  • Quebec College of Family Physicians’ new formal mentorship program
Show more Program Description

Similar Articles

Navigate

  • Home
  • Current Issue
  • Archive
  • Collections - English
  • Collections - Française

For Authors

  • Authors and Reviewers
  • Submit a Manuscript
  • Permissions
  • Terms of Use

General Information

  • About CFP
  • About the CFPC
  • Advertisers
  • Careers & Locums
  • Editorial Advisory Board
  • Subscribers

Journal Services

  • Email Alerts
  • Twitter
  • RSS Feeds

Copyright © 2021 by The College of Family Physicians of Canada

Powered by HighWire