Skip to main content

Main menu

  • Home
  • Articles
    • Current
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About CFP Mainpro+
    • Member Login
    • Instructions
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums

User menu

  • My alerts

Search

  • Advanced search
The College of Family Physicians of Canada
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums
  • My alerts
The College of Family Physicians of Canada

Advanced Search

  • Home
  • Articles
    • Current
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About CFP Mainpro+
    • Member Login
    • Instructions
  • RSS feeds
  • Follow cfp Template on Twitter
Research ArticleResearch

Assessment of communication skills in family medicine

Douglas Klein and Alim Nagji
Canadian Family Physician September 2015, 61 (9) e412-e416;
Douglas Klein
Associate Professor in the Department of Family Medicine at the University of Alberta in Edmonton.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: Doug.klein@ualberta.ca
Alim Nagji
Third-year resident in family and emergency medicine at the University of Alberta at the time of writing.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Abstract

Objective To assess the communication and interviewing skills of incoming residents and provide formative feedback to residents early in their training.

Design New residents completed a 15-minute objective structured clinical examination (OSCE) assessing communication skills and a 12-question, self-administered content quiz at the start of their residency. Each resident was directly observed by a family physician in the OSCE and provided with 15 minutes of structured feedback, with an opportunity for questions and discussion. The entire process remained private and did not affect summative evaluations.

Setting Family medicine residency training program at the University of Alberta in Edmonton.

Participants First-year family medicine residents.

Main outcome measures Residents’ scores on the OSCE and the content quiz; residents’ rating of the usefulness of the assessment and the likelihood it would lead to practice change.

Results A total of 61 residents (93.8%) completed the skills assessment (50 Canadian graduates, 11 international graduates). The mean score for the content quiz was 20.6 out of a total possible score of 24. Resident scores ranged from 8 to 24. The mean score on the OSCE practice interview was 21.1 out of 30, with a range of 13 to 29. Learner feedback indicated that the skills assessment was useful (4.68 out of 6) and would lead to a change in practice (4.43 out of 6).

Conclusion The introductory communication OSCE and quiz offer new residents an opportunity to gauge their baseline skill level, become aware of program expectations early in their training, and garner specific suggestions in a nonthreatening environment. This tailored approach helps orient residents while taking into account their previous experiences.

The doctor-patient relationship is the cornerstone of medical care1 and has been shown to affect treatment outcomes and patient satisfaction.2–6 The need for strong communication skills has been well explored.7,8 As such skills are an essential component of medical school and postgraduate curricula, further advances are necessary to ensure the development of competent clinicians and communicators.

A variety of assessment tools have been developed to evaluate the doctor-patient relationship,9 with a particular emphasis on communication.9,10 With the shift to competency-based curricula, there will be an increased need for evaluation tools that can offer formative and constructive feedback via observed interactions. Formalized communication will therefore be necessary11,12 and will require trained observers and checklists, with the possible addition of multiple observers or videorecording.13–15 Objective structured clinical examinations (OSCEs) remain the cornerstone of clinical examination, despite offering poor reliability in evaluating communication skills alongside clinical acumen.16–18

Many individuals change cities or countries when transitioning from medical school to residency. The resulting diverse backgrounds and previous experience create the potential for unequal footing during residency. In the family medicine program at the University of Alberta in Edmonton, we piloted an initial evaluative OSCE to ascertain the baseline characteristics of residents while offering a structured and formalized avenue for feedback specifically on communication skills. Given the paucity of observed interactions noted in many residency programs, it is essential that residents are offered the opportunity to have direct, specific feedback targeting their style, technique, and execution in patient interviews. As the patient history is key to medical diagnosis and the patient encounter is a critical component of the doctor-patient relationship, investing time and resources to ensure development of baseline expectations might enhance the communication skills of residents.

METHODS

In 2012, the Department of Family Medicine at the University of Alberta introduced a skills assessment at the beginning of residency. The purpose was to assess residents’ baseline skills in order to better support their training.

The skills assessment involved 2 components: an online written quiz and an observed OSCE practice interview. The online quiz evaluated the resident’s knowledge of communication microskills, such as paraphrasing and use of open-ended questions. Behaviour relating to personal well-being and resiliency was also assessed. The practice interview was observed live on camera by experienced faculty. Oral and written feedback were provided to the resident on listening skills, verbal and nonverbal communication, and the overall effectiveness of the interview. All the residents completed a formal evaluation of the process following the assessment, rating elements of the assessment on a 6-point Likert scale.

The content of the online written quiz and the evaluation criteria for the observed practice interview were determined by a community of family medicine faculty and reflect some basic competencies in interviewing and communication necessary for doctor-patient interaction. This 2-part skills assessment was based on an evaluation framework used by the College of Family Physicians of Canada.19,20 The skills assessment was then piloted with both faculty and residents in family medicine to ensure acceptability and feasibility. Ethics approval was obtained through the University of Alberta Health Research Ethics Board.

RESULTS

A total of 61 residents completed the skills assessment process, representing 93.8% of the first-year residents. Of the residents who completed the assessment, 26 were female (42.6%); 50 (82.0%) were Canadian medical graduates, while the remaining 11 were international medical graduates (IMGs). Some residents could not participate owing to scheduling conflicts with mandatory service-based rotations.

Residents scored well on the online quiz (Table 1). The mean (SD) score was 20.6 (3.05) out of a total possible score of 24 (range 8 to 24). The mean (SD) score on the observed practice interview was 21.1 (4.32) out of 30 (range 13 to 29). Table 2 shows the results of the practice interviews broken down by types of skills observed. In addition to scoring the resident, the faculty observer looked for specific behaviour during the practice interview. Elements of FIFE (feelings, ideas, function, expectations) were demonstrated by only half of the residents. Table 3 lists the behaviour observed and the frequency with which each was observed among the residents.

View this table:
  • View inline
  • View popup
Table 1.

Results of the online assessment of communication skills

View this table:
  • View inline
  • View popup
Table 2.

Results of the communication OSCE assessment: Each skill is scored out of 5 and the total is scored out of 30.

View this table:
  • View inline
  • View popup
Table 3.

Behaviour demonstrated by residents during the communication OSCE: N = 61 residents.

Overall, the residents found the 2-part skills assessment quite valuable (Table 4), citing introspective learning and potential future integration of feedback, and believed it was an appropriate measure of their skill.

View this table:
  • View inline
  • View popup
Table 4.

Results from the resident evaluation of the combined skills assessment

DISCUSSION

As in previous studies, residents’ skills assessment scores were highly varied, likely owing to their different experiences before commencing training.21,22 Therefore, the skills assessment can offer educators insight into the trends and baseline characteristics of the incoming cohort. Further, it creates an organized avenue for residents to receive targeted feedback in an area that will likely go unsupervised for most of their training.

Although the online assessment was unsupervised, it is an emerging avenue for assessing knowledge of foundational concepts, including definitions and frameworks. Determining the value of such assessment will require further research to elucidate possible relationships with the skills assessment and with resident performance.

Residents who might not have been aware of these key concepts beforehand were able to take the opportunity to supplement their knowledge before commencing their training. It is interesting to note that some residents still performed poorly in the online quiz. We hypothesize 2 possible reasons: either residents thought that they were not able to use resources while completing the quiz, or perhaps they trained at institutions that used alternate methods to impart these skills, as these individuals seemed to perform as well as their peers in the observed OSCE practice interviews.

Fortunately, most residents demonstrated solid foundational knowledge in their interviews, possibly owing to the increasing emphasis placed on communication skills in medical schools. Of note, individuals seemed to perform poorest in the FIFE domain, an interesting development given the relative ease of scoring points in this category. Feedback given after the interviews was well received by residents, with by far most indicating that it would lead to practice change and also noting that it offered introspective discovery.

Limitations

Comparing IMGs to graduates of the Canadian system poses an interesting challenge, given the relative differences in curriculum designs and the heterogeneity of the former group. Previous literature has documented the need for communication training in IMG populations.23,24 In our study the groups scored similarly on both assessments (t test, P = .52 for the quiz and P = .81 for the OSCE); however, the small sample size and single-site design are notable limitations. In Alberta, IMGs must first complete a longitudinal observership and are prescreened with communication OSCEs before receiving acceptance into our residency program.25 It is plausible that this leads to a selection bias when considering how this cohort performs on a downstream assessment, and our results might not be generalizable to other programs.

Conclusion

An introductory assessment of communication skills through observed interviews and an online quiz might be a valuable tool to stratify the baseline characteristics of new trainees. Country of training might not play a pivotal role or might be minimized by the varying entry requirements for IMGs and Canadian graduates. Residents found this to be a useful exercise with the potential to change practices as a result of the specific feedback offered. Further research can examine if these assessments can be used to identify residents who might struggle in the future.

Notes

EDITOR’S KEY POINTS

  • The diverse backgrounds and previous experience of residents creates the potential for unequal footing during training. This study aimed to assess the communication and interviewing skills of incoming residents and provide early formative feedback.

  • New residents completed an online quiz and an objective structured clinical examination assessing communication skills and received structured feedback from experienced family medicine faculty. Generally, residents performed well on both assessments, with similar performance among Canadian and international medical graduates.

  • The residents found the assessment useful and indicated that it offered the opportunity for introspective learning and had the potential to change their practice.

POINTS DE REPÈRE DU RÉDACTEUR

  • Parce qu’ils ont eu des conditionnements et des expériences différents, les résidents risquent de commencer leur formation sur des bases inégales. Cette étude voulait évaluer la capacité des nouveaux résidents de communiquer et d’effectuer des entrevues, tout en leur offrant un feedback précoce.

  • Les nouveaux résidents ont répondu à un quiz en ligne et à un examen clinique objectif structuré qui évaluaient leur habileté à communiquer pour ensuite profiter d’un feedback structuré de la part de professeurs expérimentés en médecine familiale. Les résidents ont généralement bien performé à ces deux évaluations, les diplômés canadiens et étrangers obtenant des résultats semblables.

  • Les résidents ont trouvé cette évaluation utile et souligné qu’elle leur offrait une occasion d’apprentissage introspectif susceptible de modifier leur pratique.

Footnotes

  • This article has been peer reviewed.

  • Cet article fait l’objet d’une révision par des pairs.

  • Contributors

    Both authors contributed to the concept and design of the study; data gathering, analysis, and interpretation; and preparing the manuscript for submission.

  • Competing interests

    None declared

  • Copyright© the College of Family Physicians of Canada

References

  1. 1.↵
    1. Engel GL
    . Enduring attributes of medicine relevant for the education of the physician. Ann Intern Med 1973;78(4):587-93.
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Fuertes JN,
    2. Mislowack A,
    3. Bennett J,
    4. Paul L,
    5. Gilbert TC,
    6. Fontan G,
    7. et al
    . The physician-patient working alliance. Patient Educ Couns 2007;66(1):29-36. Epub 2006 Dec 22.
    OpenUrlCrossRefPubMed
  3. 3.
    1. Martin DJ,
    2. Garske JP,
    3. Davis MK
    . Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review. J Consult Clin Psychol 2000;68(3):438-50.
    OpenUrlCrossRefPubMed
  4. 4.
    1. Griffith S
    . A review of the factors associated with patient compliance and the taking of prescribed medicines. Br J Gen Pract 1990;40(332):114-6.
    OpenUrlAbstract/FREE Full Text
  5. 5.
    1. Stewart M,
    2. Brown JB,
    3. Donner A,
    4. McWhinney IR,
    5. Oates J,
    6. Weston WW,
    7. et al
    . The impact of patient-centered care on outcomes. J Fam Pract 2000;49(9):796-804.
    OpenUrlPubMed
  6. 6.↵
    1. Kaplan SH,
    2. Greenfield S,
    3. Ware JE Jr.
    . Assessing the effects of physician-patient interactions on the outcomes of chronic disease. Med Care 1989;27(3 Suppl):S110-27.
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Dutta-Bergman MJ
    . The relation between health-orientation, provider-patient communication, and satisfaction: an individual-difference approach. Health Commun 2005;18(3):291-303.
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Cegala DJ,
    2. Street RL Jr.,
    3. Clinch CR
    . The impact of patient participation on physicians’ information provision during a primary care medical interview. Health Commun 2007;21(2):177-85.
    OpenUrlCrossRefPubMed
  9. 9.↵
    1. Eveleigh RM,
    2. Muskens E,
    3. van Ravesteijn H,
    4. van Dijk I,
    5. van Rijswijk E,
    6. Lucassen P
    . An overview of 19 instruments assessing the doctor-patient relationship: different models or concepts are used. J Clin Epidemiol 2012;65(1):10-5.
    OpenUrlPubMed
  10. 10.↵
    1. Boon H,
    2. Stewart M
    . Patient-physician communication assessment instruments:1986 to 1996 in review. Patient Educ Couns 1998;35(3):161-76.
    OpenUrlCrossRefPubMed
  11. 11.↵
    1. Herbers JE Jr.,
    2. Noel GL,
    3. Cooper GS,
    4. Harvey J,
    5. Pangaro LN,
    6. Weaver MJ
    . How accurate are faculty evaluations of clinical competence? J Gen Intern Med 1989;4(3):202-8.
    OpenUrlPubMed
  12. 12.↵
    1. Burdick WP,
    2. Schoffstall J
    . Observation of emergency medicine residents at the bedside: how often does it happen? Acad Emerg Med 1995;2(10):909-13.
    OpenUrlPubMed
  13. 13.↵
    1. Rosenzweig S,
    2. Brigham TP,
    3. Snyder RD,
    4. Xu G,
    5. McDonald AJ
    . Assessing emergency medicine resident communication skills using videotaped patient encounters: gaps in inter-rater reliability. J Emerg Med 1999;17(2):355-61.
    OpenUrlCrossRefPubMed
  14. 14.
    1. Novack DH,
    2. Dubé C,
    3. Goldstein MG
    . Teaching medical interviewing: a basic course on interviewing and the physician-patient relationship. Arch Intern Med 1992;152(9):1814-20.
    OpenUrlCrossRefPubMed
  15. 15.↵
    1. Kroboth FJ,
    2. Hanusa BH,
    3. Parker S,
    4. Coulehan JL,
    5. Kapoor WN,
    6. Brown FH,
    7. et al
    . The inter-rater reliability and internal consistency of a clinical evaluation exercise. J Gen Intern Med 1992;7(2):174-9.
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Brannick MT,
    2. Erol-Korkmaz HT,
    3. Prewett M
    . A systematic review of the reliability of objective structured clinical examination scores. Med Educ 2011;45(12):1181-9. Epub 2011 Oct 11.
    OpenUrlCrossRefPubMed
  17. 17.
    1. Nagji A
    . OSCE: the subjective experience of an objective exam. Univ Alberta Heal Sci J 2012;7(1):2.
    OpenUrl
  18. 18.↵
    1. Thistlethwaite JE
    . Developing an OSCE station to assess the ability of medical students to share information and decisions with patients: issues relating to interrater reliability and the use of simulated patients. Educ Health (Abingdon) 2002;15(2):170-9.
    OpenUrlPubMed
  19. 19.↵
    1. Lawrence KJ,
    2. Graves L,
    3. MacDonald S,
    4. Dalton D,
    5. Tatum R,
    6. Blais G,
    7. et al
    . Distinguishing a “Certificant” from a “Superior Certificant”: exploration of the illness experience. Mississauga, ON: College of Family Physicians of Canada; 2010.
  20. 20.↵
    1. Allen T,
    2. Bethune C,
    3. Brailovsky C,
    4. Crichton T,
    5. Donoff M,
    6. Laughlin T,
    7. et al
    . Defining competence in family medicine for the purposes of Certification by the College of Family Physicians of Canada: the evaluation objectives in family medicine. Mississauga, ON: College of Family Physicians of Canada; 2011.
  21. 21.↵
    1. Lypson ML,
    2. Frohna JG,
    3. Gruppen LD,
    4. Woolliscroft JO
    . Assessing residents’ competencies at baseline: identifying the gaps. Acad Med 2004;79(6):564-70.
    OpenUrlCrossRefPubMed
  22. 22.↵
    1. Roth CS,
    2. Watson KV,
    3. Harris IB
    . A communication assessment and skill-building exercise (CASE) for first-year residents. Acad Med 2002;77(7):746-7.
    OpenUrlPubMed
  23. 23.↵
    1. Hall P,
    2. Keely E,
    3. Dojeiji S,
    4. Byszewski A,
    5. Marks M
    . Communication skills, cultural challenges and individual support: challenges of international medical graduates in a Canadian healthcare environment. Med Teach 2004;26(2):120-5.
    OpenUrlCrossRefPubMed
  24. 24.↵
    1. Pilotto LS,
    2. Duncan GF,
    3. Anderson-Wurf J
    . Issues for clinicians training international medical graduates: a systematic review. Med J Aust 2007;187(4):225-8.
    OpenUrlPubMed
  25. 25.↵
    1. Hofmeister M,
    2. Lockyer J,
    3. Crutcher R
    . The multiple mini-interview for selection of international medical graduates into family medicine residency education. Med Educ 2009;43(6):573-9.
    OpenUrlCrossRefPubMed
View Abstract
PreviousNext
Back to top

In this issue

Canadian Family Physician: 61 (9)
Canadian Family Physician
Vol. 61, Issue 9
1 Sep 2015
  • Table of Contents
  • About the Cover
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on The College of Family Physicians of Canada.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Assessment of communication skills in family medicine
(Your Name) has sent you a message from The College of Family Physicians of Canada
(Your Name) thought you would like to see the The College of Family Physicians of Canada web site.
Citation Tools
Assessment of communication skills in family medicine
Douglas Klein, Alim Nagji
Canadian Family Physician Sep 2015, 61 (9) e412-e416;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Share
Assessment of communication skills in family medicine
Douglas Klein, Alim Nagji
Canadian Family Physician Sep 2015, 61 (9) e412-e416;
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • METHODS
    • RESULTS
    • DISCUSSION
    • Notes
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Related Articles

  • No related articles found.
  • Scopus
  • Google Scholar

Cited By...

  • Antibiotic use: dont blame doctors for trying to manage patient expectations
  • Scopus (2)
  • Google Scholar

More in this TOC Section

  • Patient Dignity Question
  • Choosing Wisely Canada campaign associated with less overuse of thyroid testing
  • Suicidal ideation among family practice residents at the University of British Columbia
Show more Research

Similar Articles

Subjects

  • Collection française
    • Résumés de recherche

Navigate

  • Home
  • Current Issue
  • Archive
  • Collections - English
  • Collections - Française

For Authors

  • Authors and Reviewers
  • Submit a Manuscript
  • Permissions
  • Terms of Use

General Information

  • About CFP
  • About the CFPC
  • Advertisers
  • Careers & Locums
  • Editorial Advisory Board
  • Subscribers

Journal Services

  • Email Alerts
  • Twitter
  • RSS Feeds

Copyright © 2019 by The College of Family Physicians of Canada

Powered by HighWire