Skip to main content

Main menu

  • Home
  • Articles
    • Current
    • Published Ahead of Print
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About Mainpro+
    • Member Login
    • Instructions
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums

User menu

  • My alerts

Search

  • Advanced search
The College of Family Physicians of Canada
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums
  • My alerts
The College of Family Physicians of Canada

Advanced Search

  • Home
  • Articles
    • Current
    • Published Ahead of Print
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About Mainpro+
    • Member Login
    • Instructions
  • RSS feeds
  • Follow cfp Template on Twitter
Research ArticleWeb exclusive

Assessing students and residents

Five research-based strategies

Eric Dionne
Canadian Family Physician January 2023, 69 (1) e21-e22; DOI: https://doi.org/10.46747/cfp.6901e21
Eric Dionne
Professor in the Faculty of Education and Faculty of Medicine at the University of Ottawa in Ontario and holds the uOttawa–Institut du savoir Montfort Research Chair in Medical Education.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • eLetters
  • Info & Metrics
  • PDF
Loading

In a previous issue of Canadian Family Physician, Desrosiers mentioned that “in the process of becoming physicians, we also become teachers.”1 One might add that in becoming teachers, we also become evaluators! In fact, learning assessment is at the core of the learning process. There are few pedagogic research results that garner as much consensus as the importance of assessment in the learning context.2-4 In this article, I present 5 learning assessment strategies that physician teachers and evaluators could leverage in their teaching, be it in a preclerkship, clerkship, or residency setting.

How to render the invisible visible?

The concern with the assessment process is that learning is, alas, invisible. We could never accurately visualize student and resident learning. Therefore, the challenge is to implement a system that renders learning visible, allowing us to measure or observe it to ensure the validity and fidelity of the inferences. Laurier et al5 place assessment within a dynamic of change; learning represents the result located between a final situation and an initial situation. Within a competency-based framework, it is possible to implement a number of strategies that allow us to infer the competency being assessed based on a set of performances. The key is to strategically choose performances, such as answering questions on an examination, discussing case studies, or conducting physical examinations, that would allow evaluators to make informed decisions on the quality of the progression of learning.

Keep the assessment contract in mind

The concept of the assessment contract is borrowed from the didactic contract developed by Brousseau.6 Generally speaking, learners and teachers negotiate, more or less explicitly, the elements of the assessment. This can be illustrated by the propensity of some learners, knowing they are undergoing a summative assessment, to adopt behaviour that emphasizes the best aspect of their competencies while masking the less favourable aspects. Another classic example is the fact that learners will study and primarily focus on learning that is assessed, to the detriment of learning that is not. All learning is important, but that which is assessed and could impact their progression is considered more important!

Assessing means respecting a rigorous process

For many people, assessments are reduced to a mark (eg, 90%) or a grade (eg, pass). These aspects are important because they are effectively a part of the assessment approach and represent the most visible component of it. Yet, to arrive at a decision, assessing physicians must implement an approach that is formal or informal, instrumented or not, and planned or not. In all cases, the assessment will consist of the following dimensions: planning, information gathering, the judgment and the decision, and finally, communication of the result. If the approach is formal, instrumented, and planned, as is often the case in preclerkships, the dimensions will be easily observable. Learners will be informed of the examination sessions (planning). Following the administration of the examination, teachers will grade the examination, or it will be graded automatically (information gathering). Once information is revealed through the grading process, a judgment will be made followed by a decision (eg, learners who have not passed the threshold score must retake the examination). Finally, there is the communication of the decision (eg, communicating the grade to the learner or informing them of the need to retake the examination).

The situation I have just described is characteristic of a summative approach. Yet, it is also possible to identify these dimensions when an assessment is informal and not instrumented or planned, as is often the case with formative assessments. A teacher responding to a question from a learner may use these same dimensions but in a quasi-simultaneous manner. Planning would therefore be minimal, even if competent and experienced teachers would tell us that the questions are often predictable. Teachers would collect data from the answers while judging the value of the question. They would exercise their expert judgment and make a decision (respond with another question, connect the answer with a previously taught concept, etc), and, finally, communicate it to the learner. We could compare these 2 methods to type 1 and type 2 clinical reasoning.7 Type 1 reasoning (rapid and intuitive) relates to the formative context, while type 2 reasoning (logic and analysis) relates to the summative context.

Accept that assessments will never be completely objective

An assessment, whether formative or summative, is first and foremost what we saw in the preceding point: a judgment. By definition, a judgment inherently possesses a subjective component. One might incorrectly think that multiple-choice questions are objective. However, making most of the questions about a small fraction of the material taught is enough to render the examination biased and not reflective of learners’ true progress. The grading process is the only aspect of multiple-choice questions that is objective; the questions are not. In other contexts where observation is required, as in objective structured clinical examinations, several researchers have become interested in conditions that legitimately reduce subjectivity.8 We must accept the fact that assessments are an imperfect human activity. That said, we must also work tirelessly to eliminate obstacles potentially affecting the validity of assessments.

To measure or to observe, that is the question

While assessing learning, we can rely on 2 types of information: measurement and observation. Measurement most frequently refers to marks obtained, for example, on multiple-choice questions. The number of “correct responses” serves as a “measurement”: the higher the number of correct responses, the better the learning. This correlation is not always true, but it is the essence of measuring learning. In preclerkships, learning progress is generally measured. During clerkships and residencies, observations are more heavily relied upon, which requires recording tools such as field notes and criteria grids based on the CanMEDS framework.9 The nature of the information collected, therefore, depends on its context. It is advisable to identify attributes of this context that allow one to develop or rely upon tools adapted to a specific situation.

Conclusion

It is now well documented that formative assessment has a positive impact on learning.2-4 Learning assessment training should be a part of professional development for physicians working in pedagogy.

Notes

Teaching tips

▸ The learning assessment is an approach that aims to produce the best possible decisions, both in pedagogic and administrative contexts.

▸ Learning assessment is a discipline in and of itself, with a considerable body of knowledge both on medical education as well as other pedagogic disciplines.

▸ Training on learning assessment should be a part of professional development for physicians working in pedagogy.

Teaching Moment is a quarterly series in Canadian Family Physician, coordinated by the Section of Teachers of the College of Family Physicians of Canada. The focus is on practical topics for all teachers in family medicine, with an emphasis on evidence and best practice. Please send any ideas, requests, or submissions to Dr Viola Antao, Teaching Moment Coordinator, at viola.antao{at}utoronto.ca.

Footnotes

  • Competing interests

    None declared

  • La version en français de cet article se trouve à https://www.cfp.ca dans la table des matières du numéro de janvier 2023 à la page 67.

  • Copyright © 2023 the College of Family Physicians of Canada

References

  1. 1.↵
    1. Desrosiers É.
    Mastering teaching as a resident. Easier done than said. Can Fam Physician 2015;61:e344-6 (Eng), 642-4 (Fr).
    OpenUrlFREE Full Text
  2. 2.↵
    1. Mitra NK,
    2. Barua A.
    Effect of online formative assessment on summative performance in integrated musculoskeletal system module. BMC Med Educ 2015;15:29.
    OpenUrl
  3. 3.
    1. Hattie J.
    Visible learning for teachers. Maximizing impact on learning. New York, NY: Routledge; 2012.
  4. 4.↵
    1. Black P,
    2. Wiliam D.
    Inside the black box: raising standards through classroom assessment. Phi Delta Kappan 2010;92(1):81-90.
    OpenUrlCrossRef
  5. 5.↵
    1. Laurier MD,
    2. Tousignant R,
    3. Morissette D.
    Les principes de la mesure et de l’évaluation des apprentissages. 3rd ed. Montréal, QC: Gaëtan Morin; 2005.
  6. 6.↵
    1. Brousseau G.
    Fondements et méthodes de la didactique des mathématiques. Recherches en Didactique des Mathématiques 1986;7(2):33-115.
    OpenUrl
  7. 7.↵
    1. Kahneman D.
    Thinking, fast and slow. New York, NY: Farrar, Straus and Giroux; 2011.
  8. 8.↵
    1. Chong L,
    2. Taylor S,
    3. Haywood M,
    4. Adelstein BA,
    5. Shulruf B.
    The sights and insights of examiners in objective structured clinical examinations. J Educ Eval Health Prof 2017;14:34.
    OpenUrl
  9. 9.↵
    CanMEDS: better standards, better physicians, better care. Ottawa, ON: Royal College of Physicians and Surgeons of Canada; 2015. Available from: https://www.royalcollege.ca/rcsite/canmeds/canmeds-framework-e. Accessed 13 Oct 2022.
PreviousNext
Back to top

In this issue

Canadian Family Physician: 69 (1)
Canadian Family Physician
Vol. 69, Issue 1
1 Jan 2023
  • Table of Contents
  • About the Cover
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on The College of Family Physicians of Canada.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Assessing students and residents
(Your Name) has sent you a message from The College of Family Physicians of Canada
(Your Name) thought you would like to see the The College of Family Physicians of Canada web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Assessing students and residents
Eric Dionne
Canadian Family Physician Jan 2023, 69 (1) e21-e22; DOI: 10.46747/cfp.6901e21

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Share
Assessing students and residents
Eric Dionne
Canadian Family Physician Jan 2023, 69 (1) e21-e22; DOI: 10.46747/cfp.6901e21
Reddit logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • How to render the invisible visible?
    • Keep the assessment contract in mind
    • Assessing means respecting a rigorous process
    • Accept that assessments will never be completely objective
    • To measure or to observe, that is the question
    • Conclusion
    • Notes
    • Footnotes
    • References
  • Info & Metrics
  • eLetters
  • PDF

Related Articles

  • L’évaluation des étudiants et des résidents
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

Web exclusive

  • Chronic noncancer pain management
  • Timely access to primary care in New Brunswick
  • Resistance, release
Show more Web exclusive

Teaching Moment

  • Curiosity as a tool in medical supervision
  • How to CRAFT an effective preceptor-learner relationship
Show more Teaching Moment

Similar Articles

Navigate

  • Home
  • Current Issue
  • Archive
  • Collections - English
  • Collections - Française

For Authors

  • Authors and Reviewers
  • Submit a Manuscript
  • Permissions
  • Terms of Use

General Information

  • About CFP
  • About the CFPC
  • Advertisers
  • Careers & Locums
  • Editorial Advisory Board
  • Subscribers

Journal Services

  • Email Alerts
  • Twitter
  • RSS Feeds

Copyright © 2023 by The College of Family Physicians of Canada

Powered by HighWire