Skip to main content

Main menu

  • Home
  • Articles
    • Current
    • Published Ahead of Print
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About Mainpro+
    • Member Login
    • Instructions
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums

User menu

  • My alerts

Search

  • Advanced search
The College of Family Physicians of Canada
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums
  • My alerts
The College of Family Physicians of Canada

Advanced Search

  • Home
  • Articles
    • Current
    • Published Ahead of Print
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About Mainpro+
    • Member Login
    • Instructions
  • RSS feeds
  • Follow cfp Template on Twitter
  • LinkedIn
  • Instagram
Article CommentaryCommentary

Gauging to gain

Primary care performance measurement

Sharon Johnston, Simone Dahrouge and William Hogg
Canadian Family Physician September 2008; 54 (9) 1215-1217;
Sharon Johnston
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Simone Dahrouge
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William Hogg
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Until our performance-measurement system is based on clinically relevant information and targets high-priority care, performance measurement is likely to remain a great idea that is more of a distraction than a benefit.

Rodney A. Hayward1

High-quality and accountable health care is everyone’s business.2 Over the past few years, performance measurement in health care has been heralded as a key to improving quality and reducing errors, encouraging greater efficiency,3 and improving government accountability for the largest segment of budget expenditure.4 Family physicians should embrace this movement and participate in its design to ensure it does lead to better health care.

Why measure performance?

Performance measurement in primary care can serve 2 main purposes: improving quality and promoting accountability.5 Measuring performances of individuals, practices, and even regions can highlight strengths and weakness at all levels of the system and guide reform initiatives and use of resources. It can be used to provide summative reports or offer formative feedback. Different goals for performance measurement in primary care are served by different tools and approaches.

There is broad agreement that an evaluation of primary care performance includes more than measuring the technical component of care and service delivery.6,7 It should also seek to understand the structural features of the health care system, the practice context, the patient population, and the organization of the practice—factors that can influence performance.8

The underlying goal of the evaluation and its intended target audience will help shape the measurement approach. For example, a regional policy maker might rely on the ratio of providers to population, availability of after-hours semiurgent care, or wait times for appointments to evaluate performance. The Saskatchewan Health Quality Council adapts its reports to its audience: patients, policy makers, managers, and providers. The first 2 might need more summative “bottom line” information on system-wide outcomes. The latter group needs information tailored to elements within the system that can influence aspects of care under their control, such as prescribing patterns.9

National efforts

The field of performance measurement research has produced a proliferation of measurement tools and performance indicators over the past 15 years. Until recently, most performance measurement efforts focused on large groups such as hospitals or managed care organizations rather than individual providers, with the exception of certain areas in cardiology and cardiac surgery.10 Performance measurement efforts in Canada have often not included primary care. However, this is about to change.

There is increasing agreement that there should be evidence-based standards for primary care, allowing more aspects of the delivery process to be measured against benchmarks or established targets. Several groups across Canada, as well as internationally, have worked to develop and validate primary care performance indicators.11,12 The Canadian Institute for Health Information created a set of 105 pan-Canadian primary health care indicators.13 Today data are routinely collected for a small but ever increasing number of these indicators, and this is a priority area for many research and policy groups nationally.

Evaluation of performance with indicators can use data from many sources, such as provincial billing records, chart extractions, patient surveys, and even practice and population surveys (Table 1). The use of regularly collected data from large administrative databases, such as provincial billing information, offers the potential for relatively inexpensive performance measurement.

View this table:
  • View inline
  • View popup
Table 1

Examples of performance indicators for primary care

Provincial action

Some provinces have made great progress in linking various databases to provide a more complete picture of how parts of the primary care system are performing. For example, the Saskatchewan Health Quality Council used provincial data on hospitalizations, physician billing diagnostic codes, drug claims, and vital statistics to determine the percentage of patients with diabetes in the province aged 20 years and older who were prescribed medications recommended by the Canadian Diabetes Association 2003 clinical practice guidelines.14 However, there are several weaknesses in using the provincial health administrative databases for such measures. For example, they do not capture encounter information for care provided by salaried physicians or by allied health professionals. They also do not include information on aboriginal Canadians, whose health care is funded by the federal government; most of these indices still need to be validated.

Several provinces are currently measuring the health of their populations by combining such administrative data and survey information, as in Quebec’s 2006 “Portrait de Santé.”15 The use of such data will likely increase, as all provinces have committed to reporting annually on the performance of their health care systems.14 Additionally, health quality councils across Canada are reporting on the quality of key aspects of the system.

Performance measurement is also being used at the practice level to give providers specific feedback on how they compare with peers in achieving specific quality targets.16 Initiatives across the country are incorporating performance measurement into practice-level quality improvement programs. For example, an intervention program to improve chronic disease management across the Champlain Local Health Integration Network, the regional health authority in eastern Ontario, will offer primary care providers feedback on performance for well-recognized chronic disease management targets. It will also provide an on-site organization and behavioural change facilitator to help develop interventions for improvement tailored to the practice context.17

An international example of one of the most advanced systems for performance measurement in primary care is the United Kingdom’s Quality and Outcomes Framework, which offers family practitioners the opportunity to earn up to 25% of their income in bonus payments for achieving targets for performance indicators in clinical care, practice organization, and patient experience. The data are supplied by physicians and are extracted directly from computerized records. Providers can exclude inappropriate patients from the calculation of rates for a variety of reasons, such as treatment refusal.18

A word of caution

There have only been a few attempts to evaluate the effects of performance measurement, and results to date show mixed outcomes.1,18 There is little evidence to suggest that public reporting is bringing about sustained change,4 and individual providers are not sufficiently influenced by summative, publicly reported score cards.3

Despite this, performance is being measured more and more frequently. What can be measured can be rewarded, talked about, voted on, and given political weight. Wait times for cataract surgery is a recent example of an area of concern. If primary care is not measured, it might be absent in future debates.

Performance measurement breaks down primary care into discreet elements linked to evidence. Naturally, some aspects of primary care are easier and less expensive to measure than others. Measuring trust, rates of smoking cessation counseling, patient-centred care, and cultural sensitivity is very difficult. Similarly, measurements such as the percentage of patients with diabetes who have seen an ophthalmologist are readily available from the health administration databases but say little about the primary care system.

Priorities

It is essential that care for the individual is not lost. We must be mindful of the aspects of primary care that are not currently being measured and cannot be readily measured with available data sources. There are many aspects of day-to-day primary care that are not accurately captured in billing data or even with chart abstractions. 19 It is important that a full portrait of primary care service and delivery be presented. For performance measurement to work, the providers must buy into the performance ratings; this might not happen if progress is not made in developing a more comprehensive measurement of the quality of care provided. If only part of the story is told, primary care providers will get only part of the credit (and possibly resources) they are due. And as there is an increased focus on measurable targets, practitioners could become more rigid in their care by focusing more narrowly on reported measures rather than on actual quality of care provided to patients.20

While quality indicators break down the process of care into measurable elements, not all elements are of equal importance to the patient, the provider, or the community. Summary scores of quality are often not weighted for proven effect. Therefore, foot inspection for diabetes patients might be weighted equally with achieving glycemic control, leading to unbalanced perspectives and misallocation of resources.21

Finally, there is a danger of performance measurement hindering attempts to improve quality or accountability. If measurement and reporting practices create a culture of blame, are not linked with improvement intervention strategies, or create practice patterns targeting measured aspects rather than whole-patient care, quality and accountability might suffer.

Next steps

Effective primary care performance measurement systems in Canada are still in their infancy. Research into innovative, efficient data collection and reporting methods should be encouraged. Provider input is essential at all stages, from developing the indicators of quality care to collecting data to reporting and interpreting results. Family physicians should be leaders in building these processes to ensure they are compatible with the principles and goals of family medicine.18,22 Performance measurement systems must build upon and help fulfil family physicians’ obligations for self-regulation and maintenance of competency, as well as accountability to their patients and the public.

Performance measurement offers the potential to lead to better and more accountable primary care in Canada. We must ensure performance measurement does not become a distraction from but a foundation for the care we deliver.

Footnotes

  • Cet article se trouve aussi en français à la page 1220

  • Competing interests

    None declared

  • The opinions expressed in commentaries are those of the authors. Publication does not imply endorsement by the College of Family Physicians of Canada.

  • Copyright© the College of Family Physicians of Canada

References

  1. ↵
    HaywardRAPerformance measurement in search of a pathN Engl J Med200735699513
    OpenUrlCrossRefPubMed
  2. ↵
    Health CanadaFirst Ministers’ health communiqué: accountability and reportingOttawa, ONHealth Canada2000. Available from: www.tbs-sct.gc.ca/rma/eppi-ibdrp/hrs-ceh/5/FMH-PMS_e.asp. Accessed 2008 Jul 23.
  3. ↵
    MarshallMNShekellePGDaviesHTSmithPCPublic reporting on quality in the United States and the United KingdomHealth Aff (Millwood)200322313448
    OpenUrlAbstract/FREE Full Text
  4. ↵
    BrownADPorcellatoCBarnsleyJAccountability: unpacking the suitcaseHealthc Q200693725
    OpenUrlPubMed
  5. ↵
    FreemanTUsing performance indicators to improve health care quality in the public sector: a review of the literatureHealth Serv Manage Res200215212637
    OpenUrlAbstract/FREE Full Text
  6. ↵
    DonabedianAEvaluating the quality of medical care. 1966Milbank Q2005834691729
    OpenUrlCrossRefPubMed
  7. ↵
    1. Watson D,
    2. Broemeling A,
    3. Reid R,
    4. Black C
    A results-based logic model for primary health care.Vancouver, BCCentre for Health Services and Policy Research2004. Available from: www.chspr.ubc.ca/files/publications/2004/chspr04-19.pdf. Accessed 2008 Jul 23.
  8. ↵
    1. Hogg W,
    2. Rowan M,
    3. Russell G,
    4. Geneau R,
    5. Muldoon L
    Framework for primary care organizations: the importance of a structural domainInt J Qual Health Care2008Jun13. Epub ahead of print.
  9. ↵
    ChanBTSmaduMMcMillanJSQuality councils as catalysts and leaders in quality improvement: the experience of the health quality council in SaskatchewanHealthc Pap2006633845
    OpenUrlPubMed
  10. ↵
    EpsteinAMLeeTHHamelMBPaying physicians for high-quality careN Engl J Med2004350440610
    OpenUrlCrossRefPubMed
  11. ↵
    1. Barnsley J,
    2. Berta W,
    3. Cockerill R,
    4. MacPhail J,
    5. Vayda E
    Identifying performance indicators for family practice: assessing levels of consensusCan Fam Physician2005517001e17. Available from: www.cfp.ca/cgi/reprint/51/5/700. Accessed 2008 Aug 6.
    OpenUrlAbstract/FREE Full Text
  12. ↵
    McGlynnEAAschSMDeveloping a clinical performance measureAm J Prev Med1998143 Suppl1421
    OpenUrlCrossRefPubMed
  13. ↵
    Canadian Institute for Health InformationPan-Canadian primary health care indicatorsOttawa, ONCanadian Institute for Health Information2006. Available from: http://secure.cihi.ca/cihiweb/dispPage.jsp?cw_page=GR_1489_E. Accessed 2008 Jul 23.
  14. ↵
    Health Canada2003 First Ministers’ accord on health care renewal.Ottawa, ONHealth Canada2006. Available from: www.hc-sc.gc.ca/hcs-sss/delivery-prestation/fptcollab/2003accord/index-eng.php. Accessed 2008 Jul 23.
  15. ↵
    Institut national de santé publique du Québec. Portrait de santé du Québec et de ses régions 2006: deuxième rapport national sur l’état de santé de la population du Québec. Quebec, QC: Institut national de santé publique du Québec; 2006. Available from: www.inspq.qc.ca/pdf/publications/546-PortraitSante2006_Analyses.pdf. Accessed 2008 Jul 23.
  16. ↵
    1. Rowan MS,
    2. Hogg W,
    3. Martin C,
    4. Vilis E
    Family physicians’ reactions to performance assessment feedbackCan Fam Physician20065215701e16. Available from: www.cfp.ca/cgi/reprint/52/12/1570. Accessed 2008 Aug 6.
    OpenUrlAbstract/FREE Full Text
  17. ↵
    Champlain Cardiovascular Disease Prevention NetworkImproved delivery of cardiovascular preventive care through outreach facilitationOttawa, ONChamplain Cardiovascular Disease Prevention Network2007. Available from: www.ccpnetwork.ca/priorities/primary-care_e.pdf. Accessed 2008 Jul 23.
  18. ↵
    RolandMLinking physicians’ pay to the quality of care—a major experiment in the United KingdomN Engl J Med200435114144854
    OpenUrlCrossRefPubMed
  19. ↵
    National Primary Care Research and Development Centre, RAND CorporationMeasuring general practice: a demonstration project to develop and test a set of primary care clinical quality indicators.London, EnglThe Nuffield Trust2003. Available from: www.rand.org/pubs/monograph_reports/2005/MR1725.pdf. Accessed 2008 Jul 23.
  20. ↵
    WernerRMAschDAClinical concerns about clinical performance measurementAnn Fam Med20075215963
    OpenUrlAbstract/FREE Full Text
  21. ↵
    CasalinoLPThe unintended consequences of measuring quality on the quality of medical careN Engl J Med199934115114750
    OpenUrlCrossRefPubMed
  22. ↵
    LeeTHMeyerGSBrennanTAA middle ground on public accountabilityN Engl J Med200435023240912
    OpenUrlCrossRefPubMed
PreviousNext
Back to top

In this issue

Canadian Family Physician: 54 (9)
Canadian Family Physician
Vol. 54, Issue 9
1 Sep 2008
  • Table of Contents
  • About the Cover
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on The College of Family Physicians of Canada.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Gauging to gain
(Your Name) has sent you a message from The College of Family Physicians of Canada
(Your Name) thought you would like to see the The College of Family Physicians of Canada web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Gauging to gain
Sharon Johnston, Simone Dahrouge, William Hogg
Canadian Family Physician Sep 2008, 54 (9) 1215-1217;

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Share
Gauging to gain
Sharon Johnston, Simone Dahrouge, William Hogg
Canadian Family Physician Sep 2008, 54 (9) 1215-1217;
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Why measure performance?
    • National efforts
    • Provincial action
    • A word of caution
    • Priorities
    • Next steps
    • Footnotes
    • References
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • Gauger pour gagner
  • PubMed
  • Google Scholar

Cited By...

  • Conducting waiting room surveys in practice-based primary care research: A user's guide
  • Google Scholar

More in this TOC Section

  • Will blended family physician payment models revive primary care in Canada?
  • Toward an identity and team-based practice rooted in transdisciplinarity
  • Task sharing, community health workers, and Canada’s primary care crisis
Show more Commentary

Similar Articles

Navigate

  • Home
  • Current Issue
  • Archive
  • Collections - English
  • Collections - Française

For Authors

  • Authors and Reviewers
  • Submit a Manuscript
  • Permissions
  • Terms of Use

General Information

  • About CFP
  • About the CFPC
  • Advertisers
  • Careers & Locums
  • Editorial Advisory Board
  • Subscribers

Journal Services

  • Email Alerts
  • Twitter
  • LinkedIn
  • Instagram
  • RSS Feeds

Copyright © 2025 by The College of Family Physicians of Canada

Powered by HighWire