Skip to main content

Main menu

  • Home
  • Articles
    • Current
    • Published Ahead of Print
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About Mainpro+
    • Member Login
    • Instructions
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums

User menu

  • My alerts

Search

  • Advanced search
The College of Family Physicians of Canada
  • Other Publications
    • http://www.cfpc.ca/Canadianfamilyphysician/
    • https://www.cfpc.ca/Login/
    • Careers and Locums
  • My alerts
The College of Family Physicians of Canada

Advanced Search

  • Home
  • Articles
    • Current
    • Published Ahead of Print
    • Archive
    • Supplemental Issues
    • Collections - French
    • Collections - English
  • Info for
    • Authors & Reviewers
    • Submit a Manuscript
    • Advertisers
    • Careers & Locums
    • Subscribers
    • Permissions
  • About CFP
    • About CFP
    • About the CFPC
    • Editorial Advisory Board
    • Terms of Use
    • Contact Us
  • Feedback
    • Feedback
    • Rapid Responses
    • Most Read
    • Most Cited
    • Email Alerts
  • Blogs
    • Latest Blogs
    • Blog Guidelines
    • Directives pour les blogues
  • Mainpro+ Credits
    • About Mainpro+
    • Member Login
    • Instructions
  • RSS feeds
  • Follow cfp Template on Twitter
  • LinkedIn
  • Instagram
Article CommentaryCommentary

Ten years of the Primary Care Assessment Tool in Canadian Family Physician: what is next?

Contributions from the Brazilian National Health Survey and the Canadian Community Health Survey

Luiz Felipe Pinto, Erno Harzheim, Otavio Pereira D’Avila, Lisiane Hauser, Valerie Baron and David Ponka
Canadian Family Physician July 2021; 67 (7) 479-480; DOI: https://doi.org/10.46747/cfp.6707479
Luiz Felipe Pinto
Associate Professor at the Federal University of Rio de Janeiro in Brazil, and a postdoctoral fellow at Instituto de Higiene e Medicina Tropical—Universidade Nova de Lisboa in Portugal.
MSc PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: felipepinto.rio@medicina.ufrj.br
Erno Harzheim
Associate Professor at the Federal University of Rio Grande do Sul in Brazil.
MD FCM PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Otavio Pereira D’Avila
Adjunct Professor at the Federal University of Pelotas in Rio Grande do Sul.
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lisiane Hauser
Consultant at the Brazilian Ministry of Health in Porto Alegre.
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Valerie Baron
Manager of the Besrour Centre for Global Family Medicine at the College of Family Physicians of Canada in Mississauga, Ont, at the time this article was written.
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David Ponka
Director of the Besrour Centre for Global Family Medicine at the College of Family Physicians of Canada and Associate Professor in the Department of Family Medicine at the University of Ottawa in Ontario.
MD CM CCFP(EM) FCFP MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • eLetters
  • Info & Metrics
  • PDF
Loading

It is now a little more than a decade since Canadian Family Physician published its first research article on the Primary Care Assessment Tool (PCAT),1 an instrument that has been used on 5 continents since its development in 2001.2

We review some pioneering work that used the PCAT and describe recent developments that prove it is still alive and well. The PCAT continues to be used in Canada, particularly in Alberta, and in Brazil, where it has been adapted with support from Brazil’s national statistics bureau, the Brazilian Institute of Geography and Statistics (IBGE). Statistics Canada is using innovative solutions from the Canadian Community Health Survey (CCHS), parts of which were inspired by the PCAT. In 2019, Brazil demonstrated that while using the PCAT entails a substantial effort in terms of data collection, it permits the creation of a national and provincial baseline by which to measure, compare, and track adult user experiences in primary care over time.

Ten years using the PCAT in Canada

In December 2019, Moe and colleagues3 described a study of repeated panels of PCAT use in Alberta (2007, 2010, 2013, and 2016). Their article marked the 10th anniversary of Canadian Family Physician’s first publication on the use of the PCAT to assess the extent of affiliation and primary care orientation of primary care models in 3 Canadian provinces. The series began in 2010 with the publication of Tourigny and colleagues’ evaluation of the use of the PCAT in Quebec.4

In 2010, Muldoon and colleagues1 analyzed the community orientation domain from the key baseline COMP-PC (Comparison of Models of Primary Care in Ontario) study from the perspectives of users and providers—both family physicians and nurse practitioners. To date, this baseline study is the largest Canadian study using the PCAT, with a random sample of more than 5000 adult users and providers. In 2011, 2013, and 2014, Dahrouge et al,5 Mayo-Bruinsma et al,6 and Muggah et al,7 respectively, chose other attributes measured by the PCAT for their analyses of the COMP-PC results. Their chosen attribute was family-centred care; patient-reported access and age equity (in terms of access) in different models were also considered. In 2016, Carroll et al8,9 published 2 articles that used the adult expanded version of the PCAT in Toronto, Ont, to assess academic family health teams and demonstrated that new strategies were necessary to enhance access to care.

Moe and colleagues3 were pioneering, in that they were the only researchers to follow the same patient panel over time using the PCAT as an instrument. This permitted them to follow trends at the WestView Primary Care Network in Alberta, for instance. In 2006, the WestView Primary Care Network implemented a new primary care model that included community-based family practice clinics, collaborative team-based care, and nonphysician health care professionals; it was important to have a rigorous methodology to evaluate the pioneering changes.

New challenges with primary health care (PHC) reforms in Canada

Since the beginning of the 2000s, Canadian PHC reforms have created new variables of interest in primary care models in each province and territory. New domains of interest included team-based care, new capitation schemes, new payment systems, and the use of telemedicine. In 2021, primary care merits a reassessment, as does the PCAT itself. There is a need to adapt, complement, and validate the questionnaire from the original Canadian cross-cultural version to one that better represents Canadian demographic characteristics today. This revised version could be based on a complex statistical sampling plan, as is used in the CCHS, and could provide several opportunities: to collect an appropriate statistical sample size to represent the PHC domains and provinces, to calculate the coefficients of variation of estimates, and to detail nonsampling errors. As Wonnacott and Wonnacott have pointed out, “one of the fundamental tasks of statistics would be to answer the question—‘how small is this error?’”10 Almost 20 years ago, one of the first studies using the PCAT in Canada did not find results that validated accessibility—the first-contact access domain—with certainty.11

What is next?

A new federal model for financing PHC was created by the Brazilian Ministry of Health in 2019.12 One of the assessment tools considered for this important initiative was a federal pay-for-perfomance evaluation scheme for the 27 Brazilian states.13 This initiative was piloted using the PCAT-Brazil; it was validated first by Starfield and Brazilian colleagues14 in 2006 and later by the Brazilian Ministry of Health in 2010 and again in 2020.15

To further fulfil this mission, the IBGE agreed to include a set of questions from the adult short version of the PCAT16 in one of the modules of the Brazilian National Health Survey (known as PNS-2019), and the IBGE plans to include questions from the child short version of the PCAT in the IBGE countrywide survey by 2021. In PNS-2019, more than 100 000 households were visited17 and face-to-face interviews were conducted in all states. Mobile devices were used for electronic data collection and these automatically transmitted the records to a national database. It is worth noting that in Brazil, more than half of the territory is covered by the Amazon rainforest and there are inhospitable locations with limited geographic accessibility, similar to areas in Canada. Additionally, owing to extreme weather, certain areas were only reachable by boat or aircraft.

Brazil’s new and innovative approach to health data gathering using the PCAT might offer inspiration to Statistics Canada to innovate its collection methodology for the CCHS,18 in particular to adapt the existing PHC module to contain elements of the adult version of the PCAT. The Brazilian experience demonstrated that although adding the adult version of the PCAT to the PNS-2019 demanded a substantial effort in terms of data collection, its addition to the CCHS ultimately would enable the creation of a national and provincial baseline by which to measure the important elements of patient experience in primary care. First results of the PNS-2019 demonstrate that those who use PHC services more frequently in Brazil do a better job at assessing their attributes.19

Conclusion

The PCAT was developed and pioneered as a research tool in primary care in Canada beginning in 2001.2 Over time it has shown its value in the Canadian PHC research context. Since 2006, it has been adapted for use in Brazil. Lessons learned from efforts to use the PCAT to assess PHC reforms in Brazil can inform its future use in evaluating the changing context of Canadian PHC.

Footnotes

  • Competing interests

    None declared

  • The opinions expressed in commentaries are those of the authors. Publication does not imply endorsement by the College of Family Physicians of Canada.

  • This article has been peer reviewed.

  • Cet article se trouve aussi en français à la page 485.

  • Copyright © the College of Family Physicians of Canada

References

  1. 1.↵
    1. Muldoon L,
    2. Dahrouge S,
    3. Hogg W,
    4. Geneau R,
    5. Russell G,
    6. Shortt M.
    Community orientation in primary care practices. Results from the Comparison of Models of Primary Health Care in Ontario study. Can Fam Physician 2010;56:676-83.
    OpenUrlAbstract/FREE Full Text
  2. 2.↵
    1. Haggerty JL,
    2. Pineault R,
    3. Beaulieu MD,
    4. Brunelle Y,
    5. Gauthier J,
    6. Goulet F, et al.
    Room for improvement. Patients’ experiences of primary care in Quebec before major reforms. Can Fam Physician 2007;53:1056-7.e1-6. Available from: https://www.cfp.ca/content/cfp/53/6/1056.full.pdf. Accessed 2020 Nov 3.
    OpenUrlAbstract/FREE Full Text
  3. 3.↵
    1. Moe GC,
    2. Moe JES,
    3. Bailey AL.
    Evaluating the implementation of collaborative teams in community family practice using the Primary Care Assessment Tool. Can Fam Physician 2019;65:e515-22. Available from: https://www.cfp.ca/content/cfp/65/12/e515.full.pdf. Accessed 2019 Dec 23.
    OpenUrlAbstract/FREE Full Text
  4. 4.↵
    1. Tourigny A,
    2. Aubin M,
    3. Haggerty J,
    4. Bonin L,
    5. Morin D,
    6. Reinharz D, et al.
    Patients’ perceptions of the quality of care after primary care reform. Family medicine groups in Quebec. Can Fam Physician 2010;56:e273-82. Available from: https://www.cfp.ca/content/cfp/56/7/e273.full.pdf. Accessed 2021 May 8.
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    1. Dahrouge S,
    2. Hogg W,
    3. Tuna M,
    4. Russell G,
    5. Devlin RA,
    6. Tugwell P, et al.
    Age equity in different models of primary care practice in Ontario. Can Fam Physician 2011;57:1300-9.
    OpenUrlAbstract/FREE Full Text
  6. 6.↵
    1. Mayo-Bruinsma L,
    2. Hogg W,
    3. Taljaard M,
    4. Dahrouge S.
    Family-centred care delivery. Comparing models of primary care service delivery in Ontario. Can Fam Physician 2013;59:1202-10.
    OpenUrlAbstract/FREE Full Text
  7. 7.↵
    1. Muggah E,
    2. Hogg W,
    3. Dahrouge S,
    4. Russell G,
    5. Kristjansson E,
    6. Muldoon L, et al.
    Patient-reported access to primary care in Ontario. Effect of organizational characteristics. Can Fam Physician 2014;60:e24-31. Available from: https://www.cfp.ca/content/cfp/60/1/e24.full.pdf. Accessed 2019 Dec 27.
    OpenUrlAbstract/FREE Full Text
  8. 8.↵
    1. Carroll JC,
    2. Talbot Y,
    3. Permaul J,
    4. Tobin A,
    5. Moineddin R,
    6. Blaine S, et al.
    Academic family health teams. Part 1: patient perceptions of core primary care domains. Can Fam Physician 2016;62:e23-30. Available from: https://www.cfp.ca/content/cfp/62/1/e23.full.pdf. Accessed 2021 May 8.
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    1. Carroll JC,
    2. Talbot Y,
    3. Permaul J,
    4. Tobin A,
    5. Moineddin R,
    6. Blaine S, et al.
    Academic family health teams. Part 2: patient perceptions of access. Can Fam Physician 2016;62:e31-9. Available from: https://www.cfp.ca/content/cfp/62/1/e31.full.pdf. Accessed 2021 May 8.
    OpenUrlAbstract/FREE Full Text
  10. 10.↵
    1. Wonnacott TH,
    2. Wonnacott RJ.
    Regression: a second course in statistics. New York, NY: John Wiley & Sons; 1981.
  11. 11.↵
    1. Haggerty JL,
    2. Pineault R,
    3. Beaulieu MD,
    4. Brunelle Y,
    5. Gauthier J,
    6. Goulet F, et al.
    Practice features associated with patient-reported accessibility, continuity, and coordination of primary health care. Ann Fam Med 2008;6(2):116-23.
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    1. Government of Brazil
    . National Press [website]. Portaria no. 2.979/GM/MS, de 12 de novembro de 2019. Institui o Programa Previne Brasil, que estabelece novo modelo de financiamento de custeio da atenção primária à saúde no âmbito do Sistema Único de Saúde. Diário Oficial da União 2019;220(1):97. Available from: http://www.in.gov.br/en/web/dou/-/portaria-n-2.979-de-12-de-novembro-de-2019-227652180. Accessed 2019 Dec 28.
    OpenUrl
  13. 13.↵
    1. Government of Brazil, National Press [website]
    . Portaria no. 3.222/GM/MS, de 10 de dezembro de 2019. Dispõe sobre os indicadores do pagamento por desempenho, no âmbito do Programa Previne Brasil. Diário Oficial da União 2019;239(1):172. Available from: http://www.in.gov.br/en/web/dou/-/portaria-n-3.222-de-10-de-dezembro-de-2019-232670481. Accessed 2019 Dec 28.
    OpenUrl
  14. 14.↵
    1. Harzheim E,
    2. Starfield B,
    3. Rajmil L,
    4. Álvarez-Dardet C,
    5. Stein AT.
    Internal consistency and reliability of Primary Care Assessment Tool (PCATool-Brasil) for child health services [article in Portuguese]. Cad Saude Publica 2006;22(8):1649-59. Epub 2006 Jul 7.
    OpenUrlCrossRefPubMed
  15. 15.↵
    1. Brasil, Ministério da Saúde
    . Secretaria de Atenção Primária à Saúde. Departamento de Saúde da Família. PCATool Brasil/2020: manual do instrumento de avaliação da atenção primária à saúde. Rio de Janeiro, Brazil: Ministério da Saúde; 2020. Available from: http://189.28.128.100/dab/docs/portaldab/publicacoes/30_JUN_versao_preliminar_PCATOOL_2020.pdf. Accessed 2020 Nov 3.
  16. 16.↵
    1. Federal University of Rio Grande do Sul
    . National Health Survey (PNS-2019) selected resident questionnaire. Rio de Janeiro, Brazil: Brazilian Institute of Geography and Statistics (IBGE) Research Directorate. Available from: https://www.ufrgs.br/telessauders//documentos/PNS2019_MODULO_H_versao_ingles.pdf.pdf. Accessed 2020 Feb 5.
  17. 17.↵
    1. Brazilian Institute of Geography and Statistics (IBGE) News Agency [website]
    . For the first time, IBGE carries out survey on patient check-in in public health system. IBGE News Agency 2019 Sep 27. Available from: https://agenciadenoticias.ibge.gov.br/en/agencia-news/2184-news-agency/news/25542-for-the-first-time-ibge-carries-out-survey-on-patient-check-in-in-public-health-system. Accessed 2020 Feb 5.
  18. 18.↵
    1. Statistics Canada [website]
    . Canadian Community Health Survey (CCHS)—2019. Ottawa, ON: Statistics Canada; 2019. Available from: https://www23.statcan.gc.ca/imdb/p3Instr.pl?Function=assembleInstr&a=1&&lang=en&Item_Id=1207185. Accessed 2020 Feb 5.
  19. 19.↵
    1. Instituto Brasileiro de Geografia e Estatística (IBGE)
    . Pesquisa Nacional de Saúde 2019: atenção primária à saúde e informações antropométricas. Rio de Janeiro, Brazil: IBGE; 2020. Available from: https://biblioteca.ibge.gov.br/visualizacao/livros/liv101758.pdf. Accessed 2020 Nov 3.
PreviousNext
Back to top

In this issue

Canadian Family Physician: 67 (7)
Canadian Family Physician
Vol. 67, Issue 7
1 Jul 2021
  • Table of Contents
  • About the Cover
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on The College of Family Physicians of Canada.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Ten years of the Primary Care Assessment Tool in Canadian Family Physician: what is next?
(Your Name) has sent you a message from The College of Family Physicians of Canada
(Your Name) thought you would like to see the The College of Family Physicians of Canada web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Ten years of the Primary Care Assessment Tool in Canadian Family Physician: what is next?
Luiz Felipe Pinto, Erno Harzheim, Otavio Pereira D’Avila, Lisiane Hauser, Valerie Baron, David Ponka
Canadian Family Physician Jul 2021, 67 (7) 479-480; DOI: 10.46747/cfp.6707479

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Respond to this article
Share
Ten years of the Primary Care Assessment Tool in Canadian Family Physician: what is next?
Luiz Felipe Pinto, Erno Harzheim, Otavio Pereira D’Avila, Lisiane Hauser, Valerie Baron, David Ponka
Canadian Family Physician Jul 2021, 67 (7) 479-480; DOI: 10.46747/cfp.6707479
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Ten years using the PCAT in Canada
    • New challenges with primary health care (PHC) reforms in Canada
    • What is next?
    • Conclusion
    • Footnotes
    • References
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • Dix ans de l’Outil d’évaluation des soins primaires dans Le Médecin de famille canadien : quelle est la suite?
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Equipping family physicians to thrive
  • Will blended family physician payment models revive primary care in Canada?
  • Toward an identity and team-based practice rooted in transdisciplinarity
Show more Commentary

Similar Articles

Navigate

  • Home
  • Current Issue
  • Archive
  • Collections - English
  • Collections - Française

For Authors

  • Authors and Reviewers
  • Submit a Manuscript
  • Permissions
  • Terms of Use

General Information

  • About CFP
  • About the CFPC
  • Advertisers
  • Careers & Locums
  • Editorial Advisory Board
  • Subscribers

Journal Services

  • Email Alerts
  • Twitter
  • LinkedIn
  • Instagram
  • RSS Feeds

Copyright © 2025 by The College of Family Physicians of Canada

Powered by HighWire