ABSTRACT
OBJECTIVE To evaluate how a primary care reform, which aimed to promote interprofessional and interorganizational collaborative practices, affected patients’ experiences of the core dimensions of primary care.
DESIGN Before-and-after comparison of patients’ perceptions of care at the beginning of family medicine group (FMG) implementation (15 to 20 months after accreditation) and 18 months later.
SETTING Five FMGs in the province of Quebec from various settings and types of practice.
PARTICIPANTS A random sample of patients was selected in each FMG; a total of 1046 participants completed both the baseline and follow-up questionnaires.
MAIN OUTCOME MEASURES Patients’ perceptions of relational and informational continuity, organizational and first-contact accessibility, attitude and efficiency of the clinic’s personnel and waiting times (service responsiveness), physician-nurse and primary care physician–specialist coordination, and intra-FMG collaboration were assessed over the telephone, mostly using a modified version of the Primary Care Assessment Tool. Additional items covered patients’ opinions about consulting nurses, patients’ use of emergency services, and patients’ recall of health promotion and preventive care received.
RESULTS A total of 1275 patients were interviewed at the study baseline, and 82% also completed the follow-up interviews after 18 months (n = 1046). Overall, perceptions of relational and informational continuity increased significantly (P < .05), whereas organizational and first-contact accessibility and service responsiveness did not change significantly. Perception of physician-nurse coordination remained unchanged, but perception of primary care physician–specialist coordination decreased significantly (P < .05). The proportion of participants reporting visits with nurses and reporting use of FMGs’ emergency services increased significantly from baseline to follow-up (P < .05).
CONCLUSION This reorganization of primary care services resulted in considerable changes in care practices, which led to improvements in patients’ experiences of the continuity of care but not to improvements in their experiences of the accessibility of care.
Patients living in many industrialized countries must wait longer than a day to get appointments with their primary care providers, and 30% of Canadians must wait more than 6 days.1 Initiatives to improve care accessibility, however, can compromise relational continuity of care,2,3 which is particularly valued by patients with chronic or serious health problems.4–6 A succession of national7,8 and provincial commissions9–12 in Canada have argued that, in order to address both accessibility and continuity of care, health reforms must begin with primary care, likely because of the strong correlation between health outcomes and the strength of a country’s primary health care system in countries of the Organisation for Economic Co-operation and Development.13
The province of Quebec is divided into 95 local health networks, each of which includes local community health centres (CLSCs) that have been merged into health and social services centres since June 2004. Approximately 15% of primary care services are provided through CLSCs, and the rest are provided through the physician-run clinics and private practices that are the norm elsewhere in Canada.14 In 2002, Quebec’s Ministry of Health and Social Services (MSSQ) launched a reform of its health services that revolved mostly around a key concept: family medicine groups (FMGs). An FMG is an administrative arrangement for existing practices (solo practices, CLSCs, or networks); 8 to 10 physicians who wish to participate are grouped together to collaborate with 1 to 2 nurses to offer primary care services, including patient follow-up, health promotion, and preventive care, to a set of registered patients. It offers patients access to care 24 hours a day, 7 days a week, through regular appointments, walk-in clinics, home visits, and after-hours health coverage using telephone hot-lines and emergency on-call services (Table 1). The services provided by FMGs are coordinated with those offered by regional health agencies and other health networks.15,16 As with other similar Canadian and international initiatives, the essential objective of this reorganization of primary care services was to promote interprofessional and interorganizational collaborative practices in order to improve accessibility, continuity, and coordination of health care.9
Some research projects have evaluated the effects of various primary care reforms in Canadian provinces.16–23 Among these, only a few have measured patients’ perceptions of the quality of the care they received. Khan et al22 used a prospective cohort survey to compare the perceptions of care for patients registered or not registered with primary health care teams. Howard and colleagues20 described patients’ perceptions of care in 2 interprofessional clinics. We were only able to find 2 studies that compared patients perceptions of care before and after a primary care reform in Canada, but these surveyed different sets of patients at baseline and follow-up, and participants were not randomly selected.15,16
In this article, we report on a study to evaluate the effects of FMGs on patients’ perceptions of accessibility, relational continuity, coordination, and comprehensiveness of care, which were assessed in the same patients at the beginning of FMG implementation (15 to 20 months after accreditation) and again 18 months later. Results reported here are part of a broader project that also evaluated the extent of interprofessional collaboration and interorganizational relations in FMGs using a qualitative methodology that was reported elsewhere.24
METHODS
Design, settings, and procedures
This is a before-and-after comparison of the perceptions of patients from 5 FMGs in 2 regions of the province of Quebec. At the start of this study, 13 FMGs had already been accredited. We initially selected 6 of these FMGs to participate in the study, in order to cover a spectrum of settings (urban, suburban, semirural, and rural) and types of practice (private, academic, hospital-based, and CLSCs). Each FMG was staffed by 2 nurses and a number of physicians (6 to 19). One FMG withdrew from the project before patient selection, owing to a lack of physician availability. Patients registered with physicians from the 5 participating FMGs were initially identified from Quebec’s public health insurance service (Régie de l’assurance maladie du Québec) and were eligible for the study if they spoke French, were able to give informed consent, and were aged 18 years or older.
A random sample of patients was then selected in each FMG. We calculated that a minimum sample size of 250 participants in each FMG would be needed to detect a standardized minimal effect size of 0.25 within each FMG in the targeted outcome (80% power). Taking into account an anticipated low response rate, random samples of approximated 1000 individuals were selected in each FMG using computer-generated random numbers. Selected patients were sent impersonal letters, signed by all physicians from the FMG, asking for their authorization to transmit their contact information to the research team. If patients agreed, they were contacted by telephone by a member of the research team and invited to join the study. Those interested in participating were sent an information leaflet together with the consent form and the questionnaire by mail. A member of the research team then contacted the patient to complete the questionnaire over the telephone. The first telephone interview (baseline) was performed following receipt of the signed consent form, at the beginning of FMG implementation, in the summer of 2004. There was a delay of 15 to 20 months, depending on the FMG, between FMG accreditation and baseline measurements. This delay was necessary for the FMGs to register an adequate number of patients before baseline sampling. The same subjects were interviewed again 18 months later (follow-up) in the winter of 2006. This study was approved by the research ethics committees of Laval University and the Centre hospitalier affilié universitaire de Québec.
Outcomes
Patients’ perceptions of first-contact accessibility, ongoing care (continuity), service responsiveness, and coordination and comprehensiveness of care were assessed by telephone mostly using a modified version of the adult edition of the Primary Care Assessment Tool.25,26 Items from the Primary Care Assessment Survey27 were added to the questionnaire to assess organizational accessibility. Additional items relative to the concentration of care, opinions about consulting nurses, collaboration, use of services, and overall perceptions of FMGs were also added to the questionnaire. Finally, patients’ reports on the proportion of visits with nurses and the reasons for nurse visits were also recorded. Conceptual and operational definitions of some of the constructs have been detailed by Haggerty et al,14,28 and the questionnaire is described in Table 2.25–27 The French version of the instrument was validated in Quebec with 120 subjects who had had contact with the health care system during the past year.
Each attribute of care was calculated from the mean of all corresponding items. To facilitate interpretation, we expressed the results for each attribute of care as the proportion of patients who rated that aspect of care as equal to or higher than the minimum expected care level. The minimum expected care level was defined as a mean score of at least 3.0 for items scored using a 4-point Likert scale, a mean score of at least 4.0 for items scored using a 5-point Likert scale, and a mean score of at least 4.5 for items scored using a 6-point Likert scale. These minimal thresholds of care represent a quantitative expression of patients’ expectations of care14 and were conceptually defined in an earlier publication.28
Statistical analysis
The outcomes of interest were the mean scores calculated from all of the items relating to each aspect of care. Data from baseline and follow-up were compared using generalized linear mixed models (Proc Mixed and Proc Glimmix) with repeated measures; FMG was included as a random effect to account for clustering, and time was included as a fixed effect. For categorical variables, raw proportions are presented in the tables, but models compared odds ratios. Baseline characteristics between patients who completed the study and those who withdrew after baseline measurements were compared using t tests for continuous variables and χ2 tests for categorical variables. Intraclass correlation coefficients were estimated using adjusted R2.29
RESULTS
Subjects
Of the 4880 patients invited to participate, 1603 authorized contact and 1275 completed the baseline questionnaire. Of those completing the baseline questionnaire, 1046 (82%) also completed the follow-up questionnaire after 18 months. Reasons for dropping out of the study between baseline and follow-up included the following: wrong address (n = 92, 7%); lack of interest (n = 48, 4%); unable to contact participant after 8 attempts (n = 41, 3%); not being registered with the FMGs anymore (n = 20, 2%); death (n = 16, 1%); sickness (n = 8, 0.6%); being unfit to answer a survey over the telephone (n = 2, 0.2%); admitted to a transition home (n = 1, 0.1%); and fear (n = 1, 0.1%). Significant differences (P = .001) were observed in the distribution of self-reported health status and main activity (eg, working, studying, retired) between patients who dropped out and those who participated in both data collections (Table 3).
Outcomes
To test sampling efficiency, intraclass correlation coefficients were calculated for key variables (relational continuity, R2 = 0.04; informational continuity, R2 = 0.03; organizational continuity, R2 = 0.12; face-to-face accessibility, R2 = 0.38; telephone accessibility, R2 = 0.15).
Patients’ experiences of the core attributes of primary care are summarized in Table 4. Overall, concentration of care with the primary care physician (PCP) decreased significantly (P < .01), whereas informational continuity significantly increased (P < .001). Relational continuity (P < .001) and physician-nurse coordination (P < .05) increased significantly only as continuous measures, but not as proportions of patients perceiving care to exceed the minimum expected care level. Coordination of care between PCPs and other specialists significantly decreased (P < .01), but only as the proportion of patients perceiving care to exceed the minimum expected level of care. Organizational accessibility, service responsiveness toward patients, and first-contact accessibility did not change significantly overall (P > .05). Participants’ perceptions of the way FMG professionals collaborated as teams was already high at baseline and there was no overall change at follow-up. At follow-up there was a significant improvement in patients’ evaluations of the sufficiency of information provided about FMGs (P < .001), and the proportion of patients to see more advantages than disadvantages to being registered with FMGs did not change significantly at follow-up (P > .05).
The proportion of participants reporting visits with practice nurses increased significantly from baseline to follow-up (P < .05). These proportions, however, varied among FMGs, ranging from 6% to 62% at baseline, and from 12% to 64% at follow-up. Reasons for visits with nurses included the following: disease prevention (40%), follow-up of chronic health problems (33%), and triage or previsit activities before the appointment with the physician (27%). At baseline, most patients’ opinions about consulting nurses for various reasons were favourable (Table 5). Following the introduction of FMGs, patients’ willingness to consult nurses increased significantly for all of the reasons explored (P < .01). Ratings at follow-up did not differ significantly between patients with and without nurse visits during the past year (P = .59 to .82).
Comprehensiveness of care was evaluated by patients’ recall of receiving the health promotion and preventive care recommended for their age and sex (Table 6). Counseling about safer sex and the prevention of falls increased between baseline and follow-up; counseling about drug or alcohol abuse decreased.
The proportion of patients reporting use of FMGs’ emergency on-call services increased significantly from 16% to 24% between baseline and follow-up (P < .001). Reported use of health hot-lines (Info-santé) significantly decreased from 21% to 18% (P = .041), as did ambulance use, which decreased from 8% to 6% (P = .019). Use of other emergency services (eg, hospital, 911) did not change significantly between baseline and follow-up.
DISCUSSION
Continuity
High continuity scores at baseline demonstrate that even at the beginning of the reform, patients generally had confidence in their ongoing relationships with their general practitioners. Both informational and relational continuity improved significantly at follow-up, but the 1.8% increase in the proportion of patients rating relational continuity as being above minimum expected levels of care was not statistically significant, meaning that this improvement was not clinically significant. Two other surveys of patients’ perceptions of care following the same reform have been reported, but they used a different study design by interviewing different non-random samples of patients at baseline and follow-up: One, conducted in 5 different FMGs by Beaulieu et al,16 reported significant improvements in both relational and informational continuity (no P values were reported). The other, conducted in 10 FMGs by the MSSQ,23 reported improvements in relational continuity for half of the items surveyed.
Accessibility of care
Introducing FMGs did not affect patients’ perceptions of care accessibility, even if they reported increased use of the clinics’ after-hours care services. First-contact face-to-face accessibility seems to be most problematic, with 77% of patients rating it below the minimum expected care level at baseline and with no improvement at follow-up. The regrouping of smaller practices into FMGs might reduce patients’ access to their own physicians. Delegating certain services to nurses, although improving access to a member of the primary care team in general, could also induce a sense of limited access to the PCP.30 In addition, trade-offs between continuity and accessibility of care have been reported in the literature,5,31,32 so it might have been too ambitious to aim at improving both aspects of care with a single organizational model.
Beaulieu et al16 observed a significant improvement in first-contact accessibility, whereas the MSSQ23 reported a degradation of first-contact accessibility during regular office hours but an improvement of accessibility outside regular office hours. Observed differences among studies might reflect variation of the FMG physician work force among regions, as one of the health regions represented in our project has one of the lowest ratios of family practitioners and inhabitants.
Coordination of care
Baseline perception of PCP-specialist coordination was similar to levels reported in a simultaneous study performed in other Quebec health regions.14 At follow-up, participants reported a slight reduction in the level of PCP-specialist coordination, in contrast to reports of the MSSQ23 and Beaulieu et al.16 The reform was not, however, specifically intended to improve PCP-specialist coordination. Indeed, according to a simultaneous qualitative analysis, few physicians considered the FMG to be an opportunity to redefine their link to secondary and tertiary care.24 Perception of physician-nurse coordination did not change at follow-up either, but according to a simultaneous qualitative analysis of interviews with health care professionals, interprofessional collaboration was not yet mature but was growing after 18 months.24
Nurses’ roles
That a greater proportion of patients had seen nurses and that patients were more willing to be seen by nurses reflects some practice changes following reform. Two well-documented reviews33,34 and a qualitative study30 report that increased responsibility of primary care nurses leads to improved patient satisfaction and care accessibility without affecting patient health outcomes.
With the increased role of nurse practitioners in primary care practices, the reform was expected to lead to patients reporting more comprehensive care (ie, health promotion and prevention). Improved counseling was indeed observed for 2 health topics following the reform, but counseling on other topics either remained the same or was reduced, likely a result of nurse shortages in some FMGs.
Methodologic limitations
The internal validity of this study is strengthened by its longitudinal design, the randomized sampling of participants from among all FMG patients, the relatively large overall sample size and sample sizes in each FMG, and low attrition at 18 months’ follow-up. However, the lack of concurrent control increases the risk of a change in outcome measures owing to external sources of variability. The study also presents many limitations concerning external validity. First, with only 26% of patients consenting to participate, conclusions to this study can hardly be extended to the complete population of FMG users in the province of Quebec, especially as we did not compare participants’ characteristics with those of patients who did not consent to participate. Second, differences were observed in some of the characteristics of participants who withdrew from the study and those who completed the follow-up questionnaire, further hindering the generalizability of our results. Finally, only 5 FMGs were studied from among the 190 that were accredited by September 2009 across the province. This last limitation might, however, have been attenuated by the diversity of the FMGs included in the study, as 3 were located in rural or semirural areas and 2 were located in urban settings. The external validity of this study could also be limited because it was conducted at the beginning of the FMG implantation process. Participating physicians could be considered to be “champions,” and we cannot rule out the possibility that their innovative minds influenced their care practices.
Conclusion
The implementation of FMGs changed care practices considerably, which now affects the delivery of primary care in Quebec. For example, our study showed an increase in patients’ use of clinic after-hours services and in patients’ willingness to see nurses, which in turn led to a greater proportion of patients actually having seen nurses. These modifications in care practice also came with substantial changes in some aspects of the quality of care provided, as patients perceived some improvements in care continuity. Accessibility was not, however, perceived to improve, and this underlines the difficulty of improving continuity and accessibility simultaneously with a single organizational model and limited resources. Differences among studies regarding the effects of the reform on first-contact accessibility likely highlight disparities between regions regarding the availability of health practitioners. The implementation of FMGs might therefore benefit from additional measures to increase family physicians’ availability in regions suffering the most from shortages before implementation.
Notes
EDITOR’S KEY POINTS
-
Accessibility of health care is an important issue being tackled by primary health care reforms across industrialized countries.
-
Family medicine groups were implemented by Quebec’s Ministry of Health and Social Services in 2004 to improve accessibility, continuity, and coordination of health care in Quebec.
-
Implementation of family medicine groups did result in some changes in care practices: an increase in patients’ use of clinic after-hours services and an increase in patients’ willingness to see nurses. These resulted in substantial changes in patients’ perceptions of care continuity. Accessibility was not, however, perceived to improve, and this underlines the difficulty of improving continuity and accessibility simultaneously with a single organizational model and limited resources.
POINTS DE REPÈRE DU RÉDACTEUR
-
L’accessibilité aux soins de santé est un objectif important de la réforme des soins de santé primaires dans les pays industrialisés.
-
Les groupes de médecine familiale ont été instaurés au Québec en 2004 par le ministre de la Santé et des Services sociaux afin d’améliorer l’accessibilité, la continuité et la coordination des soins dans cette province.
-
La création des groupes de médecine familiale a modifié certaines façons de faire: plus de patients ont consulté en dehors des heures régulières et ont été accepté d’être vus par des infirmiers. Ces changements ont modifié considérablement l’opinion des patients sur la continuité des soins. L’accessibilité n’était toutefois pas jugée meilleure, ce qui indique qu’il est difficile d’améliorer simultanément la continuité et l’accessibilité avec un modèle uniquement organisationnel et des ressources limitées.
Footnotes
-
This article has been peer reviewed.
-
Cet article a fait l’objet d’une révision par des pairs.
-
Contributors
All authors contributed to concept and design of the study; data gathering, analysis, and interpretation; and preparing the manuscript for submission.
-
Competing interests
None declared
- Copyright© the College of Family Physicians of Canada