|
|
Vol. 54, No. 5, May 2008, pp.712 - 720 Copyright © 2008 by The College of Family Physicians of Canada
Improving prevention in primary careEvaluating the sustainability of outreach facilitationWilliam Hogg, MSc MCISc MD FCFP, Jacques Lemelin, MD CCFP FCFP, Isabella Moroz, PhD, Enrique Soto, PhD and Grant Russell, MDDr Hogg is a Professor and the Director of Research in the Department of Family Medicine at the University of Ottawa and Director of the C.T. Lamont Primary Health Care Research Centre at the Élisabeth Bruyère Research Institute in Ottawa, Ont. Dr Lemelin is a Professor and the Acting Chair of the Department of Family Medicine at the University of Ottawa and a Principal Scientist at the C.T. Lamont Primary Health Care Research Centre. Dr Moroz was a Research Associate and Dr Soto was a Research Manager at the C.T. Lamont Primary Health Care Research Centre at the time of the study. Dr Russell is an Associate Professor in the Department of Family Medicine at the University of Ottawa and a Clinical Investigator at the C.T. Lamont Primary Health Care Research Centre. Drs Hogg and Lemelin are affiliated with the Institute of Population Health at the University of Ottawa Correspondence to: Dr William Hogg, Professor and Director of Research, Department of Family Medicine, University of Ottawa, 43 Bruyère St, Ottawa, ON K1N 5C8; telephone 613 562-4262, extension 1354; e-mail whogg{at}uottawa.ca Outreach facilitation is one of the most effective methods of implementing best practices in delivery of preventive health services in primary care.1–3 It employs individuals with a nursing background who provide prevention performance feedback to a practice, build consensus on improvement goals, and, through regular visits, support the practice by following a systems strategy tailored to that practice. We previously demonstrated, in a randomized trial within community-based family practices in Ontario, that outreach facilitation leads to substantial improvements in physician practice patterns and preventive care performance.4 Furthermore, in a recent economic evaluation, we demonstrated substantial net savings as a result of reducing inappropriate practice behaviour and increasing appropriate preventive screening.5 The sustainability of the improved care has been pursued in several studies, but only a few investigations of office-system interventions have been subjected to long-term analysis. Varying degrees of sustainability were observed as early as 6 months and as late as 5 years after the end of the interventions6–10 and were attributed to factors such as practice-individualized approaches (allowing for integration of change within day-to-day routines of the practice), provision of feedback, and physicians preventive care philosophy. In many cases, sustainability of initial success depended on continued assistance.11–13 An important concern about the postintervention maintenance of preventive care, which was not addressed in these investigations, is the effect of multiple competing demands, which often divert practitioners time and energy away from prevention and toward other activities. The goal of the present investigation was therefore to directly examine this possibility by first implementing preventive care strategies and then engaging the practices in a distractor activity. In particular, we assessed the extent to which gains in preventive performance achieved through outreach facilitation could be maintained after a period of time when the focus and attention of the practice physicians and staff members were purposefully redirected away from preventive care and toward chronic illness care.
Study design We conducted a before-and-after study to gauge the sustainability of an outreach facilitation program. The progress of the study is shown in Figure 1. The unit of intervention and analysis was the primary care practice and the units of observation for outcome assessment were obtained from medical charts and telephone interviews with patients. The study was approved by the Ottawa Hospital Research Ethics Board.
Selection and recruitment of practices The intervention involved primary care network (PCN) and family health network (FHN) practices in Ontario, which are 2 of the newer models of primary health care delivery in Ontario. Primary care networks were introduced in May 1998 and served as pilot sites for the FHNs, which were introduced in March 2001. Both models are characterized by patient rostering (with an average roster size of approximately 1500 patients per physician), capitation payment structure with added incentives for prevention and other targeted services, provision of after-hours service and teletriage, and support for information technology. Of the 30 recruited practices, 25 (83%) were from established PCNs that had existed for about 4 to 5 years at the time of the study, protecting the study against the confounding effects of transitioning into a new model of care. Solo practitioners and those who practised in groups of up to 10 were considered eligible to participate in the trial. Practices with more than 10 physicians or with an academic affiliation were excluded owing to their size and resulting complexity. We recruited practices by repeated mailings followed, when necessary, by a telephone call from a physician recruiter or principal investigator until the required number of practices provided informed consent to participate in the study. The recruitment process lasted from September 2003 to May 2004.
Intervention
The prevention facilitation phase lasted 12 months or until the facilitators felt that practices had maximized the improvement potential of preventive care delivery. It was followed by a distractor phase—chronic illness care management (CICM)—to redirect the focus of the physicians and staff members away from preventive care (Figure 2* presents a timeline of the intervention activities). This allowed for an assessment of the extent to which the increase in preventive care performance could be maintained over time in the face of competing demands placed on physicians. The CICM phase lasted between 3 and 9 months and was followed immediately by collection of the final outcome measures.
Collection of outcome data Trained auditors collected indices of practices preventive performance from chart reviews and telephone interviews with patients conducted just before the prevention facilitation phase and immediately after the CICM distractor phase. No data of that nature were collected at the end of the prevention facilitation phase. Details about the data collection process are available.* In brief, we chose 26 preventive maneuvers from grades A, B, and D, as recommended by the Canadian Task Force on Preventive Health Care.14 We limited patient eligibility to age 17 and older. Standard instruments for both chart reviews and patient interviews were used, and confidentiality was ensured.
Outcome measures The secondary outcome measure was operationally defined in an identical manner, except it utilized the information from patient telephone interviews regarding practice preventive performance of maneuvers that focused on healthy lifestyle counseling. In addition, secondary analyses were conducted on individual maneuvers to determine which were most affected by the intervention.
Sample size
Statistical analyses
From the 13 PCNs and 5 FHNs, which made up 99 primary care practice sites in Ontario, 30 practice sites with 58 physicians initially agreed to participate. Baseline practice characteristics are presented in Table 2. Most recruited practices were urban, solo, consisted of male physicians only, and had at least 1 full-time nurse on staff. A total of 63% of practices had electronic medical records. Most were using various kinds of reminder systems for preventive care. Particularly noteworthy was the high percentage of practices with personnel dedicated specifically to looking after prevention activities. Three of the 30 practices withdrew from the study during the baseline data collection phase and 1 during the intervention phase, citing lack of time as a main reason.
The mean proportions of eligible patients who received the preventive maneuvers, as determined by chart audit, are shown in Table 3. Significant improvement in performance at follow-up, conducted after the 3- to 9-month distraction period following the prevention intervention, was observed for both grade A (19.3%, 95% confidence interval [CI] 10.4% to 28.3%) and grade B (9.3%, 95% CI 5.4% to 13.2%) maneuvers, and consequently for grades A and B combined (12.3%, 95% CI 8.1% to 16.5%). In particular, colon cancer screening quadrupled (P < .0001), while visual acuity and hearing tests more than doubled in magnitude (P < .01). At the same time, the inappropriate grade D maneuver of urine dipstick testing for proteinuria significantly decreased by 15.9% (95% CI 9.6% to 22.1%). The simultaneous increase in the delivery of appropriate screening maneuvers and decrease in inappropriate maneuvers resulted in a 12% absolute improvement in the overall preventive care performance or composite primary outcome prevention index (P < .0001).
Table 4 presents the mean proportion of eligible patients who received preventive counseling on maneuvers related to healthy lifestyle as determined from telephone interviews with patients. The composite secondary outcome prevention index showed no significant differences in the overall performance related to provision of lifestyle counseling (1.3%, 95% CI –1.0% to 3.7%). Whether considering the appropriate (grade A and B) or inappropriate (grade D) health promotion counseling maneuvers, individually or in aggregate, no statistically significant mean increases were noted.
We report that a 12-month, tailored, multifaceted intervention delivered by outreach facilitators was effective in producing longer-term improvements in the delivery of preventive care maneuvers, as measured by chart audit. These improvements, observed at the follow-up conducted after the 3- to 9-month distraction period following the prevention facilitation, are of the same magnitude as those reported immediately after the end of an 18-month intervention study by Lemelin et al,4 and are comparable to those reported in other studies that tested the long-term sustainability of office-systems interventions.7,17,18 The present study lends further credence to the potential of outreach facilitation to produce lasting changes in physician behaviour. In contrast to our main outcome results, there were no changes from baseline observed at the follow-up in the implementation of preventive maneuvers related to lifestyle counseling, assessed via telephone interviews with patients. Our study has several strengths. It was conducted in community practices across Ontario and targeted a large number of preventive services simultaneously. The observed improvements in preventive care delivery occurred in a sample of practices whose baseline preventive performance was already quite high. By creating a distraction within the practices—the CICM phase—our design addressed the concept of a permanent facilitation program, where the same facilitator works with a practice on a series of quality improvement initiatives. For example, once the facilitator and practice have addressed one content area (preventive medicine) they could change topic (chronic illness) and work together to improve clinical practice in a second area and so on. Finally, our main outcomes were obtained from chart reviews, which are considered more reliable and more accurate sources of data compared with physician or patient reports.19
Limitations The generalizability of our findings is limited by the studys focus on PCN and FHN practices only, which comprised about a third of practices in Ontario at the time of the study. Comparing the studys physicians with Ontario FPs or GPs, using results from the 2004 National Physician Survey,28 revealed that a higher percentage of our practices were solo (70% vs 34.7%), used electronic patient scheduling systems (76% vs 49.9%), had electronic medical records (63% vs 22.5%), and had Internet access (83% vs 60.7%). Furthermore, we only measured preventive performance at 2 points in time. The number of practices needed to detect changes at 3 points in time, with an adequate power, increases substantially and would have exceeded the financial resources for the project. Finally, although our results are encouraging, a 3- to 9-month follow-up after the end of the intervention period might not be enough to draw valid conclusions about the interventions long-term effects. The lack of improvement in the delivery of preventive lifestyle counseling, observed on the basis of patient reports, could be a result of several factors, such as the already high preventive performance of participating practices at baseline and the well documented limitations of patient surveys.29,30
The results of our study provide reason to be optimistic, as they suggest that sustainability of outreach facilitation beyond the end of an intervention is feasible in the volatile environment of a busy primary care practice. Also important, we were able to show improvements in delivery of preventive services despite the already high baseline proportions of patients appropriately serviced. More longitudinal research, with randomized controlled designs, should be conducted to support the validity and long-term efficiency of the outreach facilitation implementation. A follow-up study of our clinics would be desirable to explore the lifespan of the observed improvements.
Funding for this research was provided by the Ontario Ministry of Health and Long-Term Care Primary Health Care Transition Fund. The views expressed in this report are the views of the authors and do not necessarily reflect those of the Ontario Ministry of Health and Long-Term Care.
Contributors Drs Hogg, Lemelin, Moroz, Soto, and Russell contributed to concept and design of the study; data gathering, analysis, and interpretation; and preparing the manuscript for submission. None declared
* Figure 2 and details about the data collection process are available at www.cfp.ca. Go to the full text of this article on-line, then click on CFPlus in the menu at the top right-hand side of the page. Cet article a fait lobjet dune révision par des pairs. This article has been peer reviewed.
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||