User satisfaction is influenced by the interval between a health care service and the assessment of the service

https://doi.org/10.1016/j.socscimed.2010.02.035Get rights and content

Abstract

In order to improve the quality of patient care, questionnaires are often used to identify user’s experiences and evaluations, but only a few studies have examined whether measuring user satisfaction at different time points influences the assessment of health care. Several studies have shown equivalency between paper and electronic patient reported outcomes; however, none of these studies have considered the fact that electronic questionnaires are usually completed at the hospital, while paper questionnaires are typically completed at home weeks after the visit. In order to ensure that the comparison of results collected by the two different methods are not biased, the aim of this study was to determine if the interval between an outpatient visit and the assessment of the quality of care influences user satisfaction and to compare response rates between questionnaires completed at different times. In a follow-up study, parents from a paediatric outpatient clinic in Denmark were quasi-randomised to 1 of 3 groups: group 1 completed an electronic questionnaire on a touch screen computer in the outpatient clinic and a paper questionnaire 3–6 weeks after the visit; group 2 completed a paper questionnaire in the outpatient clinic and a paper questionnaire 3–6 weeks after the visit; and group 3 completed a paper questionnaire 3–6 weeks after the visit. A total of 1148 parents completed at least 1 questionnaire. User satisfaction was significantly lower when the assessment was made after a visit to the outpatient clinic compared to an assessment made at the clinic. The response rates of questionnaires completed at the clinic were significantly higher than the response rates of questionnaires completed after the visit. Both the timing of surveys and response rates need to be taken into consideration when planning user surveys. Outcomes from surveys conducted at different times are not readily comparable.

Section snippets

Background

In order to improve the quality of patient care, it is essential to elicit the user’s experience and evaluation (Sitzia & Wood, 1997). Only the patients and relatives experience the course of the illness and the hospitalisation; therefore, they can point out areas with strengths in organization, treatment, and care, and areas with lack of coherence in the process and poor quality (Rubin, 1990, Sitzia and Wood, 1997).

User satisfaction can be assessed in different ways. Qualitative methods, such

Setting

The study was conducted at a Danish paediatric outpatient clinic at Kolding Hospital, which provides outpatient consultations each year for approximately 11,000 children < 18 years of age. The children have diseases representing a broad range of medical diagnoses, from serious chronic diseases to minor ailments.

Population

The parents of all the children consulting a paediatrician at the outpatient clinic during the 9 weeks from September 2008 to November 2008 were included. However, parents who did not

Results

A total of 1148 parents completed at least 1 questionnaire. Fig. 2 presents the inclusion and participation of the parents in the study.

The response rates were 73% (group 1) and 76% (group 2) for questionnaires completed at the outpatient clinic and 53% (group 1), 45% (group 2) and 58% (group 3) for questionnaires completed after the visit. Only 35% and 39% of the parents, respectively, had completed the questionnaire twice and were included in the comparative analyses (Fig. 2). Table 1

Discussion

The study showed that the parents’ perception of the quality of care in a paediatric outpatient clinic depends on when the parents are asked to respond via questionnaire. Indeed, questionnaires completed before leaving the clinic showed a higher level of satisfaction with the visit compared to responses submitted later. The study also showed that higher response rates were obtained for electronic questionnaires and paper questionnaires completed at the outpatient clinic than for paper

Conclusion

The present study showed that the timing of performing a survey has a significant impact on both the level of user satisfaction and on the response rates. This should be taken into consideration when planning a survey of user satisfaction, when comparing user satisfaction from different surveys, and when testing questionnaires.

Acknowledgements

The authors want to thank parents and staff from the paediatric clinic at Kolding Hospital and Kolding Research Committee for supporting the study.

References (24)

  • M.C. Greenwood et al.

    Touch-screen computer systems in the rheumatology clinic offer a reliable and user-friendly means of collecting quality-of-life and outcome data from patients with rheumatoid arthritis

    Rheumatology

    (2006)
  • S. Kvale

    Interviews: An introduction to qualitative research interviewing

    (1996)
  • Cited by (31)

    • Families on adult intensive care units: Are they really satisfied? A literature review

      2018, Australian Critical Care
      Citation Excerpt :

      Regarding this, Casarett et al.65 proposes that family satisfaction could be evaluated soon after patient death; however, the early stages of grief are associated with periods of denial and insensitivity, which could affect the ability of family members to objectively evaluate the care given. Research results on a satisfaction survey administered to the parents of paediatric patients also support that the moment of administration can impact response rate.66 Crow et al.67 suggests that evidence for the impacts of evaluation moment on satisfaction are contradictory, possibly depending on the nature of the disease and recovery time.

    • Digital audio recordings improve the outcomes of patient consultations: A randomised cluster trial

      2017, Patient Education and Counseling
      Citation Excerpt :

      Variation in response time poses another limitation to our results. Previous research has found that patients’ satisfaction is influenced negatively by the time gap between the consultation and the time of measurement [46,47]. Given significant variations in response time between the control group and the QPL-DAR group, it is reasonable to assume that this variation most likely contributes to a small underestimation of the effect.

    • Patient Satisfaction and Surgery: Can It Be Measured?

      2011, Seminars in Colon and Rectal Surgery
      Citation Excerpt :

      How the survey is conducted, eg, paper or electronic format, is also important. However, data supporting the use of any specific format are lacking.18 Finally, the timing of the survey appears to directly impact the level of satisfaction and the overall response rates.18

    • Research in communication skills training translated into practice in a large organization: A proactive use of the RE-AIM framework

      2011, Patient Education and Counseling
      Citation Excerpt :

      A total of 1148 parents and 346 children answered the questionnaires (the response rates on the electronic questionnaires were 73%). The conclusion was that the patient satisfaction was significantly higher when measured just before leaving the outpatient clinic than when measured after the visit [30,31]. The phase I study identified a need for improving the communication with the patients and for monitoring the perspective of the patients.

    View all citing articles on Scopus
    View full text