Short communicationComparison of Web and mail surveys for studying secondary consequences associated with substance use: Evidence for minimal mode effects
Introduction
Increasingly, Web surveys are being used on college campuses for collecting data on a wide range of health-related topics, including alcohol and other drug use (e.g., Bason, 2000, Kypri & Gallagher, 2003, Miller et al., 2002). Recent studies have highlighted some advantages of using Web surveys for collecting survey data among college students such as higher response rates, enhanced completion rates, and reduction of costs and turnaround time without compromising the integrity of the data (e.g., Carini, et al., 2003, Kypri & Gallagher, 2003, Miller et al., 2002, Pealer et al., 2001, Wygant & Lindorf, 2001).
To date, college-based mode studies have found minimal differences in the substantive responses between Web and mail surveys (Bason, 2000, Kypri et al., 2004, Pealer et al., 2001). Past randomized mode experiments found that Web and mail surveys generated similar reports of alcohol use, cigarette smoking, and illicit drug use among college students (Bason, 2000, Miller et al., 2002). However, no survey mode studies focus on secondary consequences experienced by those in proximity to the user, such as sleep disturbance, vandalism, and physical attacks (e.g., Presley et al., 1996, Wechsler et al., 1995).
The present experiment was designed to: a) compare substantive responses between respondents randomly assigned to two different survey modes, and b) examine subgroup (e.g., gender, race, etc.) differences between the responses provided by the two different survey modes. We proposed the following (null) hypothesis: When undergraduates describe their experiences with the secondary consequences of substance use, there will be no differences between the responses given in a Web survey or a mail survey.
Section snippets
Study population and data collection
The present study was fielded for a 1-month period during March and April of 2001. The University's Institutional Review Board approved the study's protocol and informed consent was provided by all participants. At the time of data collection, the total undergraduate population was 21,055 full-time students (10,732 women and 10,323 men). A sample of 7000 undergraduate students was randomly drawn from the Registrar's list, which included e-mail addresses, mailing addresses, gender, class year,
Results
Bivariate results suggest that mode of survey administration made little difference in estimates of secondary consequences. Table 2 illustrates the distribution of secondary consequences between survey modes for the sample as a whole, and for men and women separately. There were no significant mode differences within the overall sample in the reporting of secondary consequences. When bivariate analyses were conducted separately by gender we found no significant differences with the exception of
Discussion
The present study's findings demonstrate minimal substantive differences in results from Web and paper surveys regarding secondary consequences associated with substance use. Our findings highlight the possible benefits identified in prior studies of Web surveys in college student populations. For example, the Web survey yielded a substantially higher response rate and a sample more similar to the population on key demographics than the mail survey.
In addition, the findings of this study
Acknowledgements
The development of this manuscript was supported by the University of Michigan and by a National Research Service Award T32 DA 07267 (PI: C. Boyd) to Drs. McCabe and Cranford from the National Institute on Drug Abuse, National Institutes of Health.
References (13)
- et al.
An internet-based survey method for college student drinking research
Drug and Alcohol Dependence
(2004) - Bason, J.J. (2000). Comparison of telephone, mail, web, and IVR surveys of drug and alcohol use among University of...
- et al.
College student responses to web and paper surveys: Does mode matter?
Research in Higher Education
(2003) - et al.
Monitoring the future: National survey results on drug use, 1975–1999, volume 2
(2000) - Jones, S. The internet goes to college. [Online] Pew Internet and American Life Project report....
- et al.
Incentives to increase participation in an Internet survey of alcohol use: A controlled experiment
Alcohol & Alcoholism
(2003)
Cited by (44)
A cross-sectional survey to evaluate the pet squirrel population and ownership profiles
2018, Preventive Veterinary MedicineCitation Excerpt :According to this, most of the respondents in our study were in the younger age group (18–30 years old), had high education level and lived in urban settings. As for gender differences, in general Web surveys are more likely to be completed by males than by females (McCabe et al., 2006; Stanton and Rogelberg, 2001). Lower levels of Internet self- efficacy in females than in males has been proposed as one possible explanation for this finding (LaRose, Mastro, & Eastin, 2001).
Does online psychological test administration facilitate faking?
2011, Computers in Human BehaviorContemporary options for longitudinal follow-up: Lessons learned from a cohort of urban adolescents
2011, Evaluation and Program PlanningFactors affecting response rates of the web survey: A systematic review
2010, Computers in Human BehaviorInvertebrates in Science Communication: Confronting Scientists’ Practices and the Public’s Expectations
2021, Frontiers in Environmental Science