Table 3

Outcome measures according to the search engine assigned for the initial search: Before searching (T0), after the initial search (T1), and after any additional search (T2).

OUTCOMEINFOCLINIQUE (N = 132)TRIP DATABASE (N = 122)P VALUE
T0T1T2*T0T1T2*
Correct answer, n (%)34 (26)82 (62)88 (67)29 (24)77 (63)82 (67).70
Mean (SD) CI-SDM score§2.6 (0.7)3.5 (0.8)3.5 (0.7)2.6 (0.7)3.4 (0.8)3.6 (0.7).97||
Mean (SD) usefulness of information§NA3.5 (0.8)3.6 (0.7)NA3.6 (0.8)3.7 (0.7).87
Assessment of effect, n (%)#.77**
  • Strong positiveNA41 (31)43 (33)NA36 (30)40 (33)
  • PositiveNA51 (39)56 (42)NA55 (45)60 (49)
  • No or negativeNA40 (30)33 (25)NA31 (25)22 (18)
SORT, n (%)††.10**
  • Level ANA36 (34)35 (33)NA51 (48)52 (49)
  • Level BNA50 (47)52 (49)NA36 (34)37 (35)
  • Level CNA20 (19)19 (18)NA19 (18)17 (16)
  • ANCOVA—analysis of covariance, ANOVA—analysis of variance, CI-SDM—Comfort with Information for Shared Decision Making scale, NA—not applicable, SORT—Strength of Recommendation Taxonomy.

  • * Cumulative values from T1 and T2.

  • P values were calculated for the difference between the search engines at T1, adjusted for T0 when possible.

  • General linear mixed model, adjusted for baseline score (score at T0).

  • § 1—lowest to 5—highest.

  • || Mixed-model ANCOVA, adjusted for baseline score (score at T0).

  • Mixed-model ANOVA.

  • # Strong positive effect—my practice was enhanced; positive effect—I learned something new, I recalled something I had forgotten, I confirmed I was doing the right thing, and I was more confident; no or negative effect—no impact, I am frustrated because there was too much information, I am frustrated because there was nothing useful, I disagree with the information found, and I think the information found could be harmful.

  • ** χ2 test from general linear mixed model (polytomous logistic regression).

  • †† Level A—consistent and of good quality; level B—inconsistent or of limited quality; level C—based on consensus, usual practice, opinion, disease-oriented evidence, or case series. Residents selected a “not evaluable” option if the criteria did not apply or did not fit the information found. Items for which the user chose “not evaluable” were excluded from the analysis (25 for InfoClinique and 16 for the Trip database).