clm.feedback-interventions-backfire.negative-tailIn the largest meta-analysis of feedback interventions (607 effect sizes from 131 papers, 12,652 participants, 23,663 observations), feedback improved performance on average (d = 0.41) yet over 38% of effect sizes were negative — a share that survives outlier trimming and exclusion of dependence violations (32% of 470 trimmed effects) and cannot be attributed to sampling error (weighted variance 0.97 vs expected 0.09).
- supportsprimary-checkedAbstract, p. 254
“A meta-analysis (607 effect sizes; 23,663 observations) suggests that FIs improved performance on average (d = .41) but that over 1/3 of the FIs decreased performance. This finding cannot be explained by sampling error, feedback sign, or existing theories.”
weighted mean Cohen's d of feedback interventions on performance: 0.41 (n = 607 effect sizes; 12,652 participants; 23,663 observations)
Kluger, A., DeNisi, A. (1996). The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychological Bulletin, 119(2), 254-284. doi:10.1037/0033-2909.119.2.254
- supportsprimary-checkedp. 258
“The weighted mean (weighted by sample size) of this distribution is 0.41, suggesting that, on average, FI has a moderate positive effect on performance. However, over 38% of the effects were negative (see Figure 1). The weighted variance of this distribution is 0.97, whereas the estimate of the sampling error variance is only 0.09.”
share of negative effects; weighted variance vs expected sampling-error variance: >38% negative; variance 0.97 vs 0.09 expected
Kluger, A., DeNisi, A. (1996). The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychological Bulletin, 119(2), 254-284. doi:10.1037/0033-2909.119.2.254
- supportsprimary-checkedp. 273
“Overall, 470 effect sizes survived all exclusions (d′″) and contained enough information to be rated on at least one moderator. Of these effects, 32% were negative. The average FI effect was .38 with a variance of .45 (drastically reduced because of the trimming of the outliers), whereas the expected variance was .09.”
trimmed dataset (outliers, Mikulincer effects, and quasi-d time-series removed): mean d = 0.38; 32% negative; variance 0.45 vs 0.09 expected (n = 470 effect sizes)
Kluger, A., DeNisi, A. (1996). The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychological Bulletin, 119(2), 254-284. doi:10.1037/0033-2909.119.2.254
- contextualizesprimary-checkedTable 2, p. 273 (verbatim table values)
“Task complexity (P3) — Top quartile: K = 107, d = .03; Bottom quartile: K = 114, d = .55.”
mean d by task complexity quartile (after all exclusions): 0.03 (most complex) vs 0.55 (simplest) (n = K = 107 vs 114 effect sizes)
Kluger, A., DeNisi, A. (1996). The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychological Bulletin, 119(2), 254-284. doi:10.1037/0033-2909.119.2.254
- supportsprimary-checkedp. 155, Literature Review — NOTE: the aggregate includes Kluger & DeNisi itself; only the Bangert-Drowns et al. 1991 member is independent, and the unit is studies, not effects
“In fact, about one third of the total studies reviewed in two landmark meta-analyses (i.e., Bangert-Drowns et al., 1991; Kluger & DeNisi, 1996) demonstrate negative effects of feedback on learning.”
Shute, V. (2008). Focus on Formative Feedback. Review of Educational Research, 78(1), 153-189. doi:10.3102/0034654307313795
- contextualizesprimary-checkedFigure 1 caption, p. 258 — the paper prints the raw histogram itself; its x-axis runs to d = 12.5 via an axis break, with the visible bulk between roughly −2 and +3
“Figure 1. Distribution (histogram) of 607 effects (ds) of feedback intervention on performance.”
Kluger, A., DeNisi, A. (1996). The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychological Bulletin, 119(2), 254-284. doi:10.1037/0033-2909.119.2.254
- contextualizesprimary-checkedp. 273, Results
“In addition, three moderators almost reached our significance criteria of .01 (i.e., ps < .05): Computerized FI yielded stronger FI effects (consistent with P2); FIs on complex tasks yielded weaker effects (P3); and FIs were more effective with a goal-setting intervention (P4). Yet, these effects should be treated with extra caution because of the reasons that led us to set alpha at .01 above.”
Kluger, A., DeNisi, A. (1996). The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychological Bulletin, 119(2), 254-284. doi:10.1037/0033-2909.119.2.254
- contextualizesprimary-checkedp. 275, Moderator Analyses: Major Conclusions
“Task complexity had relatively low interjudge reliability (.70), reflecting perhaps the difficulty in conceptualizing task complexity (and other task dimensions) and therefore suggesting that the effect that we observed is an underestimate. Indeed, when we investigated the meaning of the weak correlational effect of task complexity with differences in mean FI effect between the extreme quartiles of task complexity (Table 2), a large effect of task complexity appeared. (Of course, this effect appears large because we looked at the extreme quartiles, yet it helps to demonstrate the implication of the weak correlation.)”
Kluger, A., DeNisi, A. (1996). The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychological Bulletin, 119(2), 254-284. doi:10.1037/0033-2909.119.2.254
- contextualizesprimary-checkedp. 274
“Table 2 also suggests that even within each level of the moderators, there is a large portion of unexplained variance of FI effects.”
Kluger, A., DeNisi, A. (1996). The Effects of Feedback Interventions on Performance: A Historical Review, a Meta-Analysis, and a Preliminary Feedback Intervention Theory. Psychological Bulletin, 119(2), 254-284. doi:10.1037/0033-2909.119.2.254
- contextualizesreport-derivedSeed report, Key sources table
“Feedback is "a double-edged sword"; praise-type FIs d ≈ 0.09 vs 0.34 without”
Kluger, A., DeNisi, A. (1998). Feedback Interventions: Toward the Understanding of a Double-Edged Sword. Current Directions in Psychological Science, 7(3), 67-72. doi:10.1111/1467-8721.ep10772989
Counter-evidence searched: Searched 2026-07-07 for rebuttals of the negative-tail figure; found no published dispute of the number itself. Two scoping caveats are incorporated instead of hidden: (1) the base is effects in the included studies — natural feedback-seeking and intrinsic feedback were out of scope — so 'one third of all feedback' overstates it; (2) any distribution with mean 0.41 and SD near 1 mechanically puts roughly a third of its mass below zero, so the scientifically interesting finding is that FIT's moderators predict which effects land in the tail, not the tail's existence. Corroboration caveat (2026-07-09): Shute (2008)'s one-third figure explicitly aggregates two meta-analyses, one of which is Kluger & DeNisi itself (the other being Bangert-Drowns et al. 1991, education-specific), and counts studies, not effects — so its support runs only through the aggregate's independent member (Bangert-Drowns et al. 1991, education-specific); the Kluger & DeNisi share is echo, not a second discovery — hence the essay presents it as corroboration with the circularity named. Predictability caveat: even within each moderator level the paper reports a large portion of unexplained variance (p. 274), so the moderators aim the distribution without pinning individual interventions.