I conducted one-way anova test and get a significant result, but when I conducted Scheffe test there was no significant result. Is this possible? How should I proceed or report the results?
Scheffe's test allows you to do more than compare group means. You can compare the average of groups A and B with the average of groups C, D and E. Etc. The only real reason to choose Scheffe's test for multiple comparisons is to do that kind of contrast. If you only compare group means, this test has less power than others (Tukey, Dunnett).
The Scheffe's test (unlike Tukey etc.) guarantees you that if the overall ANOVA is statistically significant then at least one contrast will be too (page 217, Maxwell and Delaney, 2nd edition). But that contrast may not be a simple comparison of group means, but rather may be a complex comparison involving many groups.
- Solved – R Tukey HSD Anova: Anova significant, Tukey not?
- Solved – Which Post-Hoc Test Should Be Used in Repeated Measures (ANOVA) in SPSS
- Solved – What do “single-step” and “multi-step” mean in post-hoc testing of ANOVAs
- Solved – Post-Hoc Scheffe Test (Agricolae). Where are the coefficients
- Solved – Why did I get significant difference result before using post-hoc test but I got an insignificant result after using post-hoc test