If brain cells of a dead fish were tested, can we conclude if it’s dead? When everyone thought running multiple tests would better support our claim, turns out, it rather leads to false conclusions; hence, the name “multiplicity problem”. An overview of classical and modern multiplicity adjustment methods will be introduced controlling Family-wise Error Rate (FWER) and False Discovery Rate (FDR). Software details in R will be demonstrated. Real examples and applications will be presented. Don’t revive a dead fish!
- What is “multiplicity”?
- When does “multiplicity” arise?
- (Example 1) Can dead fish be alive?
- (Example 2) Can one drug cure multiple diseases?
- How can it be handled?
- Procedures (Brace yourself for namedropping!)
- Dead fish revisited
- Drug test revisited
- How else? (Modern method)
- Parallel Gate Keeping