Experimental design matters for statistical analysis: how to handle blocking

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autoren

Organisationseinheiten

Externe Organisationen

  • Københavns Universitet
  • University of Perugia
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Seiten (von - bis)523-534
Seitenumfang12
FachzeitschriftPest management science
Jahrgang74
Ausgabenummer3
PublikationsstatusVeröffentlicht - 7 Dez. 2017

Abstract

BACKGROUND: Nowadays, evaluation of the effects of pesticides often relies on experimental designs that involve multiple concentrations of the pesticide of interest or multiple pesticides at specific comparable concentrations and, possibly, secondary factors of interest. Unfortunately, the experimental design is often more or less neglected when analysing data. Two data examples were analysed using different modelling strategies. First, in a randomized complete block design, mean heights of maize treated with a herbicide and one of several adjuvants were compared. Second, translocation of an insecticide applied to maize as a seed treatment was evaluated using incomplete data from an unbalanced design with several layers of hierarchical sampling. Extensive simulations were carried out to further substantiate the effects of different modelling strategies. RESULTS: It was shown that results from suboptimal approaches (two-sample t-tests and ordinary ANOVA assuming independent observations) may be both quantitatively and qualitatively different from the results obtained using an appropriate linear mixed model. The simulations demonstrated that the different approaches may lead to differences in coverage percentages of confidence intervals and type 1 error rates, confirming that misleading conclusions can easily happen when an inappropriate statistical approach is chosen. CONCLUSION: To ensure that experimental data are summarized appropriately, avoiding misleading conclusions, the experimental design should duly be reflected in the choice of statistical approaches and models. We recommend that author guidelines should explicitly point out that authors need to indicate how the statistical analysis reflects the experimental design.

ASJC Scopus Sachgebiete

Zitieren

Experimental design matters for statistical analysis: how to handle blocking. / Jensen, Signe M.; Schaarschmidt, Frank; Onofri, Andrea et al.
in: Pest management science, Jahrgang 74, Nr. 3, 07.12.2017, S. 523-534.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Jensen SM, Schaarschmidt F, Onofri A, Ritz C. Experimental design matters for statistical analysis: how to handle blocking. Pest management science. 2017 Dez 7;74(3):523-534. doi: 10.1002/ps.4773
Jensen, Signe M. ; Schaarschmidt, Frank ; Onofri, Andrea et al. / Experimental design matters for statistical analysis : how to handle blocking. in: Pest management science. 2017 ; Jahrgang 74, Nr. 3. S. 523-534.
Download
@article{b2dea13633d64bd3ac6af47a21dd76b6,
title = "Experimental design matters for statistical analysis: how to handle blocking",
abstract = "BACKGROUND: Nowadays, evaluation of the effects of pesticides often relies on experimental designs that involve multiple concentrations of the pesticide of interest or multiple pesticides at specific comparable concentrations and, possibly, secondary factors of interest. Unfortunately, the experimental design is often more or less neglected when analysing data. Two data examples were analysed using different modelling strategies. First, in a randomized complete block design, mean heights of maize treated with a herbicide and one of several adjuvants were compared. Second, translocation of an insecticide applied to maize as a seed treatment was evaluated using incomplete data from an unbalanced design with several layers of hierarchical sampling. Extensive simulations were carried out to further substantiate the effects of different modelling strategies. RESULTS: It was shown that results from suboptimal approaches (two-sample t-tests and ordinary ANOVA assuming independent observations) may be both quantitatively and qualitatively different from the results obtained using an appropriate linear mixed model. The simulations demonstrated that the different approaches may lead to differences in coverage percentages of confidence intervals and type 1 error rates, confirming that misleading conclusions can easily happen when an inappropriate statistical approach is chosen. CONCLUSION: To ensure that experimental data are summarized appropriately, avoiding misleading conclusions, the experimental design should duly be reflected in the choice of statistical approaches and models. We recommend that author guidelines should explicitly point out that authors need to indicate how the statistical analysis reflects the experimental design.",
keywords = "adjuvants, analysis of variance, herbicide, linear mixed model, maize, neonicotinoid, pseudo-replication",
author = "Jensen, {Signe M.} and Frank Schaarschmidt and Andrea Onofri and Christian Ritz",
note = "Publisher Copyright: {\textcopyright} 2017 Society of Chemical Industry Copyright: Copyright 2018 Elsevier B.V., All rights reserved.",
year = "2017",
month = dec,
day = "7",
doi = "10.1002/ps.4773",
language = "English",
volume = "74",
pages = "523--534",
journal = "Pest management science",
issn = "1526-498X",
publisher = "John Wiley and Sons Ltd",
number = "3",

}

Download

TY - JOUR

T1 - Experimental design matters for statistical analysis

T2 - how to handle blocking

AU - Jensen, Signe M.

AU - Schaarschmidt, Frank

AU - Onofri, Andrea

AU - Ritz, Christian

N1 - Publisher Copyright: © 2017 Society of Chemical Industry Copyright: Copyright 2018 Elsevier B.V., All rights reserved.

PY - 2017/12/7

Y1 - 2017/12/7

N2 - BACKGROUND: Nowadays, evaluation of the effects of pesticides often relies on experimental designs that involve multiple concentrations of the pesticide of interest or multiple pesticides at specific comparable concentrations and, possibly, secondary factors of interest. Unfortunately, the experimental design is often more or less neglected when analysing data. Two data examples were analysed using different modelling strategies. First, in a randomized complete block design, mean heights of maize treated with a herbicide and one of several adjuvants were compared. Second, translocation of an insecticide applied to maize as a seed treatment was evaluated using incomplete data from an unbalanced design with several layers of hierarchical sampling. Extensive simulations were carried out to further substantiate the effects of different modelling strategies. RESULTS: It was shown that results from suboptimal approaches (two-sample t-tests and ordinary ANOVA assuming independent observations) may be both quantitatively and qualitatively different from the results obtained using an appropriate linear mixed model. The simulations demonstrated that the different approaches may lead to differences in coverage percentages of confidence intervals and type 1 error rates, confirming that misleading conclusions can easily happen when an inappropriate statistical approach is chosen. CONCLUSION: To ensure that experimental data are summarized appropriately, avoiding misleading conclusions, the experimental design should duly be reflected in the choice of statistical approaches and models. We recommend that author guidelines should explicitly point out that authors need to indicate how the statistical analysis reflects the experimental design.

AB - BACKGROUND: Nowadays, evaluation of the effects of pesticides often relies on experimental designs that involve multiple concentrations of the pesticide of interest or multiple pesticides at specific comparable concentrations and, possibly, secondary factors of interest. Unfortunately, the experimental design is often more or less neglected when analysing data. Two data examples were analysed using different modelling strategies. First, in a randomized complete block design, mean heights of maize treated with a herbicide and one of several adjuvants were compared. Second, translocation of an insecticide applied to maize as a seed treatment was evaluated using incomplete data from an unbalanced design with several layers of hierarchical sampling. Extensive simulations were carried out to further substantiate the effects of different modelling strategies. RESULTS: It was shown that results from suboptimal approaches (two-sample t-tests and ordinary ANOVA assuming independent observations) may be both quantitatively and qualitatively different from the results obtained using an appropriate linear mixed model. The simulations demonstrated that the different approaches may lead to differences in coverage percentages of confidence intervals and type 1 error rates, confirming that misleading conclusions can easily happen when an inappropriate statistical approach is chosen. CONCLUSION: To ensure that experimental data are summarized appropriately, avoiding misleading conclusions, the experimental design should duly be reflected in the choice of statistical approaches and models. We recommend that author guidelines should explicitly point out that authors need to indicate how the statistical analysis reflects the experimental design.

KW - adjuvants

KW - analysis of variance

KW - herbicide

KW - linear mixed model

KW - maize

KW - neonicotinoid

KW - pseudo-replication

UR - http://www.scopus.com/inward/record.url?scp=85041356840&partnerID=8YFLogxK

U2 - 10.1002/ps.4773

DO - 10.1002/ps.4773

M3 - Article

C2 - 29064623

AN - SCOPUS:85041356840

VL - 74

SP - 523

EP - 534

JO - Pest management science

JF - Pest management science

SN - 1526-498X

IS - 3

ER -

Von denselben Autoren