Atmos. Chem. Phys. Discuss., 9, 14141-14164, 2009
www.atmos-chem-phys-discuss.net/9/14141/2009/
doi:10.5194/acpd-9-14141-2009
© Author(s) 2009. This work is distributed
under the Creative Commons Attribution 3.0 License.
Review Status
This discussion paper has been under review for the journal Atmospheric Chemistry and Physics (ACP). Please refer to the corresponding final paper in ACP.
Comment on "Quantitative performance metrics for stratospheric-resolving chemistry-climate models" by Waugh and Eyring
V. Grewe and R. Sausen
Deutsches Zentrum für Luft- und Raumfahrt, Institut für Physik der Atmosphäre, Oberpfaffenhofen, 82230 Wessling, Germany

Abstract. This comment focuses on the statistical limitations of a model grading, as applied by D. Waugh and V. Eyring (2008) (WE08). The grade g is calculated for a specific diagnostic, which basically relates the difference of model and observational data to the standard deviation in the observational dataset. Monte Carlo simulations show that this method is not leading to statistical significant gradings. Moreover, the difference between two models is hardly significant. The results of the statistical tests performed in WE08 agree with our findings. However, most of those tests are based on special cases, which implicitely assume that observations are available without any errors and that the interannual variability of the observational data and the model data are equal. Without these assumptions the grading becomes basically insignificant. We further show that the inclusion of confidence intervals into the grading approach is necessary, since it has the potential to change the grading results drastically.

Citation: Grewe, V. and Sausen, R.: Comment on "Quantitative performance metrics for stratospheric-resolving chemistry-climate models" by Waugh and Eyring, Atmos. Chem. Phys. Discuss., 9, 14141-14164, doi:10.5194/acpd-9-14141-2009, 2009.
 
Search ACPD
Discussion Paper
XML
Citation
Final Revised Paper
Share