Atmospheric Chemistry and Physics Discussions www.atmos-chem-phys-discuss.net 1680-7367 1680-7375 9 4 2009 10.5194/acpd-9-14263-2009 http://www.atmos-chem-phys-discuss.net/9/14263/2009/ http://www.atmos-chem-phys-discuss.net/9/14263/2009/acpd-9-14263-2009.html http://www.atmos-chem-phys-discuss.net/9/14263/2009/acpd-9-14263-2009.pdf 14263 14314 2009-07-01 <i>Est modus in rebus</i>: analytical properties of multi-model ensembles S. Potempski S. Galmarini stefano.galmarini@jrc.it European Commission – DG Joint Research Centre, Institute for Environment and Sustainability, 21020 Ispra VA, Italy Institute of Atomic Energy, 05-400 Otwock-Swierk, Poland In this paper we investigate some basic properties of the multi-model ensemble systems, which can be deduced from a general characteristic of statistical distributions of the ensemble members with the help of mathematical tools. In particular we show how to find optimal linear combination of model results, which minimizes the mean square error both in the case of uncorrelated and correlated models. By proving basic estimations we try to deduce general properties describing multi-model ensemble systems. We show also how mathematical formalism can be used for investigation of the characteristics of such systems. Campolongo, F., Cariboni, J., and Saltelli, A.: An effective screening design for sensitivity analysis of large models, Environ. Model. Softw. 22(10), 1509–1518, 2007. Dabbert W. F. and Miller E.: Uncertainty, ensembles and air quality dispersion modelling: applications and challenges, Atmos. Environ., 34, 4667–4673, 2000. Delle Monache L. and Stull R. B.: An ensemble air-quality forecast over western Europe during an ozone episode, Atmos. Environ., 37(25), 3469–3474, 2003. Delle Monache, L., Deng, X., Zhou Y., and Stull R.: Ozone ensemble forecasts: 1. A new ensemble design, J. Geophysi. Res., 111(D5), D05307,10.1029/2005JD006310, 2006a. Delle Monache, L., Nipen, T., Deng, X., Zhou, Y., and Stull, R.: Ozone ensemble forecasts: 2. A Kalman filter predictor bias correction, J. Geophys. Res., 111, D05308, doi:10.1029/2005JD006311, 2006b. Delle Monache, L., Wilczak, J., Mckeen, S., Grell, G., Pagowski, M., Peckham, S., Stull, R., McHenry, J., and McQueen, J.: A Kalman-filter bias correction method applied to deterministic, ensemble averaged and probabilistic forecasts of surface ozone, Tellus B, 60B(2), 238–249, 2008. Edwards, A. W. F.: Likelihood, 2nd edn., The Johns Hopkins University Press, USA, 275~pp., 1992 Draxler, R. R.: Evaluation of an ensemble dispersion calculation, J. Appl. Meteorol., 42, 308–317, 2001. Feller W.: Introduction to probability theory and its application, vol. 1, 3rd edn., vol. 2, 2nd edn., Wiley, 509~pp., 704 pp., 1968. Gandin, L. S.: Objective analysis of meteorological field, Gidro-meteorologicheskoe Izdate'stvo, Leningrad, USSR, 286~pp., 1963. Galmarini S., Bianconi R., Bellasio R., and Graziani G.: Forecasting consequences of accidental releases from ensemble dispersion modelling, J. Environ. Radioactiv., 57, 203–219, 2001. Galmarini S., Bianconi, R., Klug, W., Mikkelsen, T., Addis, R., Andronopoulos, S., Astrup, P., Baklanov, A., Bartniki, J., Bartzis, J. C., Bellasio, R., Bompay, F., Buckley, R., Bouzom, M., Champion, H., D'Amours, R., Davakis, E., Eleveld, H., Geertsema, G. T., Glaab, H., Kollax, M., Ilvonen, M., Manning, A., Pechinger, U., Persson, C., Polreich, E., Potemski, S., Prodanova, M., Saltbones, J., Slaper, H., Sofiev, M. A., Syrakov, D., Sørensen, J. H., Van der Auwera, L., Valkama, I., and Zelazny, R.: Ensemble dispersion forecasting, Part 1: Concept, Approach and indicators, Atmos. Environ., 38(28), 4607–4617, 2004a. Galmarini S., Bianconi., R., Addis, R., Andronopoulos, S., Astrup, P., Bartzis, J. C., Bellasio, R., Buckley, R., Champion, H., Chino, M., D'Amours, R., Davakis, E., Eleveld, H., Glaab, H., Manning, A., Mikkelsen, T., Pechinger, U., Polreich, E., Prodanova, M., Slaper, H., Syrakov, D., Terada, H., and Van der Auwera, L.: Ensemble dispersion forecasting, Part II: Application and evaluation, Atmos. Environ., 38(28), 4619–4632, 2004b. Galmarini S., Bianconi, R., de Vries, G., and Bellasio, R.: Real-time monitorino data for real-time multi-model validation: coupling ENSEMBLE and EURDEP, J. Environ. Radioactiv., 99, 1233–1241, 2008. Girardi, F., Graziani, G., van Veltzen, D., Galmarini, S., Mosca, S., Bianconi R., Bellasio, R., Klug, W.: The ETEX project, Office for official publication of the European Communities, Luxembourg, EUR Report 181–43 EN, 106~pp., 1998. Hanson K. M. and Hemez, F. M.: Sensitivity Analysis of Model Output Proceedings of the 4th International Conference on Sensitivity Analysis of Model Output (SAMO 2004), Santa Fe, New Mexico, 8–11~March, 519 pp. 2004. Kalnay, E.: Atmospheric Modeling, Data Assimilation and Predictability, Cambridge University Press, Cambridge, UK, 341~pp., 2004. Killip, C. A., Brooke, A. S., Best, P. R., Application of various dispersion models to management of local and regional air quality in Australia, Guideline on Air Quality Models: The Path Forward, pp. 355-371, 2003. Krishnamurti, T. N., Kishtawal, C.M., Zhang, Z., LaRow, T., Bachiochi, D., Williford, E., Gadgil, S., and Surendran, S.: Multimodel ensemble forecasts for weather and seasonal climate, J. Climate, 13(23), 4196–4216, 2000. Lehman, E.L. and Romano J. P.: Testing Statistical Hypotheses, 3rd edn., Springer, New York, usa, 768~pp., 2008 Lorenc A. C.: Analysis methods for NWP, QJRMS, 112, 1177–1194, 1986. Mallet, V. and Sportisse, B.: Ensemble-based air quality forecasts: A multimodel approach applied to ozone, J. Geophys. Res., 111, D18302, doi:10.1029/2005JD006675, 2006. McKeen S., Wilczak J., Grell G., Djalalova I., Peckham S., Hsie E.-Y., Gong W., BouchetV., Menard S., Moffet R., McHenry J., McQueen J., Tang Y., Carmichael G. R., Pagowski M., Chan A., Dye T., Frost G., Lee P., and Mathur R.: Assessment of an ensemble of seven real-time ozone forecasts over eastern North America during the summer of 2004, J. Geophys. Res.-Atmos., 110(21), 1–16, 2005. Mutemi, J. N., Ogallo, L. A., Krishnamurti, T. N., Mishra, A. K., and Vijaya Kumar, T. S. V.: Multimodel based superensemble forecasts for short and medium range NWP over various regions of Africa, Meteorol. Atmos. Phys., 95(1–2), 87–113, 2007. Pagowski M., Grell G. A., McKeen S. A., Devenyi D., Wilczak J. M., Bouchet V., Gong W., McHenry J., Peckham S., McQueen J., Moffet R., and Tang, Y.: A simple method to improve ensemble-based ozone forecasts, Geophys. Res. Lett., 32, L07814, doi:10.1029/2004GL022305, 2005. Parrish, D. F. and Derber, J. D.: The National Meteorological Center spectral statistical interpolation analysis system, Mon. Weather. Rev., 120, 1747–1763, 1992. Riccio, A., Giunta, G., and Galmarini, S.: Seeking for the rational basis of the Median Model: the optimal combination of multi-model ensemble results, Atmos. Chem. Phys., 7, 6085–6098, 2007. Potempski S., Galmarini, S., Addis, R., Astrup, P., Bader, S., Bellasio, R., Bianconi, R., Bonnardot, F., Buckley, R., D'Amours, R., van Dijk, A., Geertsema, G., Jones, A., Kaufmann, P., Pechinger, U., Persson, C., Polreich, E., Prodanova, M., Robertson, L., Sørensen, J., and Syrakov, D.: Multi-model ensemble analysis of the ETEX-2 experiment, Atmos. Environ., 42, 7250–7265, 2008. Potempski S., S. Galmarini, A. Riccio, G. Giunta, On the optimal combination of multi-model ensemble predictions and its portability, Atmos. Environ., submitted, 2009. Rodgers J. L. and Nicewander W. A.: Thirteen Ways to Look at the Correlation Coefficient, The American Statistician, 42(1), 59–66, 1988. Sasaki, Y.: Proposed inclusion of time variation terms, observational and theoretical, in numerical variational objective analysis, J. Meteorol. Soc. Jpn., 47, 115–124, 1969. Saltelli, A.: Sensitivity analysis for importance assessment, Risk Anal., 22(3), 579–590, 2002. Saltelli, A., Ratto, M., Tarantola, S., and Campolongo, F.: Sensitivity analysis practices: Strategies for model-based inference, Reliab, Eng. Syst. Saf., 91(10–11), 1109–1125, 2006. Stohl, A., Forster, C., Frank, A., Seibert, P., and Wotawa, G.: Technical note: The Lagrangian particle dispersion model FLEXPART version 6.2, Atmos. Chem. Phys., 5, 2461–2474, 2005. Strang G.: Introduction to Linear Algebra, 4th edn., Wellesley-Cambridge Press, Wellesley MA, USA, 568~pp., 2003 Stull, R. B., Hacker, J., and Modzelewski, H.: Ensemble prediction of air-pollutant transport. Measurements and Modelling in Environmental Pollution in: Measurements and modelling in environmental pollution, edited by: San José, R. and Brebbia, C. A., Computational Mechanics Publications, Southampton, UK, ISBN 1-85312-461-3, 161–167, 1997. Talagrand O.: Assimilation of observations, an introduction, J. Meteorol. Soc. Jpn., 75(1B), 191–209, 1997. Van Loon, M., Vautard, R., Schaap, M., Bergström, R., Bessagnet, B., Brandt, J., Builtjes, P. J. H., Christensen, J. H., Cuvelier, C., Graff, A., Jonson, J. E., Krol, M., Langner, J., Roberts, L. Rouil, R., Stern, L., Tarrasón, P., Thunis, E., Vignati, L., and White, P.: Wind, Evaluation of long-term ozone simulations from seven regional air quality models and their ensemble, Atmos. Environ., 41, 2083–2097, 2007. Vautard, R., Schaap, M., Bergstroöm, R., Bessagnet, B., Brandt, J., Builtjes, P. J. H., Christensen, J. H., Cuvelier, C., Foltescu, V., Graff, A., Kerschbaumer, A., Krol, M., Roberts, P., Rou\"il, L., Stern, R., Tarrason, L., Thunis, P., Vignati, E., and Wind, P.: Skill and uncertainty of a regional air quality model ensemble, in press, doi:10.1016/j.atmosenv.2008.09.083, 2008. Vijaya Kumar, T. S. V., Krishnamurti, T. N., Fiorino, M., and Nagata, M.: Multimodel superensemble forecasting of tropical cyclones in the Pacific, Mon. Weather Rev., 131(3), 574–583, 2003. Wang, B., Lee, J.-Y., Kang, I.-S., Shukla, J., Park, C.-K., Kumar, A., Schemm, J., Cocke, S., Kug, J.-S., Luo, J.-J., Zhou, T., Wang, B., Fu, X., Yun, W.-T., Alves, O., Jin, E. K., Kinter, J., Kirtman, B., Krishnamurti, T., Lau, N. C., Lau, W., Liu, P., Pegion, P., Rosati, T., Schubert, S., Stern, W., Suarez, M., and Yamagata, T.: Advance and prospectus of seasonal prediction: assessment of the APCC/CliPAS 14-model ensemble retrospective seasonal prediction (1980–2004), Clim. Dynam., 1–25, 2008. Wilczak, J., McKeen S., Djalalova I., Grell G., Peckham S., Gong W., Bouchet V., Moffet R., McHenry J., McQueen J., Lee P., Tang Y., and Carmichael, G. R.: Bias-corrected ensemble and probabilistic forecasts of surface ozone over eastern North America during the summer of 2004, J. Geophys. Res., 111, D23S28, doi:10.1029/2006JD007598, 2006. Williford, C. E., Krishnamurti, T. N., Torres, R. C., Cocke, S., Christidis, Z., and Kumar, T. S. V.: Real-time multimodel superensemble forecasts of Atlantic tropical systems in~1999, Mon. Weather Rev., Part~2, 131(8), 1878–1894, 2003. Yun, W. T., Stefanova, L., Mitra, A. K., and Krishnamurti, T. N.: Multi-model synthetic superensemble prediction system, Bull. of Amer. Met. Soc., 4119–4122, 2004. Ziehmann, C.: Comparison of a single model EPS with a multi-model ensemble consisting of a few operational models, Tellus A, 52, 280–299, 2000. Zupanski, D., Denning, A. S., Uliasz, M., Zupanski, M., Schuh, A. E., Rayner, P. J., Peters, W., and Corbin, K. D.: Carbon flux bias estimation employing Maximum Likelihood Ensemble Filter (MLEF), J. Geophys. Res.-Atmos., 112, D17107, doi:10.1029/2006JD008371, 2007.