Approximating optimal state estimation

doi:10.1017/CBO9780511617652.009

Chapter 8 - Approximating optimal state estimation

Published online by Cambridge University Press: 03 December 2009

Brian F. Farrell and

Petros J. Ioannou

Edited by

Tim Palmer and

Renate Hagedorn

Show author details

Brian F. Farrell: Affiliation:
Harvard University, Cambridge
Petros J. Ioannou: Affiliation:
Department of Physics, National and Capodistrian University of Athens
Tim Palmer: Affiliation:
European Centre for Medium-Range Weather Forecasts
Renate Hagedorn: Affiliation:
European Centre for Medium-Range Weather Forecasts

Book contents

Get access

Summary

Minimising forecast error requires accurately specifying the initial state from which the forecast is made by optimally using available observing resources to obtain the most accurate possible analysis. The Kalman filter accomplishes this for linear systems and experience shows that the extended Kalman filter also performs well in non-linear systems. Unfortunately, the Kalman filter and the extended Kalman filter require computation of the time-dependent error covariance matrix which presents a daunting computational burden. However, the dynamically relevant dimension of the forecast error system is generally far smaller than the full state dimension of the forecast model which suggests the use of reduced order error models to obtain near optimal state estimators. A method is described and illustrated for implementing a Kalman filter on a reduced order approximation of the forecast error system. This reduced order system is obtained by balanced truncation of the Hankel operator representation of the full error system. As an example application a reduced order Kalman filter is constructed for a time-dependent quasi-geostrophic storm track model. The accuracy of the state identification by the reduced order Kalman filter is assessed and comparison made with the state estimate obtained by the full Kalman filter and with the estimate obtained using an approximation to 4D-Var. The accuracy assessment is facilitated by formulating the state estimation methods as observer systems. A practical approximation to the reduced order Kalman filter that utilises 4D-Var algorithms is examined.

Type: Chapter
Information: Predictability of Weather and Climate , pp. 181 - 216

DOI: https://doi.org/10.1017/CBO9780511617652.009 [Opens in a new window]

Publisher: Cambridge University Press

Print publication year: 2006

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Book purchase

Temporarily unavailable

References

Bishop, C. H., Etherton, B. J., Majumdar, S. J. and Sharanya, J. (2001). Adaptive sampling with the ensemble transform Kalman filter. I: Theoretical aspects. Mon. Weather Rev., 129, 420–362.0.CO;2>CrossRef Google Scholar

Buizza, R. and Palmer, T. (1995). The singular vector structure of the atmospheric general circulation. J. Atmos. Sci., 52, 1434–562.0.CO;2>CrossRef Google Scholar

Cohn, S. E. and Todling, R. (1996). Approximate Kalman filters for stable and unstable dynamics. J. Meteorol. Soc. Jpn., 75, 257–88CrossRef Google Scholar

Dee, D. P. (1995). On-line estimation of error covariance parameters for atmospheric data assimilation. Mon. Weather Rev. 123, 1128–452.0.CO;2>CrossRef Google Scholar

Delsole, T. M. and Farrell, B. F. (1994). Nonlinear equilibration of localized instabilities on a baroclinic jet. J. Atmos. Sci., 51, 2270–842.0.CO;2>CrossRef Google Scholar

Dullerud, G. E. and Paganini, F. (2000). A Course in Robust Control Theory: a Convex Approach, Springer VerlagCrossRef Google Scholar

Evensen, G. (1994). Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte-Carlo methods to forecast error statistics. J. Geophys. Res., 99 (C5), 10143–62CrossRef Google Scholar

Farrell, B. F. (1982). Pulse asymptotics of the Charney baroclinic instability problem. J. Atmos. Sci., 39, 507–172.0.CO;2>CrossRef Google Scholar

Farrell, B. F. and Ioannou, P. J. (1996). Generalized stability. I: Autonomous operators. J. Atmos. Sci., 53, 2025–412.0.CO;2>CrossRef Google Scholar

Farrell, B. F. and Ioannou, P. J. (1999). Perturbation growth and structure in time dependent flows. J. Atmos. Sci., 56, 3622–392.0.CO;2>CrossRef Google Scholar

Farrell, B. F. and Ioannou, P. J. (2001a). Accurate low dimensional approximation of the linear dynamics of fluid flow. J. Atmos. Sci., 58, 2771–892.0.CO;2>CrossRef Google Scholar

Farrell, B. F. and Ioannou, P. J. (2001b). State estimation using a reduced-order Kalman filter. J. Atmos. Sci., 58, 3666–802.0.CO;2>CrossRef Google Scholar

Farrell, B. F. and Ioannou, P. J. (2005). Optimal excitation of linear dynamical systems by distributed forcing. J. Atmos. Sci., 62, 460–75CrossRef Google Scholar

Fukumori, I. and Malanotte-Rizzoli, P. (1995). An approximate Kalman filter for ocean data assimilation; an example with an idealized Gulf Stream model. J. Geophys. Res. Oceans, 100, 6777–93CrossRef Google Scholar

Gelaro, R., Reynolds, C. and Errico, R. M. (2000). Transient and asymptotic perturbation growth in a simple model. Quart. J. Roy. Meteor. Soc., 128, 205–28CrossRef Google Scholar

Ghil, M. (1997). Advances in sequential estimation for atmospheric and oceanic flows. J. Meteorol. Soc. Jpn., 75, 289–304CrossRef Google Scholar

Ghil, M. and Malanotte-Rizzoli, P. (1991). Data assimilation in meteorology and oceanography. Adv. Geophys., 33, 141–266CrossRef Google Scholar

Ghil, M. and Todling, R. (1996). Tracking atmospheric instabilities with the Kalman filter. II: Two layer results. Mon. Weather Rev., 124, 2340–522.0.CO;2>CrossRef Google Scholar

Glover, K. (1984). An optimal Hankel-norm approximation of linear multivariable systems and their L∞-error bounds. Int. J. Control, 39, 1115–93CrossRef Google Scholar

Houtekamer, P. L. and Mitchell, H. L. (1998). Data assimilation using an ensemble Kalman filter technique. Mon. Weather Rev., 126, 796–8112.0.CO;2>CrossRef Google Scholar

Ide, K. and Ghil, M. (1997). Extended Kalman filtering for vortex systems. I: Methodology and point vortices. Dyn. Atmos. Oceans, 27, 301–32CrossRef Google Scholar

Ide, K., Courtier, P., Ghil, M. and Lorenc, A. C. (1997). Unified notation for data assimilation: operational, sequential, and variational. J. Meteorol. Soc. Jpn., 75, 181–9CrossRef Google Scholar

Illyashenko, Yu. S. (1983). On the dimension of attractors of k-contracting systems in infinite-dimensional space. Vestn. Mosk. Univ. Ser. 1 Mat. Mekh., 3, 52–8Google Scholar

Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. J. Basic Eng., 82D, 35–45CrossRef Google Scholar

Kaplan, J. L. and Yorke, J. A. (1979). Preturbulence: a regime observed in a fluid flow model of Lorenz. Commun. Math. Phys., 67, 93–108CrossRef Google Scholar

Lermusiaux, P. F. J. and Robinson, A. R. (1999). Data assimilation via error statistical estimation. I: Theory and schemes. Mon. Weather Rev., 127, 1385–4072.0.CO;2>CrossRef Google Scholar

Lin, S. J. and Pierrehumbert, R. T. (1993). Is the midlatitude zonal flow absolutely unstable?J. Atmos. Sci., 50, 505–172.0.CO;2>CrossRef Google Scholar

Miller, R. N., Ghil, M. and Gauthiez, F. (1994). Advanced data assimilation in strongly nonlinear dynamical systems. J. Atmos. Sci., 51, 1037–562.0.CO;2>CrossRef Google Scholar

Moore, B. C. (1981). Principal component analysis in linear systems: controllability, observability, and model reduction. IEEE T. Automat. Contr., AC-26, 17–31CrossRef Google Scholar

North, G. (1984). Empirical orthogonal functions and normal modes. J. Atmos. Sci., 41, 879–872.0.CO;2>CrossRef Google Scholar

Palmer, T. N., Gelaro, R., Barkmeijer, J. and Buizza, R. (1998). Singular vectors, metrics, and adaptive observations. J. Atmos. Sci., 55, 633–532.0.CO;2>CrossRef Google Scholar

Reynolds, C. A. and Errico, R. M. (1999). Convergence of singular vectors towards Lyapunov vectors. Mon. Weather Rev., 127, 2309–232.0.CO;2>CrossRef Google Scholar

Stewart, G. W. and Sun, J-G. (1990). Matrix Perturbation Theory, Academic PressGoogle Scholar

Sznaier, M., Doherty, A. C., Barahona, M., Doyle, J. C. and Mabuchi, H. (2002). A new bound of the L2 ([0,T]) induced norm and applications to model reduction. In Proceedings 2002 American Control Conference, Anchorage. IEEECrossRef Google Scholar

Takens, F. (1981). Detecting strange attractors in turbulence. In Dynamical Systems and Turbulence, ed. Rand, D. and Young, L.-S., pp. 366–381. Lecture Notes in Mathematics 898. SpringerGoogle Scholar

Tippett, M. K., Cohn, S. E., Todling, R. and Marchesin, D. (2000). Low-dimensional representation of error covariance. Tellus, 52, 533–53CrossRef Google Scholar

Todling, R. and Ghil, M. (1994). Tracking atmospheric instabilities with the Kalman filter. I: Methodology and one-layer results. Mon. Weather Rev., 122, 183–2042.0.CO;2>CrossRef Google Scholar

Zhou, K. and Doyle, J. C. (1998). Essentials of Robust Control. Upper Saddle River, NJ. Prentice HallGoogle Scholar

Dooren, P. (2000). Gramian based model reduction of large-scale dynamical systems. In Numerical Analysis 1999, ed. D. F. Griffiths and Watson, G. A., pp. 231–47. Chapman and Hall/CRC PressGoogle Scholar

Verlaan, M. and Heemink, A. W. (1997). Tidal flow forecasting using reduced rank square root filters. Stoch. Hydrol. Hydraul., 11, 349–68CrossRef Google Scholar

Wunsch, C. (1996). The Ocean Circulation Inverse Problem. Cambridge University Press, CambridgeCrossRef Google Scholar