Boundary Value Problems Arising in Kalman Filtering
© Agamirza Bashirov et al. 2008
Received: 10 July 2008
Accepted: 20 October 2008
Published: 28 October 2008
The classic Kalman filtering equations for independent and correlated white noises are ordinary differential equations (deterministic or stochastic) with the respective initial conditions. Changing the noise processes by taking them to be more realistic wide band noises or delayed white noises creates challenging partial differential equations with initial and boundary conditions. In this paper, we are aimed to give a survey of this connection between Kalman filtering and boundary value problems, bringing them into the attention of mathematicians as well as engineers dealing with Kalman filtering and boundary value problems.
However, (1.1)-(1.2) form a starting point for Kalman filtering problem, where , and are matrices (resp., and are vector-valued) and is the so called vector-valued Gaussian white noise process with zero mean and covariance to be an identity matrix, all them of respective dimensions. It is assumed that is a Gaussian random vector with zero mean and known covariance and independent on .
Here (1.4) can be solved a priori and the values of stored in a memory. Then (1.3) provides a linear transformation of the observation data , into the best estimate for every . This transformation is called a Kalman filter. In applications the Kalman filter allows the replacement of the unknown signal , which is very roughly expressed as a solution of (1.1), by its best possible estimate (in the mean square sense), which can be drawn from the available observations.
This result found wide applications in many applied areas, especially in space engineering. For the mathematical and engineering aspects of Kalman filtering we refer to Davis , Fleming and Rishel , Bensoussan , Liptser and Shiryayev , Curtain and Pritchard , Bucy and Joseph , Crassidis and Junkins .
In this paper, we give a survey of new results on Kalman filtering leading to boundary value problems. Such a connection between Kalman filtering and boundary value problems arise in cases when the noises involved to the Kalman filtering problem are delayed in time.
A delay of noises is not only a mathematical generalization of the basic Kalman filtering equations (1.3)-(1.4), but has a practical significance as well. It is well known that a white noise is an ideal process, approximating the noises in reality with more or less adequacy. In this regard, the remark in [4, page 126 ] by Fleming and Rishel is spectacular, where the authors describe wide band noises as a most adequate mathematical model of real noises. The issue on wide band noise was handled in Bashirov , where a wide band noise was represented in the form of distributed delay of a white noise, and on the base of this representation the Kalman filtering equations for the wide band noise model were derived. Now (1.3)-(1.4) of Kalman filtering change their form becoming two systems of equations combining as ordinary as well as partial differential equations with respective initial and boundary conditions.
Representation of wide band noises as a distributed delay of white noises became fruitful in order to derive Kalman filtering equations for pointwise delayed white noises as well. Such noises arise in real cases when a communication between the observer and the object takes considerable time. For example, in [11, 12] the case when the signal is corrupted by pointwise delayed white noise is suggested for the improvement of the preciseness of the Global Positioning Systems. A basic tool for derivation of Kalman filtering equations for pointwise delayed white noises, used in [11, 13], is an approximation of a white noise by wide band noises.
Our aim in this paper is to bring all these boundary value problems to the attention of the community of scientists dealing with boundary value problems and suggest the investigation of numerical methods for them.
2. The Signal Corrupted by Wide Band Noise
The wide band noise Kalman filtering equations (8.60)–(8.66) from Bashirov  are too heavy since they are derived in Hilbert space case compressing two essentially different cases: wide band noise corrupting the signal and observations simultaneously. Here we delineate these cases, which lead to distinct patterns of boundary value problems and, respectively, require different numerical approaches. This essentially reduces the complication of these equations from , making a proper concentration on numerical methods.
Thus a distributed delay of white noise splits the stochastic ordinary differential equation (1.3) into two equations, given in (2.3), the first one being again a stochastic ordinary differential equation, and the second one a stochastic partial differential equation. Respectively, the Riccati equation (1.4) is split into three equations, given in (2.4), the first one being again a deterministic ordinary differential equation, and the second and third ones a deterministic partial differential equation. These partial differential equations serve for transformation of the zero initial and boundary values of and along the boundary lines and into their values along the other boundary line .
3. The Observations Corrupted by Wide Band Noise
where again is fixed and is defined by (2.1), satisfying the same conditions as in Section 2, but the dimensions of the matrix is consistent with the dimension of . Here the presence of non-degenerate white noise in observations is a restriction coming from the nature of Kalman filtering.
Again, (1.3) and (1.4) are split into two and three equations containing partial differential equations, but now they are different from (2.3)-(2.4).
4. The Signal Corrupted by Pointwise Delayed White Noise
Originally, the equations of Kalman filtering for pointwise delayed white noises were conjectured in  and then they were proved in [11, 13] with some corrections in boundary conditions. But the equations from  still contain a misprint which is corrected in .
The Kalman filtering equations from Sections 2 and 3 include zero boundary conditions. In cases when the delay of noises is pointwise some terms fall from the partial differential equations to boundary conditions, creating challenging patterns of boundary conditions.
where is the indicator function of the interval .
5. The Observations Corrupted by Pointwise Delayed White Noise
6. Remarks on Numerical Solutions
Numerical solution of the Riccati systems of equations (2.4), (3.3), (4.3), and (5.3), which replace the Riccati equation (1.4) for delay cases, is very important for realization of the Kalman filters defined by systems (2.3), (3.2), (4.2), and (5.2), respectively. Note that the existence of the unique symmetric and positive solutions of these systems has been proved. This additionally makes these systems interesting in the light of increasing demand to investigations of positive solutions of boundary value problems (see, e.g., [14, 15]).
One can observe that the systems (2.4), (3.3), (4.3), and (5.3) obey different kinds of boundary conditions. The boundary conditions of the systems (2.4) and (3.3) are constantly zero. Therefore, for numerical solution of them it suffices to use rectangular grids on and .
Whereas the boundary conditions of (4.3) and (5.3) are complicated for numerical solution by rectangular grids; they require data which are not yet calculated. But this complication can be removed by use of continuity: if a step of the grid is too small, then the required data , , and on grid points can be approximated by already calculated data , and . This idea was used in Bashirov and Mazhar  for the system (4.3) in one dimensional case, where some significant conclusions were obtained. In particular, it was demonstrated that neglecting the delay in (4.3) causes a loss of information, which is not recovered as time increases.
A numerical solution of (4.3) and (5.3) by rhombic grid in fact means a numerical solution of (6.12) and (6.13) by rectangular grid, respectively.
The paper surveys new Kalman filtering results leading to boundary value problems. We consider simplest cases, stressing on partial differential equation nature of the Kalman filtering equations under delayed noises. Numerical solution of the Riccati equations is an integral part of Kalman filters. Its complexity increases very fast if the dimension of the signal and observation systems increases. In case of ordinary Riccati differential equation (1.4), efficient algorithms are already developed. But the Riccati systems in (2.4), (3.3), (4.3), and (5.3) are awaiting. A simple trial has been done in  for the system (4.3) in one-dimensional case. The paper is a call to the community of mathematicians and engineers, dealing with Kalman filtering and boundary value problems, to attract their attention to the new kinds of boundary value problems awaiting numerical solution methods.
- Kalman RE: A new approach to linear filtering and prediction problems. Journal of Basic Engineering, Series D 1960,82(1):35-45.View ArticleGoogle Scholar
- Kalman RE, Bucy RS: New Results in Linear Filtering and Prediction Theory. Journal of Basic Engineering, Series D 1961, 83: 95-108.MathSciNetView ArticleGoogle Scholar
- Davis MHA: Linear Estimation and Stochastic Control, Chapman & Hall Mathematics Series. Chapman & Hall, London, UK; John Wiley & Sons, New York, NY, USA; 1977:xii+224.Google Scholar
- Fleming WH, Rishel RW: Deterministic and Stochastic Optimal Control, Applications of Mathematics. Volume 1. Springer, Berlin, Germany; 1975:vii+222.View ArticleGoogle Scholar
- Bensoussan A: Stochastic Control of Partially Observable Systems. Cambridge University Press, Cambridge, UK; 1992:viii+352.View ArticleMATHGoogle Scholar
- Liptser RS, Shiryayev AN: Statistics of Random Processes. II. Applications, Applications of Mathematics. Springer, New York, NY, USA; 1978:x+339.MATHGoogle Scholar
- Curtain RF, Pritchard AJ: Infinite Dimensional Linear Systems Theory, Lecture Notes in Control and Information Sciences. Volume 8. Springer, Berlin, Germany; 1978:vii+297.View ArticleGoogle Scholar
- Bucy RS, Joseph PD: Filtering for Stochastic Processes with Applications to Guidance, Interscience Tracts in Pure and Applied Mathematics, no. 23. John Wiley & Sons, New York, NY, USA; 1968:xviii+195.Google Scholar
- Crassidis JL, Junkins JL: Optimal Estimation of Dynamic Systems, Chapman & Hall/CRC Applied Mathematics and Nonlinear Science Series, 2. Chapman & Hall/CRC, Boca Raton, Fla, USA; 2004:xiv+591.MATHGoogle Scholar
- Bashirov AE: Partially Observable Linear Systems under Dependent Noises, Systems and Control: Foundations and Applications. Birkhäuser, Basel, Switzerland; 2003:xxvi+334.View ArticleMATHGoogle Scholar
- Bashirov AE: Filtering for linear systems with shifted noises. International Journal of Control 2005,78(7):521-529. 10.1080/00207170500084720MathSciNetView ArticleMATHGoogle Scholar
- Bashirov AE, Mazhar Z: On asymptotical behavior of solution of Riccati equation arising in linear filtering with shifted noises. In Mathematical Methods in Engineering. Edited by: Tas K, Machado JAT, Baleanu D. Springer, Dordrecht, The Netherlands; 2007:141-149.View ArticleGoogle Scholar
- Bashirov AE, Mazhar Z, Ertürk S: Kalman type filter for systems with delaying observation noise. submitted to Mathematics of Control, Signals and Systems
- Bai C: Existence of positive solutions for fourth-order three-point boundary value problems. Boundary Value Problems 2007, 2007:-10.Google Scholar
- Yang SJ, Shi B, Zhang DC:Existence of positive solutions for boundary value problems of nonlinear functional difference equation with -Laplacian operator. Boundary Value Problems 2007, 2007:-12.Google Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.