 Research
 Open Access
 Published:
A computational method using multiresolution for volumetric data integration
Boundary Value Problems volume 2012, Article number: 115 (2012)
Abstract
In this paper, we present a new method for integration of 3D medical data by utilizing the advantages of 3D multiresolution analysis and techniques of variational calculus. We first express the data integration problem as a variational optimal control problem where we express the displacement field in terms of wavelet expansions and, secondly, we write the components of the displacement field in terms of wavelet coefficients. We solve this optimization problem with a blockwise descent algorithm. We demonstrate the registration of 3D brain MR images in the size of $257\times 257\times 65$ as an application of the present method. Experimental results indicate that the method can integrate 3D MR images better than only variational or only waveletbased methods.
MSC: 68U10, 65D18, 65J05, 97N40.
1 Introduction
The main purpose of this paper is to present an efficient 3D medical data (image) integration technique. Image integration (sometimes called registration or matching) can be described as finding a spatial correspondence between pixels (or voxels) of two images that maximizes the similarity between the two images. The images could be of the same or different objects and imaging modalities and possibly be taken at different distances, angles, and times. Detecting tumors, locating diseased areas, monitoring changes in an individual, drug discovery, image fusion, feature matching, and motion tracking are some of the important applications of the image registration problem. So far a general theory for image matching has yet to be established. Each application venue has developed its own approaches and implementations. As a result, a single standard method for image integration has not emerged. Therefore, finding reliable and efficient image integration techniques along with fast implementation methods is significantly important and active research area. Some of the wellknown image integration algorithms can be seen in [1–5] and in the references therein.
Structure of this paper is as follows. In Section 2, we present an algorithm for integration of 3D medical data by utilizing the advantages of 3D multiresolution analysis and techniques of variational calculus. In Section 10, we present some experimental results regarding the integration of MR images as an application of the present method. We complete the paper with a final section where we briefly summarize the paper and discuss the future extensions.
2 Multiresolution approach for deformation field
Assume that both the template $\mathbf{T}(\mathbf{x})$ and reference $\mathbf{R}(\mathbf{x})$ images are defined on the same domain $\mathrm{\Omega}\subset {\mathbb{R}}^{3}$. Because reference and template images are obtained from different distances, angles, times, sensors, and sometimes even by different individuals, a displacement field may occur between the reference and template images. One of the major goals of this paper is to compute the deformation field in a systematic way.
A deformation field is a vector image that maps reference image pixel coordinates to the coordinates of the corresponding template image pixels. Consider the deformations of the form
where $u(\mathbf{x})$ denotes a displacement field. Because both the template $\mathbf{T}(\mathbf{x})$ and reference $\mathbf{R}(\mathbf{x})$ images are almost surely ‘the same’ images, we can write
In this paper, we exploit 3D Haar wavelets. When expanding the displacement field $u(\mathbf{x})$ in terms of a wavelet decomposition, it is necessary to take into account the wavelet parameters (coefficients) α, which yields that
The major goal of this paper is to compute the displacement field $u(\mathbf{x})$ in a systematic way. We express each of ${u}_{i}$, $i=1,2,3$, in terms of wavelet coefficients. Therefore, computing these wavelet coefficients will be enough to obtain the displacement field $u(\mathbf{x})$.
A multiresolution analysis of ${L}^{2}(\mathrm{\Omega})$, $\mathrm{\Omega}={\mathbb{R}}^{3}$ is a partially ordered set of closed linear subspaces
with properties:

(1)
${\bigcap}_{\mathbf{n}}{V}_{\mathbf{n}}=\{0\}$; ${\bigcup}_{\mathbf{n}}{V}_{\mathbf{n}}{\subset}_{\mathrm{dense}}{L}^{2}(\mathrm{\Omega})$;

(2)
$f(\mathbf{x})\in {V}_{\mathbf{n}}\u27faf({2}^{\mathbf{m}}\mathbf{x})\in {V}_{\mathbf{n}+\mathbf{m}}$, for every $\mathbf{n}\in {\mathbb{Z}}^{3}$, $\mathbf{m}\in E$;

(3)
$f(\mathbf{x})\in {V}_{\mathbf{n}}\u27faf(\mathbf{x}{2}^{\mathbf{k}})\in {V}_{\mathbf{n}}$, for every $\mathbf{k}\in {\mathbb{Z}}^{3}$, $\mathbf{n}\in E$;

(4)
There exists $\mathrm{\Phi}\in {V}_{\mathbf{0}}$ such that ${\{\mathrm{\Phi}(\mathbf{x}\mathbf{k})\}}_{\mathbf{k}\in {\mathbb{Z}}^{3}}$ is a Riesz basis for ${V}_{\mathbf{0}}$.
Here $\mathbf{n}=({n}_{1},{n}_{2},{n}_{3})$, ${2}^{\mathbf{n}}=({2}^{{n}_{1}},{2}^{{n}_{2}},{2}^{{n}_{3}})$, $\mathbf{0}=(0,0,0)\in {\mathbb{N}}^{3}$, $\mathbf{x}=({x}_{1},{x}_{2},{x}_{3})\in {\mathbb{R}}^{3}$, ${2}^{n}=({2}^{{n}_{1}}{x}_{1},{2}^{{n}_{1}}{x}_{2},{2}^{{n}_{1}}{x}_{3})$. The function $\mathrm{\Phi}(\mathbf{x})$ is called the scaling function of the multiresolution analysis. Detailed information about multiresolution analysis and wavelets might be seen in [6]. Let $\mathrm{\Omega}={(0,1)}^{3}\subset {\mathbb{R}}^{3}$ be the open unit cube. For any $\mathbf{n}\in {\mathbb{Z}}^{3}$, we introduce the function space ${V}_{\mathbf{n}}$: the space of piecewise constant functions on a uniform grid with mesh size $h=({2}^{{n}_{1}},{2}^{{n}_{2}},{2}^{{n}_{3}})$. These grids are uniformly spaced in each of the three coordinate directions, but possibly with a different mesh size in the different directions. The volume of these cells is denoted by ${h}^{3}={2}^{({n}_{1}+{n}_{2}+{n}_{3})}$. The functions in ${V}_{\mathbf{n}}$ are all constant in each cell defined by
A basis ${V}_{m}$ may be generated from a scaling function Φ. In order to deal with 3D deformation field, to each component of the displacement field, a multiresolution decomposition is applied. At scale m, i.e., in the space ${V}_{m}$, the displacement field ${u}^{m}=({u}_{1}^{m},{u}_{2}^{m},{u}_{3}^{m})$ will be parameterized by the vector
as
Elements (scaling functions) of a basis ${V}_{m}$ are 3D functions that are translated across the cubical grid ${\mathrm{\Omega}}_{\mathbf{n},\mathbf{k}}$. These functions are a tensor product of the 1D scaling and wavelet functions as
3 Optimal control formulation of data integration
The stateoftheart image registration problem can be expressed as an optimal control problem by
for the functional
where ${C}_{\mathrm{sim}}[\mathbf{R},\mathbf{T};{\mathit{\varphi}}_{u}]$ denotes a similarity measure between the template image T and the reference image R, ${\mathit{\varphi}}_{u}(\mathbf{x}):=\mathbf{x}+u(\mathbf{x})$ is the deformation field, u is the displacement field, Γ is the set of all possible admissible transformations, ${C}_{\mathrm{reg}}[u]$ is a regularization term, and λ is a regularization constant.
We choose the ${L}^{2}$norm type similarity measure defined as
Note that some other similarity measures might be selected depending on the problem. We choose (7) because, as of our best knowledge, this similarity measure has not been associated with any volumetric image registration algorithm in the literature and to test the convenience of this measure in these types of applications.
Without the regularizing term in functional (6), the image registration problem (5) is illposed [8]; furthermore, imaging data usually is not smooth due to edges, folding, or other unwanted deformations. Illposed problems are widely used in PDEbased image processing problems and inverse problems. An optimization problem is said to be well posed if the solution of the problem uniquely exists and the solution depends continuously on the data of the problem. If one of these two conditions is not satisfied, it is called an illposed problem. Image registration is an illposed optimal control problem. In order to overcome the illposedness of the optimization problem (5) and to assure smooth solutions, we introduce additional regularization terms. The main idea behind adding a regularization term is to smoothen the problem with respect to both the functional and the solution so that wellposedness is assured and efficient computational methods can be defined to determine minimizers. Typical regularization terms associated with image registration problems include curvature, diffusion, elasticity, and fluid. Details about each of these regularization approaches can be seen, for example, in [1] and the references therein.
In this paper, we introduce a regularization term that consists of summation of two different terms defined as follows:
Let us further point out that the regularization term (8) has not also been associated with any volumetric data integration problem in the literature. The term ${\int}_{\mathrm{\Omega}}\sqrt{{\mathrm{\nabla}u(\mathbf{x})}^{2}+\beta}\phantom{\rule{0.2em}{0ex}}d\mathbf{x}$ is known as a perturbed totalvariation model and has been used in image restoration problems. This model was obtained by modifying the regularization term mostly known as the Dirichlet regularization term given by
which penalizes nonsmooth images. Major shortcomings of (9) is that some image features, like edges of the original image, may show up blurred in the reconstructed image. To overcome this drawback, Rudin, Osher, and Fatemi (ROF) proposed replacing (9) with socalled totalvariation (TV) seminorm ${\int}_{\mathrm{\Omega}}\sqrt{\mathrm{\nabla}u(\mathbf{x})}\phantom{\rule{0.2em}{0ex}}d\mathbf{x}$. In the solution of the optimal control problem (5), in order to prevent the degeneracy of the resulting EulerLagrange equations, we modify the TVmodel as ${\int}_{\mathrm{\Omega}}\sqrt{{\mathrm{\nabla}u(\mathbf{x})}^{2}+\beta}\phantom{\rule{0.2em}{0ex}}d\mathbf{x}$, where β is an arbitrarily small perturbation parameter. Another regularization term that we use is ${\int}_{\mathrm{\Omega}}log(u(\mathbf{x}))\phantom{\rule{0.2em}{0ex}}d\mathbf{x}$. This term is added to make the regularization term original and to see its impact on the volumetric data integration problems.
Having said these, we can express the cost function of the optimization problem (5) as
This is a variational [7] convex optimization problem. Necessary and sufficient conditions for the existence and uniqueness of the solutions was given in [4]. Because we set up a connection between this variational optimization problem and 3D wavelet transforms, for a given scale m, the optimal control problem can be expressed as
where ${\mathcal{A}}^{m}$ stands for the admissible parameter set. We apply a blockwise descent algorithm. During the minimization, the cost functional $\mathcal{J}$ needs to be evaluated only on ${\mathrm{\Omega}}_{i,j,k}^{m}$, defined as
which is the support of ${\mathrm{\Phi}}_{i,j,k}^{m}$. Inside the block, the direction of descent $d\in {\mathbb{R}}^{3}$ is computed as the opposite of the gradient $\frac{\partial \mathcal{J}}{\partial {\alpha}^{m}}$ of the cost function $\mathcal{J}$ where
4 Experimental results
In this section, we demonstrate the registration of brain MR images in the size of $257\times 257\times 65$ as an application of the present method. The template, reference, and integrated images are shown in Figure 1. Duration of the registration is about 2 minutes, which is quite fast for 3D medical image integration. We applied the presented method to some other brain MR images and obtained similar results.
5 Conclusion
In this paper, we present a method for integration of 3D medical data by utilizing the advantages of 3D multiresolution analysis and techniques of variational calculus. We first express the data integration problem as a variational optimal control problem where we express the displacement field in terms of wavelet expansions and, secondly, we express the components of the displacement field in terms of wavelet coefficients. We solve the aforementioned optimization problem with a blockwise descent algorithm. We demonstrate the registration of 3D brain MR images in the size of $257\times 257\times 65$ as an application of the present method. Experimental results indicate that the method can integrate 3D MR images better than only variational or only wavelet based methods. In a related work [9], a 3D wavelet based method was presented for deformable image registration where different similarity measure, different regularization term, and different types of wavelets were used.
In future work, we will investigate the applications of this image matching technique to the registration of noisy and blurred images. Furthermore, we plan to compare the strength of these registration techniques with some wellknown image registration methods in terms of speed, quality, and effectiveness in detail.
References
 1.
Akinlar, MA: A new method for nonrigid registration of 3D images. Ph.D. thesis, The University of Texas at Arlington (2009)
 2.
Akinlar MA, Ibragimov RN: Application of an image registration method to noisy images. Sarajevo J. Math. 2011, 7(1):19.
 3.
Akinlar MA, Celenk M: Quality assessment for an image registration. Int. J. Contemporary Math. Sciences 2011, 6(30):14831490.
 4.
Akinlar MA, Kurulay M, Secer A, Bayram M: Efficient variational approaches for deformable registration of images. Abstr. Appl. Anal. 2012. doi:10.1155/2012/704567
 5.
Akinlar, MA, Kurulay, M, Secer, A, Celenk, M: Curvature driven diffusion based medical image registration methods, ICAAM (2012)
 6.
Mallat S: A Wavelet Tour of Signal Processing. Academic Press, San Diego; 2008.
 7.
Sun J, Chen H: Variational Method to the Impulsive Equation with Neumann Boundary Conditions. Bound. Value Probl. 2009., 2009: Article ID 316812. doi:10.1155/2009/316812
 8.
Denche M, Djezzar S: A modified quasiboundary value method for a class of abstract parabolic illposed problems. Bound. Value Probl. 2006., 2006: Article ID 37524. doi:10.1155/BVP/2006/37524
 9.
Noblet V, Heinrich C, Heitz F, Armspach JP: 3D deformable image registration: a topology preservation scheme based on hierarchical deformation models and interval analysis optimization. IEEE Trans. Image Process. 2005, 14(5):553566.
Author information
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
MAA and MK came up with the idea of combining variational methods with 3D wavelets techniques in 3D data integration. They designed the optimization problem in an original format and solved mathematical part of the problem. AS wrote the program of numerical solutions and implemented the solution scheme. MC suggested both to work on brain MR images and to deal with 3D Haar type wavelets. He also interpreted the results and helped in the applications of multiresolution to MR images.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
About this article
Received
Accepted
Published
DOI
Keywords
 inverse problems
 variational optimization
 multiresolution
 image integration