MULTIMODAL MEDICAL IMAGE FUSION USING IHS-DTCWT-PCA INTEGRATED APPROACH FOR EXTRACTING TUMOR FEATURES

Padmavathi K, Maya V Karki

Abstract


Medical image fusion is a technique where multiple imaging modalities are merged together to obtain a single image that contains maximum information. Spatial domain approach such as IHS-PCA fusion provides best visual quality but required large storage space and also lags directional information. A novel technique is proposed here that integrates Dual Tree Complex Wavelet Transform (DTCWT) with PCA using histogram matching and IHS space that improves the fusion of MRI with PET/SPECT images. The multispectral image PET/SPECT with RGB channels are converted to intensity hue and saturation components by IHS transform. Pathological information in the images can be highlighted in multiscale and multidirection by using DTCWT. PCA with weighted average fusion rule is used for extracting tumor features by using principal components. Visual and quantitative analysis show that our algorithm provides high structural information content, high mutual information with high spatial and spectral resolution thereby enhancing the tumor region compared to other methods.

Keywords


Image fusion, Histogram matching, IHS, DTCWT, PCA, Fusion rules.

Full Text:

PDF

References


T.Akbarpour, M Shamsi&S.Daneshvar, “Structural medical image fusion by means of dual tree complex wavelet”, 22nd Iranian Conference on Electrical Engineering, ICEE 2014, pp. 1970–1975.

F. A. Al-Wassai, N. V Kalyankar& A. A Al-Zuky, “The IHS Transformations Based Image Fusion”, Computer Vision and Pattern Recognition, Volume 2, 2011, pp. 70–77.

NChabi, M Yazdi& M Entezarmahdi, “An efficient image fusion method based on dual tree complex wavelet transform”, 8th Iranian Conference on Machine Vision and Image Processing (MVIP), 2013, pp. 403–407.

W Dou & Y Chen, “An Improved Ihs Image Fusion Method with high spectral fiedility”, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Science, XXXVII(B7), 2008, pp. 1253–1256.

J Du, W Li, K Lu & B Xiao, “An overview of multi-modal medical image fusion”, Neurocomputing, 2016, pp. 3–20.

A. M Eskicioglu& P. S Fisher, “Image quality measures and their performance”, IEEE Transactions on Communications, 1995, pp.2959–2965.

S. Goyal& R Wahla “A Survey on Image Fusion”, International Journal of Innovative Research in Computer and Communication Engineering, 2005, pp.7574–7581.

S. Goyal& R Wahla, “A Survey on Image Fusion”, 2015, pp.7574–7581.

C. He, Q. Liu, H. Li, & Wang, H. “Multimodal medical image fusion based on IHS and PCA”, Procedia Engineering, 2010, pp. 280–285.

P. R Hill, D. R Bull & C. N Canagarajah, “Image fusion using a new framework for complex wavelet transforms”, In IEEE International Conference on Image Processing, ICIP 2005.

V Himanshi, Bhateja, A Krishn, & A Sahu, “An improved medical image fusion approach using PCA and complex wavelets”, In 2014 International Conference on Medical Imaging, m-Health and Emerging Communication Systems (MedCom) pp. 442–447.

A. P James, & B. V. Dasarathy, “Medical Image Fusion: A survey of the state of the art”, Information Fusion, 2014, pp. 4–19.

Y Padma, P Rakesh, & A Pradesh, “Dual Tree Complex Wavelet Transform for Medical Image Fusion”, International Research Journal of Engineering and Technology (IRJET), 2016, pp. 684–689.

I. W Selesnick, R. G Baraniuk, & N. C Kingsbury, “The dual-tree complex wavelet transform”, IEEE Signal Processing Magazine, 2005, pp. 123–151.

S Sruthy, L Parameswaran& A. P Sasi, “Image fusion technique using DT-CWT”, In International Multi-Conference on Automation, Computing, Communication, Control and Compressed Sensing (iMac4s), 2013, pp. 160–164.

TTu, S Su, H. Shyu& P. S Huang, (2001). “A new look at IHS-like image fusion methods”, Information Fusion, 2001, pp.177–186.

X Wen, “Image Fusion Based on Improved IHS Transform with Weighted Average”, International Conference on Computational and Information Sciences, 2011, pp. 111–113.

J.L Wu, X.L Tian & Y.X Tian, ,“Multi-sensor Mars Image Fusion based on IHS Combined Robust PCA”, In Geoscience and Remote Sensing Symposium (IGARSS), 2016 IEEE International pp. 2594–2597.

J Xu, Z.Guan, & J Liu, “An improved ihs fusion method for merging multi-spectral and panchromatic images considering sensor spectral response”, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XXXVII(B7), 2008, pp. 1169–1174.

N Yadav& S Shrivastri, “A Review Of Image Fusion Using IHS With Wavelet Transform”, International Journal of Computer Science Trends and Technology, 2014, pp. 15–20.




DOI: https://doi.org/10.26483/ijarcs.v9i2.5425

Refbacks



Bookmark and Share


Copyright (c) 2018 International Journal of Advanced Research in Computer Science