The analysis of multivariate image data is a field of research that is becoming increasingly important in a broad range of applications from remote sensing to medical imaging. While traditional scientific visualization techniques are often not suitable for the analysis of this kind of data, methods of image fusion have evolved as a promising approach for synergistic data integration. In this paper, a new approach for the analysis of multivariate image data by means of image fusion is presented, which employs topographic mapping techniques based on non-Euclidean geometry. The hyperbolic self-organizing map (HSOM) facilitates the exploration of high-dimensional data and provides an interface in the tradition of distortion-oriented presentation techniques. For the analysis of hidden patterns and spatial relationships, the HSOM gives rise to an intuitive and efficient framework for the dynamic visualization of multivariate image data by means of color. In an application, the hyperbolic data explorer (HyDE) is employed for the visualization of image data from dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI). Using 12 image sequences from breast cancer research, the method is introduced by different visual representations of the data and is also quantitatively analyzed. The HSOM is compared to different standard classifiers and evaluated with respect to topology preservation.
RichardsJA. Remote Sensing Digital Image Analysis: An Introduction, 2nd edn. Springer: Berlin, Heidelberg, New York, 1993.
2.
BankmanIN, (Ed). Handbook of Medical Imaging: Processing and Analysis.Academic Press: San Diego, San Francisco, New York, Boston, London, Sydney, Tokyo, 2000.
3.
WismüllerALangeODerschDRLeinsingerGLHahnKPützBAuerD. Cluster analysis of biomedical image time-series. International Journal of Computer Vision2002; 46: 103–128.
4.
LandgrebeD. Information extraction principles and methods. In: ChenCH (Ed). Information Processing for Remote Sensing.World Scientific Publishing Co: River Edge, New Jersey, 2000; 3–38.
5.
SchumannHMüllerW. Visualisierung - Grundlagen und allgemeine Methoden.Springer: Berlin, Heiderberg, New York, 2000.
PohlCvan GenderenJL. Multisensor image fusion in remote sensing: Concepts, methods and applications. International Journal of Remote Sensing1998; 19: 823–854.
8.
SimoneGFarinaAMorabitoFCSerpicoSBBruzzoneL. Image fusion techniques for remote sensing applications. Information Fusion2002; 3: 3–15.
9.
HarikumarGBreslerY. Feature extraction techniques for exploratory visualization of vector-valued imagery. IEEE Transactions on Image Processing1996; 5: 1324–1334.
10.
KohonenT. Self-Organizing Maps. Springer Series in Information Science, 3rd edn. Springer: Berlin, Heidelberg, New York, 2001.
FungTLeDrewE. Application of principal component analysis to change detection. Photogrammetric Engineering & Remote Sensing1987; 53: 1649–1659.
13.
SchmiedlUOrthendahlDAMarkASBerryIKaufmanL. The utility of principal component analysis for the image display of brain lesions: A preliminary, comparative study. Magnetic Resonance in Medicine1987; 4: 471–486.
14.
GroßMHSeibertF. Visualization of multidimensional image data sets using a neural network. The Visual Computer1993; 1: 145–159.
15.
KouaEKraakMJ. Geovisualization to support the exploration of large health and demographic survey data. International Journal of Health Geographics2004; 3: 12.
OntrupJRitterH. Text categorization and semantic browsing with self-organizing maps on non-euclidean spaces. In: Proceedings of PKDD-2001.Springer: Berlin, 2001; 338–349.
18.
MorganF. Riemannian Geometry: A Beginner's Guide.Jones and Bartlett Publishers: Boston, London, 1993.
19.
LampingJRaoRPirolliP. A focus+content technique based on hyperbolic geometry for viewing large hierarchies. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, Denver.ACM: New York, 1995; 401–408.
20.
MunznerT. Exploring large graphs in 3D hyperbolic space. IEEE Computer Graphics and Applications1998; 18: 18–23.
21.
FrickeRKleinF. Vorlesungen über die Theorie der automorphen Funktionen, Vol. 1. Teubner: Leipzig1897 (Reprinted by Johnson Reprint: New York, 1965).
22.
MagnusW. Noneuclidean Tesselations and Their Groups.Academic Press: New York, 1974.
23.
CannonJWFloydWJKenyonRParryWR. Hyperbolic geometry. In: LevyS (Ed). Flavors of Geometry.Cambridge University Press: Cambridge and New York, 1997.
24.
CoxeterHSM. Non Euclidean Geometry.University of Toronto Press: Toronto, 1957.
25.
WalterJ. H-MDS: A new approach for interactive visualization with multidimensional scaling in the hyperbolic space. Information Systems2004; 29: 273–292.
26.
RheingansP. Task-based color scale design. In: Proceedings of Applied Image and Pattern Recognition.SPIE Press: Bellingham, Washington, 1999; 35–43.
27.
LiHBurgessEA. Evaluation of signal detection performance with pseudocolour display and lumpy backgrounds. In: Proceedings of Medical Imaging.SPIE Press: Bellingham, Washington, 1997; 143–149.
28.
TrumboB. Theory for coloring bivariate statistical maps. The American Statistician1981; 35: 220–226.
29.
HarrowerMABrewerCA. ColorBrewer.org: An online tool for selecting color schemes for maps. The Cartographic Journal2003; 40: 27–37.
30.
LevkowitzHHermanGT. Color scales for image data. IEEE Computer Graphics & Applications1992; 12: 72–80.
31.
RogowitzBETreinishLA. An Architecture for Perceptual Rule-Based Visualization. In: Proceedings of the IEEE Visualization 1993 Conference.IEE Publications, 1993; 236–243.
32.
WareC. Information Visualization, 2nd edn.Morgan Kaufmann: San Francisco, California, 2004.
33.
RheingansP. Dynamic color mapping of bivariate qualitative data. In: Proceedings of IEEE Visualization1997.IEEE Computer Society Press: Los Alamitos, California, 1997; 159–166.
34.
SmithAR. Color gamut transform pairs. In: Proceedings of SIGGRAPH 1978, ACM Press: New York, 1978; 12–19.
35.
HellwigGBrixGGriebelJLuchtRDelormeSSiebertMEnglmeierKH. Dynamic MR mammography: Three-dimensional real-time visualization of contrast enhancement in virtual reality. Academic Radiology2002; 9: 1255–1263.
36.
KuhlCKMielcareckPKlaschikSLeutnerCWardelmannEGiesekeJSchildHH. Dynamic breast MR imaging: Are signal intensity time course data useful for differential diagnosis of enhancing lesions?Radiology1999; 1: 101–110.
37.
WongPBergeronR. 30 Years of multidimensional multivariate visualization. In: NielsonGMHagenHMuellerH (Eds). Scientific Visualization - Overviews, Methodologies and Techniques.IEEE Computer Society Press: Los Alamitos, California, 1997.
38.
FawcettT. ROC Graphs: notes and practical considerations for researchers. Technical report, HP Labs Tech Report HPL-2003–4, 2003.
39.
BauerHUPawelzikK. Quantifying the neighbourhood preservation of self-organizing feature maps. IEEE Transactions on Neural Networks1992; 8: 226–233.
40.
GoodhillGJSejnowskyTJ. A unifying objective function for topographic mappings. Neural Computation1997; 9: 1291–1303.
41.
BezdekJCPalNR. An Index of topological preservation for feature extraction. Pattern Recognition1995; 28: 381–391.
42.
BauerHUVillmannT. Growing a hypercubical output space in self-organizing feature maps. IEEE Transactions on Neural Networks1997; 8: 218–226.
