Section A

Brain Hologram Visualization for Diagnosis of Tumors using Graphic Imaging

Jenie Nam1,2, Young Jae Kim2,3, Seung Hyun Lee3, Kwang Gi Kim2,*
Author Information & Copyright
1Youngsan International School of Seoul.
2Biomedical Engineering Branch, Division of Precision Medicine and Cancer Informatics, National Cancer Center, Goyang, Korea.
3Department of Plazma Bio Display, Kwangwoon University, Seoul 01897, Korea.
*Corresponding Author: Biomedical Engineering Branch, Division of Precision Medicine and Cancer Informatics, Research Institute, National Cancer Center, 323 Ilsan-ro, Ilsandong-gu, Goyang-si, Gyeonggi-do, Korea, Tel: +82-31-920-2241, E-mail: kimkg@ncc.re.kr

© Copyright 2016 Korea Multimedia Society. This is an Open-Access article distributed under the terms of the Creative Commons Attribution Non Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Received: Aug 08, 2016 ; Revised: Aug 25, 2016 ; Accepted: Aug 17, 2016

Published Online: Sep 30, 2016

Abstract

This research paper examines the usage of graphic imaging in Holographic Projections to further advance the medical field. It highlights the importance and necessity of this technology as well as avant-garde techniques applied in the process of displaying images in digital holography. This paper also discusses the different types of applications for holograms in society today. Different tools were utilized to transfer a set of a cancer patient’s brain tumor data into data used to produce a 3D holographic image. This image was produced through the transfer of data from one program to another. Through the use of semi-automatic segmentation through the seed region method, we were able to create a 3D visualization from Computed Tomography (CT) data.

Keywords: Hologram; Segmentation; Medical imaging; CT imaging; Virtual reality (VR); Augmented reality (AR)

I. INTRODUCTION

Hologram visualizations illustrate the unprecedented paradigm of technology that will continue to dramatically affect the medical field. Holographic images are produced by exposing a high-resolution photographic plate near a subject irradiated by a laser or an intense light [1]. The hologram then diffracts light into an image, creating a 3D display of a real-world object. In 1947, Dennis Gabor developed the theory of holography, but failed to further develop his conjectures due to the inadequate light sources available at that time [1]. Throughout the next three decades, researchers and scientists endeavored to find new solutions and methods to advance holographic projection [1]. Perhaps the most significant of these efforts was the “rainbow” holography invented by Dr. Stephen A. Benton. This particular hologram enables multi colored images to be seen under white-light illumination instead of a laser light, which was a vital source before [2].

Although holograms are employed in many different inventions such as the google glass, the oculus, virtual reality (VR), Augmented Reality (AR) and stereo imaging, these projections endeavor to leave a lasting impression on the medical field as well [3]. Endoscopic Holography, the projection of images inside natural cavities of the human body, has enabled researchers to record a 3D high-resolution image of internal organs, allowing a more rapid detection of deficiencies in the human body [3]. Holograms are also now a part of the “surgeon’s tool kit” as they can view the organs of a patient through the screen of a device. Scans that are displayed through holographic images allow surgeons to see bodily defects without actually having to cut open the patient’s body [3]. In addition, different types of holography, such as the external hologram recording endoscope and the multiplexed holography for medical tomography, have evolved as a new class of medical techniques that are not only used for medical diagnosis and detection, but also for industrial testing [3].

Holograms are very dependable, even in emergency situations, as they are difficult to alter or transpose, easily applied on products, and bring forth simpler interfaces and intuitive usages [4]. On the other hand, holograms can be disadvantageous as their production cost is very high, dimensions are limited, and are time consuming when constructing complex images [4]. Although there can be restrictions when using holograms, this paper discusses a particularly efficient usage; creating holograms of brain tumors. By doing this, it can potentially provide many benefits and advancements to surgeons. Although this generation’s technology is exceeding the norm, there is still no technique invented that can allow brain tumors to be fully seen during a removal surgery [5]. The projection of a brain hologram would evidently improve the precision of surgeons because they will be able to see exactly where the brain tumors are located [5]. Because they enable visualization of organs and contrastive structures, holograms will surly bring forth greater assistance in hospitals in the near future.

II. MATERIALS

The brain tumor CT data is that of a patient at the National Cancer Centre in Ilsan, South Korea. The DICOM 3.0 (ISO 12052) tool was used to receive the CT scan that would later be segmented through semi-automatic segmentation. The Analyzer (11.0 ver, Mayo Clinic, USA) tool was used for the process of segmentation through the seed-region method. Through the Region of Interest (ROI) tool, specific image editing was proceeded. After the files were rendered, the Visualization Toolkit (VTK) was used for the image processing and final rendering of the brain tumor image. Finally, LabView 2012 (National Instrument, USA) was utilized to generate holographic frames of the images to later be processed into a hologram. The Holographic pyramid (Shenzhen SMX, China) itself was borrowed from the Chonbuk National University in Jeonju, South Korea.

jmis-3-3-47-g1
Fig. 1. The holographic pyramid equipment that was used in this experiment.
Download Original Figure

II. METHOD

1. Segmentation

Digital Imaging and Communication in Medicine (DICOM) is a format that describes a set of operations for transmitting imaging modalities such as Computed Tomography (CT) and Magnetic Resonance (MR) across a network [6]. These messages combine images and metadata to create an effective medical imaging procedure. The DICOM data was used to allow the projection of 3D printing. However, before anything else, the data was segmented into several parts so that it can later be combined together to create a hologram for 3D printing.

jmis-3-3-47-g2
Fig. 2. Brain region showing how the region growing based techniques are better than the edge-based techniques in noisy images where edges are difficult to detect.
Download Original Figure

The Region of Interest was traced after the defected area was identified through the specifications of level and width. Through the AUTO TRACE tool, the area of interest was selected. This process was completed semi-automatically as the TRACE tool was also used to manually highlight the specific region. This particular segmentation was carried out through the seed region method. This method starts with a set of “seed” points in a way that the corresponding regions grow by appending to each seed point neighboring hose pixels that have similar properties. Under the supervision of an expert, this process was repeated twice to find the most accurate depiction of the image. It is also possible for both segmentations to mash up to produce the best outcome. The House field unit was then calculated to confirm the visualization of the image [7]. The Window Width (WW) and Window Level (WL) of a specific structure differ depending on the image modality. Because only CT scans were being used in this particular case, the preset (WW-WL) for the brain was 40-80 [8].

2. 3D Modeling

Throughout this process, two different files were made: one of the general outlining of the brain and another with only the tumors outlined. The two files were rendered separately, and later mashed together to present an accurate 3D image of a brain tumor.

jmis-3-3-47-g3
Fig. 3. Rendering of two separate structures: one of the outer brain structure and one of the brain tumors inside the brain itself
Download Original Figure
jmis-3-3-47-g4
Fig. 4. Two rendered products mashed together. The surface rendering of the brain was made a bit transparent so that the tumors can be visible.
Download Original Figure

The brain tumor was rendered through a technique called surface rendering. There are two types of rendering: volume rendering and surface rendering. The surface rendering method consists of contouring lines over data points to get an overview of the shape of the object [9]. Volume rendering occurs when the whole structure including the inner parts are rendered using ray casting techniques that allow the ray to be cast from the viewing plane into the object [9]. This technique calculates one individual cell of the image at a time, forcing the process to be slower. Therefore, surface rendering was used because it could be done rapidly and, more importantly, the brain tumors are visible because of the empty inside. The marching cubes algorithm was also utilized in the experiment. Marching cubes creates triangle models of constant density surfaces from 3D medical data [10]. It uses edge intersections to display a polygonal structure that illustrates how the surface cuts through each designated cube displayed in the 3D data set [11].

3. 3D Data into Hologram Data

Data was transferred into holographic data through the LabView2012 (National Instruments, USA) program. There were 360 frames created in total, each frame having been copied three times. Frame “A” was placed on one end and the copied images rotated in the following angles: 90°, 180°, and 270° respectively, were placed on the other three sides. Through this, a 360degree rotation was projected.

jmis-3-3-47-g5
Fig. 5. Format and set-up of the holographic data before the projection.
Download Original Figure

After the structure finished rendering, it was projected onto a holographic pyramid through the Pepper’s Ghost method. This optical illusion technique was initially used to create ghostlike figures in performances. It was created by placing a sheet of glass away from the stage between the audience and the actors. An off-stage actor would be lit and reflected by the glass, becoming directly visible to the audience. Similarly, the brain tumor images were placed on four opposite sides of the holographic pyramid. As the projection occurred, all four images were reflected to delude the audience of the existence of an actual hologram.

As shown in Figure 6, the brain tumor image was rotated 1°for each frame and then mashed together to create a video-like product.

jmis-3-3-47-g6
Fig. 6. Hologram images that were projected through a holographic pyramid display.
Download Original Figure

III. RESULTS

Through this experiment, the tumors in a brain were shown more accurately in a 3D visualization. This can be utilized to array defects in one’s body with more exactness allowing experts to rapidly detect something that is abnormal.

jmis-3-3-47-g7
Fig. 7. Brain tumor hologram manufactured through the holographic pyramid.
Download Original Figure

Providing3D anatomy visualization allows physicians to comprehend the complex structure and anatomy present that were not visible in the CT scanning. Using methods of auto-segmentation, hologram imaging of a brain tumor was successfully carried out to show the particular ways holograms are utilized in the medical population. We drew the ROI regions of a brain CT scan through auto-segmentation and the seed region method to construct a three-dimensional model of the brain composition with only tumors visible inside it.

IV. DISCUSSION/CONCLUSION

CT scan data was changed into 3D graphic images through the process of semi-automatic segmentation in this experiment. The images were rendered through surface rendering in the procedure. While using the hologram, an individual’s structure was displayed so it was crucial to give the patient the privacy needed by making it anonymous when sharedtwithothers.

Although holographic images of brain tumours can be very helpful, there were still some dissatisfactions felt during the process of experimenting. It took a fairly long time to perform the semi-automatic segmentation, because it was necessary to go through every frame to detect the ROI. Therefore, it would be very advantageous to use a tumour detector such as the CAD (Computer aided diagnosis) as a more rapid alternative.

It would be very useful for surgeons if the brain tumor hologram is registered to be used during the surgery so that the surgery can be done with better precision. The hologram would permit surgeons to see the overall picture of the tumor and where it is in the brain. Having a larger display of the graphic imaging would also be beneficial although it may cause distortion to occur from the light sources. In reality, to use this information in hospitals would require the application of an automated algorithm in software or hardware. The presentation and discussion of many other cases is critical to conclude how holographic imaging can be utilized in the different fields of study.

An advancement in this generation’s technology is also necessary to set the standard for use of holograms in hospitals in the near future. Despite these drawbacks,

Holography imaging will soon allow doctors and researchers to test insertion of medical instruments into a three-dimensional artificial structure before a surgical operation occurs. In addition to the many imprints holographic imaging will leave in the field of medicine, it will also be a boon to machines people use every day such as smart phones and memory devices. Using holography in our banal devices will allow a huge increase of the memory capacity of phones. The potential utilizations of holograms, especially in the area of science, are increasing rapidly. In the next ten years, it is evident that they will become the paradigm of communication in countless different fields of study.

Acknowledgement

This study was supported by a grant of National Cancer Center (16100050).

REFERENCES

[1].

Y. N. Ovechkis, “History of the Holography,” History of the Holography. Oquagen, n.d. Web.

[2].

J. D Bekenstein, “Information in the Holographic Universe,” Am Scientific American, vol. 289, no. 2, pp. 58-65, 2003.

[3].

T. Hattori, S. Sadayuki, I. Mitsuru and R. A. Nader, “Image Processing of Automatic Hologram Synthesizer for Medical Use,” Journal of Light & Visual Environment, vol. 17, no. 1, pp. 56-61, 1993.

[4].

H. Helmut, B. Herbert, Dictionary Geotechnical Engineering / Wörterbuch GeoTechnik. Berlin, Heidelberg: Springer, 2014.

[5].

Cancer.Net, “Brain Tumor: Treatment Options”, 2012; http://www.cancer.net/cancer-types/brain-tumor/treatment-options

[6].

P. Oleg S, Digital imaging and Communications in Medicine (DICOM). Berlin, Heidelberg:Springer, 2008.

[7].

D. R. Varma, “Managing DICOM Images: Tips and Tricks for the Radiologist,” The Indian Journal of Radiology & Imaging. vol. 22, no. 1, pp. 4-13, Jan. 2012.

[8].

RadiAnt DICOM Viewer, “Changing Brightness / Contrast,” http://www.radiantviewer.com/dicom-viewer-manual/change_brightness_contrast.htm, 2016.

[9].

J. Castelan, L. Schaeffer, A. Daleffe, D. Fritzen, V. Salvaro and F. Silva, “Manufacture of custom-made cranial implants from DICOM®images using 3D printing, CAD/CAM technology and incremental sheet forming,” Revista Brasileira de Engenharia Biomedica, vol. 30, no. 3, pp. 265-273, 2014.

[10].

W. Fang and Z. Hongqin, “Algorithm of Marching Cubes,” in Knowledge Acquisition and Modeling (KAM) 2011 Fourth International Symposium on., pp. 321-322, 2011.

[11].

A. G. Schreyer and S. K. Warfield, Sufrace Rendering. Berlin, Heidelberg:Springer, 2002.