A cross-platform solution for light field based 3D telemedicine

Wang, Gengkun, Xiang, Wei, and Pickering, Mark (2016) A cross-platform solution for light field based 3D telemedicine. Computer Methods and Programs in Biomedicine, 125. pp. 103-116.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: http://dx.doi.org/10.1016/j.cmpb.2015.11...
 
10
4


Abstract

Current telehealth services are dominated by conventional 2D video conferencing systems, which are limited in their capabilities in providing a satisfactory communication experience due to the lack of realism. The "immersiveness" provided by 3D technologies has the potential to promote telehealth services to a wider range of applications. However, conventional stereoscopic 3D technologies are deficient in many aspects, including low resolution and the requirement for complicated multi-camera setup and calibration, and special glasses. The advent of light field (LF) photography enables us to record light rays in a single shot and provide glasses-free 3D display with continuous motion parallax in a wide viewing zone, which is ideally suited for 3D telehealth applications. As far as our literature review suggests, there have been no reports of 3D telemedicine systems using LF technology. In this paper, we propose a cross-platform solution for a LF-based 3D telemedicine system. Firstly, a novel system architecture based on LF technology is established, which is able to capture the LF of a patient, and provide an immersive 3D display at the doctor site. For 3D modeling, we further propose an algorithm which is able to convert the captured LF to a 3D model with a high level of detail. For the software implementation on different platforms (i.e., desktop, web-based and mobile phone platforms), a cross-platform solution is proposed. Demo applications have been developed for 2D/3D video conferencing, 3D model display and edit, blood pressure and heart rate monitoring, and patient data viewing functions. The demo software can be extended to multi-discipline telehealth applications, such as tele-dentistry, tele-wound and tele-psychiatry. The proposed 3D telemedicine solution has the potential to revolutionize next-generation telemedicine technologies by providing a high quality immersive tele-consultation experience.

Item ID: 47405
Item Type: Article (Research - C1)
ISSN: 1872-7565
Keywords: 3D; cross-platform; light field; telemedicine
Funders: Queensland Government (QG)
Projects and Grants: QG Smart Futures Fellowship
Date Deposited: 02 Mar 2017 00:38
FoR Codes: 46 INFORMATION AND COMPUTING SCIENCES > 4603 Computer vision and multimedia computation > 460306 Image processing @ 50%
42 HEALTH SCIENCES > 4203 Health services and systems > 420302 Digital health @ 50%
SEO Codes: 92 HEALTH > 9204 Public Health (excl. Specific Population Health) > 920499 Public Health (excl. Specific Population Health) not elsewhere classified @ 50%
89 INFORMATION AND COMMUNICATION SERVICES > 8999 Other Information and Communication Services > 899999 Information and Communication Services not elsewhere classified @ 50%
Downloads: Total: 4
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page