Application of Mixed Reality Technology in Visualization of Medical Operations

Gao Yuan; Tan Ke; Sun Jian; Jiang Tao; Zou Xiaowen

doi:10.24920/003564

Your Location：

Home >

Browse articles >

Application of Mixed Reality Technology in Visualization of Medical Operations

Chinese Medical Sciences Journal;Chinese Medical Sciences Journal Vol. 34, Issue 2, Pages: 103-109(2019)

Review | Updated：2024-04-10

- Application of Mixed Reality Technology in Visualization of Medical Operations
- Affiliations：
  
  中国人民解放军总医院教育技术中心,100853 北京,中国
- Author bio：
  
  *，Tanke123@sina.com
- Funds：
- DOI：10.24920/003564
  CLC：
- Received：22 January 2019，
  
  Accepted：2019-4-11，
  
  Published Online：14 May 2019，
  
  Published：14 May 2019
- Accepted：
Scan QR Code
Gao Yuan, Tan Ke, Sun Jian, et al. Application of Mixed Reality Technology in Visualization of Medical Operations[J]. Chinese medical sciences journal;chinese medical sciences journal, 2019, 34(2): 103-109.
DOI：

Gao Yuan, Tan Ke, Sun Jian, et al. Application of Mixed Reality Technology in Visualization of Medical Operations[J]. Chinese medical sciences journal;chinese medical sciences journal, 2019, 34(2): 103-109. DOI： 10.24920/003564.

摘要

随着虚拟仿真技术的不断进步

医学手术可视化系统也经历着由二维平面到三维立体

由数字化到网络化、智能化的发展进程。采用混合现实技术的可视化系统也将更广泛的应用于医学手术的病例讨论、手术规划、术中指导、术后评估和康复等各个阶段

从而进一步促进医学手术的高智能化、高精确化发展

提高医疗质量和服务水平。本文探讨了基于混合现实技术的医学手术可视化系统的构成与技术特点

并简要介绍了几类混合现实技术在医学手术可视化中的典型应用

为混合现实技术在医学手术中的应用提供了新的视角。

Abstract

With the continuous progress of virtual simulation technology

medical surgery visualization system has been developed from two-dimensional to three-dimensional

from digital to network and intelligentization. The visualization system with mixed reality technology will also be used in all stage of medical surgery

such as case discussion

surgical planning

intraoperative guidance

post-operative evaluation

rehabilitation

so as to further promote high intelligence

high precision of medical surgery

and consequently improve effectiveness of treatment and quality of medical service. This paper discusses the composition and technical characteristics of medical operation visualization system based on mixed reality technology

and introduces some typical applications of mixed reality technology in medical operation visualization

which provides a new perspective for the application of mixed technology in medical surgery.

关键词

Keywords

references

Milgram P , Kishino F . A taxonomy of mixed reality visual displays . IEICE Transact Inform Syst 1994 ; 77 ( 12 ): 1321 - 9 .

The White House . Fact Sheet: President Obama’s precision medicine initiative . https://obamawhitehouse.archives.gov/precision-medicine . Accessed April 8 , 2019 . https://obamawhitehouse.archives.gov/precision-medicine https://obamawhitehouse.archives.gov/precision-medicine

Quint F , Sebastian K , Gorecky D . A Mixed-reality learning environment . Procedia Comput Sci 2015 ; 75 : 43 - 8 . doi: DOI: 10.1016/j.procs.2015.12.199 http://doi.org/10.1016/j.procs.2015.12.199 https://linkinghub.elsevier.com/retrieve/pii/S1877050915036601 https://linkinghub.elsevier.com/retrieve/pii/S1877050915036601

Ke F , Lee S , Xu X . Teaching training in a mixed-reality integrated learning environment . Comput Hum Behav 2016 ; 62 : 212 - 20 . doi: DOI: 10.1016/j.chb.2016.03.094 http://doi.org/10.1016/j.chb.2016.03.094 . DOI: 10.1016/j.chb.2016.03.094 http://doi.org/10.1016/j.chb.2016.03.094 https://linkinghub.elsevier.com/retrieve/pii/S0747563216302655 https://linkinghub.elsevier.com/retrieve/pii/S0747563216302655

Hwang Y , Lampotang S , Gravenstein N , et al . Integrating conversational virtual humans and mannequin patient simulators to present mixed reality clinical training experiences. 2009 8th IEEE International Symposium on Mixed and Augmented Reality. 2009 Sep 7; Orlando, US . IEEE ; 2009 . p. 197 - 8 . doi: DOI: 10.1109/ISMAR.2009.5336466 http://doi.org/10.1109/ISMAR.2009.5336466

Kersten-Oertel M , Jannin P , Collins DL . The state of the art of visualization in mixed reality image guided surgery . Comput med imaging graphics 2013 ; 37 ( 2 ): 98 - 112 . doi: DOI: 10.1016/j.compmedimag.2013.01.009 http://doi.org/10.1016/j.compmedimag.2013.01.009 https://linkinghub.elsevier.com/retrieve/pii/S0895611113000116 https://linkinghub.elsevier.com/retrieve/pii/S0895611113000116

Kersten-Oertel M , Jannin P , Collins DL . DVV: A taxonomy for mixed reality visualization in image guided surgery . IEEE Trans Visual Comput Graphics 2011 ; 18 ( 2 ): 332 . doi: DOI: 10.1109/TVCG.2011.50 http://doi.org/10.1109/TVCG.2011.50 .

Behringer R , Christian J , Holzinger A , et al. Some usability issues of augmented and mixed reality for e-Health applications in the medical domain. In: Holzinger A. editor. HCI and Usability for Medicine and Health Care . Berlin Heidelberg: Springer ; 2007 . doi: DOI: 10.1007/978-3-540-76805-0_21 http://doi.org/10.1007/978-3-540-76805-0_21 .

Kamphuis C , Barsom E , Schijven M , et al . Augmented reality in medical education . Perspect Med Educ 2014 ; 57 ( SI-1 Track-A ): 67 - 70 . doi: DOI: 10.1007/s40037-013-0107-7 http://doi.org/10.1007/s40037-013-0107-7

Moro C , Štromberga Z , Raikos A , et al . The effectiveness of virtual and augmented reality in health sciences and medical anatomy . Anat Sci Educ 2017 ; 10 ( 6 ): 549 - 59 . doi: DOI: 10.1002/ase.1696 http://doi.org/10.1002/ase.1696 http://doi.wiley.com/10.1002/ase.v10.6 http://doi.wiley.com/10.1002/ase.v10.6

Belmustakov S , Bailey C , Weiss CR . Augmented and virtual reality navigation for interventions in the musculoskeletal system . Curr Radiol Rep 2018 ; 6 ( 9 ): 33 . doi: DOI: 10.1007/s40134-018-0293-5 http://doi.org/10.1007/s40134-018-0293-5

Gregory TM , Gregory J , Sledge J , et al . Surgery guided by mixed reality: presentation of a proof of concept . Acta Orthop 2018 ; 89 ( 5 ): 480 - 3 . doi: DOI: 10.1080/17453674.2018.1506974 http://doi.org/10.1080/17453674.2018.1506974

17453674 . 2018 . 1506974 .

Javaux A , Bouget D , Gruijthuijsen C , et al . A mixed-reality surgical trainer with comprehensive sensing for fetal laser minimally invasive surgery . Int J CARS 2018 ; 13 ( 12 ): 1949 - 57 . doi: DOI: 10.1007/s11548-018-1822-7 http://doi.org/10.1007/s11548-018-1822-7

Wu P , Yang X , Wang Y , et al . Clinical application of mixed reality technology combined with Da Vinci robot in partial nephrectomy for completely endogenous renal tumors . J Mini Invas Urol 2018 ; 7 ( 04 ): 225 - 9 .Chinese. doi: DOI: 10.19558/j.cnki.10-1020/r.2018.04.001 http://doi.org/10.19558/j.cnki.10-1020/r.2018.04.001 .

Zhu J , Shen D , Liu Q , et al . One case report of remote cooperative robot minimally invasive surgery on mixed reality platform . J Mini invas Urol 2018 ; 7 ( 04 ): 278 - 81 . Chinese. doi: DOI: 10.19558/j.cnki.10-1020/r.2018.04.015 http://doi.org/10.19558/j.cnki.10-1020/r.2018.04.015 .

Yan R , Li X , Xiao J , et al . Exploration of the application of mixed reality technology in plastic surgery teaching . Chin J Aesthetic Med 2018 ; 27 ( 02 ): 140 - 2 . Chinese. doi: DOI: 10.15909/j.cnki.cn61-1347/r.002231 http://doi.org/10.15909/j.cnki.cn61-1347/r.002231 .

Han Y , Peng Y , Yang X , et al . Common problems and countermeasures of doctor-patient communication record . Chin Med Rec Engl Ed 2014 ; 2 ( 1 ): 37 - 40 . doi: DOI: 10.3109/23256176.2014.897503 http://doi.org/10.3109/23256176.2014.897503 .

Butalid L , Verhaak PFM , Boeije HR , et al . Patients views on changes in doctor-patient communication between 1982 and 2001: A mixed-methods study . BMC Family Practice 2012 ; 13 ( 1 ): 80 . doi: DOI: 10.1186/1471-2296-13-80 http://doi.org/10.1186/1471-2296-13-80

Li JJ . Problem-based learning and undergraduate research: another student’s perspective . Perspect Med Educ 2013 ; 2 ( 5-6 ): 360 - 1 . doi: DOI: 10.1007/s40037-013-0085-9 http://doi.org/10.1007/s40037-013-0085-9 http://link.springer.com/10.1007/s40037-013-0085-9 http://link.springer.com/10.1007/s40037-013-0085-9

Lu C , Huang S , Li Z , et al . Effects of exploratory and heuristic multi-methods on system-oriented curricula based on clinical Scenarios . Int J Higher Edu 2017 ; 6 ( 6 ): 55 . doi: DOI: 10.5430/ijhe.v6n6p55 http://doi.org/10.5430/ijhe.v6n6p55 http://www.sciedu.ca/journal/index.php/ijhe/article/view/12530 http://www.sciedu.ca/journal/index.php/ijhe/article/view/12530

Ye ZW , Wu XH , Liu R , et al. editor. Medical Mixed Reality. Wuhan : Hubei Science and Technology Press ; 2018 .

Views

1373

Downloads

CSCD

Alert me when the article has been cited

Submit

Publicity Resources

No data

Related Author

No data

Related Institution

No data

⁰