Application and exploration of mixed reality technology in accurate operation of bone and soft tissue tumors
Ma Xiaojun1, Lin Yanping2, Huang Yalei3, Sun Wei1 , Shen Jiakang1 , Sun Mengxiong1 ,Fu Zeze1 , Wang Lei1, Cai Zhengdong1
1Department of Orthopedics, Shanghai First People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai Bone Tumor Institution, Shanghai 200080, China; 2School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China; 3Shanghai Lin Yan Medical Technology Co.,Ltd., Shanghai 201210, China
Abstract：Objective To explore the application value of mixed reality technology in the surgical operation of bone and soft tissue tumors.Methods A 48-year-old female inpatient with axillary soft tissue tumor in the Department of Orthopedics of the First People's Hospital Affiliated to Shanghai Jiao Tong university was selected.The DICOM raw data of axillary soft tissue tumors on the patient by 64-slice CT scan and 3.0 T MR scan were obtained and its 3D model reconstruction was completed. Then the 3D model was mapped to the real world through hololens glasses to form mixed reality 3D images, which assisted doctors in preoperative surgical design, simulated surgical operation and effective communication with patients, and guided by mixed reality technology for tumor resection.Results The bone, tumor tissue and surrounding anatomical structure of the patient were visualized and clearly displayed in surgery by high-definition reconstruction based on original CT and MRI imaging data with the assistance of mixed reality. The operation pathway was clear, and the tumor tissue was accurately located and completely removed outside the boundary. The patient recovered after operation with normal activities of the limb. Blood vessels and nerves around the tumor retain complete. Postoperative pathological diagnosis was schwannoma.Conclusions The combination of mixed reality technology with bone and soft tissue tumor surgery has brought revolutionary progress to the clinical diagnosis and treatment. It has great application prospects in the surgical treatment of bone and soft tissue tumors.
马小军, 林艳萍, 黄亚磊, 孙伟, 沈嘉康, 孙梦熊, 傅泽泽, 王雷, 蔡郑东. 混合现实技术在骨与软组织肿瘤精准手术中的应用探索[J]. 中华解剖与临床杂志, 2019, 24(4): 322-326.
Ma Xiaojun, Lin Yanping, Huang Yalei, Sun Wei,Shen Jiakang,Sun Mengxiong,Fu Zeze,Wang Lei, Cai Zhengdong. Application and exploration of mixed reality technology in accurate operation of bone and soft tissue tumors. Chinese Journal of Anatomy and Clinics, 2019, 24(4): 322-326.
Stefan P, Pfandler M, Wucherer P, et al. Team training and assessment in mixed reality-based simulated operating room: current state of research in the field of simulation in spine surgery exemplified by the ATMEOS project[J]. Unfallchirurg, 2018, 121(4): 271-277. DOI:10.1007/s00113-018-0467-x.
Marescaux J, Dallemagne B, Perretta S, et al. Surgery without scars: report of transluminal cholecystectomy in a human being[J]. Arch Surg, 2007, 142(9): 823-827. DOI:10.1001/archsurg.142.9.823.
Nicolau SA, Pennec X, Soler L, et al. An augmented reality system for liver thermal ablation: design and evaluation on clinical cases[J]. Med Image Anal, 2009, 13(3): 494-506. DOI:10.1016/j.media.2009.02.003.
[8]
Lee SC, Fuerst B, Tateno K, et al. Multi-modal imaging, model-based tracking, and mixed reality visualisation for orthopaedic surgery[J]. Healthc Technol Lett, 2017, 4(5): 168-173. DOI:10.1049/htl.2017.0066.
[9]
Hochman JB, Sepehri N, Rampersad V, et al. Mixed reality temporal bone surgical dissector: mechanical design[J]. J Otolaryngol Head Neck Surg, 2014, 43: 23. DOI:10.1186/s40463-014-0023-9.
[10]
Gregory TM, Gregory J, Sledge J, et al. Surgery guided by mixed reality: presentation of a proof of concept[J]. Acta Orthop, 2018, 89(5): 480-483. DOI:10.1080/17453674.2018.1506974.
[11]
Steffner RJ, Jang ES. Staging of bone and soft-tissue sarcomas[J]. J Am Acad Orthop Surg, 2018, 26(13): e269-e278. DOI:10.5435/jaaos-d-17-00055.
[12]
Stokke J, Sung L, Gupta A, et al. Systematic review and meta-analysis of objective and subjective quality of life among pediatric, adolescent, and young adult bone tumor survivors[J]. Pediatr Blood Cancer, 2015, 62(9): 1616-1629. DOI:10.1002/pbc.25514.
2019, Vol. 24 
