A novel intelligent navigation technique for accurate image-guided COVID-19 lung biopsy is addressed, which systematically combines augmented reality (AR), customized haptic-enabled surgical tools, and deep neural network to achieve customized surgical navigation. Clinic data from 341 COVID-19 positive patients, with 1598 negative control group, have collected for the model synergy and evaluation. Biomechanics force data from the experiment are applied a WPD-CNN-LSTM (WCL) to learn a new patient-specific COVID-19 surgical model, and the ResNet was employed for the intraoperative force classification. To boost the user immersion and promote the user experience, intro-operational guiding images have combined with the haptic-AR navigational view. Furthermore, a 3-D user interface (3DUI), including all requisite surgical details, was developed with a real-time response guaranteed. Twenty-four thoracic surgeons were invited to the objective and subjective experiments for performance evaluation. The root-mean-square error results of our proposed WCL model is 0.0128, and the classification accuracy is 97%, which demonstrated that the innovative AR with deep learning (DL) intelligent model outperforms the existing perception navigation techniques with significantly higher performance. This article shows a novel framework in the interventional surgical integration for COVID-19 and opens the new research about the integration of AR, haptic rendering, and deep learning for surgical navigation.
基金:
National Natural Science Foundation of ChinaNational Natural Science Foundation of China (NSFC) [62062069, 62062070, 62005235]
语种:
外文
被引次数:
WOS:
PubmedID:
中科院(CAS)分区:
出版当年[2021]版:
大类|1 区工程技术
小类|1 区自动化与控制系统1 区计算机:跨学科应用1 区工程:工业
最新[2023]版:
大类|1 区计算机科学
小类|1 区自动化与控制系统1 区计算机:跨学科应用1 区工程:工业
JCR分区:
出版当年[2020]版:
Q1COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONSQ1ENGINEERING, INDUSTRIALQ1AUTOMATION & CONTROL SYSTEMS
最新[2023]版:
Q1AUTOMATION & CONTROL SYSTEMSQ1COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONSQ1ENGINEERING, INDUSTRIAL
第一作者机构:[1]Yunnan Normal Univ, Yunnan Key Lab Optoelect Informat Technol, Kunming 650500, Yunnan, Peoples R China
共同第一作者:
通讯作者:
推荐引用方式(GB/T 7714):
Tai Yonghang,Qian Kai,Huang Xiaoqiao,et al.Intelligent Intraoperative Haptic-AR Navigation for COVID-19 Lung Biopsy Using Deep Hybrid Model[J].IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS.2021,17(9):6519-6527.doi:10.1109/TII.2021.3052788.
APA:
Tai, Yonghang,Qian, Kai,Huang, Xiaoqiao,Zhang, Jun,Jan, Mian Ahmad&Yu, Zhengtao.(2021).Intelligent Intraoperative Haptic-AR Navigation for COVID-19 Lung Biopsy Using Deep Hybrid Model.IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,17,(9)
MLA:
Tai, Yonghang,et al."Intelligent Intraoperative Haptic-AR Navigation for COVID-19 Lung Biopsy Using Deep Hybrid Model".IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS 17..9(2021):6519-6527