高级检索
当前位置: 首页 > 详情页

High-Quality Novel View Synthesis of Robotic Surgical Scenes using Gaussian Splatting with Depth Prior

文献详情

资源类型:
WOS体系:
Pubmed体系:

收录情况: ◇ SCIE

机构: [1]Yunnan Key Lab Optoelectronic Information Technology, Yunnan Normal University, Kunming 650500, China [2]Department of Thoracic Surgery, Institute of The First People’s Hospital of Yunnan Province, Kunming 650032, China [3]School of Mathematics and Computer Science, Yunnan Minzu University, Kunming 650031, China [4]Yunnan Province Photoelectric Detection and Perception Technology Engineering Research Center, China
出处:
ISSN:

关键词: Robotic Assisted Surgery Novel View Synthesis 3D Gaussian Splatting Depth Anything Multi-Scale Loss

摘要:
Robot-assisted surgery has revolutionized modern medical procedures by enhancing precision, reducing invasiveness, and providing a clearer, more controlled environment. However, it still faces challenges in fully visualizing the target tissue, particularly from multiple perspectives. This limitation is most evident in minimally invasive surgeries, Therefore, the ability to synthesize new views of the surgical scene is becoming increasingly critical. By generating multi-view visualizations, surgeons can gain a more comprehensive understanding of the target tissue, improving spatial awareness and decision-making during surgery.This article proposes an innovative novel view synthesis method for robotic surgical scenarios, which utilizes pre-trained depth estimation model to obtain global depth information and solves the scale ambiguity problem encountered in the transition region of the Gaussian distribution in the 3D Gaussian model. In addition, we introduce a multi-scale loss optimization strategy that captures features of various scales through a multi-scale loss function to regularize the Gaussian parameters while maintaining the 3D consistency of the splatting.Our method is evaluated against current scene novel view synthesis techniques using our robotic surgery scene dataset, along with the Hamlyn and Stereo MIS public datasets. The proposed approach achieved an average PSNR of 33.45, SSIM of 0.939, LPIPS of 0.153, and an RMSE of 0.022 across the three datasets.Our approach helps to enhance the visualization capabilities of robotic surgical systems by synthesizing novel views of surgical scenes. A deeper understanding of the target tissue will enhance patient safety during surgery and support surgeon training. These advancements will contribute to the improvement of robot-assisted surgery, making it more adaptable to diverse clinical scenarios.Copyright © 2025 Elsevier B.V. All rights reserved.

基金:
语种:
WOS:
PubmedID:
中科院(CAS)分区:
出版当年[2025]版:
最新[2025]版:
大类 | 2 区 医学
小类 | 2 区 计算机:跨学科应用 2 区 计算机:理论方法 2 区 工程:生物医学 3 区 医学:信息
JCR分区:
出版当年[2024]版:
Q1 COMPUTER SCIENCE, THEORY & METHODS Q1 MEDICAL INFORMATICS Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Q2 ENGINEERING, BIOMEDICAL
最新[2024]版:
Q1 COMPUTER SCIENCE, THEORY & METHODS Q1 MEDICAL INFORMATICS Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Q2 ENGINEERING, BIOMEDICAL

影响因子: 最新[2024版] 最新五年平均 出版当年[2024版] 出版当年五年平均 出版前一年[2023版]

第一作者:
第一作者机构: [1]Yunnan Key Lab Optoelectronic Information Technology, Yunnan Normal University, Kunming 650500, China [4]Yunnan Province Photoelectric Detection and Perception Technology Engineering Research Center, China
通讯作者:
通讯机构: [1]Yunnan Key Lab Optoelectronic Information Technology, Yunnan Normal University, Kunming 650500, China [4]Yunnan Province Photoelectric Detection and Perception Technology Engineering Research Center, China
推荐引用方式(GB/T 7714):
APA:
MLA:

资源点击量:92723 今日访问量:1 总访问量:786 更新日期:2025-07-01 建议使用谷歌、火狐浏览器 常见问题

版权所有©2020 云南省第一人民医院 技术支持:重庆聚合科技有限公司 地址:云南省昆明市西山区金碧路157号 ICP备案:滇ICP备15003244号