ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Applications of Mixed Reality Technology in Orthopedics Surgery: A Pilot Study

Lu, Lin; Wang, Honglin; Liu, Pengran; Liu, Rong; Zhang, Jiayao; Xie, Yi; Liu, Songxiang; Huo, Tongtong; Xie, Mao; Wu, Xinghuo*; Ye, Zhewei*华中科技大学
Frontiers in Bioengineering and Biotechnology2022-2-22DOI: 10.3389/fbioe.2022.740507
16被引8阅读
引用收藏
分享

摘要

Objective: The aim of this study is to explore the potential of mixed reality (MR) technology in the visualization of orthopedic surgery.Methods: The visualization system with MR technology is widely used in orthopedic surgery. The system is composed of a 3D imaging workstation, a cloud platform, and an MR space station. An intelligent segmentation algorithm is adopted on the 3D imaging workstation to create a 3D anatomical model with zooming and rotation effects. This model is then exploited for efficient 3D reconstruction of data for computerized tomography (CT) and magnetic resonance imaging (MRI). Additionally, the model can be uploaded to the cloud platform for physical parameter tuning, model positioning, rendering and high-dimensional display. Using Microsoft's HoloLens glasses in combination with the MR system, we project and view 3D holograms in real time under different clinical scenarios. After each procedure, nine surgeons completed a Likert-scale questionnaire on communication and understanding, spatial awareness and effectiveness of MR technology use. In addition to that, the National Aeronautics and Space Administration Task Load Index (NASA-TLX) is also used to evaluate the workload of MR hologram support.Results: 1) MR holograms can clearly show the 3D structures of bone fractures, which improves the understanding of different fracture types and the design of treatment plans; 2) Holograms with three-dimensional lifelike dynamic features provide an intuitive communication tool among doctors and also between doctors and patients; 3) During surgeries, a full lesion hologram can be obtained and blended in real time with a patient's virtual 3D digital model in order to give surgeons superior visual guidance through novel high-dimensional "perspectives" of the surgical area; 4) Hologram-based magnetic navigation improves the accuracy and safety of the screw placement in orthopaedics surgeries; 5) The combination of mixed reality cloud platform and telemedicine system based on 5G provides a new technology platform for telesurgery collaboration. Results of qualitative study encourage the usage of MR technology for orthopaedics surgery. Analysis of the Likert-scale questionnaire shows that MR adds significant value to understanding and communication, spatial awareness, learning and effectiveness. Based on the NASA TLX-scale questionnaire results, mixed reality scored significantly lower under the "mental," "temporal," "performance," and "frustration" categories compared to usual 2D.Conclusion: The integration of MR technology in orthopaedic surgery reduces the dependence on surgeons' experience and provides personalized 3D visualization models for accurate diagnosis and treatment of orthopaedic abnormalities. This integration is clearly one of the prominent future development directions in medical surgery.

学科与关键词

关键词
mixed reality (MR)augmented reality (AR)orthopaedicssurgical visualizationworkloadtelesurgerynavigationcloud platform
相关
加载中…
  • 混合现实技术在股骨粗隆间骨折手术中的初步应用
    窦超超; 韩翔; 臧同心; 李宁; 孙涛中国数字医学, 2019, (11): 76-79.
  • A Realistic Test and Development Environment for Mixed Reality in Neurosurgery
    Simon, Drouin; Marta, Kersten-Oertel; Sean Jy-Shyang, Chen; D. Louis, CollinsAugmented Environments for Computer-Assisted Interventions, Springer Berlin Heidelberg, 13-23, 2012.被引 4
  • On mixed reality environments for minimally invasive therapy guidance: Systems architecture, successes and challenges in their implementation from laboratory to clinic
    Linte, Cristian A.*; Davenport, Katherine P.; Cleary, Kevin; Peters, Craig; Vosburgh, Kirby G.; Navab, Nassir; Edwards, Philip ''Eddie''; Jannin, Pierre; Peters, Terry M.; Holmes, David R., III; Robb, Richard A.COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2013, 37(2): 83-97.被引 39
查看全部 →

发表信息

论文状态
公开发表
期刊
Frontiers in Bioengineering and Biotechnology
发表日期
2022-02-22
卷期
第 10 卷
页码
740507
DOI
10.3389/fbioe.2022.740507
期刊等级
3区
成果收录
SCIE
资助标注
National Natural Science Foundation of China [81974355, 82172524, 81974349]; Establishment of National Intelligent Medical Clinical Research Centre (Establish a national-level innovation platform cultivation plan) [02.07.20030019]

作者

  • L

    Lu, Lin (第一作者)

    huazhong univ sci & technol

  • W

    Wang, Honglin

    huazhong univ sci & technol

查看全部 11 位作者收起作者
  • L

    Liu, Pengran

    huazhong univ sci & technol

  • L

    Liu, Rong

    wuhan univ sci & technol

  • Z

    Zhang, Jiayao

    huazhong univ sci & technol

  • X

    Xie, Yi

    huazhong univ sci & technol

  • L

    Liu, Songxiang

    huazhong univ sci & technol

  • H

    Huo, Tongtong

    huazhong univ sci & technol

  • X

    Xie, Mao

    huazhong univ sci & technol

  • W

    Wu, Xinghuo (通讯)

    huazhong univ sci & technol

  • Y

    Ye, Zhewei (通讯)

    huazhong univ sci & technol

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417