不同现实可视化系统在麻醉领域中的应用

随着全息影像技术的高速发展,其提供的高级可视化技术和交互式医疗体验使得不同的现实可视化系统在医学上的应用日益广泛。文章综述了不同现实可视化系统,如虚拟现实（virtual reality, VR）系统、增强现实（augmented reality, AR）系统及混合现实（mixed reality, MR）系统的定义及...     

Three-dimensional visualization and virtual reality simulation role in hepatic surgery: Further research warranted

Artificial intelligence (AI) is the study of algorithms that enable machines to analyze and execute cognitive activities including problem solving, object and word recognition, reduce the inevitable errors to improve the diagnostic accuracy, and decision-making. Hepatobiliary procedures are technically complex and the use of AI in perioperative management can improve patient outcomes as discussed below. Three-dimensional (3D) reconstruction of images obtained via ultrasound, computed tomography scan or magnetic resonance imaging, can help surgeons better visualize the surgical sites with added depth perception. Pre-operative 3D planning is associated with lesser operative time and intraoperative complications. Also, a more accurate assessment is noted, which leads to fewer operative complications. Images can be converted into physical models with 3D printing technology, which can be of educational value to students and trainees. 3D images can be combined to provide 3D visualization, which is used for preoperative navigation, allowing for more precise localization of tumors and vessels. Nevertheless, AI enables surgeons to provide better, personalized care for each patient.     

A novel enhanced intensity‐based automatic registration: Augmented reality for visualization and localization cancer tumors

The purpose of this study is to replace the manual process (selecting the landmarks on mesh and anchor points on the video) by Intensity‐based Automatic Registration method to reach registration accuracy and low processing time. The proposed system consists of an Enhanced Intensity‐based Automatic Registration (EIbAR) using Modified Zero Normalized Cross Correlation (MZNCC) algorithm. The proposed system was implemented on videos of breast cancer tumors. Results showed that the proposed algorithm—as compared to a reference—improved registration accuracy by an average of 2 mm. In addition, the proposed algorithm—as compared to a reference—reduced the number of pixel matching, thereby reducing processing time on the video by an average of 22 ms/frame. The proposed system can, thus, provide an acceptable accuracy and processing time during scene augmentation of videos, which provides a seamless use of augmented‐reality for surgeons in visualizing cancer tumors.     

增强/混合现实技术在头颈外科的应用及展望

利用增强/混合现实技术以辅助疾病的诊疗和医学教育,是目前国际上数字医学关注的热点。本文对增强/混合现实技术在头颈部外科的应用现状与发展前景进行综述,为进一步的研究提供参考。     

混合现实技术在肝胆外科领域中的应用

混合现实是将虚拟的数字世界与现实世界融合在一起的全新三维呈现技术, 在肝胆外科领域已经得到了初步应用。相比于虚拟现实、增强现实及三维可视化技术, 混合现实技术在手术前评估及制定手术方案、术中实时精准导航及三维虚拟教学中具有独特优势, 是实施精准肝胆外科手术的新一代辅助工具。本文对混合现实技术在肝胆外科领域中的应用及研究进展进行阐述, 探讨其应用潜力和目前的局限性。     

An augmented reality navigation system for pediatric oncologic surgery based on preoperative CT and MRI images

Purpose

In pediatric endoscopic surgery, a limited view and lack of tactile sensation restrict the surgeon's abilities. Moreover, in pediatric oncology, it is sometimes difficult to detect and resect tumors due to the adhesion and degeneration of tumors treated with multimodality therapies. We developed an augmented reality (AR) navigation system based on preoperative CT and MRI imaging for use in endoscopic surgery for pediatric tumors.

Methods

The patients preoperatively underwent either CT or MRI with body surface markers. We used an optical tracking system to register the reconstructed 3D images obtained from the CT and MRI data and body surface markers during surgery. AR visualization was superimposed with the 3D images projected onto captured live images. Six patients underwent surgery using this system.

Results

The median age of the patients was 3.5 years. Two of the six patients underwent laparoscopic surgery, two patients underwent thoracoscopic surgery, and two patients underwent laparotomy using this system. The indications for surgery were local recurrence of a Wilms tumor in one case, metastasis of rhabdomyosarcoma in one case, undifferentiated sarcoma in one case, bronchogenic cysts in two cases, and hepatoblastoma in one case. The average tumor size was 22.0 ± 14.2 mm. Four patients were treated with chemotherapy, three patients were treated with radiotherapy before surgery, and four patients underwent reoperation. All six tumors were detected using the AR navigation system and successfully resected without any complications.

Conclusions

The AR navigation system is very useful for detecting the tumor location during pediatric surgery, especially for endoscopic surgery.     

Extended,virtual and augmented reality in thoracic surgery: a systematic review

 Open in a separate windowOBJECTIVESExtended reality (XR), encompassing both virtual reality (VR) and augmented reality, allows the user to interact with a computer-generated environment based on reality. In essence, the immersive nature of VR and augmented reality technology has been warmly welcomed in all aspects of medicine, gradually becoming increasingly feasible to incorporate into everyday practice. In recent years, XR has become increasingly adopted in thoracic surgery, although the extent of its applications is unclear. Here, we aim to review the current applications of XR in thoracic surgery.METHODSA systematic database search was conducted of original articles that explored the use of VR and/or augmented reality in thoracic surgery in EMBASE, MEDLINE, Cochrane database and Google Scholar, from inception to December 2020.RESULTSOur search yielded 1494 citations, of which 21 studies published from 2007 to 2019 were included in this review. Three main areas were identified: (i) the application of XR in thoracic surgery training; (ii) preoperative planning of thoracic procedures; and (iii) intraoperative assistance. Overall, XR could produce progression along the learning curve, enabling trainees to reach acceptable standards before performing in the operating theatre. Preoperatively, through the generation of 3D-renderings of the thoracic cavity and lung anatomy, VR increases procedural accuracy and surgical confidence through familiarization of the patient’s anatomy. XR-assisted surgery may have therapeutic use particularly for complex cases, where conventional methods would yield inadequate outcomes due to inferior accuracy.CONCLUSIONXR represents a salient step towards improving thoracic surgical training, as well as enhancing preoperative planning and intraoperative guidance.     

根本原因分析法在控制骨科手术部位感染中的应用

【摘要】〓目的〓分析骨科手术部位感染危险因素,采取有效措施降低手术部位感染率。方法 采用根本原因分析方法对骨科手术部位感染相关危险因素进行分析,并采取相关措施,对比处理前后的干预效果。结果〓调查阶段共进行骨科手术578例,发生手术部位感染13例,感染率2.2%。干预阶段共进行骨科手术375例,发生手术部位感染2例,感染率0.5%。结论〓应用根本原因分析法干预可有效降低骨科手术部位感染的发生。     

Breast cancer surgery with augmented reality

Introduction: Innovations in 3D spatial technology and augmented reality imaging driven by digital high-tech industrial science have accelerated experimental advances in breast cancer imaging and the development of medical procedures aimed to reduce invasiveness. Presentation of case: A 57-year-old post-menopausal woman presented with screen-detected left-sided breast cancer. After undergoing all staging and pre-operative studies the patient was proposed for conservative breast surgery with tumor localization. During surgery, an experimental digital and non-invasive intra-operative localization method with augmented reality was compared with the standard pre-operative localization with carbon tattooing (institutional protocol). The breast surgeon wearing an augmented reality headset (Hololens) was able to visualize the tumor location projection inside the patient’s left breast in the usual supine position. Discussion: This work describes, to our knowledge, the first experimental test with a digital non-invasive method for intra-operative breast cancer localization using augmented reality to guide breast conservative surgery. In this case, a successful overlap of the previous standard pre-operative marks with carbon tattooing and tumor visualization inside the patient’s breast with augmented reality was obtained. Conclusion: Breast cancer conservative guided surgery with augmented reality can pave the way for a digital non-invasive method for intra-operative tumor localization.     

Application value of mixed reality in hepatectomy for hepatocellular carcinoma

BACKGROUNDAs a new digital holographic imaging technology, mixed reality (MR) technology has unique advantages in determining the liver anatomy and location of tumor lesions. With the popularization of 5G communication technology, MR shows great potential in preoperative planning and intraoperative navigation, making hepatectomy more accurate and safer. AIMTo evaluate the application value of MR technology in hepatectomy for hepatocellular carcinoma (HCC).METHODSThe clinical data of 95 patients who underwent open hepatectomy surgery for HCC between June 2018 and October 2020 at our hospital were analyzed retrospectively. We selected 95 patients with HCC according to the inclusion criteria and exclusion criteria. In 38 patients, hepatectomy was assisted by MR (Group A), and an additional 57 patients underwent traditional hepatectomy without MR (Group B). The perioperative outcomes of the two groups were collected and compared to evaluate the application value of MR in hepatectomy for patients with HCC.RESULTSWe summarized the technical process of MR-assisted hepatectomy in the treatment of HCC. Compared to traditional hepatectomy in Group B, MR-assisted hepatectomy in Group A yielded a shorter operation time (202.86 ± 46.02 min vs 229.52 ± 57.13 min, P = 0.003), less volume of bleeding (329.29 ± 97.31 mL vs 398.23 ± 159.61 mL, P = 0.028), and shorter obstructive time of the portal vein (17.71 ± 4.16 min vs 21.58 ± 5.24 min, P = 0.019). Group A had lower alanine aminotransferas and higher albumin values on the third day after the operation (119.74 ± 29.08 U/L vs 135.53 ± 36.68 U/L, P = 0.029 and 33.60 ± 3.21 g/L vs 31.80 ± 3.51 g/L, P = 0.014, respectively). The total postoperative complications and hospitalization days in Group A were significantly less than those in Group B [14 (37.84%) vs 35 (60.34%), P = 0.032 and 12.05 ± 4.04 d vs 13.78 ± 4.13 d, P = 0.049, respectively].CONCLUSIONMR has some application value in three-dimensional visualization of the liver, surgical planning, and intraoperative navigation during hepatectomy, and it significantly improves the perioperative outcomes of hepatectomy for HCC.     

Computer-assisted orthopedic surgery

 Computer-assisted surgery (CAS) utilizing robotic or image-guided technologies has been introduced into various orthopedic fields. Navigation and robotic systems are the most advanced parts of CAS, and their range of functions and applications is increasing. Surgical navigation is a visualization system that gives positional information about surgical tools or implants relative to a target organ (bone) on a computer display. There are three types of surgical planning that involve navigation systems. One makes use of volumetric images, such as computed tomography, magnetic resonance imaging, or ultrasound echograms. Another makes use of intraoperative fluoroscopic images. The last type makes use of kinetic information about joints or morphometric information about the target bones obtained intraoperatively. Systems that involve these planning methods are called volumetric image-based navigation, fluoroscopic navigation, and imageless navigation, respectively. To overcome the inaccuracy of hand-controlled positioning of surgical tools, three robotic systems have been developed. One type directs a cutting guide block or a drilling guide sleeve, with surgeons sliding a bone saw or a drill bit through the guide instrument to execute a surgical action. Another type constrains the range of movement of a surgical tool held by a robot arm such as ACROBOT. The last type is an active system, such as ROBODOC or CASPAR, which directs a milling device automatically according to preoperative planning. These CAS systems, their potential, and their limitations are reviewed here. Future technologies and future directions of CAS that will help provide improved patient outcomes in a cost-effective manner are also discussed. Received: October 28, 2002 RID="*"     

Role of artificial intelligence in hepatobiliary and pancreatic surgery

Over the past decade, enhanced preoperative imaging and visualization, improved delineation of the complex anatomical structures of the liver and pancreas, and intra-operative technological advances have helped deliver the liver and pancreatic surgery with increased safety and better postoperative outcomes. Artificial intelligence (AI) has a major role to play in 3D visualization, virtual simulation, augmented reality that helps in the training of surgeons and the future delivery of conventional, laparoscopic, and robotic hepatobiliary and pancreatic (HPB) surgery; artificial neural networks and machine learning has the potential to revolutionize individualized patient care during the preoperative imaging, and postoperative surveillance. In this paper, we reviewed the existing evidence and outlined the potential for applying AI in the perioperative care of patients undergoing HPB surgery.     

A hand‐eye calibration method for augmented reality applied to computer‐assisted orthopedic surgery

Background: Augmented reality (AR) allows the surgeon to represent holographic patient‐specific anatomical information and surgical instruments in the physical world. To correctly superimpose virtual and physical objects, a hand‐eye (HE) calibration method for mapping the virtual and physical spaces was proposed. Methods: Mathematical relationships between the virtual camera and the physical space were derived. Finally, the accuracy and robustness of the proposed HE calibration method were qualitatively and quantitatively evaluated. Results: The proposed calibration method allows us to determine an optimal invariant spatiotemporal mapping between the virtual camera and the physical space. Conclusion: Qualitatively and quantitatively reliable and accurate estimates for the physical‐virtual mapping transformation were verified. Consequently, imaging data and surgical instruments holograms can be precisely represented in the physical space.     

Current trends in three-dimensional visualization and real-time navigation as well as robot-assisted technologies in hepatobiliary surgery

With the continuous development of digital medicine, minimally invasive precision and safety have become the primary development trends in hepatobiliary surgery. Due to the specificity and complexity of hepatobiliary surgery, traditional preoperative imaging techniques such as computed tomography and magnetic resonance imaging cannot meet the need for identification of fine anatomical regions. Imaging-based three-dimensional (3D) reconstruction, virtual simulation of surgery and 3D printing optimize the surgical plan through preoperative assessment, improving the controllability and safety of intraoperative operations, and in difficult-to-reach areas of the posterior and superior liver, assistive robots reproduce the surgeon’s natural movements with stable cameras, reducing natural vibrations. Electromagnetic navigation in abdominal surgery solves the problem of conventional surgery still relying on direct visual observation or preoperative image assessment. We summarize and compare these recent trends in digital medical solutions for the future development and refinement of digital medicine in hepatobiliary surgery.     

New focus on anatomy for surgical trainees

The demise of anatomy teaching in the undergraduate medical curriculum has inevitably reduced the general level of applied anatomical knowledge displayed by junior doctors. Initiatives such as the European Working Time Directive have exacerbated the problem by reducing trainees’ opportunities to acquire appropriate anatomical knowledge and clinical skills through workplace training. Medical Schools and postgraduate Colleges and Schools of Surgery must work together to design and deliver quality‐assured courses in core and non‐core anatomy, that cross the undergraduate/postgraduate interface. All medical students should learn a core syllabus of anatomy, agreed by a panel of clinicians and anatomists but delivered according to the pedagogic style favoured by individual Medical Schools. This core will define the anatomy, that all F1 doctors should know, particularly the anatomy associated with clinical procedures: it will be assessed across all years of the undergraduate medical programme. Medical Schools should also offer modules in non‐core surgical and/or radiological anatomy, some of which may be designed and delivered in partnership with Colleges of Surgery and Radiology: these modules would be particularly attractive to students contemplating a career in surgery or interventional radiology, but would not be offered exclusively to this cohort. At present, the inadequate anatomical knowledge of Foundation doctors must be addressed by ensuring that early postgraduate training programmes include explicit, formal teaching in anatomy, for example, the Core Surgical Anatomy course currently being piloted at the Royal College of Surgeons of England.