A real-time freehand ultrasound calibration system with automatic accuracy feedback and control

This article describes a fully automatic, real-time, freehand ultrasound calibration system. The system was designed to be simple and sterilizable, intended for operating-room usage. The calibration system employed an automatic-error-retrieval and accuracy-control mechanism based on a set of ground-truth data. Extensive validations were conducted on a data set of 10,000 images in 50 independent calibration trials to thoroughly investigate the accuracy, robustness, and performance of the calibration system. On average, the calibration accuracy (measured in three-dimensional reconstruction error against a known ground truth) of all 50 trials was 0.66 mm. In addition, the calibration errors converged to submillimeter in 98% of all trials within 12.5 s on average. Overall, the calibration system was able to consistently, efficiently and robustly achieve high calibration accuracy with real-time performance.     

Temporal calibration of freehand three-dimensional ultrasound using image alignment

All freehand 3-D ultrasound systems have some latency between the acquisition of an image and its associated position. Previously, estimation of latency has been made by tracking a phantom in a sequence of images and correlating its motion to that recorded by the position sensor. However, tracking-based temporal calibration uses the assumption that latency is constant between scans. This paper presents a new method for temporal calibration that avoids this assumption. Temporal calibration is performed on the scan data by finding the latency at which the best alignment of the 2-D images within the reconstructed volume occurs. The mean voxel intensity variance is used as a global measure of the quality of alignment within the volume and is minimized with respect to latency for each scan. The new method is compared with previous methods using an ultrasound phantom. Finally, integration of temporal calibration with existing spatial calibration methods is discussed.     

Improving N-wire phantom-based freehand ultrasound calibration

Purpose

   Freehand tracked ultrasound imaging is an inexpensive non-invasive technique used in several guided interventions. This technique requires spatial calibration between the tracker and the ultrasound image plane. Several calibration devices (a.k.a. phantoms) use N-wires that are convenient for automatic procedures since the segmentation of fiducials in the images and the localization of the middle wires in space are straightforward and can be performed in real time. The procedures reported in literature consider only the spatial position of the middle wire. We investigate if better results can be achieved if the information of all the wires is equally taken into account. We also evaluated the precision and accuracy of the implemented methods to allow comparison with other methods.

Methods

   We consider a cost function based on the in-plane errors between the intersection of all the wires with the image plane and their respective segmented points in the image. This cost function is minimized iteratively starting from a seed computed with a closed-form solution based on the middle wires.

Results

   Mean calibration precision achieved with the N-wire phantom was about 0.5 mm using a shallow probe, and mean accuracy was around 1.4 mm with all implemented methods. Precision was about 2.0 mm using a deep probe.

Conclusions

   Precision and accuracy achieved with the N-wire phantom and a shallow probe are at least comparable to that obtained with other methods traditionally considered more precise. Calibration using N-wires can be done more consistently if the parameters are optimized with the proposed cost function.     

Real-time freehand 3D ultrasound calibration

Z-fiducial phantoms allow three-dimensional ultrasound probe calibration with a single B-scan. One of the main difficulties in using this phantom is the need for reliable segmentation of the wires in the ultrasound images, which necessitates manual intervention. In this article, we have shown how we can solve this problem by mounting a thin rubber membrane on top of the phantom. The membrane is segmented automatically and the wires can be easily located as they are at known positions relative to the membrane. This enables us to segment the wires automatically at the full PAL frame rate of 25 Hz, to produce calibrations in real-time, while achieving accuracies similar to those reported in the literature. We have also devised a technique to improve the estimation of the elevational offset (calibration parameter) by capturing a few images of the planar membrane. If spatial calibration is known, fully automatic wire segmentation allows the fiducials to be tracked in real-time. This also enables temporal calibration to be performed in real-time as the probe is moved away from the phantom. We have evaluated the performance of our phantom by calibrating a probe at 8 cm and 15 cm depth. The precision of the calibrations are 0.7 mm and 1.2 mm, respectively. The point reconstruction accuracies of fiducial points provided by the same Z-phantom are slightly below 1.5 mm. The point reconstruction accuracies obtained by scanning the end of a wire tip are 2.5 mm and 3.0 mm. These results match the accuracies achieved in the literature. It takes approximately 2 min to set up the experiment, submerge the phantom in the water bath, locate the phantom in space with a pointer and capture six images of the planar membrane. After this, spatial calibration can be performed in less than a second. Temporal calibration can be completed in approximately 3 s.     

Confhusius: a robust and fully automatic calibration method for 3D freehand ultrasound

This paper describes a new robust and fully automatic method for calibration of three-dimensional (3D) freehand ultrasound called Confhusius (CalibratiON for FreeHand UltraSound Imaging USage). 3D Freehand ultrasound consists in mounting a position sensor on a standard probe. The echographic B-scans can be localized in 3D and compounded into a volume. However, especially for quantitative use, this process dramatically requires a calibration procedure that determines its accuracy and usefulness. Calibration aims at determining the transformation (translations, rotations, scaling) between the coordinates system of the echographic images and the coordinate system of the localization system. To calibrate, we acquire images of a phantom whose 3D geometrical properties are known. We propose a robust and fully automatic calibration method based on the Hough transform and robust estimators. Experiments have been done with synthetic and real sequences, and this calibration method is shown to be easy to perform, accurate, automatic and fast enough for clinical use.     

Improvement of freehand ultrasound calibration accuracy using the elevation beamwidth profile

This article presents a novel approach that incorporates an ultrasound slice-thickness profile into a filtered, weighted-least-square framework to improve the reconstruction accuracy of a real-time freehand calibration system. An important part of the system is a slice-thickness calibration device that aids in the extraction of the slice thickness across a wide range of imaging depths. Extensive experiments were conducted on a 10,000-image dataset to evaluate the effects of the framework on the calibration accuracy. The results showed that three-dimensional (3-D) reconstruction errors were significantly reduced in every experiment (p < 0.001). Real-time testing showed that the proposed method worked effectively with a small number of input images, suggesting great potential for intraoperative use where only a limited number of data may be available. This new framework can enable efficient quality control of calibration accuracy in real-time operating-room use.     

Comparison of freehand 3-D ultrasound calibration techniques using a stylus

In a freehand 3-D ultrasound system, a probe calibration is required to find the rigid body transformation from the corner of the B-scan to the electrical center of the position sensor. The most intuitive way to perform such a calibration is by locating fiducial points in the scan plane directly with a stylus. The main problem of this approach is the difficulty in aligning the tip of the stylus with the scan plane. The thick beamwidth makes the tip of the stylus visible in the B-scan, even if the tip is not exactly at the elevational center of the scan plane. We present a novel stylus and phantom that simplify the alignment process for more accurate probe calibration. We also compare our calibration techniques with a range of styli. We show that our stylus and cone phantom are both simple in design and can achieve a point reconstruction accuracy of 2.2 mm and 1.8 mm, respectively, an improvement from 3.2 mm and 3.6 mm with the sharp and spherical stylus. The performance of our cone stylus and phantom lie between the state-of-the-art Z-phantom and Cambridge phantom, where accuracies of 2.5 mm and 1.7 mm are achieved.     

Probe calibration for freehand 3-D ultrasound

Ultrasound (US) probe calibration establishes the rigid body transformation between the US image and a tracking device attached to the probe. This is an important requirement for correct 3-D reconstruction of freehand US images and, thus, for accurate surgical navigation based on US. In this study, we evaluated three methods for probe calibration, based on a single-point phantom, a wire-cross phantom requiring 2-D alignment and a wire phantom for freehand scanning. The processing of acquired data is fairly common to these methods and, to a great extent, based on automated procedures. The evaluation is based on quality measures in 2-D and 3-D reconstructed data. With each of the three methods, we calibrated a linear-array probe, a phased-array sector probe and an intraoperative probe. The freehand method performed best, with a 3-D navigation accuracy of 0.6 mm for one of the probes. This indicates that clinical accuracy in the order of 1 mm may be achieved in US-based surgical navigation.     

Robot-assisted automatic ultrasound calibration

Purpose

Ultrasound (US) calibration is the process of determining the unknown transformation from a coordinate frame such as the robot’s tooltip to the US image frame and is a necessary task for any robotic or tracked US system. US calibration requires submillimeter-range accuracy for most applications, but it is a time-consuming and repetitive task. We provide a new framework for automatic US calibration with robot assistance and without the need for temporal calibration.

Method

US calibration based on active echo (AE) phantom was previously proposed, and its superiority over conventional cross-wire phantom-based calibration was shown. In this work, we use AE to guide the robotic arm motion through the process of data collection; we combine the capability of the AE point to localize itself in the frame of the US image with the automatic motion of the robotic arm to provide a framework for calibrating the arm to the US image automatically.

Results

We demonstrated the efficacy of the automated method compared to the manual method through experiments. To highlight the necessity of frequent ultrasound calibration, it is demonstrated that the calibration precision changed from 1.67 to 3.20 mm if the data collection is not repeated after a dismounting/mounting of the probe holder. In a large data set experiment, similar reconstruction precision of automatic and manual data collection was observed, while the time was reduced by 58 %. In addition, we compared ten automatic calibrations with ten manual ones, each performed in 15 min, and showed that all the automatic ones could converge in the case of setting the initial matrix as identity, while this was not achieved by manual data sets. Given the same initial matrix, the repeatability of the automatic was [0.46, 0.34, 0.80, 0.47] versus [0.42, 0.51, 0.98, 1.15] mm in the manual case for the US image four corners.

Conclusions

The submillimeter accuracy requirement of US calibration makes frequent data collections unavoidable. We proposed an automated calibration setup and showed feasibility by implementing it for a robot tooltip to US image calibration. The automated method showed a similar reconstruction precision as well as repeatability compared to the manual method, while the time consumed for data collection was reduced. The automatic method also reduces the burden of data collection for the user. Thus, the automated method can be a viable solution for applications that require frequent calibrations.

     

Rapid, easy and reliable calibration for freehand 3D ultrasound

This paper presents improvements to the plane-based technique for calibrating freehand 3D ultrasound systems. The improvements are designed to make it easier for inexperienced users to perform plane-based calibration and to know that they have got a reliable result. In particular, we enable the calibration to be performed using water at room temperature while producing a result that is valid for average soft tissue and we show how it is possible to provide feedback on the reliability of the calibration using a metric based on the curvature of the calibration criterion function. We present comprehensive results showing that these innovations improve the precision of the calibration and offer useful feedback to the user.     

3D elastography using freehand ultrasound

We present an elastography system using freehand 3D ultrasound. A review is provided of the standard elastography methods that have been adapted for this purpose. The scanning protocol is simple and promising results are presented of 3D strain images from freehand scans. Robustness is a problem, however, and the main sources of error are explained. Measures have been developed to improve the quality of the freehand images by means of drop-out correction and frame filtering. Results from the application of these techniques provide an indication of development strands which should lead to a system that is both easy-to-use and produces reliable, high quality images.     

A review of calibration techniques for freehand 3-D ultrasound systems

Three-dimensional (3-D) ultrasound (US) is an emerging new technology with numerous clinical applications. Ultrasound probe calibration is an obligatory step to build 3-D volumes from 2-D images acquired in a freehand US system. The role of calibration is to find the mathematical transformation that converts the 2-D coordinates of pixels in the US image into 3-D coordinates in the frame of reference of a position sensor attached to the US probe. This article is a comprehensive review of what has been published in the field of US probe calibration for 3-D US. The article covers the topics of tracking technologies, US image acquisition, phantom design, speed of sound issues, feature extraction, least-squares minimization, temporal calibration, calibration evaluation techniques and phantom comparisons. The calibration phantoms and methods have also been classified in tables to give a better overview of the existing methods.     

A review of calibration techniques for freehand 3-D ultrasound systems

Three-dimensional (3-D) ultrasound (US) is an emerging new technology with numerous clinical applications. Ultrasound probe calibration is an obligatory step to build 3-D volumes from 2-D images acquired in a freehand US system. The role of calibration is to find the mathematical transformation that converts the 2-D coordinates of pixels in the US image into 3-D coordinates in the frame of reference of a position sensor attached to the US probe. This article is a comprehensive review of what has been published in the field of US probe calibration for 3-D US. The article covers the topics of tracking technologies, US image acquisition, phantom design, speed of sound issues, feature extraction, least-squares minimization, temporal calibration, calibration evaluation techniques and phantom comparisons. The calibration phantoms and methods have also been classified in tables to give a better overview of the existing methods.     

An efficient calibration method for freehand 3-D ultrasound imaging systems

A phantom has been developed to quickly calibrate a freehand 3-D ultrasound (US) imaging system. Calibration defines the spatial relationship between the US image plane and an external tracking device attached to the scanhead. The phantom consists of a planar array of strings and beads, and a set of out-of-plane strings that guide the user to proper scanhead orientation for imaging. When an US image plane is coincident with the plane defined by the strings, the calibration parameters are calculated by matching of homologous points in the image and phantom. The resulting precision and accuracy of the 3-D imaging system are similar to those achieved with a more complex calibration procedure. The 3-D reconstruction performance of the calibrated system is demonstrated with a magnetic tracking system, but the method could be applied to other tracking devices.     

Intensity-based registration of freehand 3D ultrasound and CT-scan images of the kidney

Objectives This paper presents a method to register a pre-operative computed-tomography (CT) volume to a sparse set of intra-operative ultra-sound (US) slices. In the context of percutaneous renal puncture, the aim is to transfer planning information to an intra-operative coordinate system. Materials and methods The spatial position of the US slices is measured by optically localizing a calibrated probe. Assuming the reproducibility of kidney motion during breathing, and no deformation of the organ, the method consists in optimizing a rigid 6 degree of freedom transform by evaluating at each step the similarity between the set of US images and the CT volume. The correlation between CT and US images being naturally rather poor, the images were preprocessed in order to increase their similarity. Among the similarity measures formerly studied in the context of medical image registration, correlation ratio turned out to be one of the most accurate and appropriate, particularly with the chosen non-derivative minimization scheme, namely Powell-Brent’s. The resulting matching transforms are compared to a standard rigid surface registration involving segmentation, regarding both accuracy and repeatability. Results The obtained results are presented and discussed.     

Beam calibration without a phantom for creating a 3-D freehand ultrasound system

To create a freehand three-dimensional (3-D) ultrasound (US) system for image-guided surgical procedures, an US beam calibration process must be performed. The calibration method presented in this work does not use a phantom to define in 3-D space the pixel locations in the beam. Rather, the described method is based on the spatial relationship between an optically tracked pointer and a similarly tracked US transducer. The pointer tip was placed into the US beam, and US images, physical coordinates of the pointer and the transducer location were simultaneously recorded. US image coordinates of the pointer were mapped to the physical points using two different registration methods. Two sensitivity studies were performed to determine the location and number of points needed to calibrate the beam accurately. Results showed that the beam is most efficiently calibrated with approximately 20 points collected from throughout the beam. This method of beam calibration proved to be highly accurate, yielding registration errors of approximately 0.4 mm.     

Multi-modal registration of speckle-tracked freehand 3D ultrasound to CT in the lumbar spine

A method for registration of speckle-tracked freehand 3D ultrasound (US) to preoperative CT volumes of the spine is proposed. We register the US volume to the CT volume by creating individual US "sub-volumes", each consisting of a small section of the entire US volume. The registration proceeds incrementally from the beginning of the US volume to the end, registering every sub-volume, where each sub-volume contains overlapping images with the previous sub-volume. Each registration is performed by generating simulated US images from the CT volume. As a by-product of our registration, the significant drift error common in speckle-tracked US volumes is corrected for. Results are validated through a phantom study of plastic spine phantoms created from clinical patient CT data as well as an animal study using a lamb cadaver. Results demonstrate that we were able to successfully register a speckle-tracked US volume to CT volume in four out of five phantoms with a success rate of greater than 98%. The final error of the registered US volumes decreases by over 50 percent from the speckle tracking error to consistently below 3 mm. Studies on the lamb cadaver showed a mean registration error consistently below 2 mm.     

Dynamic three-dimensional freehand echocardiography using raw digital ultrasound data.

In this paper, we present a new method for simple acquisition of dynamic three-dimensional (3-D) ultrasound data. We used a magnetic position sensor device attached to the ultrasound probe for spatial location of the probe, which was slowly tilted in the transthoracic scanning position. The 3-D data were recorded in 10-20 s, and the analysis was performed on an external PC within 2 min after transferring the raw digital ultrasound data directly from the scanner. The spatial and temporal resolutions of the reconstruction were evaluated, and were superior to video-based 3-D systems. Examples of volume reconstructions with better than 7 ms temporal resolution are given. The raw data with Doppler measurements were used to reconstruct both blood and tissue velocity volumes. The velocity estimates were available for optimal visualization and for quantitative analysis. The freehand data reconstruction accuracy was tested by volume estimation of balloon phantoms, giving high correlation with true volumes. Results show in vivo 3-D reconstruction and visualization of mitral and aortic valve morphology and blood flow, and myocardial tissue velocity. We conclude that it was possible to construct multimodality 3-D data in a limited region of the human heart within one respiration cycle, with reconstruction errors smaller than the resolution of the original ultrasound beam, and with a temporal resolution of up to 150 frames per second.     

Sensorless freehand 3-D ultrasound using regression of the echo intensity

In freehand 3-D ultrasound (US), a position sensor is attached to the probe of a 2-D US machine. The resulting 3-D data permit flexible visualisation and more accurate volume measurement than can be achieved using 2-D B-scans alone; however, the use of the position sensor can be inconvenient for the clinician. The objective is, thus, to replace the sensor with a technique for estimating the probe trajectory based on the B-scan images, themselves. One such technique exists, based on decorrelation algorithms. This paper presents an alternative approach based on linear regression of the echo-envelope intensity signal. A probabilistic analysis of the speckle characteristics of the US signal leads to a linear model, on which the regression algorithm is based. The gradient parameter of this model is shown to be directly related to probe motion. The viability of the new approach is demonstrated through simulations and in vitro and in vivo experiments.