Digital breast pathology: validation and training for primary digital practice

Digital pathology is a technology which is transforming the way in which breast histopathology specimens are assessed, reported and reviewed. Large scale clinical laboratory deployments of whole slide imaging systems are occurring in diagnostic pathology departments across the world, requiring laboratory and diagnostic staff to navigate new skills and workflows. Transferring from conventional light microscopy assessment of breast specimens to the use of whole slide images (WSI) can be a challenging experience. This article describes an approach to training and validation for breast consultant histopathologists, which has been used and adapted at a number of sites. Examples of types of case that are suitable for training, and some of the potential “pitfalls” of digital reporting for the novice are described, and practical advice regarding clinical digital breast workflow is shared.     

Digital pathology: current status and future perspectives

During the last decade pathology has benefited from the rapid progress of image digitizing technology. The improvement in this technology had led to the creation of slide scanners which are able to produce whole slide images (WSI) which can be explored by image viewers in a way comparable to the conventional microscope. The file size of the WSI ranges from a few megabytes to several gigabytes, leading to challenges in the area of image storage and management when they will be used routinely in daily clinical practice. Digital slides are used in pathology for education, diagnostic purposes (clinicopathological meetings, consultations, revisions, slide panels and, increasingly, for upfront clinical diagnostics) and archiving. As an alternative to conventional slides, WSI are generally well accepted, especially in education, where they are available to a large number of students with the full possibilities of annotations without the problem of variation between serial sections. Image processing techniques can also be applied to WSI, providing pathologists with tools assisting in the diagnosis-making process. This paper will highlight the current status of digital pathology applications and its impact on the field of pathology.     

Reconciliation of diverse telepathology system designs. Historic issues and implications for emerging markets and new applications

Telepathology, the distant service component of digital pathology, is a growth industry. The word "telepathology" was introduced into the English Language in 1986. Initially, two different, competing imaging modalities were used for telepathology. These were dynamic (real time) robotic telepathology and static image (store-and-forward) telepathology. In 1989, a hybrid dynamic robotic/static image telepathology system was developed in Norway. This hybrid imaging system bundled these two primary pathology imaging modalities into a single multi-modality pathology imaging system. Similar hybrid systems were subsequently developed and marketed in other countries as well. It is noteworthy that hybrid dynamic robotic/static image telepathology systems provided the infrastructure for the first truly sustainable telepathology services. Since then, impressive progress has been made in developing another telepathology technology, so-called "virtual microscopy" telepathology (also called "whole slide image" telepathology or "WSI" telepathology). Over the past decade, WSI has appeared to be emerging as the preferred digital telepathology digital imaging modality. However, recently, there has been a re-emergence of interest in dynamic-robotic telepathology driven, in part, by concerns over the lack of a means for up-and-down focusing (i.e., Z-axis focusing) using early WSI processors. In 2010, the initial two U.S. patents for robotic telepathology (issued in 1993 and 1994) expired enabling many digital pathology equipment companies to incorporate dynamic-robotic telepathology modules into their WSI products for the first time. The dynamic-robotic telepathology module provided a solution to the up-and-down focusing issue. WSI and dynamic robotic telepathology are now, rapidly, being bundled into a new class of telepathology/digital pathology imaging system, the "WSI-enhanced dynamic robotic telepathology system". To date, six major WSI processor equipment companies have embraced the approach and developed WSI-enhanced dynamic-robotic digital telepathology systems, marketed under a variety of labels. Successful commercialization of such systems could help overcome the current resistance of some pathologists to incorporate digital pathology, and telepathology, into their routine and esoteric laboratory services. Also, WSI-enhanced dynamic robotic telepathology could be useful for providing general pathology and subspecialty pathology services to many of the world's underserved populations in the decades ahead. This could become an important enabler for the delivery of patient-centered healthcare in the future.     

Whole-slide imaging in cytopathology: state of the art and future directions

Whole slide imaging (WSI) has been increasingly adopted for digital evaluation of surgical pathology specimens. Unlike histological slides, cytological preparations frequently display a heterogeneous distribution of cells throughout slides in different focal planes sometimes admixed with obscuring material, therefore requiring multiple scanning planes which significantly lengthens image acquisition and evaluation times. Although examination of digital images can be more advantageous than conventional glass slides, the challenges of focusing, scanning and screening cytological specimens and the associated increase in scan times and data storage needs have limited the routine application of WSI in cytopathology practice. Emerging digital systems designed to overcome image acquisition obstacles coupled with artificial intelligence algorithms augmenting screening of digital cytology slides offer innovative solutions to address these limitations. The aim of this review is to critically address the potential benefits and pitfalls of employing WSI in cytopathology practice and to introduce promising state-of-the-art solutions on the horizon.     

Artificial intelligence in pathology: an overview

Artificial intelligence (AI) is at the forefront of modern technology and emerging uses within the healthcare sector are now being realised. Pathology will be a key area where the impact of AI will be felt. With more and more laboratories making the transition to digital pathology this will provide the key infrastructure in which to deploy these tools and their use will start to become a reality in diagnostic practice. The potential of AI in pathology is to create image analysis tools which could either be used for diagnostic support or to derive novel insights into disease biology, in addition to those achievable with a human observer. Some examples providing diagnostic support currently exist for a limited, but expanding number of applications, such as tumour detection, automated tumour grading, immunohistochemistry scoring, and predicting mutation status. There are a number of challenges to consider, not least the validation and regulatory framework for these tools. In this article, we set out an overview of AI in histopathology, discuss its potential workflow applications, and give key examples of the potential for AI in clinical practice. Considerations for the implementation of AI in practice are also explored.     

Evaluation of whole slide image immunohistochemistry interpretation in challenging prostate needle biopsies

Whole slide images (WSIs), also known as virtual slides, can support electronic distribution of immunohistochemistry (IHC) stains to pathologists that rely on remote sites for these services. This may lead to improvement in turnaround times, reduction of courier costs, fewer errors in slide distribution, and automated image analyses. Although this approach is practiced de facto today in some large laboratories, there are no clinical validation studies on this approach. Our retrospective study evaluated the interpretation of IHC stains performed in difficult prostate biopsies using WSIs. The study included 30 foci with IHC stains identified by the original pathologist as both difficult and pivotal to the final diagnosis. WSIs were created from the glass slides using a scanning robot (T2, Aperio Technologies, Vista, CA). An evaluation form was designed to capture data in 2 phases: (1) interpretation of WSIs and (2) interpretation of glass slides. Data included stain interpretations, diagnoses, and other parameters such as time required to diagnose and image/slide quality. Data were also collected from an expert prostate pathologist, consensus meetings, and a poststudy focus group. WSI diagnostic validity (intraobserver pairwise kappa statistics) was "almost perfect" for 1 pathologist, "substantial" for 3 pathologists, and "moderate" for 1 pathologist. Diagnostic agreement between the final/consensus diagnoses of the group and those of the domain expert was "almost perfect" (kappa = 0.817). Except for one instance, WSI technology was not felt to be the cause of disagreements. These results are encouraging and compare favorably with other efforts to quantify diagnostic variability in surgical pathology. With thorough training, careful validation of specific applications, and regular postsignout review of glass IHC slides (eg, quality assurance review), WSI technology can be used for IHC stain interpretation.     

Whole-slide imaging: widening the scope of cytopathology

Whole slide imaging (WSI) is broadening the scope of cytopathology. Whole slide images are being used for telecytology, quality assurance activities (e.g. proficiency testing) and teaching (e.g. digital teaching sets and online virtual atlases). Progress in WSI technology that permits high resolution scanning, z-stacking, and hybrid robotic devices has encouraged the use of this imaging modality for cytology practice, education and research. However, widespread adoption in cytology still depends on overcoming barriers unrelated to cytology and challenges directly related to digitizing cytopathology slides. The aim of this article is to review WSI technology, applications and limitations specific to cytopathology.     

Whole-slide imaging: routine pathologic diagnosis

Digital pathology systems offer pathologists an alternate, emerging mechanism to manage and interpret information. They offer increasingly fast and scalable hardware platforms for slide scanning and software that facilitates remote viewing, slide conferencing, archiving, and image analysis. Deployed initially and validated largely within the research and biopharmaceutical industries, WSI is increasingly being implemented for direct patient care. Improvements in image quality, scan times, and imageviewing browsers will hopefully allow pathologists to more seamlessly convert to digital pathology, much like our radiology colleagues have done before us. However, WSI creates both opportunities and challenges. Although niche applications of WSI technology for clinical, educational, and research purposes are clearly successful, it is evident that several areas still require attention and careful consideration before more widespread clinical adoption of WSI takes place. These include regulatory issues, development of standards of practice and validation guidelines, workflow modifications, as well as defining situations where WSI technology will really improve practice in a cost-effective way. Current progress on these and other issues, along with improving technology, will no doubt pave the way for increased adoption over the next decade, allowing the pathology community as a whole to harness the true potential of WSI for patient care. The digital decade will likely redefine how pathology is practiced and the role of the pathologist.     

High agreement between whole slide imaging and optical microscopy for assessment of HER2 expression in breast cancer: Whole slide imaging for the assessment of HER2 expression

Whole slide imaging (WSI) technology has been used for training, teaching, researching, and remote consultation. Few studies compared HER2 expression using optical microscopy (OM) and WSI evaluations in breast carcinomas. However, no consensus has been achieved comparing both assessments.Material and methodsSections from tissue microarray containing 200 preselected invasive breast carcinomas were submitted to immunohistochemistry applying three anti-HER2 antibodies (HercepTest™, CB11, SP3) and in situ hybridization (DDISH). Slides were evaluated using OM and WSI (Pannoramic MIDI and Viewer, 3DHISTECH). Sensitivity and specificity were calculated comparing the anti-HER2 antibodies and DDISH.ResultsWSI and OM HER2 evaluations agreement was considered good (SP3, k = 0.80) to very good (CB11 and HercepTest™, k = 0.81). WSI evaluation led to higher sensitivity (ranging from 100 of SP3 and HercepTest™ to 97 of CB11) and lower specificity (ranging from 86.4 of SP3 to 89.4 of HercepTest™) compared to OM evaluation (sensitivity ranged from 92.1 of CB11 to 98 of SP3 and specificity ranged from 95.2 of SP3 and HercepTest™ to 97.1 of CB11 and SP3).ConclusionHigh agreement was achieved between WSI and OM evaluations. All three antibodies were highly sensitive and specific using both evaluations. WSI can be considered a useful tool for HER2 immunohistochemical assessment.     

Utility of whole slide imaging and virtual microscopy in prostate pathology

Whole slide imaging (WSI) has been used in conjunction with virtual microscopy (VM) for training or proficiency testing purposes, multicentre research, remote frozen section diagnosis and to seek specialist second opinion in a number of organ systems. The feasibility of using WSI/VM for routine surgical pathology reporting has also been explored. In this review, we discuss the utility and limitations of WSI/VM technology in the histological assessment of specimens from the prostate. Features of WSI/VM that are particularly well suited to assessment of prostate pathology include the ability to examine images at different magnifications as well as to view histology and immunohistochemistry side-by-side on the screen. Use of WSI/VM would also solve the difficulty in obtaining multiple identical copies of small lesions in prostate biopsies for teaching and proficiency testing. It would also permit annotation of the virtual slides, and has been used in a study of inter-observer variation of Gleason grading to facilitate precise identification of the foci on which grading decisions had been based. However, the large number of sections examined from each set of prostate biopsies would greatly increase time required for scanning as well as the size of the digital file, and would also be an issue if digital archiving of prostate biopsies is contemplated. Z-scanning of glass slides, a process that increases scanning time and file size would be required to permit focusing a virtual slide up and down to assess subtle nuclear features such as nucleolar prominence. The common use of large blocks to process prostatectomy specimens would also be an issue, as few currently available scanners can scan such blocks. A major component of proficiency testing of prostate biopsy assessment involves screening of the cores to detect small atypical foci. However, screening virtual slides of wavy fragmented prostate cores using a computer mouse aided by an overview image is very different from screening glass slides using a microscope stage. Hence, it may be more appropriate in this setting to mark the lesional area and focus only on the interpretation component of competency testing. Other issues limiting the use of digital pathology in prostate pathology include the cost of high quality slide scanners for WSI and high resolution monitors for VM as well as the requirement for fast Internet connection as even a subtle delay in presentation of images on the screen may be very disturbing for a pathologist used to the rapid viewing of glass slides under a microscope. However, these problems are likely to be overcome by technological advances in the future.     

HER2 challenge contest: a detailed assessment of automated HER2 scoring algorithms in whole slide images of breast cancer tissues

Aims

Evaluating expression of the human epidermal growth factor receptor 2 (HER2) by visual examination of immunohistochemistry (IHC) on invasive breast cancer (BCa) is a key part of the diagnostic assessment of BCa due to its recognized importance as a predictive and prognostic marker in clinical practice. However, visual scoring of HER2 is subjective, and consequently prone to interobserver variability. Given the prognostic and therapeutic implications of HER2 scoring, a more objective method is required. In this paper, we report on a recent automated HER2 scoring contest, held in conjunction with the annual PathSoc meeting held in Nottingham in June 2016, aimed at systematically comparing and advancing the state‐of‐the‐art artificial intelligence (AI)‐based automated methods for HER2 scoring.

Methods and results

The contest data set comprised digitized whole slide images (WSI) of sections from 86 cases of invasive breast carcinoma stained with both haematoxylin and eosin (H&E) and IHC for HER2. The contesting algorithms predicted scores of the IHC slides automatically for an unseen subset of the data set and the predicted scores were compared with the ‘ground truth’ (a consensus score from at least two experts). We also report on a simple ‘Man versus Machine’ contest for the scoring of HER2 and show that the automated methods could beat the pathology experts on this contest data set.

Conclusions

This paper presents a benchmark for comparing the performance of automated algorithms for scoring of HER2. It also demonstrates the enormous potential of automated algorithms in assisting the pathologist with objective IHC scoring.     

深度学习在数字病理中的应用

临床上,病理切片是癌症诊断的金标准。病理医生通过对病理切片进行镜检,完成病理诊断和预后评估,但是这个过程通常费时费力。在病理切片的数字化的背景下,人工智能技术走进病理领域,并推动病理分析逐渐从定性分析向定量分析转变,这一改变使病理诊断更加准确客观。尤其是以深度学习为代表的人工智能技术在病理分析中取得令人瞩目的成果,不但使病理诊断更加智能化,而且使诊断结果更加精准和客观。阐述深度学习的基本概念及其在数字病理切片分析中的应用,简要概述深度学习在细胞和组织的检测和分割、组织层面上癌症的分类和分级的应用,以及其他一些应用,最后指出目前数字病理切片分析中存在的问题并对未来的发展方向提出展望。     

An efficient architecture to support digital pathology in standard medical imaging repositories

In the past decade, digital pathology and whole-slide imaging (WSI) have been gaining momentum with the proliferation of digital scanners from different manufacturers. The literature reports significant advantages associated with the adoption of digital images in pathology, namely, improvements in diagnostic accuracy and better support for telepathology. Moreover, it also offers new clinical and research applications. However, numerous barriers have been slowing the adoption of WSI, among which the most important are performance issues associated with storage and distribution of huge volumes of data, and lack of interoperability with other hospital information systems, most notably Picture Archive and Communications Systems (PACS) based on the DICOM standard.This article proposes an architecture of a Web Pathology PACS fully compliant with DICOM standard communications and data formats. The solution includes a PACS Archive responsible for storing whole-slide imaging data in DICOM WSI format and offers a communication interface based on the most recent DICOM Web services. The second component is a zero-footprint viewer that runs in any web-browser. It consumes data using the PACS archive standard web services. Moreover, it features a tiling engine especially suited to deal with the WSI image pyramids. These components were designed with special focus on efficiency and usability. The performance of our system was assessed through a comparative analysis of the state-of-the-art solutions. The results demonstrate that it is possible to have a very competitive solution based on standard workflows.     

Application and performance of artificial intelligence technology in cytopathology

Deep learning algorithms and artificial intelligence (AI) are making great progress in their capacity to evaluate and interpret image data recent advancements in computer vision and machine learning. The first use of AI in a pathology lab was in cytopathology, when a computer-assisted Pap test screening was created. Initially designed to diagnose rather than screen, there was a lot of disagreement concerning their wide use to clinical specimens. However, whole-slide imaging of both gynaecological and non-gynaecological histopathology have been the subject of recent AI work. An overview of the literature on AI in cytopathology is provided in this brief review. To be more precise, it intends to emphasize the relevance of applications of AI algorithms to gynaecological and non-gynaecologic cytology. Between January 2000 and December 2021, a search on artificial intelligence in cytopathology was conducted in several well-known databases, including PubMed, Web of Science, Scopus, Embase, and Google Scholar. Only full-text papers that could be accessed online were evaluated.     

Use of whole slide imaging in surgical pathology quality assurance: design and pilot validation studies

By imaging large numbers of slides automatically at high resolution, modem automated whole slide imaging (WSI) systems have the potential to become useful tools in pathology practice. This article describes a pilot validation study for use of automated high-speed WSI systems for surgical pathology quality assurance (QA). This was a retrospective comparative study in which 24 full genitourinary cases (including 47 surgical parts and 391 slides) were independently reviewed with traditional microscopy and whole slide digital images. Approximately half the cases had neoplasia in the diagnostic line. At the end of the study, diagnostic discrepancies were evaluated by a pathology consensus committee. The study pathologists felt that the traditional and WSI methods were comparable for case review. They reported no difference in perceived case complexity or diagnostic confidence between the methods. There were 4 clinically insignificant discrepancies with the signed-out cases: 2 from glass slide and 2 with WSI review. Of the 2 discrepancies reported by the WSI method, the committee agreed with the reviewer once and the original report once. At the end of the study, the participants agreed that automated WSI is a viable potential modality for surgical pathology QA, especially in multifacility health systems that would like to establish interfacility QA. The participants felt that major issues limiting the implementation of WSI-based QA did not involve image acquisition or quality but rather image management issues such as the pathologist's interface, the hospital's network, and integration with the laboratory information system.     

Factors that impact turnaround time of surgical pathology specimens in an academic institution

Turnaround time of laboratory results is important for customer satisfaction. The College of American Pathologists' checklist requires an analytic turnaround time of 2 days or less for most routine cases and lets every hospital define what a routine specimen is. The objective of this study was to analyze which factors impact turnaround time of nonbiopsy surgical pathology specimens. We calculated the turnaround time from receipt to verification of results (adjusted for weekends and holidays) for all nonbiopsy surgical specimens during a 2-week period. Factors studied included tissue type, number of slides per case, decalcification, immunohistochemistry, consultations with other pathologists, and diagnosis. Univariate and multivariate analyses were performed. A total of 713 specimens were analyzed, 551 (77%) were verified within 2 days and 162 (23%) in 3 days or more. Lung, gastrointestinal, breast, and genitourinary specimens showed the highest percentage of cases being signed out in over 3 days. Diagnosis of malignancy (including staging of the neoplasia), consultation with other pathologists, having had a frozen section, and use of immunohistochemical stains were significantly associated with increased turnaround time in univariate analysis. Decalcification was not associated with increased turnaround time. In multivariate analysis, consultation with other pathologists, use of immunohistochemistry, diagnosis of malignancy, and the number of slides studied continued to be significantly associated with prolonged turnaround time. Our findings suggest that diagnosis of malignancy is central to significantly prolonging the turnaround time for surgical pathology specimens, thus institutions that serve cancer centers will have longer turnaround time than those that do not.     

A validation study of whole slide imaging for primary diagnosis of lymphoma

Whole slide imaging (WSI) is being increasingly used worldwide. Although previous studies have asserted the validity of WSI diagnosis, they have primarily targeted only small specimens and excluded cases requiring immunohistochemistry or special staining, such as lymphoma. The purpose of this study was to evaluate the accuracy of WSI diagnosis of lymphoma, for which 240 biopsies and resections of lymphoma cases were selected from the study set of lymphomas. All slides including H&E, immunohistochemical and special staining were digitized using a WSI image scanner. An experienced pathologist performed the WSI diagnoses, which were compared with original diagnoses based on light microscopic examinations. Discrepancy between the two interpretations were classified into three categories: concordance, minor discrepancy (no clinical significance), and major discrepancy (with clinical significance). Overall concordance between the light microscopic and WSI diagnosis was found in 223 cases (92.92%; 95%CI = 88.90–95.82), minor discrepancy in fifteen (6.25%; 95%CI = 3.54–10.10), and major discrepancy in two (0.83%; 95%CI = 0.10–2.98). Diagnosis of lymphoma using WSI appeared to be mostly accurate, suggesting that WSI may be a reliable technology for the diagnosis of lymphoma.