윤치호 (POSTECH)

한빛사논문

조회108

POSTECH

인터뷰 보기

Light-Sci. Appl., Sep 02 2024, 13 (1) | https://doi.org/10.1038/s41377-024-01554-7 Deep learning-based virtual staining, segmentation, and classification in label-free photoacoustic histology of human specimens

Chiho Yoon ¹, Eunwoo Park ¹, Sampa Misra ¹, Jin Young Kim^1,2, Jin Woo Baik ¹, Kwang Gi Kim ³, Chan Kwon Jung^4,5 and Chulhong Kim^1,2

¹Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea.

²Opticho Inc., Pohang, Republic of Korea.

³Department of Health Sciences and Technology, Gachon Advanced Institute for Health Sciences and Technology(GAIHST), Gachon University, Incheon, Republic of Korea.

⁴Cancer Research Institute, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea.

⁵Department of Hospital Pathology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea

These authors contributed equally: Chiho Yoon, Eunwoo Park, Sampa Misra

Correspondence: Chan Kwon Jung or Chulhong Kim

Abstract

In pathological diagnostics, histological images highlight the oncological features of excised specimens, but they require laborious and costly staining procedures. Despite recent innovations in label-free microscopy that simplify complex staining procedures, technical limitations and inadequate histological visualization are still problems in clinical settings. Here, we demonstrate an interconnected deep learning (DL)-based framework for performing automated virtual staining, segmentation, and classification in label-free photoacoustic histology (PAH) of human specimens. The framework comprises three components: (1) an explainable contrastive unpaired translation (E-CUT) method for virtual H&E (VHE) staining, (2) an U-net architecture for feature segmentation, and (3) a DL-based stepwise feature fusion method (StepFF) for classification. The framework demonstrates promising performance at each step of its application to human liver cancers. In virtual staining, the E-CUT preserves the morphological aspects of the cell nucleus and cytoplasm, making VHE images highly similar to real H&E ones. In segmentation, various features (e.g., the cell area, number of cells, and the distance between cell nuclei) have been successfully segmented in VHE images. Finally, by using deep feature vectors from PAH, VHE, and segmented images, StepFF has achieved a 98.00% classification accuracy, compared to the 94.80% accuracy of conventional PAH classification. In particular, StepFF's classification reached a sensitivity of 100% based on the evaluation of three pathologists, demonstrating its applicability in real clinical settings. This series of DL methods for label-free PAH has great potential as a practical clinical strategy for digital pathology.

논문정보

형식Research article
게재일2024년 09월 (BRIC 등록일 2024-09-03)
연구진국내 연구진
분야 바이오·의료융합 > 의료기기

댓글 작성 로그인

CV 열람하기

연락처 보기