Faculty Profiles - MORI, Kensaku

Papers - MORI, Kensaku

Division display 21 - 40 of about 1,775 ／ All the affair displays >>

Surgical area recognition from laparoscopic images in laparoscopic gastrectomy for gastric cancer using label smoothing and uncertainty Invited Reviewed

Yuichiro Hayashi,Kazunari Misawa, Kensaku Mori

Proc. SPIE 12466 Vol. 12466 2023

A semantic segmentation method for laparoscopic images using semantically similar groups Invited Reviewed

Uramoto L., Hayashi Y., Oda M., Kitasaka T., Misawa K., Mori K.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE Vol. 12466 2023

Authorship：Corresponding author Language：English Publishing type：Research paper (scientific journal) Publisher：Progress in Biomedical Optics and Imaging - Proceedings of SPIE

In this paper, we present a segmentation method for laparoscopic images using semantically similar groups for multi-class semantic segmentation. Accurate semantic segmentation is a key problem for computer assisted surgeries. Common segmentation models do not explicitly learn similarities between classes. We propose a model that, in addition to learning to segment an image into classes, also learns to segment it into human-defined semantically similar groups. We modify the LinkNet34 architecture by adding a second decoder with an auxiliary task of segmenting the image into these groups. The feature maps of the second decoder are merged into the final decoder. We validate our method against our base model LinkNet34 and a larger LinkNet50. We find that our proposed modification increased the performance both with mean Dice (average +1.5%) and mean Intersection over Union metrics (average +2.8%) on two laparoscopic datasets.

DOI： 10.1117/12.2654636

Scopus

AI画像解析による内視鏡外科手術手技のビデオ評価及び手術支援システムの構築 Invited Reviewed

安井昭洋, 内田広夫, 森健策, 石田昇平, 出家亨一, 檜顕成, 城田千代栄, 小田昌宏, 林雄一郎

生体医工学 Vol. Annual61 ( Abstract ) page： 127_2 - 127_2 2023

Authorship：Corresponding author Language：Japanese Publishing type：Research paper (scientific journal) Publisher：公益社団法人日本生体医工学会

【はじめに】術後成長発達する小児患者にとって、低侵襲手術は非常に重要である。しかし患者数は限られているため、しっかりとした手術を行うためにoff the job-training(OJT)が重要である。さらにOJTでの効率的な手技獲得には、手技を客観的に評価しfeed backを行うシステムが必須である。また安全で効率的な内視鏡手術を行うためには、臓器の位置関係の把握が必要であるため、術中ナビゲーションは重要な要件となる。これらの課題に対して、AIを用いた内視鏡手技評価および手術支援システムの構築に着手しており現状の成果を報告する。【方法と結果】食道閉鎖症モデルを用いた吻合手技を被験者に課し、各被験者の手技を最初に人の目で「check 表」「エラー項目」「時間」を用いて評価した。次にビデオから検出した鉗子の動きと人が判定した手技優劣の関係性をAIで学習させ、上位88％・下位95％の精度で手技優劣が自動判定可能となった。この結果を解析することで今まで必要だった50項目以上の肉眼チェックが、わずか７項目チェックするだけで手技の優劣を判断できることが明らかになった。現在食道閉鎖症の手術画像を用いて、食道・迷走神経・気管を深層学習させ、各種構造物の自動認識を進めている。【まとめ】AI画像解析により内視鏡手技の優劣をビデオで判定可能となった。この結果から新たに効率的な手技判断基準を定めることができた。術中ナビゲーションは現在精度のさらなる向上を目指している。

DOI： 10.11239/jsmbe.annual61.127_2

CiNii Research

Automated Detection of the Thoracic Ossification of the Posterior Longitudinal Ligament Using Deep Learning and Plain Radiographs. Invited Reviewed

Ito S, Nakashima H, Segi N, Ouchida J, Oda M, Yamauchi I, Oishi R, Miyairi Y, Mori K, Imagama S

BioMed research international Vol. 2023 page： 8495937 2023

Authorship：Corresponding author Language：English Publishing type：Research paper (scientific journal) Publisher：BioMed Research International

Ossification of the ligaments progresses slowly in the initial stages, and most patients are unaware of the disease until obvious myelopathy symptoms appear. Consequently, treatment and clinical outcomes are not satisfactory. This study is aimed at developing an automated system for the detection of the thoracic ossification of the posterior longitudinal ligament (OPLL) using deep learning and plain radiography. We retrospectively reviewed the data of 146 patients with thoracic OPLL and 150 control cases without thoracic OPLL. Plain lateral thoracic radiographs were used for object detection, training, and validation. Thereafter, an object detection system was developed, and its accuracy was calculated. The performance of the proposed system was compared with that of two spine surgeons. The accuracy of the proposed object detection model based on plain lateral thoracic radiographs was 83.4%, whereas the accuracies of spine surgeons 1 and 2 were 80.4% and 77.4%, respectively. Our findings indicate that our automated system, which uses a deep learning-based method based on plain radiographs, can accurately detect thoracic OPLL. This system has the potential to improve the diagnostic accuracy of thoracic OPLL.

DOI： 10.1155/2023/8495937

Scopus

PubMed

膀胱鏡画像におけるtiny-YOLOを用いた腫瘍検出 Invited Reviewed

牟田口淳, 小田昌宏, 猪口淳一, 森健策, 江藤正俊

生体医工学 Vol. Annual61 ( Abstract ) page： 255_2 - 255_2 2023

Authorship：Corresponding author Language：Japanese Publishing type：Research paper (scientific journal) Publisher：公益社団法人日本生体医工学会

【背景】膀胱癌は経尿道手術後に再発が多い腫瘍であり、膀胱鏡での腫瘍の見落としが原因とされている。内視鏡での観察は、従来の白色光(WLI)の他に、NBIを使用するが、いずれの腫瘍検出精度は検者の技量・経験に依存するため、検査の再現性・客観性が少ないことが課題である。近年、人工知能(AI)が多くの医療分野で活用されており、AIによる検査は、客観性・再現性を持った上で、エキスパートレベルと同程度の診断能を持つ可能性があるとされている。今回、WLI/NBI膀胱鏡画像を用いて、AIによる腫瘍検出の精度を検証した。【方法】2019年から2021年まで、経尿道的膀胱腫瘍切除術(TURBT)の際に、WLI/NBIを用いて観察を行った症例の手術動画から膀胱鏡画像を作成し、腫瘍を含む画像を腫瘍画像、腫瘍を含まない画像を正常画像と定義した。腫瘍画像内の膀胱腫瘍を矩形でアノテーションを行い、テストデータ用の画像を用いてAIによる感度、特異度、陽性的中率を評価した。AIでの物体検出はtiny-YOLOを用い、腫瘍検出精度の検証を行った。【結果】WLIとNBIから、それぞれ腫瘍画像をそれぞれtiny-YOLOで学習を行い、腫瘍画像(WLI: 525枚、NBI:219枚)と正常画像(WLI:98枚、NBI:108枚)で精度検証を行った。AIによる物体検出の感度/特異度/陽性的中率は、WLIで87.8%/88.8%/97.7%、NBIで82.2%/81.4%/90.0%であった。【結論】膀胱鏡画像において、AIにより比較的良好に腫瘍検出が可能であった。更なる精度改善、リアルタイム検出への課題について、文献的考察を加え報告する。

DOI： 10.11239/jsmbe.annual61.255_2

CiNii Research

看護師の職域プレゼンティズム（心身不調）をIoTセンシングで早期検出する Invited Reviewed

山下佳子, 大山慎太郎, 鈴木輝彦, 坂本祐二, 出野義則, 山下暁士, 赤川里美, 藤井晃子, 白鳥義宗, 森健策

生体医工学 Vol. Annual61 ( Abstract ) page： 225_1 - 225_1 2023

Authorship：Corresponding author Language：Japanese Publishing type：Research paper (scientific journal) Publisher：公益社団法人日本生体医工学会

看護職は心身不調に由来する顕在化していない労働生産性低下状態（プレゼンティズム）が他職種より多く、不規則な勤務形態や強い心身ストレスにより、離職に至る率も高いのが現状である。類似研究は腰痛に注目してウェアラブルデバイスで筋硬度測定によりプレゼンティズム発生を予測するが、性別や運動経験の有無など個人の特性を大きく反映するため予測が難しいと報告がある。そこで本研究では、プレゼンティズムの主な要因で筋骨格系疼痛の原因となる看護行動を、Internet of Things (IoT)センシングで抽出・判別することを目的とする。既設のBLE 屋内測位(AoA法）アンテナを利用した加速度センサデバイスによる看護行動データの収集と、観察者の直接観察による看護行動に対するラベルデータ（看護行動、実施場所、行動の開始・終了時刻を入力）作成を実施した。看護行動は身体プレゼンティズムリスク(腰痛・膝痛・頚肩腕痛)に分類し定義した。1分毎の行動データ（位置情報の平均値、加速度の最大・最小・平均値・標準偏差）、及び時刻を入力データとし、ラベルデータを教師データとして機械学習を行い、行動認識モデルを構築した。看護行動割合は、腰痛43.6%、膝痛3.3%、頚肩腕痛7.4%であった。IoTセンシングで個人ごとのプレゼンティズムに発展する行動をモニタリングすることにより、プレゼンティズムを予防することが可能と示唆された。

DOI： 10.11239/jsmbe.annual61.225_1

CiNii Research

医用画像とAI Invited

森健策

カレントテラピー Vol. 41 page： 79 - 79 2023

TriMix: A General Framework for Medical Image Segmentation from Limited Supervision Invited Reviewed

Zheng Z., Hayashi Y., Oda M., Kitasaka T., Mori K.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Vol. 13846 LNCS page： 185 - 202 2023

Authorship：Corresponding author Language：English Publishing type：Research paper (scientific journal) Publisher：Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

We present a general framework for medical image segmentation from limited supervision, reducing the reliance on fully and densely labeled data. Our method is simple, jointly trains triple diverse models, and adopts a mix augmentation scheme, and thus is called TriMix. TriMix imposes consistency under a more challenging perturbation, i.e., combining data augmentation and model diversity on the tri-training framework. This straightforward strategy enables TriMix to serve as a strong and general learner learning from limited supervision using different kinds of imperfect labels. We conduct extensive experiments to show TriMix’s generic purpose for semi- and weakly-supervised segmentation tasks. Compared to task-specific state-of-the-arts, TriMix achieves competitive performance and sometimes surpasses them by a large margin. The code is available at https://github.com/MoriLabNU/TriMix.

DOI： 10.1007/978-3-031-26351-4_12

Scopus

Thrombosis region extraction and quantitative analysis in confocal laser scanning microscopic image sequence in in-vivo imaging Invited Reviewed

Wu Y., Oda M., Hayashi Y., Kawamura S., Takebe T., Mori K.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE Vol. 12468 2023

Authorship：Corresponding author Language：English Publishing type：Research paper (scientific journal) Publisher：Progress in Biomedical Optics and Imaging - Proceedings of SPIE

In this paper, we propose a scheme that includes automated extraction of thrombus regions and quantitative analysis of thrombosis in confocal laser scanning microscope (CLSM) blood flow image sequence. Making thrombosis model in animal models play an important role in the development of antithrombotic drugs and ascertaining thrombosis mechanisms. Making thrombosis model in cerebral cortex of mice is usually observed using a CLSM in the fluorescence mode. However, some small changes of thrombus regions are not easily observed in CLSM blood flow image sequences. In addition, it is not easy for researchers to quantitatively analyze the degree of thrombosis. Therefore, we propose a scheme to achieve automatic thrombosis region extraction and quantitative analysis. In which, our thrombosis region extraction method uses analysis of changing pattern of thrombosis regions in CLSM blood flow image sequence. Experimental results showed that our scheme can help biological researchers observe and analyze the changes of thrombosis in animal models and reduced the use of fluorescent thrombus markers.

DOI： 10.1117/12.2654632

Scopus

Real Bronchoscopic Images-based Bronchial Nomenclature: a Preliminary Study Invited Reviewed

Wang C., Hayashi Y., Oda M., Kitasaka T., Takabatake H., Mori M., Honma H., Natori H., Mori K.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE Vol. 12466 2023

Authorship：Corresponding author Language：English Publishing type：Research paper (scientific journal) Publisher：Progress in Biomedical Optics and Imaging - Proceedings of SPIE

This article describes a method for bronchial nomenclature using real bronchoscopic (RB) images and pre-built knowledge base of branches. The bronchus has a complex tree-like structure, which increases the difficulty of bronchoscopy. Therefore, a bronchoscopic navigation system is used to help physicians during examination. Conventional navigation system used preoperative CT images and real bronchoscopic images to obtain the camera pose for navigation, whose accuracy is influenced by organ deformation. We propose a bronchial nomenclature method to estimate branch names for bronchoscopic navigation. This method consists of a bronchus knowledge base construction model, a camera motion estimation module, an anatomical structure tracking module, and a branch name estimation module. The knowledge base construction module is used to find the relationship of each branch. The anatomical tracking module is used to track the bronchial orifice (BO) extracted in each RB frame. The camera motion estimation module is used to estimate the camera motion between two frames. The branch name estimation module uses the pre-built bronchus knowledge base and BO tracking results to find the name of each branch. Experimental results showed that it is possible to estimate branch names using only RB images and the pre-built knowledge base of branches.

DOI： 10.1117/12.2654508

Scopus

Priority attention network with Bayesian learning for fully automatic segmentation of substantia nigra from neuromelanin MRI Invited Reviewed

Hu T., Itoh H., Oda M., Saiki S., Hattori N., Kamagata K., Aoki S., Mori K.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE Vol. 12464 2023

Authorship：Corresponding author Language：English Publishing type：Research paper (scientific journal) Publisher：Progress in Biomedical Optics and Imaging - Proceedings of SPIE

Neuromelanin magnetic resonance imaging (NM-MRI) has been widely used in the diagnosis of Parkinson’s disease (PD) for its significantly enhanced contrast between the PD-related structure, the substantia nigra (SN) and surrounding tissues. To develop the computer-aided diagnosis (CAD) system of PD and reduce the labor burden of clinicians, precise and automatic segmentation of SN is becoming more and more desired. This paper proposes a novel network combining the priority gating attention and Bayesian learning for improving the accuracy of fully automatic SN segmentation from NM-MRI. Different from the conventional gated attention model, the proposed network uses the prior SN probability map for guiding the attention computation and reducing the potential disruptions introduced by the background. Additionally, to lower the risks of over-fitting and estimate the confidence scores for the segmentation results, Bayesian learning with Monte Carlo dropout is applied in the training and testing phases. The quantitative results showed that the proposed network acquired the averaged Dice score of 79.46% in comparison with the baseline model 77.93%.

DOI： 10.1117/12.2655112

Scopus

Octree Cube Constraints in PBD Method for High Resolution Surgical Simulation Invited Reviewed

Miyazaki R., Hayashi Y., Oda M., Mori K.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE Vol. 12464 2023

Authorship：Corresponding author Language：English Publishing type：Research paper (scientific journal) Publisher：Progress in Biomedical Optics and Imaging - Proceedings of SPIE

This paper proposes a deformable tissue model that introduces octree lattice vertex layout and cubic constraints to the orthodox PBD (Position Based Dynamics) method. Surgical simulation is expected to provide a safe method for training in surgery, which is especially useful for preoperative education of inexperienced surgeons and/or for the case a prior attempt is required. To build a surgical simulator, it is necessary to develop organ models with deformations and interaction algorithms between surgical instruments and organ models, all of which must be performed in real time. Since existing surgical simulators focus on real-time performance, the resolution of organ models is limited. The proposed method restricts the vertex locations of the PBD method to the vertices of the octree lattice to save computation time while maintaining a high deformation resolution. To obtain appropriate results even for large deformations, three-dimensional constraints are applied to each octree cube as the constraints of the PBD method. In the simulations, we tested the overall deformation by dropping a liver model and the local deformation scene by laparoscopic clipping. As a result, we achieved deformation simulations at 26.5 fps for the model with approximately 2,672 cube elements and 20,659 vertices.

DOI： 10.1117/12.2654092

Scopus

Multi-view Guidance for Self-supervised Monocular Depth Estimation on Laparoscopic Images via Spatio-Temporal Correspondence Invited Reviewed

Li W., Hayashi Y., Oda M., Kitasaka T., Misawa K., Mori K.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Vol. 14228 LNCS page： 429 - 439 2023

This work proposes an innovative self-supervised approach to monocular depth estimation in laparoscopic scenarios. Previous methods independently predicted depth maps ignoring spatial coherence in local regions and temporal correlation between adjacent images. The proposed approach leverages spatio-temporal coherence to address the challenges of textureless areas and homogeneous colors in such scenes. This approach utilizes a multi-view depth estimation model to guide monocular depth estimation when predicting depth maps. Moreover, the minimum reprojection error is extended to construct a cost volume for the multi-view model using adjacent images. Additionally, a 3D consistency of the point cloud back-projected from predicted depth maps is optimized for the monocular depth estimation model. To benefit from spatial coherence, deformable patch-matching is introduced to the monocular and multi-view models to smooth depth maps in local regions. Finally, a cycled prediction learning for view synthesis and relative poses is designed to exploit the temporal correlation between adjacent images fully. Experimental results show that the proposed method outperforms existing methods in both qualitative and quantitative evaluations. Our code is available at https://github.com/MoriLabNU/MGMDepthL.

DOI： 10.1007/978-3-031-43996-4_41

Scopus

Masked Frequency Consistency for Domain-Adaptive Semantic Segmentation of Laparoscopic Images Invited Reviewed

Zhao X., Hayashi Y., Oda M., Kitasaka T., Mori K.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Vol. 14220 LNCS page： 663 - 673 2023

Semantic segmentation of laparoscopic images is an important issue for intraoperative guidance in laparoscopic surgery. However, acquiring and annotating laparoscopic datasets is labor-intensive, which limits the research on this topic. In this paper, we tackle the Domain-Adaptive Semantic Segmentation (DASS) task, which aims to train a segmentation network using only computer-generated simulated images and unlabeled real images. To bridge the large domain gap between generated and real images, we propose a Masked Frequency Consistency (MFC) module that encourages the network to learn frequency-related information of the target domain as additional cues for robust recognition. Specifically, MFC randomly masks some high-frequency information of the image to improve the consistency of the network’s predictions for low-frequency images and real images. We conduct extensive experiments on existing DASS frameworks with our MFC module and show performance improvements. Our approach achieves comparable results to fully supervised learning method on the CholecSeg8K dataset without using any manual annotation. The code is available at github.com/MoriLabNU/MFC.

DOI： 10.1007/978-3-031-43907-0_63

Scopus

Improved method for COVID-19 Classification of Complex-Architecture CNN from Chest CT volumes using Orthogonal Ensemble Networks Invited Reviewed

Toda R., Oda M., Hayashi Y., Otake Y., Hashimoto M., Akashi T., Aoki S., Mori K.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE Vol. 12465 2023

Authorship：Corresponding author Language：English Publishing type：Research paper (scientific journal) Publisher：Progress in Biomedical Optics and Imaging - Proceedings of SPIE

This paper introduces the improved method for the COVID-19 classification based on computed tomography (CT) volumes using a combination of a complex-architecture convolutional neural network (CNN) and orthogonal ensemble networks (OEN). The novel coronavirus disease reported in 2019 (COVID-19) is still spreading worldwide. Early and accurate diagnosis of COVID-19 is required in such a situation, and the CT scan is an essential examination. Various computer-aided diagnosis (CAD) methods have been developed to assist and accelerate doctors' diagnoses. Although one of the effective methods is ensemble learning, existing methods combine some major models which do not specialize in COVID-19. In this study, we attempted to improve the performance of a CNN for the COVID-19 classification based on chest CT volumes. The CNN model specializes in feature extraction from anisotropic chest CT volumes. We adopt the OEN, an ensemble learning method considering inter-model diversity, to boost its feature extraction ability. For the experiment, We used chest CT volumes of 1283 cases acquired in multiple medical institutions in Japan. The classification result on 257 test cases indicated that the combination could improve the classification performance.

DOI： 10.1117/12.2653792

Scopus

Classification of COVID-19 cases from chest CT volumes using hybrid model of 3D CNN and 3D MLP-Mixer Invited Reviewed

Oda M., Zheng T., Hayashi Y., Otake Y., Hashimoto M., Akashi T., Aoki S., Mori K.

Progress in Biomedical Optics and Imaging - Proceedings of SPIE Vol. 12465 2023

Authorship：Corresponding author Language：English Publishing type：Research paper (scientific journal) Publisher：Progress in Biomedical Optics and Imaging - Proceedings of SPIE

This paper proposes an automated classification method of COVID-19 chest CT volumes using improved 3D MLP-Mixer. Novel coronavirus disease 2019 (COVID-19) spreads over the world, causing a large number of infected patients and deaths. Sudden increase in the number of COVID-19 patients causes a manpower shortage in medical institutions. Computer-aided diagnosis (CAD) system provides quick and quantitative diagnosis results. CAD system for COVID-19 enables efficient diagnosis workflow and contributes to reduce such manpower shortage. In image-based diagnosis of viral pneumonia cases including COVID-19, both local and global image features are important because viral pneumonia cause many ground glass opacities and consolidations in large areas in the lung. This paper proposes an automated classification method of chest CT volumes for COVID-19 diagnosis assistance. MLP-Mixer is a recent method of image classification using Vision Transformer-like architecture. It performs classification using both local and global image features. To classify 3D CT volumes, we developed a hybrid classification model that consists of both a 3D convolutional neural network (CNN) and a 3D version of the MLP-Mixer. Classification accuracy of the proposed method was evaluated using a dataset that contains 1205 CT volumes and obtained 79.5% of classification accuracy. The accuracy was higher than that of conventional 3D CNN models consists of 3D CNN layers and simple MLP layers.

DOI： 10.1117/12.2654706

Scopus

Anatomy Aware-based 2.5D Bronchoscope Tracking for Image-guided Bronchoscopic Navigation Invited Reviewed

Cheng Wang, Masahiro Oda, Yuichiro Hayashi, Takayuki Kitasaka, Hayato Itto, Hirotoshi honma,Hirotsugu takabatake, Masaki Mori, Hiroshi Natori, Kensaku Mori

Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization 2022.12

Surgical Assistance in Laparoscopic Surgery Using AI Invited Reviewed

HAYASHI Yuichiro, MORI Kensaku

Medical Imaging Technology Vol. 40 ( 4 ) page： 164 - 169 2022.9

Authorship：Corresponding author Language：Japanese Publishing type：Research paper (scientific journal) Publisher：The Japanese Society of Medical Imaging Technology

Laparoscopic surgery is currently performed as one of surgical procedures for various organs. Laparoscopic surgery requires highly skill of surgeon. Therefore, computer aided surgery which is used computer technology for assisting surgery has been researched. These assistances are sometimes referred as surgical navigation. In recent year, as the development of AI (Artificial Intelligence) technology, there are many researches on laparoscopic video analysis using deep learning for assisting laparoscopic surgery. In this paper, we introduce our researches about laparoscopic video analysis using AI.

DOI： 10.11409/mit.40.164

CiNii Research

AI for VR Invited Reviewed

森健策

日本VR医学会学術大会プログラム・抄録集 Vol. 2022 ( 0 ) page： 9 - 9 2022.8

BONE MARROW EDEMA SCORE IN HAND X-RAY FILM BY AI DEEP LEARNING ASSOCIATE WITH MRI BONE EDEMA IN RHEUMATOID ARTHRITIS. Invited Reviewed

Katayama, K; Pan, D; Oda, M; Okubo, T; Mori, K

ANNALS OF THE RHEUMATIC DISEASES Vol. 81 page： 1773 - 1774 2022.6

　 PREV - NEXT 　

<MORI, Kensaku>

Papers - MORI, Kensaku