Faculty Profiles - Deguchi Daisuke

Papers - Deguchi Daisuke

Division display 41 - 60 of about 253 ／ All the affair displays >>

Median-Shape Representation Learning for Category-Level Object Pose Estimation in Cluttered Environments Reviewed

Hiroki Tatemichi, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Ayako Amma, Hiroshi Murase

Proceedings of the 25th International Conference on Pattern Recognition page： 4473 - 4480 2021.1

Language：English Publishing type：Research paper (international conference proceedings)

In this paper, we propose an occlusion-robust pose
estimation method of an unknown object instance in an
object category from a depth image. In a cluttered
environment, objects are often occluded mutually. For
estimating the pose of an object in such a situation, a
method that de-occludes the unobservable area of the object
would be effective. However, there are two difficulties;
occlusion causes offset between the actual object center
and the center of its observable area, and different
instances in a category may have different shapes. To cope
with these difficulties, we propose a two-stage
Encoder-Decoder model to extract features with objects
whose centers are aligned to the image center. In the
model, we also propose the Median-shape Reconstructor as
the second stage to absorb shape variations in a category.
By evaluating the method with both a large-scale virtual
dataset and a real dataset, we confirmed the proposed
method achieves good performance on pose estimation of an
occluded object from a depth image.

Human Skeleton Estimation Method Focusing on the Difference of Human Position and Action from an Extremely Low-Resolution FIR Image Sequence Reviewed

Saki Iwata, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Tomoyoshi Aizawa

Journal of the Japan Society for Precision Engineering Vol. 87 ( 1 ) page： 99 - 106 2021.1

Imageability Estimation using Visual and Language Features Reviewed

Chihaya Matsuhira, Marc A. Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Keisuke Doman, Daisuke Deguchi, Hiroshi Murase

Proceedings of the 2020 International Conference on Multimedia Retrieval page： 306–310 2020.10

Language：English Publishing type：Research paper (international conference proceedings)

Imageability is a concept from Psycholinguistics quantizing the human perception of words. However, existing datasets are created through subjective experiments and are thus very small. Therefore, methods to automatically estimate the imageability can be helpful. For an accurate automatic imageability estimation, we extend the idea of a psychological hypothesis called Dual-Coding Theory, that discusses the connection of our perception towards visual information
and language information, and also focus on the relationship between the pronunciation of a word and its imageability. In this research, we propose a method to estimate imageability of words
using both visual and language features extracted from corresponding data. For the estimation, we use visual features extracted from low- and high-level image features, and language features extracted from textual features and phonetic features of words. Evaluations how that our proposed method can estimate imageability more accurately than comparative methods, implying the contribution of each feature to the imageability.

DOI： 10.1145/3372278.3390731

Modeling Eye-Gaze Behavior of Electric Wheelchair Drivers via Inverse Reinforcement Learning Reviewed

Yamato Maekawa, Naoki Akai, Takatsugu Hirayama, Luis Yoichi Morales, Daisuke Deguchi, Yasutomo Kawanishi, Ichiro Ide, Hiroshi Murase

Proceedings of 2020 IEEE International Conference on Intelligent Transportation Systems page： 158 - 164 2020.9

Language：English Publishing type：Research paper (international conference proceedings)

It is intuitively obvious that eye-gaze behaviors of experienced drivers are different from those of novice drivers. However, it is not easy to understand the difference in their behavior quantitatively. In this work, we present an explainable eye-gaze behavior modeling method for electric wheelchair drivers based on Inverse Reinforcement Learning (IRL). We first create feature maps that represent risk factors during driving. These feature maps are able to represent not only to what but also from where drivers pay attention. IRL uses the feature maps to learn the reward representing the eye-gaze behaviors and allows us to see important features via the automatic acquisition of the reward. Through analysis of the learned model, we show quantitative evidence that eye-gaze behaviors of experienced drivers are better-balanced by paying attention to multiple risks.

DOI： 10.1109/ITSC45102.2020.9294255

Estimating the imageability of words by mining visual characteristics from crawled image data Reviewed

Marc Aurel Kastner, Ichiro Ide, Frank Nack, Yasutomo Kawanishi, Takatsugu Hirayama, Daisuke Deguchi, Hiroshi Murase

Multimedia Tools and Applications Vol. 79 ( 25 ) page： 18167 - 18199 2020.7

Performance Boost of Attribute-aware Semantic Segmentation via Data Augmentation for Driver Assistance Reviewed

Mahmud Dwi Sulistiyo, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Takatsugu Hirayama, Hiroshi Murase

page： 293 - 298 2020.6

Language：English Publishing type：Research paper (international conference proceedings)

This paper is an extension of our work in developing an attribute-aware semantic segmentation method which focuses on pedestrian understanding in a traffic scene. Recently, the trending topic of semantic segmentation has been expanded to be able to collaborate with the object’s attributes recognition task; Here, it refers to recognizing a pedestrian’s body orientation. The attribute-aware semantic segmentation can be more beneficial for driver assistance compared to the conventional semantic segmentation because it can provide a more informative output to the system. In this paper, we conduct a study of the data augmentation usage as an effort to enhance the performance of the attribute-aware semantic segmentation task. The experiments show that the proposed method in augmenting the training data is able to improve the model’s performance. We also demonstrate some of qualitative results and discuss the benefits to a driver assistance system.

DOI： 10.1109/ICoICT49345.2020.9166219

Estimation of the Number of Vehicles by Regression Based on Parts Detection Reviewed

Fumito Shinmura, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase

Vol. 32 ( 3 ) page： 705 - 712 2020.6

Simultaneous Image Matching for Person Re-identification via the Stable Marriage Algorithm Reviewed

Nik Mohd Zarifie Hashim, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase

IEEJ Transactions ON Electrical AND Electronic Engineering Vol. 15 ( 6 ) page： 909 - 917 2020.4

SOANets: Encoder-Decoder based Skeleton Orientation Alignment Network for White Cane User Recognition from 2D Human Skeleton Sequence Reviewed

Naoki Nishida, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Jun Piao

Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP) 2020 Vol. 5 page： 435 - 443 2020.2

Language：English Publishing type：Research paper (international conference proceedings)

In recent years, various facilities have been deployed to support visually impaired people. However, accidents caused by visual disabilities still occur. In this paper, to support the visually impaired people in public areas, we aim to identify whether a pedestrian image sequence obtained by a surveillance camera indicates the presence of a white cane user by analyzing the temporal transition of a human skeleton represented as 2D coordinates. Our previously proposed method aligns the orientation of the human skeletons to various orientations and identifies a white cane user from the corresponding sequences, relying on multiple classifiers related to each orientation. The method employs an exemplar-based approach to perform the alignment. However, it heavily depends on the number of exemplars and consumes excessive memory. In this paper, we propose a method to align 2D human skeleton representation sequence to various orientations using the proposed Skeleton Orientation Alignment Networks (SOANets) based on an encoder-decoder model. Using SOANets, we can obtain 2D skeleton representation sequences aligned to various orientations, extract richer skeleton features, and recognize white cane users accurately. We conducted an experiment to confirm that the
proposed method improves the recognition rate by 16%, compared to the method that does not use the skeleton
orientation alignment.

Development and Evaluation of "KamiRepo" Web Service with Return of Handwritten Assignments via LMS Reviewed

Shigeki Ohira, Shunya Seiya, Ryuya Ito, Kosuke Okamoto, Ukyo Tanikawa, Daisuke Deguchi, Tomoki Toda

Vol. 6 ( 1 ) page： 52 - 68 2020.2

Occlusion-Aware Skeleton Trajectory Representation for Abnormal Behavior Detection Reviewed

Onur Temuroglu, Yasutomo Kawanishi, Daisuke Deguchi, Takatsugu Hirayama, Ichiro Ide, Hiroshi Murase, Mayuu Iwasaki, Atsushi Tsukada

2020.2

Language：English Publishing type：Research paper (international conference proceedings)

Surveillance cameras are expected to play a large role in the development of ITS technologies. They can be used to detect abnormally behaving individuals which can then be reported to drivers nearby. There are multiple works that tackle the problem of abnormal behavior detection. However, most of these works make use of appearance features which have redundant information and are susceptible to noise. While there are also works that make use of pose skeleton representation, they do not consider well how to handle cases with occlusions, which can occur due to the simple reason of pedestrian orientation preventing some joints from appearing in the frame clearly. In this paper, we propose a skeleton trajectory representation that enables handling of occlusions. We also propose a framework for pedestrian abnormal behavior detection that uses the proposed representation and detect relatively hard-to-notice anomalies such as drunk walking. The experiments we conducted show that our method outperforms other representation methods.

Browsing Visual Sentiment Datasets Using Psycholinguistic Groundings

Marc Aurel Kastner, Ichiro Ide, Yasutomo Kawanishi, Takatsugu Hirayama, Daisuke Deguchi, Hiroshi Murase

Lecture Note in Computer Science Vol. 11962 page： 697 - 702 2020.1

Language：English Publishing type：Research paper (international conference proceedings)

Recent multimedia applications commonly use text and imagery from Social Media for tasks related to sentiment research. As such, there are various image datasets for sentiment research for popular classification tasks. However, there has been little research regarding the relationship between the sentiment of images and its annotations from a multi-modal standpoint. In this demonstration, we built a tool to visualize psycholinguistic groundings for a sentiment dataset. For each image, individual psycholinguistic ratings are computed from the image's metadata. A sentiment-psycholinguistic spatial embedding is computed to show a clustering of images across different classes close to human perception. Our interactive browsing tool can visualize the data in various ways, highlighting different psycholinguistic groundings with heatmaps.

DOI： 10.3758/s13428-018-1099-3

More-Natural Mimetic Words Generation for Fine-Grained Gait Description Reviewed

Hirotaka Kato, Takatsugu Hirayama, Ichiro Ide, Keisuke Doman, Yasutomo Kawanishi, Daisuke Deguchi, Hiroshi Murase

Lecture Note in Computer Science Vol. 11962 page： 214 - 225 2020.1

Language：English Publishing type：Research paper (international conference proceedings)

A mimetic word is used to verbally express the manner of a phenomenon intuitively. The Japanese language is known to have a greater number of mimetic words in its vocabulary than most other languages. Especially, since human gaits are one of the most commonly represented behavior by mimetic words in the language, we consider that it should be suitable for labels of fine-grained gait recognition. In addition, Japanese mimetic words have a more decomposable structure than these in other languages such as English. So it is said that they have sound-symbolism and their phonemes are strongly related to the impressions of various phenomena. Thanks to this, native Japanese speakers can express their impressions on them briefly and intuitively using various mimetic words. Our previous work proposed a framework to convert the body-parts movements to an arbitrary mimetic word by a regression model. The framework introduced a phonetic space" based on sound-symbolism, and it enabled fine-grained gait description using the generated mimetic words consisting of an arbitrary combination of phonemes. However, this method did not consider the "naturalness" of the description. Thus, in this paper, we propose an improved mimetic word generation module considering its naturalness, and update the description framework. Here, we define the co-occurrence frequency of phonemes composing a mimetic word as the naturalness. To investigate the co-occurrence frequency, we collected many mimetic words through a subjective experiment. As a result of evaluation experiments, we confirmed that the proposed module could describe gaits with more natural mimetic words while maintaining the description accuracy."

DOI： 10.1007/978-3-030-37734-2_18

Attribute-Aware Loss Function for Accurate Semantic Segmentation Considering the Pedestrian Orientations Reviewed

Mahmud Dwi Sulistiyo, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Takatsugu Hirayama, Jiang-Yu Zheng, Hiroshi Murase

IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences Vol. E103-A ( 1 ) page： 231 - 242 2020.1

Language：English Publishing type：Research paper (scientific journal)

Numerous applications such as autonomous driving, satellite imagery sensing, and biomedical imaging use computer vision as an important tool for perception tasks. For Intelligent Transportation Systems (ITS), it is required to precisely recognize and locate scenes in sensor data. Semantic segmentation is one of computer vision methods intended to perform such tasks. However, the existing semantic segmentation tasks label each pixel with a single object’s class. Recognizing object attributes, e.g., pedestrian orientation, will be more informative and help for a better scene understanding. Thus, we propose a method to perform semantic segmentation with pedestrian attribute recognition simultaneously. We introduce an attribute-aware loss function that can be applied to an arbitrary base model. Furthermore, a re-annotation to the existing Cityscapes dataset enriches the ground-truth labels by annotating the attributes of pedestrian orientation. We implement the proposed method and compare the experimental results with others. The attribute-aware semantic segmentation shows the ability to outperform baseline methods both in the traditional object segmentation task and the expanded attribute detection task.

DOI： 10.1587/transfun.2019TSP0001

Analysis of Effective Flicker Light Patterns to Improve the Pedestrian Detectability from a Driver for an Intelligent Headlight System Reviewed

Takashi Maeda, Takatsugu Hirayama, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase

Journal of the Japan Society for Precision Engineering Vol. 85 ( 12 ) page： 1157 - 1162 2019.12

Cyclist Recognition via Size-Adaptable PointNet Reviewed

Taiki Yamamoto, Fumito Shinmura, Daisuke Deguchi, Yasutomo Kawanishi, Ichiro Ide, Kazuki Kato, Hiroshi Murase

Journal of the Japan Society for Precision Engineering Vol. 85 ( 12 ) page： 1117 - 1126 2019.12

Scene-Adaptive Driving Area Prediction based on Automatic Label Acquisition from Driving Information Reviewed

Takuya Migishima, Haruya Kyutoku, Daisuke Deguchi, Yasutomo Kawanishi, Ichiro Ide, Hiroshi Murase

Proceedings of the 5th IAPR Asian Conference on Pattern Recognition (ACPR2019) 2019.11

Semantic Segmentation of Railway Images Considering Temporal Continuity Reviewed

Yuki Furitsu, Daisuke Deguchi, Yasutomo Kawanishi, Ichiro Ide, Hiroshi Murase, Hiroki Mukoujima, Nozomi Nagamine

Proceedings of the 5th IAPR Asian Conference on Pattern Recognition (ACPR2019) 2019.11

An Analysis of How Driver Experience Affects Eye-Gaze Behavior for Robotic Wheelchair Operation Reviewed

Yamato Maekawa, Naoki Akai, Takatsugu Hirayama, Luis Yoichi Morales, Daisuke Deguchi, Yasutomo Kawanishi, Ichiro Ide, Hiroshi Murase

Proceedings of 2019 IEEE International Conference on Computer Vision (ICCV) Workshops page： 4443 - 4451 2019.11

Language：English Publishing type：Research paper (international conference proceedings)

Drivers obtain information on surrounding environment using their eyesights. Experienced eye-gaze behavior is needed when driving at places where multiple risks exist to prepare for and avoid them. In this work, we analyze the change in eye-gaze behavior in such situations while a driver gains experience on the operation of a robotic wheelchair. Accurate distance information in the traffic environment is important to analyze the eye-gaze behavior. However, almost all previous works analyze eye-gaze behavior in a 2D environment, so they could not obtain accurate distance information. For this reason, we analyze eye-gaze behavior in 3D space. Concretely, we developed a novel eye-gaze behavior analysis platform based on a robotic wheelchair and estimated the driver's attention in 3D space. We try to analyze the eye-gaze behavior considering a useful field-of-view in 3D space based on the distance information instead of only the fixation point to investigate the objects that a driver implicitly pays attention to and from where s/he focuses on them. Results show that novice drivers pay attention to a single risk at a time. In contrast, they pay more attention to multiple risks simultaneously as they gain experience. Additionally, we discuss what features are effective to model the eye-gaze behavior based on the results.

DOI： 10.1109/ICCVW.2019.00545

Exemplar-based Pseudo-Viewpoint Rotation for White-Cane User Recognition from a 2D Human Pose Sequence Reviewed

Naoki Nishida, Yasutomo Kawanishi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Jun Piao

2019.9

　 PREV - NEXT 　

<Deguchi Daisuke>

Papers - Deguchi Daisuke