記述言語：日本語   出版者・発行元：IEEE Intelligent Vehicles Symposium, Proceedings  

In this research, a two-stage risk object warning method is proposed to generate the auditory and visual warning information simultaneously from the driving scene. The auditory warning module (AWM) is designed as a classification task by combining the rough location and type information as warning sentences and treating each sentence as one class. The visual warning module (VWM) is designed as a weakly supervised method to save the labor-intensive bounding box marking of risk objects. To confirm the effectiveness of the proposed method, we also create a linguistic risk notification (LRN) dataset by describing the driving scenario as several different sentences. The average accuracy of auditory warning is 96.4% for generating the warning sentences. The average accuracy of the weakly supervised visual warning algorithm is 81.3% for getting the risk vehicle localization without any supervisory information.

DOI： 10.1109/IV51971.2022.9827382

Web of Science

Scopus

出版者・発行元：UIST 2022 Adjunct - Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology  

Many people now listen to music with earphones while walking, and are less likely to notice approaching people, cars, etc. Many methods of detecting approaching objects and notifying pedestrians have been proposed, but few have focused on low urgency situations or music listeners, and many notification methods are unpleasant. Therefore, in this work, we propose methods of gently notifying pedestrians listening to music of approaching objects using environmental sound. We conducted experiments in a virtual environment to assess directional perception accuracy and comfort. Our results show the proposed method allows participants to detect the direction of approaching objects as accurately as explicit notification methods, with less discomfort.

DOI： 10.1145/3526114.3558728

Web of Science

Scopus

出版者・発行元：BMVC 2022 - 33rd British Machine Vision Conference Proceedings  

Recent self-supervised models have demonstrated equal or better performance than supervised methods, opening for AI systems to learn visual representations from practically unlimited data. However, these methods are typically classification-based and thus ineffective for learning high-resolution feature maps that preserve precise spatial information. This work introduces superpixels to improve self-supervised learning of dense semantically rich visual concept embeddings. Decomposing images into a small set of visually coherent regions reduces the computational complexity by O(1000) while preserving detail. We experimentally show that contrasting over regions improves the effectiveness of contrastive learning methods, extends their applicability to high-resolution images, improves overclustering performance, superpixels are better than grids, and regional masking improves performance. The expressiveness of our dense embeddings is demonstrated by improving the SOTA unsupervised semantic segmentation benchmark on Cityscapes, and for convolutional models on COCO. Code is available at https://github.com/robin-karlsson0/vice.

Scopus

記述言語：日本語   掲載種別：研究論文（学術雑誌）  

DOI： doi/10.20729/00213195

記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）  

記述言語：日本語   掲載種別：研究論文（研究会，シンポジウム資料等）  

記述言語：日本語   出版者・発行元：公益社団法人 自動車技術会  

本研究では，End-to-End自動運転を用いて分岐含む経路を追従するための手法について研究を行う．本手法では，L2正則化を用いて入力画像の特徴量にかかる重みの大きさを制限し，もう一つの入力である分岐の進行方向を示すベクトルを強調することで，ロボットが分岐を含む経路を追従できる学習手法を提案する．

DOI： 10.11351/jsaeronbun.52.1368

CiNii Research

記述言語：日本語   出版者・発行元：IEEE Intelligent Vehicles Symposium, Proceedings  

Video captioning aims to generate textual descriptions according to the video contents. The risk assessment of autonomous driving vehicles has become essential for an insurance company for providing adequate insurance coverage, in particular, for emerging MaaS business. The insurers need to assess the risk of autonomous driving business plans with a fixed route by analyzing a large number of driving data, including videos recorded by dash cameras and sensor signals. To make the process more efficient, generating captions for driving videos can provide insurers concise information to understand the video contents quickly. A natural problem with driving video captioning is, since the absence of egovehicles in these egocentric videos, descriptions of latent driving behaviors are difficult to be grounded in specific visual cues. To address this issue, we focus on generating driving video captions with accurate behavior descriptions, and propose to incorporate in-vehicle sensors which encapsulate the driving behavior information to assist the caption generation. We evaluate our method on the Japanese driving video captioning dataset called City Traffic, where the results demonstrate the effectiveness of in-vehicle sensors on improving the overall performance of generated captions, especially on generating more accurate descriptions for the driving behaviors.

DOI： 10.1109/IVWorkshops54471.2021.9669259

Web of Science

Scopus

記述言語：日本語   出版者・発行元：Adjunct Proceedings - 11th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019  

When operating the touch screen in a car, the touch point can shift due to the vibration, resulting in selection errors. Using larger target is a possible solution, but this significantly limits the amount of content that can be displayed on the touch screen. Therefore, we propose a method for in-vehicle touch screen target selection that can be used with a variety of sensors to increase selection accuracy. In this method, the vibration feature is learned by Variational Auto-Encoder based model, and it is used for estimating touch point distribution. Our experimental results demonstrate that the proposed method allows users to achieve higher target selection accuracy than conventional methods.

DOI： 10.1145/3349263.3351327

Scopus

記述言語：日本語  

本論文では，畳み込み雑音除去自己符号化器（convolutional denoising autoencoder: CDAE）と対数周波数領域振幅スペクトル特徴を利用し，楽曲信号から個々の楽器音信号を強調するための技術について提案する．これまでに提案されてきた深層ニューラルネットワーク（deep neural network: DNN）を用いて音源信号の振幅スペクトルを推定する試みの多くは，楽器音信号の物理的な性質がDNNの構造に考慮されていない．本論文では，多くの楽器音の対数周波数領域振幅スペクトルが，楽器ごとに固有の包絡構造成分と様々な基本周波数に対応する調波構造成分の重みづけ和との掛け合わせでモデル化されることに着目し，楽器音信号の特性を考慮したDNN構造を用いることで，楽器音の振幅スペクトル推定精度が向上すると考えた．対数周波数領域の振幅スペクトル特徴量をCDAEに入力することで目的音の振幅スペクトルを推定する方式を提案し，実験を通して従来方式より信号対干渉音比（signal to interference ratio: SIR）が改善することを確認した．また，目的音と雑音間の相補性に着目し，目的音だけでなく，雑音の振幅スペクトル推定を同時に行い，それらを組み合わせたところ，SIR改善量が更に上昇した．

DOI： 10.14923/transinfj.2017pdp0021

CiNii Research

CiNii Research

記述言語：英語   出版者・発行元：IEICE Transactions on Information and Systems  

A single-dimensional interface which enables users to obtain diverse localizations of audio sources is proposed. In many conventional interfaces for arranging audio sources, there are multiple arrangement parameters, some of which allow users to control positions of audio sources. However, it is difficult for users who are unfamiliar with these systems to optimize the arrangement parameters since the number of possible settings is huge. We propose a simple, single-dimensional interface for adjusting arrangement parameters, allowing users to sample several diverse audio source arrangements and easily find their preferred auditory localizations. To select subsets of arrangement parameters from all of the possible choices, auditory-localization space vectors (ASVs) are defined to represent the auditory localization of each arrangement parameter. By selecting subsets of ASVs which are approximately orthogonal, we can choose arrangement parameters which will produce diverse auditory localizations. Experimental evaluations were conducted using music composed of three audio sources. Subjective evaluations confirmed that novice users can obtain diverse localizations using the proposed interface.

DOI： 10.1587/transinf.2017EDP7028

Web of Science

Scopus

CiNii Research

記述言語：日本語   出版者・発行元：ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings  

Through smartphones, user enables to download/listen music anytime and anywhere. As a concept of a future audio player, we propose a framework of music staging artificial intelligence (AI). In that framework, audio object signals, e.g. vocal, guitar, bass, drums and keyboards, are assumed to be extracted from stereo music signals. To visualize music as if live performance is virtually conducted, playing motion sequence is estimated by using separated signals. After adjusting the spatial arrangement of audio objects so as to each user prefers it, audio/visual rendering is conducted. We constructed two types of demonstration systems for music staging AI. In the smartphone-based implementation, each user enables to change the spatial arrangement through sliderbar dragging. Since information of user preferable spatial arrangement can be sent from each smartphone to server, it would enable to predict/recommend the user preferable spatial arrangement. In another implementation, head mount display (HMD) was utilized to dive into virtual music live performance. Each user enables to walk/teleport anywhere and audio is then changing corresponding to the user view.

DOI： 10.1109/ICASSP.2017.8005294

Scopus