Faculty Profiles - KAWAGUCHI, Nobuo

都市を対象とした大規模移動履歴に基づく疑似人流データ生成手法 Invited Reviewed

田村直樹, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

情報処理学会論文誌 Vol. 64 ( 1 ) page： 123 - 133 2023.1

ER-Chat: A Text-to-Text Open-Domain Dialogue Framework for Emotion Regulation Reviewed

Katayama Shin, Aoki Shunsuke, Yonezawa Takuro, Okoshi Tadashi, Nakazawa Jin, Kawaguchi Nobuo

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING Vol. 13 ( 4 ) page： 2229 - 2237 2022.10

Authorship：Last author Language：English Publishing type：Research paper (scientific journal) Publisher：IEEE Transactions on Affective Computing

Emotions are essential for constructing social relationships between humans and interactive systems. Although emotional and empathetic dialogue generation methods have been proposed for dialogue systems, appropriate dialogue involves not only mirroring emotions and always being empathetic but also complex factors such as context. This paper proposes Emotion Regulation Chat (ER-Chat) as an end-to-end dialogue framework for emotion regulation. Emotion regulation is concerned with actions to approach appropriate emotional states. Learning appropriate emotion and intent when responding on the basis of the context of the dialogue enables the generation of more human-like dialogue. We conducted automatic and human evaluations to demonstrate the superiority of ER-Chat over the baseline system. The results show that inclusion of emotion and intent prediction mechanisms enable generation of dialogues with greater fluency, diversity, emotion awareness, and emotion appropriateness, which are greatly preferred by humans.

DOI： 10.1109/TAFFC.2022.3191973

Deep Learning for Ballroom Dance Recognition: A Temporal and Trajectory-Aware Classification Model With Three-Dimensional Pose Estimation and Wearable Sensing Reviewed

Matsuyama Hitoshi, Aoki Shunsuke, Yonezawa Takuro, Hiroi Kei, Kaji Katsuhiko, Kawaguchi Nobuo

IEEE SENSORS JOURNAL Vol. 21 ( 22 ) page： 25437 - 25448 2021.11

Authorship：Last author Language：English Publishing type：Research paper (scientific journal) Publisher：IEEE Sensors Journal

Dance performance recognition methods have been investigated and shown various applications such as picture-pose evaluation and synchronizing foot timing and direction. However, detailed analysis and feedback are still missing. To provide them, understanding the performance by component level is necessary. Specifically, we formulate it as a dance-figure classification problem using three-dimensional body joints and wearable sensors. Our model is based on long short-term memory (LSTM) and includes the temporal and trajectory-wise structure that uses the trajectory information in a timestep and the temporal masking module. As a result, we achieved 93% accuracy with our proposed method, which is highly overwhelming the baseline result (84.7%) and very close to the accuracy of the experienced dancers (93.6%). We have made the dataset of ballroom dance performance dataset open to researchers to develop the activity recognition field further.

DOI： 10.1109/JSEN.2021.3098744

Additive Compositionality in Urban Area Embeddings Based on Human Mobility Patterns

大規模ユーザの滞在情報に基づくエリアの特徴付けとCOVID-19による影響分析 Reviewed

庄子和之, 青木俊介, 米澤拓郎, 河口信夫

情報処理学会論文誌 Vol. 62 page： 1644 - 1657 2021.10

Efficient Edge AI based Annotation and Detection Framework for Logistics Warehouses Reviewed

Yuki Mori, Yusuke Asai, Keisuke Higashiura, Shin Katayama, Kenta Urano, Takuro Yonezawa, Nobuo Kawaguchi

IEEE Consumer Communications & Networking Conference 2025 2025.1

Naoki Tamura, Haru Terashima, Kazuyuki Shoji, Shin Katayama, Kenta Urano, Takuro Yonezawa, Nobuo Kawaguchi

Proceedings of the 32nd ACM International Conference on Advances in Geographic Information Systems page： 577 - 580 2024.10

Unveiling Human Attributes through Life Pattern Clustering using GPS Data Only

Kazuyuki Shoji, Haru Terashima, Nobuo Kawaguchi, Shin Katayama, Kenta Urano, Takuro Yonezawa, Naoki Tamura

Proceedings of the 32nd ACM International Conference on Advances in Geographic Information Systems page： 621 - 624 2024.10

Time-series Stay Frequency for Multi-City Next Location Prediction using Multiple BERTs Reviewed

Terashima H., Takagi S., Tamura N., Shoji K., Hossain T., Katayama S., Urano K., Yonezawa T., Kawaguchi N.

32nd ACM SIGSPATIAL International Workshop on the Human Mobility Prediction Challenge, HuMob-Challenge 2024 page： 5 - 9 2024.10

自律移動ロボットを用いた人流計測のための探索経路生成 Invited Reviewed

下里浩昇, 片山晋, 浦野健太, 米澤拓郎, 河口信夫

情報処理学会論文誌 Vol. 65 page： 1511 - 1522 2024.10

倉庫内業務の量子アニーリングによる最適化とシミュレーションによる評価

瀧上昂希，福島悠人，浅井悠佑，片山晋，浦野健太，米澤拓郎，河口信夫

第81回UBI研究会 2024.2

Area Modeling using Stay Information for Large-Scale Users and Analysis for Influence of COVID-19.

Kazuyuki Shoji, Shunsuke Aoki, Takuro Yonezawa, Nobuo Kawaguchi

arxiv.org/abs/2401.10648v1 Vol. abs/2401.10648 2024

Poster: Sustainable Data Management Flow for Spatio-Temporal Datasets

Nagata, Y; Kohama, D; Watanabe, Y; Katayama, S; Urano, K; Yonezawa, T; Kawaguchi, N

PROCEEDINGS OF THE 2024 THE 22ND ANNUAL INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS, APPLICATIONS AND SERVICES, MOBISYS 2024 page： 688 - 689 2024

Language：English Publishing type：Research paper (scientific journal) Publisher：MOBISYS 2024 - Proceedings of the 2024 22nd Annual International Conference on Mobile Systems, Applications and Services

Spatio-temporal data is utilized in various fields, but its scale is continuously growing, leading to significant labor and costs in storage and processing. Therefore, the value that can be derived from spatio-temporal data is diluted due to management costs. We propose a new data management flow using various metadata and common programs for spatio-temporal data utilization. Traditionally, various spatio-temporal data processing have been implemented and processed according to each spatio-temporal data. We defined spatio-temporal data structure metadata and performed data processing based on metadata using a common data processing program. Furthermore, we automated the generation of data structure metadata by combining our data skeleton recognition method and generative AI model. Using this flow, we expect to improve the sustainability of utilizing spatio-temporal data.

DOI： 10.1145/3643832.3661423

Demo: Assisting System for Creating Ceiling Plan Using a Video from a Smatrphone

Kohama, D; Nagata, Y; Yasutake, K; Katayama, S; Urano, K; Yonezawa, T; Kawaguchi, N

PROCEEDINGS OF THE 2024 THE 22ND ANNUAL INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS, APPLICATIONS AND SERVICES, MOBISYS 2024 page： 620 - 621 2024

We present an assisting system for creating a ceiling plan. Conventional methods of creating a ceiling plan are time-consuming and high-cost. Our system requires only two inputs from a user and outputs the panoramic ceiling image that shows the whole ceiling surface. The system detects the ceiling fixtures and depicts them seamlessly for a reliable resulting image. We confirmed the possibility of assisting in creating a ceiling plan with our system through the experiment.

DOI： 10.1145/3643832.3661847

Balancing Excitement and Environmental Conservation in Information Dissemination for Safari Game Drives

Shimura, K; Katayama, S; Urano, K; Leleito, E; Yonezawa, T; Kawaguchi, N

DISTRIBUTED, AMBIENT AND PERVASIVE INTERACTIONS, PT I, DAPI 2024 Vol. 14718 page： 311 - 323 2024

Language：English Publishing type：Research paper (scientific journal) Publisher：Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

In the context of Kenyan Safari Game Drives, which traditionally rely on visual scouting and intermittent communication, challenges arise regarding the effectiveness of animal detection and environmental conservation. Consequently, animals experience stress, and tourists encounter difficulties in observation due to obstruction by other visitors. Addressing these challenges involves maintaining animal welfare while enhancing tourist satisfaction. To revitalize post-pandemic tourism and enrich safari experiences, this study proposes a wildlife spotting and sharing system. The proposed method integrates wildlife detection and sharing technologies guided by three core principles: preserving encounter serendipity, regulating information access, and promoting environmental conservation. The system architecture incorporates sensors, GPS, and tablet terminals to facilitate real-time data collection, animal identification, and information dissemination. This approach aims to foster an engaging, efficient, and environmentally conscious wildlife spotting and sharing experience, potentially establishing a model for sustainable wildlife tourism in comparable wildlife-rich regions.

DOI： 10.1007/978-3-031-59988-0_19

Towards a Real-Time and Energy-Efficient Edge AI Camera Architecture in Mega Warehouse Environment

Asai Y., Mori Y., Higashiura K., Yokoyama K., Katayama S., Urano K., Yonezawa T., Kawaguchi N.

Proceedings - 2024 IEEE 3rd Real-Time and Intelligent Edge Computing Workshop, RAGE 2024 page： 12 - 17 2024

Language：English Publishing type：Research paper (scientific journal) Publisher：Proceedings - 2024 IEEE 3rd Real-Time and Intelligent Edge Computing Workshop, RAGE 2024

In response to the exponential growth of e-commerce, our paper addresses the transformation of warehouse operations towards mega warehouses, necessitating advanced digitalization. We focus on the integration and optimization of edge AI technologies to enhance operational efficiency, accuracy, and timeliness in logistic warehouses. We propose a novel edge AI architecture tailored to the processes of warehouse operations ensuring that digitalization aligns with operational workflows. Utilizing a real-world warehouse equipped with over 60 cameras as a testbed, we demonstrate the practical application and benefits of edge computing in logistics. Our experiments have shown significant potential improvements in energy efficiency and timeliness, crucial metrics for the successful integration of edge AI technologies in warehouses.

DOI： 10.1109/RAGE62451.2024.00010

Enhancing Group Telepresence Interaction through Seamless Inverse Panorama Projection on Spherical Display

Hayashida, N; Katayama, S; Urano, K; Yonezawa, T; Kawaguchi, N

COMPANION OF THE 2024 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, UBICOMP COMPANION 2024 page： 286 - 289 2024

Language：English Publishing type：Research paper (scientific journal) Publisher：UbiComp Companion 2024 - Companion of the 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing

In recent years, advancements in telepresence technology have made remote communication and collaboration easier. MetaPo is a system that uses spherical displays to seamlessly integrate physical and digital interactions. However, conventional inverse panorama techniques face challenges such as image seams, coverage issues, and overlapping displays. To address these challenges, this study proposes an inverse panorama technique based on coordinate transformation, enhancing visual continuity and user experience. Additionally, evaluation methods necessary to demonstrate the effectiveness of the proposed method in improving the quality of remote communication have been devised. This research provides a novel solution to challenges in spherical display technology and paves the way for more immersive telepresence experiences.

DOI： 10.1145/3675094.3678369

Demonstration:Remote 3D Scanning with VR and Robotic Arm

Usami, R; Watanabe, K; Gushi, Y; Tsutsui, S; Watanabe, Y; Kano, K; Aikawa, Y; Shimura, K; Hayashida, N; Urano, K; Yonezawa, T; Kawaguchi, N

COMPANION OF THE 2024 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, UBICOMP COMPANION 2024 page： 201 - 204 2024

Although VR headsets have gained widespread acceptance, their potential for real-world actuation remains underexplored. We propose a system that allows to work in VR space using a robotic arm and VR headset, focusing on 3D scanning as the task. The robotic arm is equipped with an RGB-D camera to achieve remote 3D scanning. This system enables immersive remote work and enhances the link between real space and VR space by reproducing the real objects into the VR space.

DOI： 10.1145/3675094.3677548

Composite Image Generation Using Labeled Segments for Pattern-Rich Dataset without Unannotated Target

Kano, K; Mori, Y; Higashiura, K; Hossain, T; Katayama, S; Urano, K; Yonezawa, T; Kawaguchi, N

COMPANION OF THE 2024 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, UBICOMP COMPANION 2024 page： 507 - 512 2024

Although object detection technology using cameras offers potential for various applications, it incurs dataset creation costs to train new models where general-purpose models are ineffective, such as in industrial settings. We have previously developed a semi-automated annotation framework that employs optical flow and representation learning techniques to reduce human effort significantly. However, it was likely to cause unintended annotation omissions and mistakes compared to manual annotation. In this study, we propose a composite image generation approach to create omission-free and pattern-rich datasets. The proposed method synthesizes natural-looking images without unannotated targets by placing labeled foreground segments at their original positions on targetless background frames collected with the same fixed-point cameras. Evaluation with video footage in a logistics warehouse confirmed that improved dataset reliability led to higher model performance.

DOI： 10.1145/3675094.3678447

Panoramic Ceiling Image Synthesis Method Prioritizing Fixture Outlines using an Omnidirectional Camera Reviewed

深層学習PDRとBLEビーコンを用いたハイブリッド測位

加納一馬，東浦圭亮，瀧上昂希，山口公平，永田吉輝，片山晋，浦野健太，米澤拓郎，河口信夫

HCGシンポジウム 2023 2023.12

Digitization and Analysis Framework for Warehouse Truck Berth Reviewed

Yokoyama, K; Katayama, S; Urano, K; Yonezawa, T; Kawaguchi, N

2023 FOURTEENTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORK, ICMU 2023.12

Kohama D., Nagata Y., Yasutake K., Urano K., Katayama S., Yonezawa T., Kawaguchi N.

2023 14th International Conference on Mobile Computing and Ubiquitous Network, ICMU 2023 2023.12

Authorship：Last author Language：English Publishing type：Research paper (international conference proceedings) Publisher：2023 14th International Conference on Mobile Computing and Ubiquitous Network, ICMU 2023

The manual creation of a ceiling plan consumes many human resources to confirm the current state of existing buildings for the renovation. Especially the positions and the types of existing fixtures are important. In this paper, we propose a synthesis method for a panoramic ceiling image using a video shot by an omnidirectional camera. We utilize a Visual SLAM method to map the positions of omnidirectional video frames including the ceiling. We prioritize the clear depiction of fixture outlines for easier identification of the types of ceiling fixtures. To draw clear fixture outlines in the resulting image, each fixture is referred from the single video frame that captures it most clearly. In the experiment, we collected an omnidirectional video in the indoor area of approximately 273 square meters with multiple rooms. We evaluated the synthesized image for positional accuracy of the ceiling fixtures, and our proposed method demonstrated higher accuracy compared to the baseline.

DOI： 10.23919/ICMU58504.2023.10412256

Digitization and Analysis Framework for Warehouse Truck Berth

Yokoyama K., Katayama S., Urano K., Yonezawa T., Kawaguchi N.

2023 14th International Conference on Mobile Computing and Ubiquitous Network, ICMU 2023 2023.12

Language：English Publishing type：Research paper (scientific journal) Publisher：2023 14th International Conference on Mobile Computing and Ubiquitous Network, ICMU 2023

In distribution warehouses, various forms of data transformation are underway, such as the conversion of data related to receiving and inventory management. Distribution warehouses have designated areas known as truck berths, where trucks are parked for loading/unloading. While data collection is expected to enhance work efficiency at these truck berths, there is no data regarding the status of work in progress in the unloading space, and no system is in place to analyze the work. Consequently, it is unclear which tasks are problematic and how to enhance efficiency. To address this issue, this paper proposes a framework for analyzing the loading/unloading situation at truck berths with the objective of enhancing berth utilization efficiency and work efficiency. Specifically, we employed a fixed camera for object detection through instance segmentation. This approach enables us to understand the situation of trucks, unloading spaces, and workers. The training data were annotated using a large amount of real-world data, allowing for the measurement and analysis of the efficiency of loading/unloading operations. By calculating the amount of cargo based on the floor space, we assessed the efficiency of unloading operations per truck. Through the analysis of both efficient and inefficient operations, insights for enhancing work efficiency were provided.

DOI： 10.23919/ICMU58504.2023.10412228

360 Robot Hand Interaction for Group Telepresence with MetaPo

Human Mobility Prediction Challenge: Next Location Prediction using Spatiotemporal BERT Invited Reviewed

Haru Terashima, Naoki Tamura, Kazuyuki Shoji, Shin Katayama, Kenta Urano, Takuro Yonezawa, Nobuo Kawaguchi

ACM SIGSPATIAL 2023 Workshop HuMob 2023 2023.11

Watanabe Y., Hayashida N., Katayama S., Urano K., Yonezawa T., Kawaguchi N.

ACM International Conference Proceeding Series page： 183 - 185 2023.11

Language：English Publishing type：Research paper (scientific journal) Publisher：ACM International Conference Proceeding Series

In this demonstration paper, we present the RHS360, a 360-degree robotic hand system designed to facilitate communication across spatial domains. The RHS360 is capable of providing continuous alignment between the user's position in the cyber space and the robotic hand's position. Furthermore, it allows users in the cyber space to reposition the robotic hand to accommodate their movements within the space. Our system not only enables communication, including gestures, through the use of the robotic hand but also provides essential social cues that are crucial in effective communication.

DOI： 10.1145/3627050.3630730

Wildlife Spotting and Sharing System for Kenyan Safari Game Drives

Shimura K., Katayama S., Urano K., Leleito E., Yonezawa T., Kawaguchi N.

ACM International Conference Proceeding Series page： 150 - 153 2023.11

Language：English Publishing type：Research paper (scientific journal) Publisher：ACM International Conference Proceeding Series

Traditional wildlife spotting on Kenyan Safari Game Drives, rooted in visual scouting and sporadic communication, encounters challenges in animal detection efficiency and environmental preservation. In light of rejuvenating post-pandemic tourism and enhancing safari experiences, this study proposes a wildlife spotting and sharing system. The methodology melds wildlife detection and sharing technologies, anchored by three core principles: preserving chance of encounters, regulating information accessibility, and endorsing environmental conservation. The system architecture employs sensors, GPS, and tablet terminals for real-Time data acquisition, animal identification, and information propagation. This approach aims to nurture an engaging, efficient, and eco-conscious wildlife spotting and sharing experience, potentially setting a benchmark for sustainable wildlife tourism in similar wildlife-rich regions.

DOI： 10.1145/3627050.3630727

360 Robot Hand System for Omni-directional Interaction by Multiple Users

Watanabe Y., Hayashida N., Katayama S., Urano K., Yonezawa T., Kawaguchi N.

ACM International Conference Proceeding Series page： 295 - 299 2023.11

Language：English Publishing type：Research paper (scientific journal) Publisher：ACM International Conference Proceeding Series

The rise of diverse digital environments like digital twins and the metaverse emphasizes the importance of telepresence methods for linking users across different spaces. These methods aim to boost communication and services between these spaces. This paper introduces RHS360, a 360-degree robot hand system designed for inter-spatial communication. RHS360 ensures the robot hand aligns precisely with the user in cyberspace, adjusting based on the user's movements in the virtual realm. This enables the robot hand not only to aid communication and gestures but also to convey crucial social cues, enhancing the overall communication experience. Additionally, a user survey was conducted, revealing that observing the robot hand's movements significantly improved understanding their partner's thoughts and fostered a greater sense of intimacy. These findings suggest that the proposed method enhances communication between different spaces.

DOI： 10.1145/3627050.3631573

Gait-Robust Heading Estimation Using Horizontal Acceleration for Smartphone-based PDR Reviewed

Kazuma Kano, Takuto Yoshida, Shin Katayama, Kenta Urano, Takuro Yonezawa, and Nobuo Kawaguchi

Proceedings of the Work-in-Progress Papers at the 13th International Conference on Indoor Positioning and Indoor Navigation (IPIN-WiP 2023) 2023.9

天伏図作成補助システムにおける全方位カメラを用いた天井設備の多視点画像抽出手法

小濱大輝, 永田吉輝, 安武和成, 浦野健太, 片山晋, 米澤拓郎, 河口信夫

2023年(第41回)電気設備学会全国大会 2023.8

駅ホームの人流センサおよび改札通過情報による電車乗降情報の分析

浦野健太，米澤拓郎，河口信夫

第51回可視化情報シンポジウム 2023.8

LiDARの視野を考慮した能動的な人流計測手法の検討

下里浩昇，片山晋，浦野健太，米澤拓郎，河口信夫

第51回可視化情報シンポジウム 2023.8

Mobility Link XR: Interspace Interaction System in Electric Wheelchair

Hayashida N., Shimosato H., Urano K., Yonezawa T., Kawaguchi N.

Communications in Computer and Information Science Vol. 1833 CCIS page： 314 - 320 2023.7

Language：English Publishing type：Research paper (scientific journal) Publisher：Communications in Computer and Information Science

This research proposes a communication system called Mobility Link XR that connects physical space and cyberspace with mobility. Mobility Link XR is a system that enables remote users to view panoramic video from a 360-degree camera attached to a mobility vehicle in different space by wearing a VR device, and mobility users to view the remote user as an avatar by wearing an MR device. In this way, sharing space in three dimensions using XR enables a higher level of human communication. In this paper, we apply Mobility Link XR to an electric wheelchair and design two types of scenarios: an assistance mode that reproduces the positional relationship of communication in a conventional wheelchair, and a passenger mode that reproduces the positional relationship inside a vehicle, which is said to be a suitable distance for conversation. We also evaluated the reproducibility of communication in the wheelchair and the effectiveness of communication using the avatar. The results showed that the reproducibility of voice and emotion was highly evaluated and that the side-by-side positional relationship enabled higher quality communication as the avatar was more easily seen and felt present.

DOI： 10.1007/978-3-031-35992-7_43

Open-Domain Dialogue Management Framework Across Multiple Device for Long-Term Interaction Reviewed

Understanding Regional Characteristics Through EC Data Analysis Reviewed

Yamaguchi K., Shoji K., Tamura N., Sakakura N., Matsukura Y., Hiranaga Y., Shimomura K., Urano K., Yonezawa T., Kawaguchi N.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Vol. 14036 LNCS page： 390 - 404 2023.7

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Vol. 14013 LNCS page： 354 - 365 2023.7

点群データと基盤地図情報を用いた屋外自律移動ロボット向け地図の生成手法 Reviewed

相川雄也, 浦野健太, 片山晋, 米澤拓郎, 河口信夫

マルチメディア，分散，協調とモバイル(DICOMO2023)シンポジウム 2023.7

インスタンスセグメンテーションを用いたトラックバース状況の分析 Reviewed

横山皓大, 片山晋, 浦野健太, 米澤拓郎, 河口信夫

マルチメディア，分散，協調とモバイル(DICOMO2023)シンポジウム 2023.7

全方位カメラによる設備外形を考慮した天井パノラマ画像合成手法 Reviewed

小濱大輝, 永田吉輝, 安武和成, 浦野健太, 片山晋, 米澤拓郎, 河口信夫

マルチメディア，分散，協調とモバイル(DICOMO2023)シンポジウム 2023.7

天井設置型の複数マイクと話者の位置情報を用いた発話方向推定手法 Reviewed

市川直人, 戸出悠太 , 片山晋, 浦野健太, 米澤拓郎, 河口信夫

マルチメディア，分散，協調とモバイル(DICOMO2023)シンポジウム 2023.7

複数ユーザによる全方位インタラクションを可能にする360ロボットハンドシステム Reviewed

渡辺圭貴，林田望海，片山晋，浦野健太，米澤拓郎，河口信夫

マルチメディア，分散，協調とモバイル(DICOMO2023)シンポジウム 2023.7

通過情報を活用した移動経路分析・応用手法の評価と応用

永田吉輝, 浦野健太, 米澤拓郎, 河口信夫

第78回UBI研究会 2023.5

滞在ビッグデータに基づくエリア分散表現の加法構成性の分析と活用

田村直樹, 浦野健太, 米澤拓郎, 河口信夫

第107回MBL研究会 2023.5

移動ビッグデータを用いた公共空間の価値評価手法

坂倉波輝, 米澤拓郎, 田村直樹, 永田吉輝, 庄子和之, 山口公平, 浦野健太, 河口信夫

第107回MBL研究会 2023.5

IRIS: Interpretable Rubric-Informed Segmentation for Action Quality Assessment

Matsuyama H., Kawaguchi N., Lim B.Y.

International Conference on Intelligent User Interfaces, Proceedings IUI page： 368 - 378 2023.3

Language：English Publishing type：Research paper (scientific journal) Publisher：International Conference on Intelligent User Interfaces, Proceedings IUI

AI-driven Action Quality Assessment (AQA) of sports videos can mimic Olympic judges to help score performances as a second opinion or for training. However, these AI methods are uninterpretable and do not justify their scores, which is important for algorithmic accountability. Indeed, to account for their decisions, instead of scoring subjectively, sports judges use a consistent set of criteria - rubric - on multiple actions in each performance sequence. Therefore, we propose IRIS to perform Interpretable Rubric-Informed Segmentation on action sequences for AQA. We investigated IRIS for scoring videos of figure skating performance. IRIS predicts (1) action segments, (2) technical element score differences of each segment relative to base scores, (3) multiple program component scores, and (4) the summed final score. In a modeling study, we found that IRIS performs better than non-interpretable, state-of-the-art models. In a formative user study, practicing figure skaters agreed with the rubric-informed explanations, found them useful, and trusted AI judgments more. This work highlights the importance of using judgment rubrics to account for AI decisions.

DOI： 10.1145/3581641.3584048

CrowdFlowTransformer: Capturing Spatio-Temporal Dependence for Forecasting Human Mobility Reviewed

Choya T., Tamura N., Katayama S., Urano K., Yonezawa T., Kawaguchi N.

2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2023 page： 496 - 501 2023.3

Authorship：Last author Language：English Publishing type：Research paper (international conference proceedings) Publisher：2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events, PerCom Workshops 2023

Crowd flow forecasting is expected to have a wide range of applications such as human resource allocation, guidance design, marketing, disaster mitigation and congestion prediction for avoiding epidemic such as COVID-19. Crowd flow forecasting is challenging because it requires considering both the task of capturing the temporal dependency of data and capturing the spatial dependence. To address these challenges, in this paper, we propose a mechanism for referencing time-series features that are important for forecasting and incorporating graph convolution into Transformer, and we introduce CrowdFlowTransformer(CF-Transformer), a deep learning model based on Google's Transformer framework captures the Spatio-temporal dependency of time series. CF-Transformer captures the time series dependency by extracting important local time series from the past time series, inputting them to the decoder of Transformer, and encoding critical features into the model's input. We adapted CF-Transformer to a real-world crowd flow dataset. We evaluated it by comparing its forecasting accuracy with conventional models, and the results demonstrate that our model outperforms the conventional models.

DOI： 10.1109/PerComWorkshops56833.2023.10150301

Coordinated autonomous networks for remote synchronized video services with the autonomous mobility robots - prelude implementation Reviewed

異種空間間のコミュニケーションを実現するロボット型メタポータルMetaPoにおけるロボットハンド・インタラクション

渡辺圭貴, 林田望海, 浦野健太, 米澤拓郎, 河口信夫

インタラクション2023 2023.3

自律ネットワークにつながる自律移動ロボットを用いる映像サービス実現に向けた初期プロトタイプの開発

髙橋美乃里, 山本秀樹, 岩下将人, 金田悠作, Leon Wong, 浦野健太, 米澤拓郎, 河口信夫

電子情報通信学会　総合大会 2023.3

Yamamoto, HH; Iwashita, M; Kondo, N; Wong, L; Kaneta, Y; Urano, K; Yonezawa, T; Kawaguchi, N

2023 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION, ICAIIC page： 598 - 601 2023.2

A Survey of Ground Truth Measurement Systems for Indoor Positioning Reviewed

Yoshida Takuto, Kaji Katsuhiko, Ogiso Satoki, Ichikari Ryosuke, Uchiyama Hideaki, Kurata Takeshi, Kawaguchi Nobuo

Journal of Information Processing Vol. 31 ( 0 ) page： 15 - 20 2023.1

Authorship：Last author Language：English Publishing type：Research paper (scientific journal) Publisher：Information Processing Society of Japan

Various types of indoor positioning methods have been proposed. Accordingly, various ground-truth measurement methods have also been used. The selection of the ground-truth measurement method is crucial when appropriately evaluating the indoor positioning methods. In recent years, data-driven methods have been actively proposed, making the ground-truth measurement even more critical. Most existing survey papers only focus on classifying indoor positioning methods and datasets for evaluation. Our survey paper investigates the methods to measure the ground truth. First, we list the primary examples of ground truth measurement systems and summarize their characteristics, such as the scale, accuracy, and frequency when collecting ground truth. Then, we classify them into the following five categories: OMC, ToF/MFPS, SLAM, Manual, and Others. Their advantages and disadvantages are also discussed based on four indices: accuracy, coverage, device cost, and labor cost. Finally, we discuss the appropriate way to select the ground-truth measurement system for quantitative evaluation. Our survey will be the guideline for selecting an appropriate ground-truth measurement system for indoor positioning and indoor navigation.

DOI： 10.2197/ipsjjip.31.15

XR Communication System for Remote Control Wheelchairs Reviewed

Hironori Shimosato, Nozomi Hayashida, Kenta Urano, Takuro Yonezawa, Nobuo Kawaguchi

IoT '22: Proceedings of the 12th International Conference on the Internet of Things page： 219 - 223 2022.11

Dialogue Response Generation for Text-Based Dialogue Systems with Emotion Regulation

KATAYAMA Shin, YONEZAWA Takuro, KAWAGUCHI Nobuo

Journal of Japan Society for Fuzzy Theory and Intelligent Informatics Vol. 34 ( 3 ) page： 568 - 578 2022.8

Language：English Publishing type：Research paper (scientific journal) Publisher：Japan Society for Fuzzy Theory and Intelligent Informatics

Dialogue systems that handle emotions have been shown to improve user satisfaction and increase positive interactions, and are expected to play a role as a digital partner that accompanies humans. In order for dialogue systems to recognize user emotions and express their own emotions, emotion regulation methods that select appropriate emotions from the context of the dialogue are indispensable. In this paper, we propose a text-based dialogue framework that performs emotion regulation, which estimates appropriate emotions during response. Our proposed method estimates appropriate emotions by considering the semantic and emotional context of the user’s text, and generates dialogue responses with emotional expressions using a neural network. The effectiveness of the proposed method was demonstrated through automatic evaluation using an evaluation metrics for the quality of dialogue generation and human evaluation by 100 subjects collected through a crowdsourcing.

DOI： 10.3156/jsoft.34.3_568

Towards Mobility-related Law Search by Utilizing Relationship between Laws

KOMAMIZU Takahiro, TOYAMA Katsuhiko, KAWAGUCHI Nobuo, SANO Tomoya

JSAI Technical Report, Type 2 SIG Vol. 2022 ( SWO-057 ) page： 04 2022.8

MetaPo: A Robotic Meta Portal for Interspace Communication Reviewed

Yonezawa T., Hayashida N., Przybilla J., Kyono Y., Urano K., Kawaguchi N.

Proceedings - SIGGRAPH 2022 Posters 2022.7

Authorship：Last author Language：English Publishing type：Research paper (scientific journal) Publisher：Proceedings - SIGGRAPH 2022 Posters

We introduce MetaPo, a mobile robot with spheric display, 360° media I/O and robotic hands for creating a unified model of interspace communication. MetaPo works as a portal between pairs of physical-physical, cyber-cyber and cyber-physical spaces to provide 1) panoramic communication for multiple remote users, and 2) immersive interspace migration with mobility functionality. The paper overviews our concept and first prototype of MetaPo with its hardware and software implementation.

DOI： 10.1145/3532719.3543255

Smartphone Localization with Solar-Powered BLE Beacons in Warehouse Reviewed

Kano Kazuma, Yoshida Takuto, Hayashida Nozomi, Asai Yusuke, Matsuyama Hitoshi, Katayama Shin, Urano Kenta, Yonezawa Takuro, Kawaguchi Nobuo

DISTRIBUTED, AMBIENT AND PERVASIVE INTERACTIONS, SMART ENVIRONMENTS, ECOSYSTEMS, AND CITIES Vol. 13325 page： 291 - 310 2022.6

Authorship：Last author Language：English Publishing type：Research paper (scientific journal) Publisher：Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Workloads in logistics warehouses have been increasing to meet growing demand, and a labor shortage has become a problem. Utilizing information of laborer locations leads to an increase in productivity. We propose an integrated positioning method using solar-powered Bluetooth Low Energy (BLE) beacons. They are easy to install and maintenance-free since they can work without power sources. However, their advertisement interval depends on illuminance and is unstable. Moreover, there are many obstructions in warehouses, such as shelves and products, which cause signal attenuation, interference, and packet losses. We apply particle filters, map matching, and speed prediction with a neural network model to improve robustness and accuracy. We installed 94 beacons in a logistics warehouse. We evaluated the accuracy and found that our method is more accurate than a baseline method.

DOI： 10.1007/978-3-031-05463-1_21

RobotNEST: Toward a Viable Testbed for IoT-Enabled Environments and Connected and Autonomous Robots Reviewed

Time-Sensitive Cooperative Perception for Real-Time Data Sharing over Vehicular Communications: Overview, Challenges, and Future Directions Invited Reviewed International coauthorship

Shunsuke Aoki, Takuro Yonezawa, Nobuo Kawaguchi, Peter Steenkiste, Ragunathan Raj Rajkumar

IEEE Internet of Things Magazine 2022.6

大規模屋外施設におけるWi-Fiパケットセンサへの影響と利活用の検証 Reviewed

村井大地, 浦野健太, 望月祐洋, 米澤拓郎, 西田純二, 河口信夫

情報処理学会デジタルプラクティス Vol. 3 ( 2 ) page： 12 - 21 2022.4

機械学習による慣性センサを用いた転倒動作検知に関する研究

東浦圭亮，吉田拓人，加納一馬，瀧上昂希，山口公平，浦野健太，青木俊介，米澤拓郎，河口信夫

社会システムと情報技術研究ウィーク (WSSIT2022) 2022.3

Aoki Shunsuke, Yonezawa Takuro, Kawaguchi Nobuo

IEEE SENSORS LETTERS Vol. 6 ( 2 ) 2022.1

Authorship：Last author Language：English Publishing type：Research paper (scientific journal) Publisher：IEEE Sensors Letters

Autonomous mobile robots (AMRs), including delivery robots, security robots, and automated wheelchairs, are very promising for improving the quality of life, safety, mobility, and productivity. To deploy such sensor-rich AMRs in real-world society, we have to resolve not only technical challenges but also ethical and societal issues. In addition, since multiple companies are developing different types of AMRs individually, we have to design and develop practical platform to enable safe cooperation and collaboration before using them in the society. Hence, in this letter, we present a viable Nagoya Experimental Site and Testbed named <italic>RobotNEST</italic> developed at Nagoya City, Japan, where we leverage vehicular communications and edge/cloud computing technologies to develop cooperative mobile robots. RobotNEST provides real-world AMRs, experimental fields, learning kits, and infrastructural sensors and communications, including 5G private networks. We also introduce multiple developed applications at RobotNEST that enable safe cooperation for autonomous robots. Finally, we discuss the scalability and limitations of the testbed and conclude with future research directions.

DOI： 10.1109/LSENS.2021.3139624

Synthetic People Flow: Privacy-Preserving Mobility Modeling from Large-Scale Location Data in Urban Areas Reviewed

Tamura N., Urano K., Aoki S., Yonezawa T., Kawaguchi N.

Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST Vol. 419 LNICST page： 553 - 567 2022

Authorship：Last author Language：English Publishing type：Research paper (scientific journal) Publisher：Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST

Recently, there has been an increasing demand for traffic simulation and congestion prediction for urban planning, especially for infection simulation due to the Covid-19 epidemic. On the other hand, the widespread use of wearable devices has made it possible to collect a large amount of user location history with high accuracy, and it is expected that this data will be used for simulation. However, it is difficult to collect location histories for the entire population of a city, and detailed data that can reproduce trajectories is expensive. In addition, such personal location histories contain private information such as addresses and workplaces, which restricts the use of raw data. This paper proposes Agent2Vec, a mobility modeling model based on unsupervised learning. Using this method, we generate synthetic human flow data without personal information.

DOI： 10.1007/978-3-030-94822-1_36

A Data-Driven Approach for Online Pre-impact Fall Detection with Wearable Devices Reviewed

Yoshida Takuto, Kano Kazuma, Higashiura Keisuke, Yamaguchi Kohei, Takigami Koki, Urano Kenta, Aoki Shunsuke, Yonezawa Takuro, Kawaguchi Nobuo

SENSOR- AND VIDEO-BASED ACTIVITY AND BEHAVIOR COMPUTING, ABC 2021 Vol. 291 page： 133 - 147 2022

Authorship：Last author Language：English Publishing type：Research paper (scientific journal) Publisher：Smart Innovation, Systems and Technologies

The implementation of wearable airbags to prevent fall injuries depends on accurate pre-impact fall detection and a clear distinction between activities of daily living (ADL) and them. We propose a novel pre-impact fall detection algorithm that is robust against ambiguous falling activities. We present a data-driven approach to estimate the fall risk from acceleration and angular velocity features and use thresholding techniques to robustly detect a fall before impact. In the experiment, we collect simulated fall data from subjects wearing an inertial sensor on their waist. As a result, we succeeded in significantly improving the accuracy of fall detection from 50.00 to 96.88%, the recall from 18.75 to 93.75%, and the specificity 81.25 to 100.00% over the baseline method.

DOI： 10.1007/978-981-19-0361-8_8

How to monitor multiple autonomous vehicles remotely with few observers: An active management method

物流倉庫における人・配送ロボット協調のためのセンサ統合システム

河口信夫

情報処理学会研究報告 (MBL) Vol. 2022-MBL-104 page： 1 - 8 2022

大規模移動履歴に基づく滞在推定結果を用いた公園の滞在特徴の分類手法

河口信夫

情報処理学会第104回MBL研究会 Vol. 2022-MBL-104 page： 1 - 6 2022

3次元LiDARを搭載した自律走行ロボットを用いたWi-Fi電波強度および通信速度測定システム

盛下泰暉, 浅井悠佑, 浦野健太, 米澤拓郎, 河口信夫

情報処理学会研究報告 Vol. 2021-MBL-101 ( 34 ) page： 1 - 6 2021.12

スマートメータを利用した行動認識のための電気使用量クラスタリングに関する検討

深谷暢也，浦野健太，青木俊介, 米澤拓郎, 河口信夫

令和3年度電気・電子・情報関係学会東海支部連合 2021.9

Ding M., Takeuchi E., Ishiguro Y., Ninomiya Y., Kawaguchi N., Takeda K.

IEEE Intelligent Vehicles Symposium, Proceedings Vol. 2021-July page： 1168 - 1173 2021.7

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：IEEE Intelligent Vehicles Symposium, Proceedings

In this research, we proposed an active management method to tele-monitor and tele-operate more autonomous vehicles (AVs) with few observers by adjusting the movement of the AVs actively. A management system is created to get the status from the AVs and separate the monitoring requirement to the observers optimally. When the requirements might be intensive, the management system can also adjust the movements of the AVs actively to distribute the monitoring time, which can make the observers monitor more vehicles. We implement and verify the management system in an autonomous driving simulator - CARLA for the limited number of AVs and observers. Based on the data acquired from the driving simulator, we also create a numerical simulator and tested our method with the pairs of a large number of AVs and observers. The result of both simulators shows that our method can reduce the utilization degree of observers and make them monitor more AVs.

DOI： 10.1109/IV48863.2021.9575997

An End-to-End BLE Indoor Localization Method Using LSTM

都市を対象とした大規模移動履歴に基づく疑似人流データ生成手法

田村直樹, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2021シンポジウム 2021.7

自律移動ロボットのセンサ機器を用いた人流推定手法の提案

下里浩昇, 片山晋, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2021シンポジウム 2021.7

大規模公園環境におけるWiFiパケットセンサデータの利活用に関する分析と課題

村井大地, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2021シンポジウム 2021.7

IoTに基づく潜在的社会需要の推定と柔軟なサービス需給交換基盤

永田吉輝, 村井大地, 片山晋, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2021シンポジウム 2021.7

時空間ルーティングを用いた複数自律移動ロボットの協調走行

福島悠人, 浅井悠佑, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2021シンポジウム 2021.7

赤外線グリッドセンサを用いた深層学習での人の位置推定手法の検討

戸出悠太, 片山晋, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2021シンポジウム 2021.7

Transformerモデルを用いた人流の時系列予測

挺屋友幹, 片山晋, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2021シンポジウム 2021.7

加速度の時空間情報を考慮した進行方向推定手法の検討

吉田拓人, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2021シンポジウム 2021.7

都市を対象とした大規模移動履歴に基づく疑似人流データ生成手法

田村直樹, 浦野健太, 青木俊介, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2021シンポジウム 2021.7

時間・空間的相関を考慮した人流の時系列予測手法

挺屋友幹, 青木俊介, 米澤拓郎, 河口信夫

研究報告ユビキタスコンピューティングシステム（UBI） 2021.3

Urano Kenta, Hiroi Kei, Yonezawa Takuro, Kawaguchi Nobuo

Journal of Information Processing Vol. 29 ( 0 ) page： 58 - 69 2021

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：Information Processing Society of Japan

This paper proposes an indoor localization method for Bluetooth Low Energy (BLE) devices using an end-to-end LSTM neural network. We focus on a large-scale indoor space where there is a tough environment for wireless indoor localization due to signal instability. Our proposed method adopts end-to-end localization, which means input is a time-series of signal strength and output is the estimated location at the latest time in the input. The neural network in our proposed method consists of fully-connected and LSTM layers. We use a custom-made loss function with 3 error components: MSE, the direction of travel, and the leap of the estimated location. Considering the difficulty of data collection in a short preparation term, the data generated by a simple signal simulation is used in the training phase, before training with a small amount of real data. As a result, the estimation accuracy achieves an average of 1.92m, using the data collected in GEXPO exhibition in Miraikan, Tokyo. This paper also evaluates the estimation accuracy assuming the troubles in a real operation.

DOI： 10.2197/ipsjjip.29.58

A Basic Study on Ballroom Dance Figure Classification with LSTM Using Multi-modal Sensor

Matsuyama H, Hiroi K, Kaji K, Yonezawa T, Kawaguchi N

Smart Innovation, Systems and Technologies Vol. 204 page： 209 - 226 2021

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：Smart Innovation, Systems and Technologies

The paper presents a ballroom dance figure classification method with LSTM using video and wearable sensors. Ballroom dance is a popular sport among people regardless of age or sex. However, learning ballroom dance is very difficult for less experienced dancers as it has many complex types of “dance figures”, which is a completed set of footsteps. Therefore, we aim to develop a system to assist dance exercise which gives advice proper to each dance figure characteristic by recognizing dance figures correctly. While the major approach to recognize dance performance is to utilize video, we cannot simply adopt it for ballroom dance because the images of dancers overlap each other. To solve the problem, we propose a hybrid figure recognition method combining video and wearable sensors to enhance its accuracy and robustness. We collect video and wearable sensor data of seven dancers including acceleration, angular velocity, and body parts location change by pose estimation. After that, we preprocess them and put them into an LSTM-based deep learning network. As a result, we confirmed that our approach achieved an F1-score of 0.86 for 13 figure types recognition using the multi-modal sensors with trial-based fivefold cross-validation. We also performed user-based cross-validation, and sliding window algorithms. In addition, we compared the results with our previous method using Random Forest and also evaluated the robustness with occlusions. We found the LSTM-based method worked better than Random Forest with keypoint data. On the other hand, LSTM could not perform well with a sliding window algorithm. We consider the LSTM-based method would work better with a larger dance figure data, which is our next work. In addition, we will investigate how to solve occlusion problems with pose estimation.

DOI： 10.1007/978-981-15-8944-7_13

An Active Management Method for Monitoring Multiple Autonomous Vehicles Remotely with Few Observers

DING Ming, Takeuchi Eijiro, ISHIGURO Yoshio, NINOMIYA Yoshiki, KAWAGUCHI Nobuo, TAKEDA Kazuya

The Proceedings of JSME annual Conference on Robotics and Mechatronics (Robomec) Vol. 2021 ( 0 ) page： 2P1-B10 2021

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：The Japan Society of Mechanical Engineers

In this research, we proposed an active management method to monitor more autonomous vehicles (AVs) remotely with few observers. A management system is created to get the status from the AVs and separate the monitoring requirement to the observers optimally. When the requirements might be intensive, the management system can adjust the movements of the AVs actively to distribute the monitoring time, which can make the observers monitor more vehicles. Based on the data acquired from the driving simulator, we create a numerical simulator and test our method with different pairs of a large number of AVs and observers. The result showed that our method can reduce the utilization degree of observers and make them monitor more AVs.

DOI： 10.1299/jsmermd.2021.2p1-b10

RGNet: Robust Gravity Estimation Neural Network for IMU-based Localization Using Smartphone Reviewed

Yoshida T., Urano K., Aoki S., Yonezawa T., Kawaguchi N.

13th International Conference on Mobile Computing and Ubiquitous Network, ICMU 2021 2021

Authorship：Last author Language：English Publishing type：Research paper (scientific journal) Publisher：13th International Conference on Mobile Computing and Ubiquitous Network, ICMU 2021

With the rapid development of Micro Electro-Mechanical Systems (MEMS) technologies, indoor navigation and localization with Inertial Measurement Unit (IMU) has been increasingly feasible. IMU-based indoor localization is a low-cost, energy-efficient, and infrastructure-free approach. There are various methods for it, and most of them require gravity estimation (e.g. the projection of angular velocity, the extraction of horizontal acceleration). In particular, when you use a smartphone, it changes the orientation of its IMU frequently, therefore the gravity estimation needs to be more robust to sensor orientation and its noise. In this paper, we propose a gravity estimation method based on deep learning called RGNet (Robust Gravity Estimation Neural Network) that is robust to sensor orientation and noise. We train an LSTM (Long short-term memory)-based neural network that estimates gravity from acceleration and angular velocity. Furthermore, for the problem that it is difficult to prepare the ground truth of gravity directly, we propose a method to train the gravity estimation neural network indirectly using the heading, taking advantage of the fact that the heading can be estimated from the gravity and angular velocity. The evaluation results show that the accuracy of the proposed method outperformed the baseline gravity estimation method (Android API, Low-pass filter, and Extended Kalman filter). We also confirmed that the accuracy of IMU-based localization is affected by the difference in gravity estimation methods.

DOI： 10.23919/ICMU50196.2021.9638853

Estimating and Leveraging Latent Social Demand Based on IoT sensors: An Empirical Study in a Large Public Park Reviewed

Person-Flow Estimation with Preserving Privacy Using Multiple 3D People Counters Reviewed

Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST Vol. 372 page： 615 - 634 2021

Nagata Y, Murai D, Katayama S, Urano K, Aoki S, Yonezawa T, Kawaguchi N

13th International Conference on Mobile Computing and Ubiquitous Network, ICMU 2021 page： 1 - 8 2021

DigiMobot: Digital Twin for Human-Robot Collaboration in Indoor Environments. Reviewed

Yuto Fukushima, Yusuke Asai, Shunsuke Aoki, Takuro Yonezawa, Nobuo Kawaguchi

IEEE Intelligent Vehicles Symposium(IV) Vol. 2021-July page： 55 - 62 2021

A Gaze-Based Unobstructive Information Selection by Context-Aware Moving UI in Mixed Reality Reviewed

Hayashida N, Matsuyama H, Aoki S, Yonezawa T, Kawaguchi N

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) Vol. 12782 LNCS page： 301 - 315 2021

ER-Chat: 感情制御を伴う対話システムにおけるテキスト応答生成手法

片山晋, 米澤拓郎, 大越匡, 中澤仁, 河口信夫

情報処理学会研究報告ユビキタスコンピューティングシステム(UBI) Vol. 2020-UBI-68 No.26 2020.12

感情制御を伴うテキスト対話システムの実現

片山晋, 米澤拓郎, 大越匡. 中澤仁. 河口信夫

人間情報学会オーラルセッション Vol. 第37回 2020.12

Person-Flow Estimation with Preserving Privacy using Multiple 3D People Counters Reviewed

Yoshiteru Nagata, Takuro Yonezawa, Nobuo Kawaguchi

Transaction of 5th EAI International Conference on IoT in Urban Space 2020.12

Autonomous Mobile Robot System for Human Machine Harmonization using Harmoawre Invited

Nobuo Kawaguchi

IEEE InTech Forum 2020.12

COVID-19における人流分析とHarmoware-VISによる可視化

河口信夫

電子情報通信学会 SeMI 研究会 2020.11

COVID-19における人流分析とHarmoware-VISによる可視化 Invited

河口信夫

電子情報通信学会 SeMI 研究会 2020.11

社交ダンスの動作特性を考慮したマルチモーダルセンサによるダンスフィガー認識 Reviewed

松山仁, 浦野健太，廣井慧, 梶克彦, 米澤拓郎, 河口信夫

情報処理学会論文誌 Vol. Vol. 61 ( No. 10 ) 2020.10

A Basic Study on Ballroom Dance Figure Classification with LSTM using Multi-modal Sensor Reviewed

Hitoshi Matsuyama, Kei Hiroi, Katsuhiko Kaji, Takuro Yonezawa, Nobuo Kawaguchi

2nd International Conference on Activity and Behavior Computing 2020.9

分散型人流・交通流シミュレータの大規模環境における動作実証

平野流，米澤拓郎，河口信夫

電気・電子・情報関係学会東海支部連合大会 2020.9

エリア毎の滞在利用情報を用いた移動遷移モデルの分析

庄子和之，米澤拓郎，河口信夫

電気・電子・情報関係学会東海支部連合大会 2020.9

Wi-Fiパケットセンサを用いた大規模レジャー施設における人流分析

村井大地，米澤拓郎，河口信夫

電気・電子・情報関係学会東海支部連合大会 2020.9

Civic Crowdsensing through Location-aware Virtual Monsters Reviewed

Takuro Yonezawa, Mina Sakamura, Jin Nakazawa, Nobuo Kawaguchi

22nd INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION (HCII 2020) 2020.7

Civic Crowdsensing through Location-aware Virtual Monsters Reviewed

Takuro Yonezawa, Mina Sakamura, Jin Nakazawa, Nobuo Kawaguchi

22nd INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION (HCII 2020) Vol. 12203 LNCS page： 464 - 476 2020.7

Nurse Care Activity Recognition Challenge: A Comparative Verification of Multiple Preprocessing Approaches Reviewed

Hitoshi Matsuyama, Takuto Yoshida, Nozomi Hayashida, Yuto Fukushima, Takuro Yonezawa, Nobuo Kawaguchi

UbiComp-ISWC '20: Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computer page： 414 2020.7

人と協調する倉庫内配送ロボットのシミュレーションを用いた最適化の検討

浅井悠佑, 廣井慧, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2020シンポジウム 2020.6

大規模分散環境における人流・交通流シミュレータの設計と課題

平野流, 廣井慧, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2020シンポジウム 2020.6

複数の3D通過センサによるプライバシーを考慮した人流推定手法

永田吉輝, 廣井慧, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2020シンポジウム 2020.6

粒度の異なる多様な時空間データの保存・抽出システムの設計と実装

鷲田健斗, 廣井慧, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2020シンポジウム 2020.6

滞在に関する時系列情報を用いたエリア毎の分散表現の検討

庄子和之,廣井慧,米澤拓郎,酒田理人,河口信夫

マルチメディア、分散、協調とモバイル DICOMO2020シンポジウム 2020.6

Wi-Fiパケットセンサを用いた大規模レジャー施設における行動パターンの分析

村井大地, 廣井慧, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2020シンポジウム 2020.6

ドキドキをセンシングして可視化するLEDライティングデバイス

浦野健太, 廣井慧, 米澤拓郎, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2020シンポジウム 2020.6

CityFeder: 異種スマートシティ基盤を柔軟につなぐプログラマブル・フェデレーション機構

米澤拓郎, 河崎隆文, 吉田拓人, 伊藤友隆, 上津原一利, 古城篤, 中澤仁, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2020シンポジウム 2020.6

CityFeder: 異種スマートシティ基盤を柔軟につなぐプログラマブル・フェデレーション機構

米澤拓郎, 河崎隆文, 吉田拓人, 伊藤友隆, 上津原一利, 古城篤, 中澤仁, 河口信夫

マルチメディア、分散、協調とモバイル DICOMO2020シンポジウム 2020.6

Synerex: 超スマート社会を支える需給交換プラットフォームの設計コンセプトと機能

河口信夫, 米澤拓郎, 廣井慧

情報処理学会研究報告ユビキタスコンピューティングシステム(UBI) Vol. 2020-UBI-65(49) 2020.3

歩容に頑健なPDRのための深層学習を用いた進行方向推定手法

吉田拓人, 廣井慧, 米澤拓郎, 河口信夫

研究報告ユビキタスコンピューティングシステム（UBI） 2020.3

柔軟に構成を変更可能な人流・交通流シミュレータの設計と評価

平野流, 廣井慧, 米澤拓郎, 河口信夫

研究報告モバイルコンピューティングとパーベイシブシステム研究会（MBL） 2020.3

マルチモーダル社交ダンス認識における従来手法と深層学習の比較評価

松山仁, 廣井慧, 梶克彦, 米澤拓郎, 河口信夫

研究報告ユビキタスコンピューティングシステム（UBI） 2020.3

個人に依存した時空間セマンティクスの分散表現の検討

庄子和之, 米澤拓郎, 廣井慧, 河口信夫

情報処理学会研究報告ユビキタスコンピューティングシステム（UBI） Vol. 2020-UBI-65(30) 2020.3

高精度MI磁気センサを用いたSMM位置推定の精度評価

渡邊康祐 , 廣井慧 , 米澤拓郎 , 梶克彦 , 河口信夫

情報処理学会研究報告ユビキタスコンピューティングシステム（UBI） Vol. 2020-UBI-65(31) 2020.3

倉庫における人と自律配送ロボットの協調制御手法の基礎的検討

浅井悠佑, 廣井慧, 米澤拓郎, 河口信夫

情報処理学会研究報告ユビキタスコンピューティングシステム（UBI） Vol. 2020-UBI-65(33) 2020.3

ドキドキをセンシングして可視化するLEDライティングデバイスの検討

浦野健太，廣井慧，米澤拓郎，河口信夫

研究報告モバイルコンピューティングとパーベイシブシステム研究会（MBL） 2020.3

回転磁石マーカを用いたスマートフォン2次元経路推定 Reviewed

渡邊康祐, 廣井慧, 米澤拓郎, 梶克彦, 河口信夫

情報処理学会論文誌 Vol. Vol.61 ( No.2 ) 2020.2

地形の影響を考慮した積雪時のバス遅延の分析と到着時刻予測への適用 Reviewed

廣井慧, 花之内広太郎, 今井瞳, 河口信夫

電気学会論文誌Ｃ（電子・情報・システム部門誌） Vol. 140 巻 ( 2 号 ) page： 257 - 266 2020.2

An Analysis of Bus Traffic Delay with Geographical Characteristics and an Application to Arrival Time Prediction in Snowfall Situation

Hiroi Kei, Hananouchi Koutaro, Imai Hitomi, Kawaguchi Nobuo

IEEJ Transactions on Electronics, Information and Systems Vol. 140 ( 2 ) page： 257 - 266 2020

Language：English Publishing type：Research paper (scientific journal) Publisher：The Institute of Electrical Engineers of Japan

Bus transportation service is more influenced than other public transport by various factors such as traffic congestion, weather condition, number of passengers, traffic signals. These factors often cause delay and the users may feel inconvenience while waiting at the bus stop. In the case of snowfall event, a large delay occurs, which greatly reduces the convenience of the bus. This paper aims at highly accurate arrival time prediction for each bus stop section in snow event in urban area. We investigate vulnerability of bus operations to snowfall and incorporate into predictions using geographical characteristics. In each bus stop section, we estimate geographical characteristics (gradient angle and gradient direction) and snow accumulation amount with detailed spatial resolution as factors affecting bus delay. Then, we evaluate a prediction accuracy using the arrival time prediction model with multiple regression analysis and the Kalman filter. As a result of the multiple regression analysis, it was found that the geographical characteristics of each bus stop section were the explanatory variables that greatly affect the bus delay at snowfall event. Furthermore, we predicted the bus arrival time using actual bus operation data. Of the 29 routes, 18 routes showed improvement in the predicted arrival time.

DOI： 10.1541/ieejeiss.140.257

Nurse Care Activity Recognition Challenge: A Comparative Verification of Multiple Preprocessing Approaches

Matsuyama, H; Yoshida, T; Hayashida, N; Fukushima, Y; Yonezawa, T; Kawaguchi, N

UBICOMP/ISWC '20 ADJUNCT: PROCEEDINGS OF THE 2020 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2020 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS page： 414 - 418 2020

ユーザの休日における外出先POI情報に基づくプライバシーを考慮した居住地属性推定手法の一検討

湯木悠太, 米澤拓郎, 廣井慧, 河口信夫

情報処理学会研究報告モバイルコンピューティングとパーベイシブシステム研究会（MBL） Vol. Vol.2019-MBL-03 ( No.7 ) 2019.11

Anomaly Event Detection using Bus Management Information -Case Study of Anomaly Operation Status Detection and Its Application Reviewed

Wei Sun , Kei Hiroi , Takuro Yonezawa , Nobuo Kawaguchi

( 2019-ITS-79(5) ) page： 1 - 5 2019.11

Anomaly Event Detection using Bus Management Information -Case Study of Anomaly Operation Status Detection and Its Application Reviewed

Wei Sun, Kei Hiroi, Takuro Yonezawa, Nobuo Kawaguchi

( 2019-ITS-79(5) ) page： 1 - 5 2019.11

An End-to-End BLE Indoor Location Estimation Method using LSTM Reviewed

Kenta Urano, Kei Hiroi, Takuro Yonezawa, Nobuo Kawaguchi

ICMU2019 2019.11

An End-to-End BLE Indoor Location Estimation Method using LSTM Reviewed

Kenta Urano, Kei Hiroi, Takuro Yonezawa, Nobuo Kawaguchi

ICMU2019 2019.11

An End-to-End BLE Indoor Location Estimation Method Using LSTM

Urano K, Hiroi K, Yonezawa T, Kawaguchi N

2019 12th International Conference on Mobile Computing and Ubiquitous Network, ICMU 2019 2019.11

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：2019 12th International Conference on Mobile Computing and Ubiquitous Network, ICMU 2019

Indoor location estimation has long been researched to realize location-based services. In this paper, we propose an indoor location estimation method for Bluetooth Low Energy (BLE) devices using end-to-end LSTM neural network. We focus on large-scale exhibition where is a tough environment for wireless indoor location estimation due to signal strength instability. To achieve higher accuracy, deep learning based methods are proposed rather than trilateration or fingerprint. Existing deep learning based methods estimate the location from the probabilities using the difference of query signal strength and autoencoder-reconstruction of it. Proposed method adopts end-to-end location estimation, which means the neural network takes a time-series of signal strength and outputs the estimated location at the latest time in the input time-series. We also build a loss function which takes how a person walks into account. Considering the difficulty of data collection within a short preparation term of an exhibition, the data generated by a simple simulation is used in the training phase before training with a small amount of real data. As a result, the estimation accuracy is average of 1.92m, using the data collected in GEXPO exhibition in Miraikan, Tokyo. Proposed method outperforms our previous trilateration based method's 4.51m average.

DOI： 10.23919/ICMU48249.2019.9006638

An Empirical Study of Adaptive Training of Daily Activity Classifier and Chat Application Designed for the Elderly to Go Out Reviewed

Sampling Rate Dependency in Pedestrian Walking Speed Estimation using DualCNN-LSTM Reviewed

Takuto Yoshida, Junto Nozaki, Kenta Urano, Kei Hiroi, Katsuhiko Kaji, Takuro Yonezawa, Nobuo Kawaguchi

Ubicomp2019 2019.10

End-to-End Walking Speed Estimation Method for Smartphone PDR using DualCNN-LSTM Reviewed

Nobuo Kawaguchi, Junto Nozaki, Takuto Yoshida, Kei Hiroi, Takuro Yonezawa, Katsuhiko Kaji

The Tenth International Conference on Indoor Positioning and Indoor Navigation(IPIN2019). 2019.9

End-to-End Walking Speed Estimation Method for Smartphone PDR using DualCNN-LSTM Reviewed

Nobuo Kawaguchi, Junto Nozaki, Takuto Yoshida, Kei Hiroi, Takuro Yonezawa, Katsuhiko Kaji

The Tenth International Conference on Indoor Positioning and Indoor Navigation(IPIN2019). 2019.9

Ballroom Dance Step Type Recognition by Random Forest Using Video and Wearable Sensor Reviewed

Hitoshi Matsuyama, Kei Hiroi, Katsuhiko Kaji, Takuro Yonezawa, Nobuo Kawaguchi

UBICOMP/ISWC'19 2019.9

歩容に頑健なPDRのための深層学習を用いた歩行速度推定手法

吉田拓人, 野崎惇登, 廣井慧, 梶克彦, 米澤拓郎, 河口信夫

研究報告ユビキタスコンピューティングシステム（UBI） 2019.8

ニューラルネットワークを用いた大規模イベント向けBLE屋内位置推定の比較評価

浦野健太，廣井慧，米澤拓郎，河口信夫

マルチメディア、分散協調とモバイルシンポジウム2019論文集(DICOMO2019) 2019.7

回転磁石マーカを用いたスマートフォン所持者の2次元経路推定

渡邊康祐, 廣井慧, 米澤拓郎, 梶克彦, 河口信夫

マルチメディア、分散協調とモバイルシンポジウム2019論文集(DICOMO2019) 2019.7

人の回避行動を考慮した移動ロボットの経路計画法の検討

浅井悠佑，廣井慧，米澤拓郎，河口信夫

マルチメディア、分散協調とモバイルシンポジウム2019論文集(DICOMO2019) 2019.7

異なるサービス提供者間におけるトラストモデルとその実装に関する研究

平野流，廣井慧，米澤拓郎，河口信夫

マルチメディア、分散協調とモバイルシンポジウム2019論文集(DICOMO2019) 2019.7

自動運転車のレーザセンサを利用した路面性状調査 Reviewed

浦野健太, 廣井慧, 加藤真平, 駒形望, 河口信夫

マルチメディア、分散協調とモバイルシンポジウム2018論文集(DICOMO2018) Vol. - ( - ) page： 264 - 269 2019.7

Akira Tamamori, Yoshio Ishiguro, Kei Hiroi, Nobuo Kawaguchi, Kazuya Takeda

IPSJ Transactions on Consumer Device & Systems (CDS) Vol. 9 ( 2 ) page： 33 - 46 2019.5

Hybrid activity recognition for ballroom dance exercise using video and wearable sensor

Matsuyama H., Hiroi K., Kaji K., Yonezawa T., Kawaguchi N.

2019 Joint 8th International Conference on Informatics, Electronics and Vision, ICIEV 2019 and 3rd International Conference on Imaging, Vision and Pattern Recognition, icIVPR 2019 with International Conference on Activity and Behavior Computing, ABC 2019 page： 112 - 117 2019.5

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：2019 Joint 8th International Conference on Informatics, Electronics and Vision, ICIEV 2019 and 3rd International Conference on Imaging, Vision and Pattern Recognition, icIVPR 2019 with International Conference on Activity and Behavior Computing, ABC 2019

In this paper, we propose a hybrid activity recognition method for ballroom dance exercise using video and wearable sensor. The purpose of our research is to design a mechanism to support ballroom dance exercise, and this paper reports the first part to design a mechanism is to support ballroom dance exercise, and this paper reports the first outcome to achieve the purpose - recognizing ballroom dance exercise. There are two conceivable ways to recognize dance exercise: videos and wearable sensor. However, each of them has its disadvantages. Using video is a good way to recognize the movement of the body. However, it cannot provide us accurate timing or strength of foot actions because the number of their flames per seconds is too small to recognize the fast movements of dancers. On the other hand, while a wearable sensor is good at recognizing foot timing and strength, it is not good at recognizing the movement of the whole body. Therefore we propose a hybrid recognition method utilizing the merits of both video and wearable sensor. This paper focuses to recognize four different types of steps in Latin American, a kind of ballroom dance. For each step, we record wearable sensing data and videos. As a result, it is found that the accuracy of step recognition is improved by adding wearable sensing data to video data shot from two different angles.

DOI： 10.1109/ICIEV.2019.8858524

End-to-end walking speed estimation method for smartphone PDR using DualCNN-LSTM

Road Surface Condition Inspection Using a Laser Scanner Mounted on an Autonomous Driving Car Reviewed

Kenta Urano, Kei Hiroi, Shinpei Kato, Nozomi Komagata, Nobuo Kawaguchi

PerVehicle 2019 Vol. - ( - ) page： 826 - 831 2019.3

Kawaguchi N, Nozaki J, Yoshida T, Hiroi K, Yonezawa T, Kaji K

CEUR Workshop Proceedings Vol. 2498 page： 463 - 470 2019

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：CEUR Workshop Proceedings

Most of the current inertial positioning systems can be categorized as the strapdown algorithm and the step-and-heading approach. However, for the strapdown algorithm using smartphone as a sensor device, the accuracy of the current MEMS based accelerometer are not enough for estimating relative movement. Also, for the step-and-heading approach, robust estimation of step length is always difficult. In this paper, we propose an end-to-end walking speed estimation method using Deep Learning to overcome these problems. By using our method, we can achieve a smartphone PDR with higher accuracy and better robustness to gait type.

Sampling Rate Dependency in Pedestrian Walking Speed Estimation Using DualCNN-LSTM

Flood Area Estimation using Personal Location Data - Case Study of Japan Floods in 2018-

Hiroi Kei, Yoshida Takahiro, Yamagata Yoshiki, Kawaguchi Nobuo

2019 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS (PERCOM WORKSHOPS) page： 285-291 2019

Yoshida Takuto, Nozaki Junto, Urano Kenta, Hiroi Kei, Kaji Katsuhiko, Yonezawa Takuro, Kawaguchi Nobuo

UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS page： 862-868 2019

Editor's Message to Special Issue of Pervasive System and Intelligent Transportation Systems for Future Life. Reviewed

Nobuo Kawaguchi

JIP Vol. 27 ( 0 ) page： 1 - 1 2019

A Smartphone 3D Positioning Method using a Spinning Magnet Marker. Reviewed

Kosuke Watanabe, Kei Hiroi, Takeshi Kamiyama, Hiroyuki Sano, Masakatsu Tsukamoto, Masaji Katagiri, Daizo Ikeda, Katsuhiko Kaji, Nobuo Kawaguchi

JIP Vol. 27 ( 0 ) page： 10 - 24 2019

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：Information Processing Society of Japan

In recent years, the importance of location information has increased due to the popularization of terminals such as smartphones. Our purpose is to estimate the 3D position of smartphones within several centimeters. This location information can reveal a person's behavior patterns and subject of interest. A method based on dynamic magnetism can estimate the 3D position of a terminal within several centimeters, and it is robust against the environment. However, since the performance of the smartphone's magnetic sensor is limited, this method cannot be used in smartphones. In this research, we propose a smartphone 3D positioning method using a Spinning Magnet Marker (SMM) that spins a powerful neodymium magnet with a motor. Magnetoquasistatic field generated by an SMM is detected by a magnetic sensor mounted on a smartphone, and the 3D position of a smartphone based on the SMM is estimated from the magnetism. We developed an SMM with a stepper motor to improve estimation accuracy. In addition, we studied the magnetism generated by an SMM and derive equations to estimate the 3D position of a smartphone. Furthermore, we improved the estimation accuracy and expanded coverage by introducing a noise reduction method. We evaluate the estimation accuracy of the proposed method. When the azimuth angle is 0°, the elevation angle is 0°, and the distance is 3m, the azimuth angle is estimated with a mean error of 1°, the elevation angle is estimated with a mean error of 4°, and the distance is estimated with a mean error of 9cm.

DOI： 10.2197/ipsjjip.27.10

Ballroom Dance Step Type Recognition by Random Forest Using Video and Wearable Sensor

Matsuyama Hitoshi, Hiroi Kei, Kaji Katsuhiko, Yonezawa Takuro, Kawaguchi Nobuo

配布型BLEタグとタンデムスキャナを用いた屋内位置推定手法 Reviewed

浦野健太, 廣井慧, 梶克彦, 河口信夫

情報処理学会論文誌 Vol. 60 page： 58 - 75 2019

Road Surface Condition Inspection Using a Laser Scanner Mounted on an Autonomous Driving Car. Reviewed

Kenta Urano, Kei Hiroi, Shinpei Kato, Nozomi Komagata, Nobuo Kawaguchi

IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2019, Kyoto, Japan, March 11-15, 2019 page： 826 - 831 2019

Hybrid Activity Recognition for Ballroom Dance Exercise using Video and Wearable Sensor

Matsuyama Hitoshi, Hiroi Kei, Kaji Katsuhiko, Yonezawa Takuro, Kawaguchi Nobuo

2019 JOINT 8TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2019 3RD INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR) WITH INTERNATIONAL CONFERENCE ON ACTIVITY AND BEHAVIOR COMPUTING (ABC) page： 112 - 117 2019

Road Surface Condition Inspection Using a Laser Scanner Mounted on an Autonomous Driving Car

Urano Kenta, Hiroi Kei, Kato Shinpei, Komagata Nozomi, Kawaguchi Nobuo

2019 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS (PERCOM WORKSHOPS) page： 826 - 831 2019

Gait Dependency of Smartphone Walking Speed Estimation using Deep Learning. Reviewed

Takuto Yoshida, Junto Nozaki, Kenta Urano, Kei Hiroi, Takuro Yonezawa, Nobuo Kawaguchi

Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys 2019, Seoul, Republic of Korea, June 17-21, 2019. page： 641 - 642 2019

A Smartphone Short-Range Path Estimation with Hyperbolic Function for Spinning Magnet Marker. Reviewed

Kosuke Watanabe, Nobuo Kawaguchi

IEEE International Conference on Pervasive Computing and Communications Workshops, PerCom Workshops 2019, Kyoto, Japan, March 11-15, 2019 page： 459 - 460 2019

An End-to-End BLE Indoor Location Estimation Method Using LSTM

Urano Kenta, Hiroi Kei, Yonezawa Takuro, Kawaguchi Nobuo

2019 TWELFTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORK (ICMU) 2019

Basic Study of BLE Indoor Localization using LSTM-based Neural Network. Reviewed

Kenta Urano, Kei Hiroi, Takuro Yonezawa, Nobuo Kawaguchi

Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys 2019, Seoul, Republic of Korea, June 17-21, 2019. page： 558 - 559 2019

Capturing Subjective Time as Context and It's Applications. Reviewed

Takuro Yonezawa, Yuuki Nishiyama, Kei Hiroi, Nobuo Kawaguchi

Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys 2019, Seoul, Republic of Korea, June 17-21, 2019. page： 647 - 648 2019

Compensation Scheme for PDR Using Component-Wise Error Models. Reviewed

Junto Nozaki, Kei Hiroi, Katsuhiko Kaji, Nobuo Kawaguchi

Human Activity Sensing - Corpus and Applications page： 29 - 46 2019

End-to-end walking speed estimation method for smartphone PDR using DualCNN-LSTM

Kawaguchi N., Nozaki J., Yoshida T., Hiroi K., Yonezawa T., Kaji K.

CEUR Workshop Proceedings Vol. 2498 page： 463 - 470 2019

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：CEUR Workshop Proceedings

Image Translation Between Sar and Optical Imagery with Generative Adversarial Nets. Reviewed

Human Activity Sensing Corpus and Applications Preface

Kawaguchi Nobuo, Nishio Nobuhiko, Roggen Daniel, Inoue Sozo, Pirttikangas Susanna, Van Laerhoven Kristof

HUMAN ACTIVITY SENSING: CORPUS AND APPLICATIONS page： V - V 2019

An End-to-End BLE Indoor Location Estimation Method Using LSTM

Urano Kenta, Hiroi Kei, Yonezawa Takuro, Kawaguchi Nobuo

2019 TWELFTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORK (ICMU) 2019

A Slope-robust Cascaded Ground Segmentation in 3D Point Cloud for Autonomous Vehicles

Narksri Patiphon, Takeuchi Eijiro, Ninomiya Yoshiki, Morales Yoichi, Akai Naoki, Kawaguchi Nobuo

2018 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC) page： 497-504 2018

Activity Recognition Using Dual-ConvLSTM Extracting Local and Global Features for SHL Recognition Challenge

Yuki Yuta, Nozaki Junto, Hiroi Kei, Kaji Katsuhiko, Kawaguchi Nobuo

PROCEEDINGS OF THE 2018 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2018 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC'18 ADJUNCT) page： 1643-1651 2018

IMAGE TRANSLATION BETWEEN SAR AND OPTICAL IMAGERY WITH GENERATIVE ADVERSARIAL NETS

Enomoto Kenji, Sakurada Ken, Wang Weiming, Kawaguchi Nobuo, Matsuoka Masashi, Nakamura Ryosuke

IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM page： 1752-1755 2018

Image-Matching Based Identification of Store Signage Using Web-Crawled Information

Liao Chenyi, Wang Weimin, Sakurada Ken, Kawaguchi Nobuo

IEEE ACCESS Vol. 6 page： 45590-45605 2018

Short Segment Random Forest with Post Processing Using Label Constraint for SHL Recognition Challenge

Matsuyama Hitoshi, Urano Kenta, Hiroi Kei, Kaji Katsuhiko, Kawaguchi Nobuo

A Smartphone Positioning Method Based on Spinning Magnet Marker Reviewed

武島知勲, 梶克彦, 廣井慧, 河口信夫, 神山剛, 太田賢, 稲村浩

情報処理学会論文誌ジャーナル(Web) Vol. 59 ( 1 ) page： 138 - 149 2018

Kenji Enomoto, Ken Sakurada, Weiming Wang, Nobuo Kawaguchi, Masashi Matsuoka, Ryosuke Nakamura

2018 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2018, Valencia, Spain, July 22-27, 2018 Vol. 2018-July page： 1752 - 1755 2018

Scale Estimation of Monocular SfM for a Multi-modal Stereo Camera. Reviewed

Shinya Sumikura, Ken Sakurada, Nobuo Kawaguchi, Ryosuke Nakamura

CoRR Vol. abs/1810.11856 2018

仮想空間を利用した空間認識能力の計測手法の提案 Reviewed

嶋田光佑, 廣井慧, 梶克彦, 河口信夫

情報処理学会論文誌 Vol. 59 ( 1 ) page： 150 - 167 2018

Reflectance Intensity Assisted Automatic and Accurate Extrinsic Calibration of 3D LiDAR and Panoramic Camera Using a Printed Chessboard

Wang Weimin, Sakurada Ken, Kawaguchi Nobuo

REMOTE SENSING Vol. 9 ( 8 ) 2017.8

FloodEye: Real-time flash flood prediction system for urban complex water flow

Hiroi K., Kawaguchi N.

Proceedings of IEEE Sensors 2017.1

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：Proceedings of IEEE Sensors

This study presents a water-level sensor system that has multiple functions: real-time river-level monitoring and high accurate flood prediction for urban complex water flow (CWF) flooding caused by Localized Heavy Rain. Traditional water-level sensors for large-scale river can detect water-level rising, though they have limitations in detecting urban river dyke height to alert about flooding. This is a result of various riverside environmental limitations. Additionally, previous prediction methods are difficult to detect CWF flooding with high accuracy because water rising differ depends on a location's environment. Therefore, we propose a detection scheme for CWF by developing a water-level sensor system that works in various installation environments using infrared image processing with both low installation and operation cost. We implemented a CWF prediction system that produces accurate and early predictions using a Linear Regression (LR) of deep learning approach with data assimilation. Evaluating based on actual installations (over 1,000 days, 13 locations), our system proved to accurately monitor and predict water-level rising after 5 minutes.

DOI： 10.1109/ICSENS.2016.7808626

Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets

Enomoto Kenji, Sakurada Ken, Wang Weimin, Fukui Hiroshi, Matsuoka Masashi, Nakamura Ryosuke, Kawaguchi Nobuo

2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW) page： 1533-1541 2017

5th Int. Workshop on Human Activity Sensing Corpus and Applications (HASCA): Towards Open-Ended Context Awareness

Kawaguchi Nobuo, Inoue Sozo, Nishio Nobuhiko, Pirttikangas Susanna, Roggen Daniel, Van Laerhoven Kristof

PROCEEDINGS OF THE 2017 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2017 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC '17 ADJUNCT) page： 530-536 2017

A Location Estimation Method using Mobile BLE Tags with Tandem Scanners

Urano Kenta, Hiroi Kei, Kaji Katsuhiko, Kawaguchi Nobuo

Compensation Scheme for PDR using Sparse Location and Error Model

Nozaki Junto, Hiroi Kei, Kaji Katsuhiko, Kawaguchi Nobuo

Event.Locky: System of event-data extraction from webpages based onweb mining Reviewed

Chenyi Liao, Kei Hiroi, Katsuhiko Kaji, Ken Sakurada, Nobuo Kawaguchi

Journal of Information Processing Vol. 25 ( 0 ) page： 321 - 330 2017

Language：English Publishing type：Research paper (scientific journal) Publisher：Information Processing Society of Japan

Nearby event data, such as those for exhibitions and sales promotions, may help users spend their free time more efficiently. However, most event data are hidden in millions of webpages, which is very time-consuming for a user to find such data. To address this issue, we use web mining that extracts event data from webpages. In this paper, we propose and discuss the implementation of Event.Locky – a system for extracting event data from webpages in a user-defined area and displaying them to a user in a spatial-temporal structure. Furthermore, we design two core algorithms for event data extraction in Event.Locky: webpage-data-record extraction and event-record classification. The former is used to convert a semi-structural HTML document into processable structured data. The latter filters out non-event data from extracted data records using machine learning. We trained and evaluated Event.Locky with an actual dataset composed by 96 restaurants and shops at Nagoya train station. As a result, our event-classification algorithm achieved an F1 score of 91.61%, an increase of 3.07% from current event-classification algorithms. The combination of our event-classification algorithm and our data-record-extraction algorithm achieved F1 score 83.96% to extract event records from webpages. That increased 1.6% from current algorithm. Finally, we discuss the feasibility of Event.Locky in an actual online environment through the implementation of a demonstration application.

DOI： 10.2197/ipsjjip.25.321

Dense Optical Flow based Change Detection Network Robust to Difference of Camera Viewpoints. Reviewed

通路に設置した回転する磁石による歩行者の通過検出手法 Reviewed

武島知勲, 梶克彦, 廣井慧, 河口信夫, 神山剛, 太田賢, 稲村浩

情報処理学会論文誌 Vol. 58 ( 1 ) page： 43 - 56 2017

Pedestrian Indoor Positioning Method Using Magnetic Data Reviewed

村田雄哉, 梶克彦, 廣井慧, 河口信夫, 神山剛, 太田賢, 稲村浩

情報処理学会論文誌ジャーナル(Web) Vol. 58 ( 1 ) page： 57 - 67 2017

Ken Sakurada, Weimin Wang, Nobuo Kawaguchi, Ryosuke Nakamura

CoRR Vol. abs/1712.02941 2017

A three-dimensional smartphone positioning method using a spinning magnet marker. Reviewed

Kosuke Watanabe, Kei Hiroi, Takeshi Kamiyama, Hiroyuki Sano, Masakatsu Tsukamoto, Masaji Katagiri, Daizo Ikeda, Katsuhiko Kaji, Nobuo Kawaguchi

Tenth International Conference on Mobile Computing and Ubiquitous Network, ICMU 2017, Toyama, Japan, October 3-5, 2017 Vol. 2018-January page： 1 - 7 2017

A Three-Dimensional Smartphone Positioning Method using a Spinning Magnet Marker

Watanabe Kosuke, Hiroi Kei, Kamiyama Takeshi, Sano Hiroyuki, Tsukamoto Masakatsu, Katagiri Masaji, Ikeda Daizo, Kaji Katsuhiko, Kawaguchi Nobuo

2017 TENTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORK (ICMU) page： 38 - 44 2017

「究極のヒューマンインタフェースの実現を目指して」

河口信夫

知能と情報 Vol. 28 ( 6 ) page： 169 - 169 2016.12

Wi-Fi Human Behavior Analysis and BLE Tag Localization: A Case Study at an Underground Shopping Mall Reviewed

Nobuo Kawaguchi, Kei Hiroi, Atsushi Shionozaki, Masamichi Asukai, Toshimune Nasu, Yu Hashimoto, Takeharu Nakamura, Tetsuya Gotou, Shinsuke Ando

ACM International Conference Proceeding Series Vol. 28- page： 151 - 159 2016.11

Language：English Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery

Techniques for obtaining customers' behavior (dwell time, count, and flow) in a shopping mall or large exhibit are highly sought-after by organizers or shop owners. Additionally, ways of effectively directing customers from cyber space such as the Web or smartphone apps to physical retail stores are also in high demand. "Online to Offline (O2O) Marketing" has recently been attracting attention to make these a reality. However, the know-how accumulated through "O2O Marketing" is not shared widely as it can be sensitive for business and customer's privacy. In this paper, we provide the knowledge obtained through the demonstration experiments held by the "O2O Digital Marketing Study Group" organized by NPO Lisra at a large underground shopping mall in Nagoya. 250 BLE tags and 12 Wi-Fi scanners were installed in this mall. We also organized a "coupon campaign" to increase the number of participants. We were able to effectively collect visiting customer count measurements via Wi-Fi scanners irrespective of the anonymization of BSSID, as our results showed similar trends collected by optical human detectors inherently installed at the venue. This paper provides preliminary insight into understanding the behaviors of retail shoppers and we believe this is a firm starting point for this area.

DOI： 10.1145/2994374.2994403

PIEM: Path Independent Evaluation Metric for Relative Localization Reviewed

Masaaki Abe, Katsuhiko Kaji, Kei Hiroi, Nobuo Kawaguchi

2016 International Conference on Indoor Positioning and Indoor Navigation, IPIN 2016 page： 1 - 8 2016.11

Language：English Publishing type：Research paper (international conference proceedings) Publisher：Institute of Electrical and Electronics Engineers Inc.

There are many methods for indoor positioning. These methods are divided into the relative localization and absolute localization. In the relative localization, one widely used method is Pedestrian Dead Reckoning (PDR). Relative localization estimates the moving distance, orientation, and height of the pedestrian. However, relative localization has a problem caused by an accumulated error: the longer the path, the worse the accuracy of relative localization. There is another problem in the existing evaluating metrics: they compare only the actual location and the estimated location of the destination. Relative localization also has this evaluation problem. We propose PIEM: Path Independent Evaluation Metric for Relative Localization. PIEM is a path independent evaluation metric, considering the complexity of the path
distance, orientation, and height. Then we evaluate these three factors of relative localization in addition to the position. Our proposed method showed more consistent results for the complexity of the path than the existing methods of relative localization evaluation.

DOI： 10.1109/IPIN.2016.7743587

Urban planning: Is a networked compact city vision realistic?

Incremental and Enhanced Scanline-Based Segmentation Method for Surface Reconstruction of Sparse LiDAR Data

Wang Weimin, Sakurada Ken, Kawaguchi Nobuo

REMOTE SENSING Vol. 8 ( 11 ) 2016.11

Kawaguchi N.

Labor Forces and Landscape Management: Japanese Case Studies page： 373-380 2016.1

Estimating 3D Pedestrian Trajectories using Stability of Sensing Signal

Kaji Katsuhiko, Kawaguchi Nobuo

2016 INTERNATIONAL CONFERENCE ON INDOOR POSITIONING AND INDOOR NAVIGATION (IPIN) page： . 2016

UbiComp/ISWC 2015 PDR challenge corpus Reviewed

Katsuhiko Kaji, Masaaki Abe, Weimin Wang, Kei Hiroi, Nobuo Kawaguchi

UbiComp 2016 Adjunct - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing page： 696 - 704 2016

Language：Japanese Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery, Inc

PDR (Pedestrian Dead Reckoning) is a very promising technology for indoor positioning. We held a technical challenge, entitled the UbiComp/ISWC 2015 PDR Challenge, consisting of the following three categories: Algorithm, Evaluation, and Exhibition. In this paper, we specially focus on collected data for PDR algorithm category. UbiComp/ISWC participants equip smartphone by hand and walk around the particular floors. The pedestrian sensing data is collected. The number of our prepared route pattern is 5. Over two days, we collected the sensing data of 105 subjects. The total number of collected pedestrian sensing data was 343. After removing faulty data, this number was 241 and the number of unique subjects was 103. Sensor types are accelerometer, gyro, magnetic, and air pressure. We, PDR Challenge organizers, provide the corpus as UbiComp/ISWC 2015 PDR Challenge Corpus. The corpus contains ground truth of 3-D coordinates of the pedestrian sensing data for each second.

DOI： 10.1145/2968219.2968276

HASC-PAC2016: Large scale human pedestrian activity corpus and its baseline recognition Reviewed

FloodEye: Real-time Flash Flood Prediction System for Urban Complex Water Flow

Hiroi Kei, Kawaguchi Nobuo

2016 IEEE SENSORS page： . 2016

Haruyuki Ichino, Katsuhiko Kaji, Ken Sakurada, Kei Hiroi, Nobuo Kawaguchi

UbiComp 2016 Adjunct - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing page： 705 - 714 2016

Language：Japanese Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery, Inc

Human activity recognition by wearable sensors will enable a next-generation human-oriented ubiquitous computing. However, most of the existing research on human activity recognition is based on a small number of subjects, and lab-created-data. To overcome this problem, we hold HASC Challenge as a technical challenge to collect the data for activity recognition. In addition to HASC Challenge, we collected indoor pedestrian sensing data of 107 people with a balance of gender and age (HASC-IPSC). Through these data collection, we gathered 111,968 sensor files of 510 subjects. For the convenience of the future researchers in this field, we combined them as a single corpus named HASC-PAC2016 and make it public. Baseline recognition result of HASC-PAC2016 segmented data is 73.4% accuracy for overall, 81.4% for limited by terminal position, and 85.1% with file-based recognition. For sequence data, we only get 73.4% even for limited subjects. This shows we need further research of activity recognition using HASC-PAC2016.

DOI： 10.1145/2968219.2968277

A Location Estimation Method using BLE Tags Distributed Among Participants of a Large-Scale Exhibition Reviewed

Measurement Methods of Spatial Ability using a Virtual Reality System

Shimada Kosuke, Hiroi Kei, Kawaguchi Nobuo, Kaji Katsuhiko

2016 NINTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORKING (ICMU) page： 80-85 2016

Multi-Algorithm On-Site Evaluation System for PDR Challenge

Kaji Katsuhiko, Kanagu Kohei, Murao Kazuya, Nishio Nobuhiko, Urano Kenta, Iida Hirokazu, Kawaguchi Nobuo

2016 NINTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORKING (ICMU) page： 74-79 2016

Kenta Urano, Kei Hiroi, Katsuhiko Kaji, Nobuo Kawaguchi

ADJUNCT PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING NETWORKING AND SERVICES (MOBIQUITOUS 2016) Vol. 28-November-2016 page： 124 - 129 2016

Language：Japanese Publishing type：Research paper (international conference proceedings) Publisher：ASSOC COMPUTING MACHINERY

Indoor location estimation is essential technology when we analyse the participants' activities in large-scale exhibition. There are some problems with existing methods such as PDR, ultrasound and laser range finder: installation location of measurement equipment at large site, cost for measurement equipment, and necessity of smartphone application. We focus on Bluetooth Low Energy(BLE). Currently, BLE technology is used as proximity notification for smart phones and cannot detect the exact distance between two BLE devices. This is because BLE radiowave is unstable and signal strength changes every time at the same distance. In this paper, we propose a location estimation method which utilizes BLE beacon tags and single board computers. In contrast to conventional ways using location-fixed BLE beacons, BLE beacon tags are distributed to participants at the event. Signal strengths of BLE advertising packets captured by multiple location-fixed scanners are used for location estimation. The method requires less cost for equipment and labor of installing an application. It can be used without complex initial setting. We had a data collection experiment at real large-scale exhibition. We estimate locations of participants by applying the proposed method to the collected data, then evaluate accuracy of estimation and analyse the activities such as the time of longer stay booths based on participants' occupation. As a result, we could track the movement of the participants to some meters error and find the characteristic booths based on longer-stay booths per occupations.

DOI： 10.1145/3004010.3004051

4th workshop on human activity sensing corpus and applications: Towards open-ended context awareness Reviewed

Nobuo Kawaguchi, Nobuhiko Nishio, Daniel Roggen, Sozo Inoue, Susanna Pirttikangas, Kristof Van Laerhoven

UbiComp 2016 Adjunct - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing page： 690 - 695 2016

Language：Japanese Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery, Inc

Current motion sensors in wearable devices are primarily used for simple orientation and motion sensing. They provide however signals related to more complex and subtle human behaviours which will enable next-generation human-oriented computing in scenarios of high societal value. This requires large scale human activity corpuses and improved methods to recognise activities and their context. This workshop deals with the challenges of designing reproducible experimental setups, running large-scale dataset collection campaigns, designing robust activity and context recognition methods and evaluating systems in the real world. As a special topic, we wish to reflect on the challenges and approaches to recognise activities outside of a pre-defined set to achieve an open-ended activity and context awareness. Following the success of previous years, this workshop is the place to share experiences on human activity corpus and their applications and to discuss the future of activity sensing, in particular towards open-ended contextual intelligence.

DOI： 10.1145/2968219.2968294

A better positioning with BLE tag by rssi compensation through crowd density estimation Reviewed

Kei Hiroi, Yoichi Shinoda, Nobuo Kawaguchi

UbiComp 2016 Adjunct - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing page： 831 - 840 2016

Language：Japanese Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery, Inc

We present a scheme that improves accuracy of 2.4GHz RF tag based indoor positioning. The accuracy of indoor positioning using 2.4GHz RF tags is affected by propagation loss caused by human body shielding, especially in crowded situations. This paper proposes a RSSI compensation scheme that estimate a crowd density level based on detected 2.4 GHz RSSI. We developed a scanner system to sense BLE (Bluetooth Low Energy) tag for 2.4 GHz RSSI compensation. We deployed 40 BLE scanners and over 100 BLE tags, and collected data for 100 participants at an actual event over a period of four days. Using the collected data, we estimated crowd density level that can be applied to the proposed compensation scheme based on theoretical methods on propagation loss. Our scheme resulted in 59.8% higher accuracy than simple positioning method without the compensation.

DOI： 10.1145/2968219.2968293

安定センシング区間検出に基づく3次元歩行軌跡推定手法 Reviewed

梶克彦, 河口信夫

情報処理学会論文誌 Vol. 57 ( 1 ) page： 12 - 24 2016

Multi-Algorithm On-Site Evaluation System for PDR Challenge Reviewed

Katsuhiko Kaji, Kohei Kanagu, Kazuya Murao, Nobuhiko Nishio, Kenta Urano, Hirokazu Iida, Nobuo Kawaguchi

2016 NINTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORKING (ICMU) page： 74 - 79 2016

Language：English Publishing type：Research paper (international conference proceedings) Publisher：IEEE

PDR (Pedestrian Dead Reckoning) is a very promising technology for indoor positioning. We held a technical challenge, entitled the UbiComp/ISWC 2015 PDR Challenge, consisting of the following three categories: a PDR algorithm category; a PDR Evaluation method category; and an exhibition. In this paper, we especially focus on several systems for the PDR algorithm category. A PDR skeleton was prepared for the participants. Using an Android skeleton, participants focus on implementing the PDR algorithm because of the skeleton's various functions, such as sensor data acquisition, trajectory visualization, and sensor data upload. The evaluation server evaluates the accuracy of each PDR algorithm automatically as often as sensor data is uploaded to the server and provides a trajectory image file so that participants can compare their PDR algorithms in real time.

DOI： 10.1109/ICMU.2016.7742094

FloodEye: Real-time Flash Flood Prediction System for Urban Complex Water Flow Reviewed

Kei Hiroi, Nobuo Kawaguchi

2016 IEEE SENSORS 2016

Language：English Publishing type：Research paper (international conference proceedings) Publisher：IEEE

Proceedings of the 7th ACM SIGSPATIAL International Workshop on Indoor Spatial Awareness, ISA 2015: Foreword

Li K.

Proceedings of the 7th ACM SIGSPATIAL International Workshop on Indoor Spatial Awareness, ISA 2015 page： . 2015.11

A proposal of IndoorGML extended data model for pedestrian-oriented voice navigation system Reviewed

Hirokazu Iida, Kei Hiroi, Katsuhiko Kaji, Nobuo Kawaguchi

Proceedings of the 7th ACM SIGSPATIAL International Workshop on Indoor Spatial Awareness, ISA 2015 page： 9 - 14 2015.11

Language：English Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery, Inc

We propose Landmark-Conscious Voice Navigation as one type of a pedestrian navigation system, which navigate users by only voice guidance. It is necessary to standardize data model in order to use this system widely. In a previous paper[1], we constructed a basic voice navigation system, which uses Open Street Map based data model. In this paper, at first, we conduct an experiment of voice navigation at an underground shopping area of Nagoya Station with two types of landmark descriptions. After that, we discuss what data structure is necessary to describe landmark information for voice navigation. Therefore, we propose to extend IndoorGML1.0 by adding landmark space as a new defined data model for voice navigation. The main contribution of this paper is that we conduct an experiment of voice navigation and research how different landmark descriptions affect users
furthermore, we discuss a IndoorGML extended data model for voice navigation.

DOI： 10.1145/2834812.2834814

Velobug: A mobile system for 3D indoor mapping Reviewed

Weimin Wang, Katsuhiko Kaji, Kenji Yamakawa, Nobuo Kawaguchi, Kei Hiroi

UbiComp and ISWC 2015 - Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the Proceedings of the 2015 ACM International Symposium on Wearable Computers page： 337 - 340 2015.9

Language：English Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery, Inc

In this work, we implement a mobile system called Velobug to measures 3D data of the environment. Velobug could generate dense and colored point cloud to reconstruct the environment for 3D mapping with long effective range. Velobug is mainly consisted of a Velodyne HDL-32e LiDAR senor and a Point Grey Research Ladybug3 panoramic camera. The LiDAR sensor is utilized to acquire 3D data of the environment and generate point cloud. Pictures captured by the panoramic camera are used for complementing RGB information of the point cloud after the calibration between the panoramic camera and the LiDAR sensor. We could maker point cloud denser by registering multiple frames of point cloud with Generalized Iterative Closet Point(Generalized-ICP) method. We evaluate Velobug in an underground shopping street near Nagoya Station. The experiment result shows the mobility, practicability and efficiency in reconstruction for 3D indoor mapping.

DOI： 10.1145/2800835.2800878

Design and implementation of algorithm for estimation of elevator travel distance using smartphone accelerometer Reviewed

Antonio Martinez, Kei Hiroi, Nobuo Kawaguchi

Language：English Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery, Inc

Since the advent of smartphones equipped with sophisticated sensing hardware, human activity recognition research has moved from utilizing dedicated sensing devices to using commercial smartphones. This paper presents the design of an algorithm to recognize and estimate travel distance when riding an elevator and its corresponding implementation within an app for a smartphone running Apple's mobile operating system (iOS). The algorithm receives solely the signal of the smartphone's accelerometer, recognizes that it belongs to an elevator ride, and proceeds to calculate the distance traveled by the rider. The algorithm has been designed in a way that simplifies the necessary operations to calculate the travel distance with the objective of minimizing processing power, while keeping the corresponding estimations highly accurate. This is an initial attempt towards the building of a robust, but simple and fast, real-time human activity recognition service on a wearable platform.

DOI： 10.1145/2800835.2801620

スマートステーションなごや:次世代屋内位置情報サービスの研究開発

Pedestrian Dead-Reckoning as a Basic Technology of Indoor Positioning

Vol. 56 ( 9 ) page： 855-857 2015.9

河口信夫, 坂涼司, 一円真治, 飯田啓量, 山川健司, 廣井慧, 梶克彦

情報処理学会研究報告. UBI, [ユビキタスコンピューティングシステム] Vol. 2015 ( 4 ) page： 1-7 2015.5

Language：English Publishing type：Research paper (scientific journal)

大規模駅周辺は複雑な立体構造を構成しており,店舗や構造の情報が集約されていないため,利用者のプロファイルや目的に応じた情報提供が適切になされていない.そこで,ICT を活用し大規模駅において利用者の多様な状況に対応し,適切な店舗や経路の推薦やナビゲーションを行う総合的な情報提供・屋内案内サービスを実現する.また,利用者の利便性を向上させると同時に,駅関連事業者との適切な情報流通を実現し,地域社会の活性化を促進する.特に,東京や大阪と並んで複雑な構造をしている名古屋駅周辺を対象とし,次世代位置情報サービスを提供するスマートステーション化することを目指す.本研究は,1.無線 LAN・磁気・PDR を統合した屋内位置推定,2.音声に基づいて経路案内を行うナビゲーションシステム,3.目的志向の店舗推薦システム,4.店舗情報の継続的更新を可能にするクラウドソーシングシステムといった 4 つのサブテーマから構成される.

A Proportion of Event Data Extraction based on HTML Structure Analysis and Machine Learning

Vol. 2015 ( 13 ) page： 1-7 2015.5

UbiComp2015チャレンジ

河口信夫

情報処理学会研究報告. UBI, [ユビキタスコンピューティングシステム] Vol. 2015 ( 58 ) page： . 2015.2

UbiComp2015チャレンジ

河口信夫

情報処理学会研究報告. MBL, [モバイルコンピューティングとユビキタス通信研究会研究報告] Vol. 2015 ( 58 ) page： . 2015.2

Pedestrian Route Estimation Method using Magnetic Data

MURATA Yuya, KAJI Katsuhiko, HIROI Kei, KAWAGUCHI Nobuo, KAMIYAMA Takeshi, OHTA Ken, INAMURA Hiroshi

IEICE technical report. ASN, Ambient intelligence and sensor networks Vol. 114 ( 418 ) page： 61-66 2015.1

Language：English Publishing type：Research paper (scientific journal)

Because GPS has poor accuracy indoors, indoor positioning method is required. In this research, we propose pedestrian route estimation method using magnetic. The route is limited in indoor environment and every route has different magnetic. We walk the route and collect the magnetic, and utilize them for route estimation. As estimation method, we adopt particle filter. We estimate the route by comparing candidate route data and observed data by particle filter. We evaluate this method in real environment. The result shows that the route is estimated in high accuracy better than 97% as far as there are few candidates.

Indoor Positioning Method Integrating Pedestrian Dead Reckoning with Magnetic Field and WiFi Fingerprints

Ban Ryoji, Kaji Katsuhiko, Hiroi Kei, Kawaguchi Nobuo

2015 EIGHTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORKING (ICMU) page： 167 - 172 2015

An Event Data Extraction Method Based on HTML Structure Analysis and Machine Learning Reviewed

Chenyi Liao, Kei Hiroi, Katsuhiko Kaji, Nobuo Kawaguchi

IEEE 39TH ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS (COMPSAC 2015), VOL 3 Vol. 3 page： 217 - 222 2015

Language：Japanese Publishing type：Research paper (international conference proceedings) Publisher：IEEE

This paper proposes an event data extraction method that extracts business event data, such as coupons, tickets, sales campaigns, etc., from a homepage or blog of shops and pushes them to users. Users no longer need to browse their favorite shops' homepage one by one. The method supports comprehensiveness and effectiveness for event data obtainment. This proposition works into two tasks: web page block segmentation and event data identification. The first task segments the web page into blocks. Each of the blocks includes information, such as title, notification, date, etc. relating to event information. Many related works suppose web page block segmentation based on specific tags, vision, function, etc. In this research, we propose a web page block segmentation method based on HTML document structure analysis. The second task is used to identity event data from segmented blocks. We propose a method to implement event data identification based on machine learning. We show the results of a verification experiment. Experimental data are from 96 shops located in two underground shopping streets UNIMALL and ESCA, at a train station in the city of Nagoya (Japan). Because the event data identification depends on the Japanese language, this method is available for all the Japanese home page.

DOI： 10.1109/COMPSAC.2015.235

浸水被害の画像を用いた市街地における浸水深の検出手法の提案

A pedestrian passage detection method by using spinning magnets on corridors. Reviewed

Chihiro Takeshima, Katsuhiko Kaji, Kei Hiroi, Nobuo Kawaguchi, Takeshi Kamiyama, Ken Ohta, Hiroshi Inamura

page： 411 - 414 2015

A pedestrian passage detection method by using spinning magnets on corridors. Reviewed

Chihiro Takeshima, Katsuhiko Kaji, Kei Hiroi, Nobuo Kawaguchi, Takeshi Kamiyama, Ken Ohta, Hiroshi Inamura

Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers, UbiComp/ISWC Adjunct 2015, Osaka, Japan, September 7-11, 2015 page： 411 - 414 2015

廣井慧 , 河口信夫

情報処理学会研究報告. HCI, ヒューマンコンピュータインタラクション研究会報告 Vol. 2014 ( 3 ) page： 1-6 2014.10

Language：English Publishing type：Research paper (scientific journal)

都市域での豪雨が起こす市街地の浸水被害を軽減するためには,浸水の発生箇所やその浸水深のような,浸水状況の情報提供が有効である.浸水状況を知ることで,道路上の危険箇所の歩行やアンダーパスでの車両の水没からの回避が可能になると考えられる.しかし,既存で用いられる水位計は定点観測用途が主であり,観測地点数が限られるため,観測点以外の浸水状況が把握できない.また,豪雨の発生時には浸水の様子を撮影した画像がインターネット上で多数共有されるが,浸水深を検出するためには量水板のように水位と比較可能な目安となる対象物が必要となるため,このような画像から浸水深を知ることが難しい.そこで,市街地における観測点以外の地点での浸水深の把握を目的に,インターネット上から収集した市街地の浸水の様子を撮影した画像を活用して,浸水深を検出する手法を提案する.本手法は,画像に写る人物の大きさと水位を比較し,人への影響に応じて膝以下,股下以下,胸部以下,胸部以上という分類で浸水深を推定することで,目安となる対象物を必要とせず,浸水深の検出を可能にする.提案手法を用いて,過去に市街地で発生した実際の浸水被害における浸水深を検出し,その結果を述べる.

安定歩行区間に基づく歩行軌跡推定手法

梶克彦 , 河口信夫

情報処理学会研究報告. HCI, ヒューマンコンピュータインタラクション研究会報告 Vol. 2014 ( 19 ) page： 1-8 2014.10

Language：English Publishing type：Research paper (scientific journal)

複数の歩行センシングデータを用いて建物構造を生成するためには,歩行センシングデータから歩行軌跡を正確に推定できなければならない.本稿では,右左折や蛇行を伴わない歩行が一定時間以上安定してセンシングできている区間を安定歩行区間と定義し,それに基づいて歩行軌跡を推定する手法を提案する.一般的に人は合理的に行動するため,安定歩行時には直線的な軌跡をたどると考えられる.また屋内の通路の多くは直線的である.よって,混雑した通路や複雑な形状の建物の歩行を除けば,移動の大半は直線的な歩行とみなせる.安定歩行区間の検出には角速度を用いる.検出された安定歩行区間を直線的な歩行とみなし,角速度に乗っているオフセット値を求め,ドリフトを除去する.また,多くの通路の曲がり角の角度が 90 度であるという建物知識を導入し,安定歩行区間同士が平行または垂直になるように歩行軌跡を修正する.さらに,安定歩行区間が一定以上の割合となる歩行センシングデータを,高精度の歩行軌跡推定が期待できる信頼性の高いデータみなす.屋内歩行センシングコーパス HASC-IPSC を用いて提案手法の評価実験を行い,歩行軌跡の推定手法と信頼性の高い歩行センシングデータの発見手法の双方で有効性を確認した.信頼性の高いデータに限定すれば,歩行軌跡末端における進行方向の誤差平均は約 7 度となり,90 度以上の大きな誤差になる割合は約 1 %となった.

自律型電源を用いた停電時に運用可能な市街地の浸水観測システムの提案 (ITS)

廣井慧, 仲倉利浩, 落合秀也, 井上朋哉, 山形与志樹, 河口信夫

電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 Vol. 114 ( 225 ) page： 5-11 2014.9

Language：English Publishing type：Research paper (scientific journal)

都市域で発生する豪雨は,市街地の浸水を招き,避難者の歩行困難やアンダーパスでの車両の水没等,道路交通に大きな被害を与える.特に中小河川や水路から溢れる水は,一般市町村道のような生活道路の浸水を招く.浸水の発生箇所や浸水深の情報提供は,歩行者や車両の被害軽減に有効であるため,生活道路での浸水の情報提供を実現を目指し,安価で簡易に構築可能な浸水観測ネットワークFloodEyeの開発と実環境での運用を行っている.しかし,豪雨や浸水被害が拡大すると,市街地では停電が発生することが多く,浸水観測やデータ提供の継続が難しい.そこで本研究は,被害拡大後も安定的に運用でき,生活道路の浸水被害軽減に活用できる浸水観測システムの開発を行う.本システムは,豪雨発生前に太陽光から蓄電した電力を活用し,停電時に観測とFloodEyeへのデータ伝送をする自律型電源機能をもつ.本システムを実環境に設置して,観測とデータ伝送を行い,連続した降雨日での電力消費量を計測した.この計測結果をもとに,同程度の降雨発生時に安定的な運用を実現するための効率的な電力使用の分析を行う.近傍の降水量や警報の発表状況から推定する被害拡大の可能性,観測結果からの浸水の発生状況を用いた,観測とデータ伝送の制御開始タイミングの決定と時間間隔の最適化の考察結果を述べる.

自律型電源を用いた停電時に運用可能な市街地の浸水観測システムの提案

廣井慧 , 仲倉利浩 , 落合秀也 , 井上朋哉 , 山形与志樹 , 河口信夫

情報処理学会研究報告. ITS, [高度交通システム] Vol. 2014 ( 2 ) page： 1 - 7 2014.9

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：一般社団法人情報処理学会

都市域で発生する豪雨は,市街地の浸水を招き,避難者の歩行困難やアンダーパスでの車両の水没等,道路交通に大きな被害を与える.特に中小河川や水路から溢れる水は,一般市町村道のような生活道路の浸水を招く.浸水の発生箇所や浸水深の情報提供は,歩行者や車両の被害軽減に有効であるため,生活道路での浸水の情報提供を実現を目指し,安価で簡易に構築可能な浸水観測ネットワーク FloodEye の開発と実環境での運用を行っている.しかし,豪雨や浸水被害が拡大すると,市街地では停電が発生することが多く,浸水観測やデータ提供の継続が難しい.そこで本研究は,被害拡大後も安定的に運用でき,生活道路の浸水被害軽減に活用できる浸水観測システムの開発を行う.本システムは,豪雨発生前に太陽光から蓄電した電力を活用し,停電時に観測と FloodEye へのデータ伝送をする自律型電源機能をもつ.本システムを実環境に設置して,観測とデータ伝送を行い,連続した降雨日での電力消費量を計測した.この計測結果をもとに,同程度の降雨発生時に安定的な運用を実現するための効率的な電力使用の分析を行う.近傍の降水量や警報の発表状況から推定する被害拡大の可能性,観測結果からの浸水の発生状況を用いた,観測とデータ伝送の制御開始タイミングの決定と時間間隔の最適化の考察結果を述べる.

屋内歩行センシングコーパスHASC-IPSC利用のすすめ

梶克彦 , 渡辺穂高 , 坂涼司 , 河口信夫

情報処理学会研究報告. MBL, [モバイルコンピューティングとユビキタス通信研究会研究報告] Vol. 2014 ( 8 ) page： 1 - 2 2014.8

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：一般社団法人情報処理学会

近年のモバイルコンピューティング分野で盛んな研究テーマとして,屋内位置推定や建物構造の自動推定が挙げられる.しかし,現在までにこれらの研究で共通して利用可能なデータは存在せず,新たな手法を提案しても,既存研究との精度の比較検討が困難であった.そこで我々は,屋内位置推定研究と建物構造推定研究を主なターゲットとした,屋内歩行センシングコーパス (HASC-IPSC) を構築した.このデータ収集対象環境として選定した建物は,名古屋大学 IB 電子情報館の北棟 (B1F-5F),中棟 (B1F-2F),南棟 (1F-3F) の 3 つの建物である.これらの建物は互いに隣接しており,中庭や地下通路を通じて行き来できる (図1).被験者は Android 端末 2 台 (Nexus 4,Garaxy S3) を装着して建物内の様々な経路を移動する.この際被験者には普段と同様の歩行を心がけてもらい,通路中央の歩行,ドアを自分自身で開ける,階段を 1 段ずつ昇降するよう指示している.センサデータ収集には HASC Logger を用いた.収集したセンサ情報は,加速度 (3 軸),角速度 (3 軸),地磁気 (3 軸),気圧,無線 LAN の計 5 種類である.無線 LAN のサンプリングレートは 1Hz,その他は 100Hz とした.経路移動のセンサデータに対して,右左折や階段昇降といった詳細な行動ラベルが人手により付与されている.移動開始・終了,右左折やドア通過,階段昇降の開始・終了などのイベントに対しては,その行動をした時刻,行動の種類,対応するノード ID がラベルとして付与されている.また,イベントとイベントの間の移動行動 (リンクに相当) に対しては,行動の開始・終了時刻,行動の種類 (歩行・階段昇降),移動距離がラベルとして付与される.行動距離は,階段等の上下移動を伴う移動の場合,水平方向の移動距離に加え,垂直方向の移動距離,階段の段数が記述される.ラベルデータから経路を可視化した例を図 2 に示す.また各歩行移動データには,スタート地点を原点とした 1 秒ごとの 3 次元座標の正解データも用意されている.このデータを利用して,各研究で提案された歩行者デッドレコニング手法の精度を検証可能である.また,建物全体の歩行空間ネットワーク構造 (図 3) も用意されており,複数の歩行センシングデータを統合して建物構造を自動推定する研究のリファレンスデータとして利用できる.主な統計情報を表 1 に示す.被験者総数は 107 名,延べ経路センシングデータ数は 452 である.経路の種類は 114 種類であり,このうち同一建物内移動経路を 56 種類,異なる建物間の移動経路を 58 種類である.これまでの HASC Corpus では,被験者の年齢・性別的な偏りがみられていた.年齢や性別の違いは行動の仕方に影響を与える.例えば 20 代男性と 60 代女性では,歩行や階段昇降の姿勢や移動速度は明らかに異なる.そこで,HASC-IPSC ではできるだけ年齢と性別をバランスさせ,男女それぞれにつき 5 歳ごとの各世代の被験者数を 5 名程度用意した (表 2).本コーパスは,利用規約に同意いただければ,誰でも無料で利用可能である (http://hasc.jp/ipsc/).HASC-IPSC が本研究分野の発展促進に寄与することを期待する.

Linked Open Dataによる店舗POIの公開と活用手法の提案

一円真治, 梶克彦, 廣井慧, 河口信夫

マルチメディア、分散協調とモバイルシンポジウム2014論文集 Vol. 2014 page： 1930-1938 2014.7

集約情報を用いた通知ダイアログへの対応支援手法

上島愛史, 梶克彦, 河口信夫, 竹中光, 武内重樹, 岡本学

マルチメディア、分散協調とモバイルシンポジウム2014論文集 Vol. 2014 page： 93-99 2014.7

時空間情報に基づくイベント情報の集約システムの開発

廖宸一, 梶克彦, 廣井慧, 河口信夫

マルチメディア、分散協調とモバイルシンポジウム2014論文集 Vol. 2014 page： 657-665 2014.7

無線LANモバイル基地局検出のための基地局情報収集フレームワーク

武島知勳, 梶克彦, 廣井慧, 河口信夫

マルチメディア、分散協調とモバイルシンポジウム2014論文集 Vol. 2014 page： 975-981 2014.7

ライフログ写真データに基づく連想検索に関する研究

上村真也, 梶克彦, 廣井慧, 竹中光, 武内重樹, 岡本学, 河口信夫

マルチメディア、分散協調とモバイルシンポジウム2014論文集 Vol. 2014 page： 1104-1111 2014.7

歩行者自律測位における行動センシング知識の利用

村田雄哉, 梶克彦, 廣井慧, 河口信夫

マルチメディア、分散協調とモバイルシンポジウム2014論文集 Vol. 2014 page： 1614-1619 2014.7

Origin and Activity of NPO Location Information Service Research Agency

KAWAGUCHI Nobuo

The Journal of the Institute of Electronics, Information, and Communication Engineers Vol. 97 ( 6 ) page： 488 - 492 2014.6

Origin and activity of NPO location information service research agency

Kawaguchi N.

Journal of the Institute of Electronics, Information and Communication Engineers Vol. 97 ( 6 ) page： 488 - 492 2014.6

距離画像による空間情報マッチングに基づくマーカレスARシステムの設計と実装 Reviewed

山川健司，梶克彦，河口信夫

情報処理学会論文誌（コンシューマ・デバイス＆システム研究会トランザクション，CDS9) Vol. 4 ( 1 ) page： 1-10 2014.4

HASC-IPSC : 屋内歩行センシングコーパス (モバイルネットワークとアプリケーション)

梶克彦, 渡辺穂高, 坂涼司, 河口信夫

電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 Vol. 113 ( 495 ) page： 69-76 2014.3

Language：English Publishing type：Research paper (scientific journal)

近年モバイルコンピューティング分野で盛んな研究テーマとして,屋内位置推定や建物構造の自動推定が挙げられる.しかし,現在までにこれらの研究で共通して利用可能なデータが存在せず,新たな手法を提案しても,既存研究との精度の比較検討が困難であった.我々は,屋内位置推定研究と建物構造推定研究を主なターゲットとした,屋内歩行センシングコーパス(GASC-IPSC)を構築した.被験者はスマートフォンを装着して建物内の様々な経路を移動する.スマートフォンに記録された加速度等のセンサデータに対して,右左折や階段昇降といった詳細な行動ラベルが人手で付与されている.また各歩行移動データには,スタート地点を原点とした1秒ごとの3次元座標の正解データも用意されている.このデータを利用して,各研究で提案された歩行者デッドレコニング手法の精度を検証可能である.また建物全体の歩行空間ネットワーク構造の正解データが用意されており,複数の歩行センシングデータを統合して建物構造を自動推定する研究のリファレンスデータとして利用できる.

HASC-IPSC: 屋内歩行センシングコーパス

梶克彦 , 渡辺穂高 , 坂涼司 , 河口信夫

情報処理学会研究報告. MBL, [モバイルコンピューティングとユビキタス通信研究会研究報告] Vol. 2014 ( 41 ) page： 1-8 2014.3

Language：English Publishing type：Research paper (scientific journal)

近年モバイルコンピューティング分野で盛んな研究テーマとして,屋内位置推定や建物構造の自動推定が挙げられる.しかし,現在までにこれらの研究で共通して利用可能なデータが存在せず,新たな手法を提案しても,既存研究との精度の比較検討が困難であった.我々は,屋内位置推定研究と建物構造推定研究を主なターゲットとした,屋内歩行センシングコーパス (HASC-IPSC) を構築した.被験者はスマートフォンを装着して建物内の様々な経路を移動する.スマートフォンに記録された加速度等のセンサデータに対して,右左折や階段昇降といった詳細な行動ラベルが人手で付与されている.また各歩行移動データには,スタート地点を原点とした 1 秒ごとの 3 次元座標の正解データも用意されている.このデータを利用して,各研究で提案された歩行者デッドレコニング手法の精度を検証可能である.また建物全体の歩行空間ネットワーク構造の正解データが用意されており,複数の歩行センシングデータを統合して建物構造を自動推定する研究のリファレンスデータとして利用できる.

HASC-IPSC: 屋内歩行センシングコーパス

梶克彦 , 渡辺穂高 , 坂涼司 , 河口信夫

情報処理学会研究報告. UBI, [ユビキタスコンピューティングシステム] Vol. 2014 ( 41 ) page： 1 - 8 2014.3

Publishing type：Research paper (scientific journal) Publisher：一般社団法人情報処理学会

近年モバイルコンピューティング分野で盛んな研究テーマとして,屋内位置推定や建物構造の自動推定が挙げられる.しかし,現在までにこれらの研究で共通して利用可能なデータが存在せず,新たな手法を提案しても,既存研究との精度の比較検討が困難であった.我々は,屋内位置推定研究と建物構造推定研究を主なターゲットとした,屋内歩行センシングコーパス (HASC-IPSC) を構築した.被験者はスマートフォンを装着して建物内の様々な経路を移動する.スマートフォンに記録された加速度等のセンサデータに対して,右左折や階段昇降といった詳細な行動ラベルが人手で付与されている.また各歩行移動データには,スタート地点を原点とした 1 秒ごとの 3 次元座標の正解データも用意されている.このデータを利用して,各研究で提案された歩行者デッドレコニング手法の精度を検証可能である.また建物全体の歩行空間ネットワーク構造の正解データが用意されており,複数の歩行センシングデータを統合して建物構造を自動推定する研究のリファレンスデータとして利用できる.

BI-7 Big Data for Ambient Intelligence and Sensor Networks

OHASHI Masayoshi, KAWAGUCHI Nobuo, KOHTAKE Naohiko, UEDA Naonori

Proceedings of the IEICE General Conference Vol. 2014 ( 2 ) page： "SS-71" 2014.3

An Indoor Positioning Method Integrating Pedestrian Dead Reckoning with Magnetic Filed and WiFi Map

BAN Ryoji, KAJI Katsuhiko, KAWAGUCHI Nobuo

IEICE technical report. ASN, Ambient intelligence and sensor networks Vol. 113 ( 399 ) page： 23-28 2014.1

Language：English Publishing type：Research paper (scientific journal)

An indoor positioning method is required for the realization of life-log, navigation and so on, because the accuracy of GPS is generally not enough in indoor environments such as commercial facilities and stations. As a indoor positioning method, pedestrian dead reckoning and using the WiFi radio waves have been studied. In this paper, we propose an indoor positioning method using residual magnetism in addition to the above described methods. Moreover, we evaluated this method in real environment and confirmed that this method can provide accurate indoor positioning with an error of mean less than 4m.

A Gate Passing Detection Method Based on WiFi Significant Point

Katsuhiko Kaji, Nobuo Kawaguchi

IPSJ Journal Vol. 55 ( 1 ) page： 366 - 377 2014.1

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：Information Processing Society of Japan (IPSJ)

We propose a gate passing detection method based on WiFi signal strength and accelerometer of the user's smartphone. Gate such as door and elevater devides physical areas such as room and hallway. Thus, the WiFi environments of them tend to vary on a large scale. Conversely, it can be said that a gate should exist when the point that the WiFi environment varies on a large scale. We define such point "WiFi Significant Point." We propose the detection method based on WiFi distance function and estimated moving distance according to accelerometer. We evaluated the proposal method and found out that more than half part of gate passing can be detected. We also found that the existence of gates that can be estimated same gate passing with a high degree of accuracy.

Taxonomy of Survey Technology:—From Celestial Navigation to Indoor Localization—

A Gate Passing Detection Method Based on WiFi Significant Point Reviewed

Vol. 55 ( 1 ) page： 366-377 2014.1

Design and Implementation of Event Information Summarization System

Liao Chenyi, Kaji Katsuhiko, Hiroi Kei, Kawaguchi Nobuo

2014 38TH ANNUAL IEEE INTERNATIONAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS (COMPSACW 2014) page： 572-577 2014

Proposal of a Platform Integrating POI Information

Ichien Shinji, Kaji Katsuhiko, Kawaguchi Nobuo

2014 SEVENTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORKING (ICMU) page： 123 - 128 2014

KAWAGUCHI Nobuo

IEEJ Transactions on Sensors and Micromachines Vol. 134 ( 12 ) page： 832 - 835 2014

距離画像による空間情報マッチングに基づくマーカレスARシステムの設計と実装 Reviewed

山川健司, 梶克彦, 河口信夫

情報処理学会論文誌コンシューマ・デバイス＆システム（CDS） Vol. 4 ( 1 ) page： 12 - 21 2014

Privacy Protection in WiFi-based Location Estimation Reviewed

Zuotao Peng, Katsuhiko Kaji, Nobuo Kawaguchi

2014 SEVENTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORKING (ICMU) page： 62 - 67 2014

Language：English Publishing type：Research paper (international conference proceedings) Publisher：IEEE

In recent years, along with the spread of WiFi-based location estimation service, the privacy problem has been pointed out. For existing WiFi-based location estimation service, users' traces and position information can be obtained fraudulently. Personal privacy may be compromised. This research proposes an algorithm that determines the reliability of the user by considering the probability of both spatial and temporal to resolve the privacy problem in WiFi-based location estimation. Meanwhile, we are operating a portal Locky. jp on location estimation using WiFi. Based on the actual data of base stations stored in the Locky. jp database, we confirm this algorithm. As a result, the percentage of returning position for privacy invasion data and whole data (privacy invasion data is also included) are about 20% and 55% respectively. In summary, we know that this algorithm reduced the privacy invasion to about 20% in the WiFi-based location estimation system.

DOI： 10.1109/ICMU.2014.6799059

International workshop on human activity sensing corpus and its application (HASCA2014) Reviewed

Nobuo Kawaguchi, Nobuhiko Nishio, Daniel Roggen, Sozo Inoue, Susanna Pirttikangas

UbiComp 2014 - Adjunct Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing page： 715 - 719 2014

Language：Japanese Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery, Inc

Recent advancement of technology enables installations of small sized accelerometers or gyroscopes on various kinds of wearable/portable information devices. By using such wearable sensors, these devices can estimate its posture or status. However, most of current devices only utilize these sensors for simple orientation and gesture recognition. More deep understandings and recognition of human activity through these sensors will enable the next-generation human-oriented computing. To enable the real-world application by these kinds of wearable sensors, a large scale human activity sensing corpus might play an important role. Additionally, we have now a lot of high-performance mobile devices in real-world such as smart-phones. It is a great challenge to utilize such an enormous number of wearable sensors to collect a large-scale activity corpus. In recent years, there are several ongoing projects which are collecting human activities. Following on a huge success of last year's workshop, we are further planning to share these experiences of current research on human activity corpus and its applications among the researchers and the practitioners and to have a deep discussion for future of activity sensing.

DOI： 10.1145/2638728.2641314

Other Link： http://dblp.uni-trier.de/db/conf/huc/ubicomp2014ap.html#conf/huc/KawaguchiINPR14

Pedestrian dead reckoning based on human activity sensing knowledge Reviewed

Yuya Murata, Katsuhiko Kaji, Kei Hiroi, Nobuo Kawaguchi

UbiComp 2014 - Adjunct Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing page： 797 - 806 2014

Language：Japanese Publishing type：Research paper (international conference proceedings) Publisher：Association for Computing Machinery, Inc

This research addresses improvement of the accuracy of pedestrian dead reckoning (PDR), which is one effective technique to estimate indoor positions using smartphone sensors. Even though various techniques using step lengths and their number have been previously proposed for PDR, insufficient accuracy is gotten from smartphone sensors. In this research, we define human activity sensing knowledge and propose improvements to PDR accuracy based on it. Human activity sensing knowledge consists of four kinds of information: pedestrian, environmental, activity, and terminal. Previous studies separately used these kinds of information
however, no study has systematically arranged them for use in PDR. We improved PDR accuracy by adjusting the step length in passages and on stairs and revised activity recognition error with human activity sensing knowledge. To investigate the effectiveness of that strategy, we used HASC-IPSC, which is an indoor pedestrian sensing corpus. After our investigation, activity recognition accuracy improved from 71.2% to 91.4%, and the distance estimation error was reduced from approximately 27 m to approximately 7 m using human activity sensing knowledge. Copyright 2014 ACM.

DOI： 10.1145/2638728.2641305

Gate-passing detection method based on WIFI significant points

Other Link： http://dblp.uni-trier.de/db/conf/huc/ubicomp2014ap.html#conf/huc/MurataHKK14

Privacy Protection in WiFi-based Location Estimation

Peng Zuotao, Kaji Katsuhiko, Kawaguchi Nobuo

2014 SEVENTH INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND UBIQUITOUS NETWORKING (ICMU) page： 62 - 67 2014

みんなで作る位置情報サービス～スマートステーションなごや構想～

河口信夫

測量 Vol. 2014年4月号 page： 10 - 15 2014

位置情報技術の進化と活用事例

河口信夫

OHM Vol. 2014年3月号 page： 8 - 11 2014

スマートな位置情報サービスの構築に向けて～NPO法人 Lisraの取り組み～

河口信夫

アーバン・アドバンス Vol. 2014年3月号 page： 47 - 55 2014

Kaji K., Kawaguchi N.

Lecture Notes in Engineering and Computer Science Vol. 2 LNECS page： 1409 - 1414 2013.11

Language：Japanese Publishing type：Research paper (scientific journal) Publisher：Lecture Notes in Engineering and Computer Science

We propose a gate-passing detection method based on WiFi signal strength and the accelerometers of user smartphones. Since doors divide such physical areas as rooms and hallways, the WiFi environments tend to greatly vary. A gate should exist when the points in the WiFi environments vary on a large scale. We define such points as WiFi significant points and propose a detection method based on a WiFi distance function and estimated moving distance according to an accelerometer. We evaluated our proposed method and found out that most door passings can be detected. We also found that we can estimate the existence of doors that have identical door passings with a high degree of accuracy.

Elevator Acceleration Sensing: Design and Estimation Recognition Algorithm Using Crowdsourcing Reviewed

Tianhui Yang, Katsuhiko Kaji and Nobuo Kawaguchi

CDS 2013: The 1st IEEE International Workshop on Consumer Devices and Systems page： 534-539 2013.7

Gate-Passing Detection Method Based on WiFi Significant Points Reviewed

Katsuhiko Kaji, Nobuo Kawaguchi

The World Congress on Engineering 2013, Certificate of Merit for The 2013 International Conference of Wireless Networks page： 1409-1414 2013.7

実世界に広がる装着型センサを用いた行動センシングとその応用：1. 大規模人間行動センシングデータベースHASC Corpusとその応用 Invited Reviewed

河口信夫

情報処理 Vol. 54 ( 6 ) page： 564-567 2013.5

Authorship：Lead author Language：Japanese

音声や画像といった分野では，大規模データの活用により性能向上が図られてきたが，行動認識には利用できるデータが存在していない．我々は人間行動センシングコンソーシアム（Human Activity Sensing Consortium: HASC）を設立し，行動認識技術のより一層の進展のために大規模な行動センシングデータベース HASC corpusを構築した．HASC Challenge を2010年から3年間開催し，300名を超える被験者の行動データを収集した．データの応用例として被験者数の増大に基づく認識率向上や，経路識別を示す．また，年齢にバランスしたデータや，屋内案内をターゲットとしたデータ収集も進めている．これらのデータの多くは登録すれば無償で利用できるため，ぜひ利用して，あらたな成果を生んでいただきたい．

Scalable QoS for XCAST Using Differentiated Services Architecture Reviewed

Odira Elisha Abade, Katsuhiko Kaji, Nobuo Kawaguchi

Vol. 20 ( 1 ) page： 131-144 2013.1

A Localization Method for Markerless AR Using a Depth Image Sensor Reviewed

Kenji Yamakawa,Katsuhiko Kaji, Nobuo Kawaguchi

Proceedings of the the International Workshop on Advanced Image Technology (IWAIT'13) page： 1182-1187 2013.1

An Intuitive Multi-touch Interface Using Finger Posture for Operating 3D Objects Reviewed

Shingo Baba, Katsuhiko Kaji, and Nobuo Kawaguchi Toshiyuki Hagiya and Tsuneo Kato

Proceedings of the the International Workshop on Advanced Image Technology (IWAIT'13) page： 244-249 2013.1

Elevator acceleration sensing: Design and estimation recognition algorithm using crowdsourcing

Yang Tianhui, Kaji Katsuhiko, Kawaguchi Nobuo

2013 IEEE 37TH ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS (COMPSACW) page： 534-539 2013

Gate-Passing Detection Method Based on WiFi Significant Points Reviewed

Katsuhiko Kaji, Nobuo Kawaguchi

WORLD CONGRESS ON ENGINEERING - WCE 2013, VOL II page： 1409 - 1414 2013

Language：English Publishing type：Research paper (international conference proceedings) Publisher：INT ASSOC ENGINEERS-IAENG

We propose a gate-passing detection method based on WiFi signal strength and the accelerometers of user smart-phones. Since doors divide such physical areas as rooms and hallways, the WiFi environments tend to greatly vary. A gate should exist when the points in the WiFi environments vary on a large scale. We define such points as WiFi significant points and propose a detection method based on a WiFi distance function and estimated moving distance according to an accelerometer. We evaluated our proposed method and found out that most door passings can be detected. We also found that we can estimate the existence of doors that have identical door passings with a high degree of accuracy.

HASC-IPSC: Indoor pedestrian sensing corpus with a balance of gender and age for indoor positioning and floor-plan generation researches Reviewed

Gate-Passing Detection Method Based on WiFi Significant Points

Kaji Katsuhiko, Kawaguchi Nobuo

WORLD CONGRESS ON ENGINEERING - WCE 2013, VOL II page： 1409 - 1414 2013

Katsuhiko Kaji, Ryoji Ban, Hodaka Watanabe, Nobuo Kawaguchi

UbiComp 2013 Adjunct - Adjunct Publication of the 2013 ACM Conference on Ubiquitous Computing page： 605 - 610 2013

Language：English Publishing type：Research paper (international conference proceedings) Publisher：ACM

Up till now, the majority of researches related to location estimation and floor plan creation have used different kinds of data and there has simply been no technique to compare the relative advantages and disadvantages. We collected indoor pedestrian sensing data of 100 people with a balance of gender and age. The data is part of the HASC corpus, free to use for research purposes. Copyright © 2013 ACM.

DOI： 10.1145/2494091.2495981

Scalable QoS for XCAST Using Differentiated Services Architecture

Other Link： http://dblp.uni-trier.de/db/conf/huc/ubicomp2013ap.html#conf/huc/KajiWBK13

Abade Odira Elisha, Kaji Katsuhiko, Kawaguchi Nobuo

Information and Media Technologies Vol. 8 ( 1 ) page： 182 - 195 2013

Language：English Publishing type：Research paper (scientific journal) Publisher：Information and Media Technologies Editorial Board

Explicit multiunicast (XCAST) has been proposed as a multicasting scheme with complementary scaling properties which can solve the scalability problems of conventional IP Multicast. XCAST is suitable for videoconferencing, online games and IPTV. This paper deals with QoS provisioning in XCAST networks using Differentiated Services (DiffServ). We show that integration of DiffServ in XCAST is a non-trivial problem due to inherent architectural differences between XCAST and DiffServ. We then propose a scheme called QS-XCAST that uses dynamic DSCPs to adapt to the heterogeneity of receivers in an XCAST network. We also provide an algorithm for harmonizing the receiver-driven and sender-driven QoS approaches between XCAST and DiffServ thereby determining the correct DSCP-PHB for all links in an XCAST network. By simulating using OMNeT++ we evaluate QS-XCAST using four metrics: throughput, average per-hop-delay, link utilization and forwarding fairness to other traffic in the network. Our solution eliminates DSCP confusion and collusion attack problems to which naive XCAST QoS provisioning is vulnerable. It also offers a more efficient bandwidth utilization, better forwarding fairness and less traffic load compared to the existing XCAST.

DOI： 10.11185/imt.8.182

Chairs' summary/proposal for international workshop on human activity sensing corpus and its application (HASCA2013) Reviewed

Nobuo Kawaguchi, Nobuhiko Nishio, Daniel Roggen, Kaori Fujinami, Susanna Pirttikangas

UbiComp 2013 Adjunct - Adjunct Publication of the 2013 ACM Conference on Ubiquitous Computing page： 599 - 603 2013

Language：English Publishing type：Research paper (international conference proceedings) Publisher：ACM

Recent advancement of technology enables installations of small sized accelerometers or gyroscopes on various kinds of wearable/portable information devices. By using such wearable sensors, these devices can estimate its posture or status. However, most of current devices only utilize these sensors for simple orientation and gesture recognition. More deep understandings and recognition of human activity through these sensors will enable the next-generation human-oriented computing. To enable the real-world application by these kinds of wearable sensors, a large scale human activity sensing corpus might play an important role. Additionally, we have now a lot of high-performance mobile devices in real-world such as smart-phones. It is a great challenge to utilize such an enormous number of wearable sensors to collect a large-scale activity corpus. In recent years, there are several ongoing projects which are collecting human activities. In this workshop, we are planning to share these experiences of current research on the human activity corpus and its applications among the researchers and the practitioners and to have a deep discussion for future of activity sensing. Copyright © 2013 ACM.

DOI： 10.1145/2494091.2495992

Other Link： http://dblp.uni-trier.de/db/conf/huc/ubicomp2013ap.html#conf/huc/KawaguchiNRFP13

大規模人間行動センシングデータベースHASC Corpusとその応用

河口信夫

情報処理学会誌 Vol. Vol.54, No.6 page： 564 - 567 2013

Design and Implementation of WiFi Indoor Localization based on Gaussian Mixture Model and Particle Filter Reviewed

Katsuhiko Kaji, Nobuo Kawaguchi

Proceedings of the International Conference on Indoor Positioning and Indoor Navigation (IPIN'12) 2012.11

Application Layer Traffic Engineering for Multipoint Communication System Reviewed

Yumi Nakayama, Katsuhiko Kaji, Nobuo Kawaguchi

The 15th International Conference on Network-Based Information Systems (NBiS-2012) page： 284-289 2012.9

大規模人間行動センシングコーパスHASC2012corpus の概要とその応用 Reviewed

河口信夫, 渡辺穂高, 楊天輝, 小川延宏, 岩崎陽平, 梶克彦, TERADA TSUTOMU, MURAO KAZUYA, 羽田久一, 井上創造, 川原圭博, 角康之, 西尾信彦

情報処理学会シンポジウムシリーズマルチメディア，分散，協調とモバイルシンポジウム(DICOMO2012)論文集 page： 1110–1116 2012.7

Language：Japanese Publishing type：Research paper (conference, symposium, etc.)

人間行動の理解は，情報システムの究極の目標の一つである．我々は装着型センサを用いた人間行動の大規模コーパスの構築を行うために，HASC Challengeを2010年,2011年と開催した．これらの成果として，HASC2011corpus(被験者数116, 行動データ数4898),HASC2012corpus(被験者数136, 行動データ数7668)を構築した．本稿では，HASC2012corpusの概要と，新たな実環境データの応用について述べる．

Design and Implementation of WiFi Indoor Localization based on Gaussian Mixture Model and Particle Filter Reviewed

HASC2012corpus: Large Scale Human Activity Corpus and Its Application Reviewed

KAWAGUCHI Nobuo, WATANABE Hodaka, YANG Tianhui, OGAWA Nobuhiro, IWASAKI Yohei, KAJI Katsuhiko, TERADA Tsutomu, MURAO Kazuya, HADA Hisakazu, INOUE Sozo, SUMI Yasuyuki, KAWAHARA Yoshihiro, NISHIO Nobuhiko

the Second International Workshop of Mobile Sensing: From Smartphones and Wearables to Big Data(Held with IPSN2012 and CPSWeek 2012) page： 10 - 14 2012.4

Design and Implementation of WiFi Indoor Localization based on Gaussian Mixture Model and Particle Filter

Kaji Katsuhiko, Kawaguchi Nobuo

2012 INTERNATIONAL CONFERENCE ON INDOOR POSITIONING AND INDOOR NAVIGATION (IPIN) page： . 2012

QS-XCAST: a QoS aware XCAST implementation. Reviewed

Odira Elisha Abade, Katsuhiko Kaji, Nobuo Kawaguchi

International ICST Conference on Simulation Tools and Techniques, SIMUTOOLS '12, Sirmione-Desenzano, Italy, March 19-23, 2012 page： 307 - 310 2012

Katsuhiko Kaji, Nobuo Kawaguchi

2012 INTERNATIONAL CONFERENCE ON INDOOR POSITIONING AND INDOOR NAVIGATION (IPIN) page： 1 - 9 2012

Language：English Publishing type：Research paper (international conference proceedings) Publisher：IEEE

Up to now Scene Analysis has been based on the WiFi location estimation technique and it has been necessary to have a large scale database and a large amount of calculation. We propose a WiFi estimation method that uses little data or calculation. First of all we apply Gaussian Mixture Model to represent the large scale WiFi database to decrease the WiFi data by no less than 95%. Secondly, we apply Particle Filter to adjust the possible calculation quantity needed for the location estimation technique. As experimental result, we achieved real-time location estimation within 6 similar to 10m. Another important issue for Scene Analysis technique is the high cost of operation of the previous WiFi observation. Accordingly crowdsourcing approach was used, employing as system where some users could contribute and other uses could share. The ideal system is a composition of the Web and mobile terminal. WiFi data observed by mobile terminals is uploaded to a Web server where it is managed and integrated into GMM and large scale operations are carried out on data and calculations. When the lightweight modeled data is downloaded to the mobile-terminal, the mobile terminal then has the ability to carry out real-time location estimation independently.

DOI： 10.1109/IPIN.2012.6418943

External device session initiation framework using mobile phone connection information Reviewed

Toshiharu Asai, Katsuhiko Kaji, Nobuo Kawaguchi

Asian Internet Engineeering Conference, AINTEC 2012 page： 55 - 61 2012

Language：English Publishing type：Research paper (international conference proceedings) Publisher：ACM

Recent advancement of communications systems enables that any person can easily connect to others using network devices. However, it is still bothering to setup an external device to communicate with other devices. This paper proposes a framework for external device session initiation using a mobile phone connection information. To overcome the complex configuration issues, we employ several global servers for session initiation. By using connection information of a mobile phone, one can easily connect an external device with other device without setting any connection information. By using the framework, we have developed a prototype which can easily connect Kiosk video terminal with other device just facing an Android smartphone with NFC feature over the Kiosk terminal. We have counted the steps required to the user for the session initiation, and confirm the framework overcomes the issues. Copyright 2012 ACM.

DOI： 10.1145/2402599.2402607

Constructing and Collecting Indoor Structural Map Data with Crowdsourcing

Other Link： http://dblp.uni-trier.de/db/conf/aintec/aintec2012.html#conf/aintec/AsaiKK12

A Proposal of Landmark-conscious Voice Navigation Reviewed

河口信夫

The Sixth International Conference on Mobile Computing and Ubiquitous Networking(ICMU 2012) page： 56 - 61 2012

A Proposal of Landmark-conscious Voice Navigation Reviewed

河口信夫

The Sixth International Conference on Mobile Computing and Ubiquitous Networking(ICMU 2012) page： 56 - 61 2012

App.Locky:コンテキスト依存型サービス推薦を目的としたユーザ状況収集プラットフォーム Reviewed

矢野幹樹，梶克彦，河口信夫

情報処理学会論文誌 Vol. 52 ( 12 ) page： 3274-3288 2011.12

Language：Japanese Publishing type：Research paper (scientific journal)

モバイル端末向けに提供されるWeb サービスやアプリケーションなどのサービス
の数は爆発的に増加しており，膨大な数のサービスの中から自分に必要な物を探し出
すことが困難となりつつある．我々は，ユーザの状況に応じてサービスの推薦を行う
システムの実現を目指す．推薦を実現する上で必要となる学習情報の獲得を行うため
に，現在状況をクエリとするアプリ検索サービスを提供し，ユーザ状況の収集から推
薦までを行うプラットフォームを提案する．提案に基づいた状況依存型アプリ検索シ
ステム「App.Locky」の実装を行い，インターネット上にて公開した上で，実ユーザ
を対象とした大規模検索ログ収集実験を行った．実験の結果，収集された検索ログを
ユーザ状況の推定に利用可能であることを確認した．

indoor.Locky: UGCを利用した無線LAN 屋内位置情報基盤 Reviewed

梶克彦，河口信夫

情報処理学会論文誌 Vol. 52 ( 12 ) page： 3263-3273 2011.12

Language：Japanese Publishing type：Research paper (scientific journal)

我々は，様々な建物において屋内位置情報を一般に利用できる環境の実現を目指し，
GMM に基づく無線LAN 位置推定技術を用いた屋内位置情報基盤indoor.Locky の
研究開発を行っている．本基盤の実用化に向けた最も大きな問題は，一般ユーザが行
う事前の無線LAN 観測の作業コストが高いという点である．そこで，この作業を複
数ユーザで分担できるようUGC(User Generated Content) のアプローチを採用す
る．商業施設に置いて実証実験を行い，複数ユーザの観測情報がWeb サービス側で
正常に統合されることを確認した．また最も作業コストと位置推定精度のバランスが
とれた観測地点の間隔が5m 程度であることを明らかにした．これにより，一般ユー
ザが行う観測作業の適切な間隔を提示可能になるため，多くの箇所の観測を行ってし
まい作業コストが必要以上増加してしまうのを防ぐことができる．

SUZUKI Yuki, KAJI Katsuhiko, KAWAGUCHI Nobuo

IEICE technical report Vol. 111 ( 296 ) page： 1-6 2011.11

Language：English Publishing type：Research paper (scientific journal)

Currently, there are many indoor positioning researches using wireless LAN etc. However, there is no wide existance of structural map information on buildings or underground centers that can be applied in indoor positioning. In order to implement indoor location-based services such navigation based on user location, indoor map information is required. Moreover, indoor map information is also useful in the development of research in indoor positioning. This research aims at widely collecting indoor structure map information based on floor map pictures from sources such websites and a the guidance information for an institution through crowdsourcing approach. This paper describes a series of flows, such as acquisition of a floor map, automatic structuring, modification of users, concentration of structural information, and sharing of structural information. It also describes the system which used in supporting this approach. In addition, details of the contents of structural information are also given.

Adaptation of Integrity Maintenance Method for Location Estimation to Large Scale Wireless LAN Observation Database

He Tao, Kaji Katsuhiko, Kawaguchi Nobuo

IEICE technical report Vol. 111 ( 296 ) page： 13 - 18 2011.11

Publishing type：Research paper (scientific journal) Publisher：The Institute of Electronics, Information and Communication Engineers

We have operated a portai Locky.jp on location information and estimation using wireless LAN. It is possible to estimate the current location based on the database of wireless LAN information observed and submitted by general users. However, the failure in wireless LAN observation, together with the base station which has been moved, base station in Shinkansen, and mobile WiFi, would cause adverse effect in accuracy of location estimation if they did not have the proper handle. In this paper, intended with the large base station database collected by Locky.jp, we detect the failure in wireless LAN observation and base station which has been moved, and fix them to maintain the integrity of wireless LAN database. The results of evaluation confirmed the improvement of the location estimation accuracy with applying these corrections.

Adaptation of Integrity Maintenance Method for Location Estimation to Large Scale Wireless LAN Observation Database

HE Tao, KAJI Katsuhiko, KAWAGUCHI Nobuo

Vol. 111 ( 296 ) page： 13-18 2011.11

Constructing and Collecting Indoor Structural Map Data with Crowdsourcing

SUZUKI Yuki, KAJI Katsuhiko, KAWAGUCHI Nobuo

Vol. 111 ( 296 ) page： 1-6 2011.11

Large Scale Data Processing on the Ubiquitous Systems : From the Experience of Locky.jp

KAWAGUCHI Nobuo

IEICE technical report. Data engineering Vol. 111 ( 173 ) page： . 2011.7

Language：English Publishing type：Research paper (scientific journal)

Locky.jp project handles more than 1 million WiFi AP information which is extracted from 100 million crowd sourced data. Our smart phone applications which include "Eki.Locky" are downloaded over 1 million times. By serving such services, we get huge amount of usage data. There are several frameworks to handle this kind of huge information. However, there is no mature technology to handle them. In this talk, I'll introduce our case-study and current study about heterogeneous data handling.

HASC Challenge2010 :人間行動理解のための装着型加速度センサデータコーパスの構築 Reviewed

KAWAGUCHI Nobuo, OGAWA Nobuhiro, IWASAKI Yohei, KAJI Katsuhiko, TERADA Tsutomu, MURAO Kazuya, INOUE Sozo, KAWAHARA Yoshihiro, SUMI Yasuyuki, NISHIO Nobuhiko

情報処理学会マルチメディア，分散，協調とモバイルシンポジウム (DICOMO 2011) 論文集 Vol. 2011 ( 1 ) page： 69 - 75 2011.7

Design, Implementation and Evaluation of a Routing Engine for a Multipoint Communication Protocol: XCAST6 Reviewed

Odira Elisha Abade, Katsuhiko Kaji, Nobuo Kawaguchi

International Journal of Computer Science and Network Security Vol. 11 ( 5 ) page： 200-209 2011.5

Language：English Publishing type：Research paper (scientific journal)

In this paper we therefore propose an "XCAST6 Routing Engine", an out-of-the-box solution that simplifies gradual deployment of XCAST in the real-world. The contribution of this paper is two fold. We not only provide a simple solution that can hasten deployment of XCAST on the real Internet but we also exemplify through experimental performance evaluation of our
solution with respect to a number of performance and resource utilization metrics, that contrary to other perceptions, XCAST does not actually add an extra ordinary load to the routing resources.

A Streaming Video Augmentation Method for Improving Visibility of the Content

KAJI KATSUHIKO, KAWAGUCHI NOBUO

IEICE technical report Vol. 111 ( 50 ) page： 75-82 2011.5

Language：English Publishing type：Research paper (scientific journal)

Recently, demand of presentation video is increasing so that various conferences provide the streaming service of presentation video. In many cases, presentation slides and posters in the streaming video are not so visible because of various reasons such as low resolution and distortion. Users cannot understand the presentation clearly in such situation. In this paper, we propose a streaming video augmentation method to improve the visibility of the content in the streaming video. In the method, the client downloads the original data of the content in the streaming video previously. Then, in the watching phase, the image generated from original data is superimposed at the location of the content area in the streaming video. We implemented poster presentation live streaming system. We also conducted experiment of the system. In result, we found out that the system improve the visibility of poster in the streaming video, and reduce the flustration of watching the video.

Gaussian Mixture Modelを用いた無線LAN位置推定手法 Reviewed

藤田迪，梶克彦，河口信夫

情報処理学会論文誌 Vol. 52 ( 3 ) page： 1069-1081 2011.3

HASC challenge: Gathering large scale human activity corpus for the real-world activity understandings Reviewed

Nobuo Kawaguchi, Nobuhiro Ogawa, Yohei Iwasaki, Katsuhiko Kaji, Tsutomu Terada, Kazuya Murao, Sozo Inoue, Yoshihiro Kawahara, Yasuyuki Sumi, Nobuhiko Nishio

ACM International Conference Proceeding Series ( Article 27 ) page： 27 2011

Language：English Publishing type：Research paper (international conference proceedings) Publisher：ACM

Understandings of human activity through wearable sensors will enable the next-generation human-oriented computing. However, most of researches on the activity recognition so far are based on small number of test subjects, and not well adapted for real world applications. To overcome the situation, we have started a project named "HASC Challenge" to collect a large scale human activity corpus. By the end of 2010, by the collaboration of 20 teams, more than 6700 accelerometer data with 540 subjects have been collected through our project. We also developed a tool named "HASC Tool" for management, evaluation and collection of the large number of activity sensor data. Copyright 2011 ACM.

DOI： 10.1145/1959826.1959853

Other Link： http://dblp.uni-trier.de/db/conf/aughuman/aughuman2011.html#conf/aughuman/KawaguchiOIKTMIKSN11

HASC2011corpus: Towards the Common Ground of Human Activity Recognition

Kawaguchi Nobuo, Yang Ying, Yang Tianhui, Ogawa Nobuhiro, Iwasaki Yohei, Kaji Katsuhiko, Terada Tsutomu, Murao Kazuya, Inoue Sozo, Kawahara Yoshihiro, Sumi Yasuyuki, Nishio Nobuhiko

UBICOMP'11: PROCEEDINGS OF THE 2011 ACM INTERNATIONAL CONFERENCE ON UBIQUITOUS COMPUTING page： 571-572 2011

Distributed Human Activity Data Processing using HASC Tool

Kawaguchi Nobuo, Ogawa Nobuhiro, Iwasaki Yohei, Kaji Katsuhiko

UBICOMP'11: PROCEEDINGS OF THE 2011 ACM INTERNATIONAL CONFERENCE ON UBIQUITOUS COMPUTING page： 603-604 2011

Quantitative simulation of XCAST6 performance using OMNeT++ Reviewed

Odira Elisha Abade, Katsuhiko Kaji, Nobuo Kawaguchi

Asian Internet Engineeering Conference, AINTEC 2011 page： 22 - 29 2011

Language：English Publishing type：Research paper (international conference proceedings) Publisher：ACM

Explicit multiunicast (XCAST) is a form of small group multicast in which the sender embeds IP addresses of all receiving nodes in a special header and sends it with all data packets. On sending, each XCAST-aware router in the path examines the packet and partitions the destinations into various sets based on their next hops. For each set, the router uses a bitmap in the packet header to ensure that each copy of the packet is delivered only to destinations whose corresponding bits in the bitmap are set to 1. Sometimes real world implementation of XCAST6 can take a long time to deploy and resource constraints can limit the scale of testing that can be done. We have therefore integrated XCAST6 into the IPv6 stack of INET Framework for OMNeT++ to allow for large-scale, exhaustive and realistic investigation of XCAST6 characteristics and to complement our current research into real world deployment of XCAST6. The contribution of this paper is two fold. First, it describes our implementation of XCAST6 in OMNeT++'s INET framework. Secondly, it experimentally shows the effectiveness of XCAST6 with regards to various multicast performance metrics such as stress, end-to-end delay, efficiency and packet processing overhead rate.

DOI： 10.1145/2089016.2089021

Other Link： http://dblp.uni-trier.de/db/conf/aintec/aintec2011.html#conf/aintec/AbadeKK11

Gaussian Mixture Modelを用いた無線LAN位置推定手法 Reviewed

藤田迪, 梶克彦, 河口信夫

情報処理学会論文誌 Vol. 52 ( 3 ) page： 1069 - 1081 2011

HASC2011corpus: Towards the common ground of human activity recognition Reviewed

Nobuo Kawaguchi, Ying Yang, Tianhui Yang, Nobuhiro Ogawa, Yohei Iwasaki, Katsuhiko Kaji, Tsutomu Terada, Kazuya Murao, Sozo Inoue, Yoshihiro Kawahara, Yasuyuki Sumi, Nobuhiko Nishio

UbiComp'11 - Proceedings of the 2011 ACM Conference on Ubiquitous Computing page： 571 - 572 2011

Language：English Publishing type：Research paper (international conference proceedings) Publisher：ACM

Human activity recognition through the wearable sensor will enable a next-generation human-oriented ubiquitous computing. However, most of research on human activity recognition so far is based on small number of subjects, and non-public data. To overcome the situation, we have gathered 4897 accelerometer data with 116 subjects and compose them as HASC2011corpus. In the field of pattern recognition, it is very important to evaluate and to improve the recognition methods by using the same dataset as a common ground. We make the HASC2011corpus into public for the research community to use it as a common ground of the Human Activity Recognition. We also show several facts and results of obtained from the corpus. © 2011 Authors.

DOI： 10.1145/2030112.2030218

Other Link： http://dblp.uni-trier.de/db/conf/huc/ubicomp2011.html#conf/huc/KawaguchiYYOIKTMIKSN11

indoor.Locky: UGCを利用した無線LAN 屋内位置情報基盤 Reviewed

梶克彦, 河口信夫

情報処理学会論文誌 Vol. 52 ( 12 ) page： 3263 - 3273 2011

Distributed human activity data processing using HASC tool Reviewed

Nobuo Kawaguchi, Nobuhiro Ogawa, Yohei Iwasaki, Katsuhiko Kaji

UbiComp'11 - Proceedings of the 2011 ACM Conference on Ubiquitous Computing page： 603 - 604 2011

Language：English Publishing type：Research paper (international conference proceedings) Publisher：ACM

To accelerate and simplify human activity recognition research, we have been developing a data processing tool named "HASC Tool." As the activity corpus becomes huge, it is not simple to handle the large number of files because it takes a lot of time to process. In this paper, we propose a distributed data processing mechanism which is implemented in the HASC Tool. By using the system, we can simply scale the local system into distributed processing. We also show the preliminary experimental result. © 2011 Authors.

DOI： 10.1145/2030112.2030234

App.locky: Users' context collecting platform for context-aware application recommendation Reviewed

Other Link： http://dblp.uni-trier.de/db/conf/huc/ubicomp2011.html#conf/huc/KawaguchiOIK11

Katsuhiko Kaji, Motoki Yano, Nobuo Kawaguchi

UbiCrowd'11 - Proceedings of the 2nd International Workshop on Ubiquitous Crowdsouring page： 29 - 32 2011

Language：English Publishing type：Research paper (international conference proceedings)

Recently, it has become very hard for users to find their desired mobile services because the number of applications and Web services are rapidly increasing. Therefore, it is important to realize context-aware application recommendation. Because it is necessary to collect large learning data to estimate user's context, we propose a platform for collecting users' context and relationship between context and application by providing an application search system that inquires user's current context. We implemented a system named "App.Locky" based on our proposal and conducted experiments by publishing the system on the internet. As a result, we confirmed that collected search logs can be used to estimate user's context and relationship between context and application. © 2011 ACM.

DOI： 10.1145/2030100.2030110

Signal Processing for Human Activity Understanding

App.Locky:コンテキスト依存型サービス推薦を目的としたユーザ状況収集プラットフォーム Reviewed

矢野幹樹, 梶克彦, 河口信夫

情報処理学会論文誌 Vol. 52 ( 12 ) page： 3274 - 3288 2011

indoor.Locky : UGCを利用した無線LAN屋内位置情報基盤 Reviewed

河口信夫

情報処理学会論文誌 Vol. Vol.52, No.12 page： 3263 - 3273 2011

大規模データベースと装着型センサで人間行動を理解する

河口信夫

情報処理 Vol. 52-1 page： 32 - 36 2011

大規模データベースと装着型センサで人間行動を理解する Invited

河口信夫

情報処理 Vol. 52 ( 1 ) page： 32 2010.12

人間行動理解のための信号処理 Invited

河口信夫，武田一哉

電子情報通信学会誌 Vol. 93 ( 12 ) page： 1060 2010.12

KAWAGUCHI Nobuo, TAKEDA Kazuya

The Journal of the Institute of Electronics, Information and Communication Engineers Vol. 93 ( 12 ) page： 1060-1062 2010.12

Eki.Locky : Time Table Information System using WiFi Location Technology

YANO Motoki, IWASAKI Yohei, KAWAGUCHI Nobuo

Vol. 72 ( 0 ) page： 289-290 2010.3

D-19-8 Applications of Public Sensors on Privacy Protection

Kitade Takuya, Iwasaki Yohei, Kawaguchi Nobuo, Hirano Yasushi, Kajita Shoji, Mase Kenji

Proceedings of the IEICE General Conference Vol. 2010 ( 2 ) page： . 2010.3

Development of a Fine-grained Power Sensing and Presentation System

UEDA Yasutaka, OGAWA Nobuhiro, KAWAGUCHI Nobuo, KATAYAMA Masaaki

Vol. 2010 ( 1 ) page： 27-32 2010.1

TimeTable.Locky: Nation wide WiFi location information system based on user contributed information Reviewed

Motoki Yano, Katsuhiko Kaji, Nobuo Kawaguchi

Proceedings of the 3rd International Workshop on Location and the Web, LocWeb 2010 page： 24 - 25 2010

Language：English Publishing type：Research paper (international conference proceedings) Publisher：ACM

We introduce an iPhone / iPod touch timetable application using WiFi location system named "Eki.Locky". This application adopts UGC (User Generated Content) approach to collect TimeTable information andWiFi access point (AP) information from public users. Since the service started in October 2009, Eki.Locky has been used by over 440,000 people, posted timetable information covers 98% of all stations in Japan and 350,000 WiFi AP information were collected. In addition, since June 2010, we started a new version of this application named "TimeTable.Locky" which supports any timetable such as buses and airplanes. TimeTable.Locky also has been used large number of people, and collected over 23,000 of timetable information. Copyright 2010 ACM.

DOI： 10.1145/1899662.1899669