研究者詳細 - 駒水　孝裕

論文 - 駒水　孝裕

分割表示 100 件中 21 - 40 件目／全件表示 >>

L3Masking: Multi-task Fine-tuning for Language Models by Leveraging Lessons Learned from Vanilla Models

Yusuke Kimura, Takahiro Komamizu, Kenji Hatano

Proceedings of the 1st Workshop on Customizable NLP: Progress and Challenges in Customizing NLP for a Domain, Application, Group, or Individual (CustomNLP4U) 頁： 53 - 62 2024年

L3Masking: Multi-task Fine-tuning for Language Models by Leveraging Lessons Learned from Vanilla Models

Kimura Y., Komamizu T., Hatano K.

1st Workshop on Customizable NLP: Progress and Challenges in Customizing NLP for a Domain, Application, Group, or Individual, CustomNLP4U 2024 - Proceedings of the Workshop 頁： 53 - 62 2024年

出版者・発行元：1st Workshop on Customizable NLP: Progress and Challenges in Customizing NLP for a Domain, Application, Group, or Individual, CustomNLP4U 2024 - Proceedings of the Workshop

When distributional differences exist between pre-training and fine-tuning data, language models (LMs) may perform poorly on downstream tasks. Recent studies have reported that multi-task learning of downstream task and masked language modeling (MLM) task during the fine-tuning phase improves the performance of the downstream task. Typical MLM tasks (e.g., random token masking (RTM)) tend not to care tokens corresponding to the knowledge already acquired during the pre-training phase, therefore LMs may not notice the important clue or not effective to acquire linguistic knowledge of the task or domain. To overcome this limitation, we propose a new masking strategy for MLM task, called L3Masking 1, that leverages lessons (specifically, token-wise likelihood in a context) learned from the vanilla language model to be fine-tuned. L3Masking actively masks tokens with low likelihood on the vanilla model. Experimental evaluations on text classification tasks in different domains confirms a multi-task text classification method with L3Masking performed task adaptation more effectively than that with RTM. These results suggest the usefulness of assigning a preference to the tokens to be learned as the task or domain adaptation.

Scopus

RecipeMeta: Metapath-enhanced Recipe Recommendation on Heterogeneous Recipe Network

Shi J., Komamizu T., Doman K., Kyutoku H., Ide I.

Proceedings of the 5th ACM International Conference on Multimedia in Asia, MMAsia 2023 2023年12月

出版者・発行元：Proceedings of the 5th ACM International Conference on Multimedia in Asia, MMAsia 2023

Recipe is a set of instructions that describes how to make food. It can help people from the preparation of ingredients, food cooking process, etc. to prepare the food, and increasingly in demand on the Web. To help users find the vast amount of recipes on the Web, we address the task of recipe recommendation. Due to multiple data types and relationships in a recipe, we can treat it as a heterogeneous network to describe its information more accurately. To effectively utilize the heterogeneous network, metapath was proposed to describe the higher-level semantic information between two entities by defining a compound path from peer entities. Therefore, we propose a metapath-enhanced recipe recommendation framework, RecipeMeta, that combines GNN (Graph Neural Network)-based representation learning and specific metapath-based information in a recipe to predict User-Recipe pairs for recommendation. Through extensive experiments, we demonstrate that the proposed model, RecipeMeta, outperforms state-of-the-art methods for recipe recommendation.

DOI： 10.1145/3595916.3626430

Scopus

NarSUM 2023 Chairs Welcome

Kankanhalli M.S., Patras I., Liu J., Wong Y., Komamizu T.

NarSUM 2023 - Proceedings of the 2nd Workshop on User-centric Narrative Summarization of Long Videos, Co-located with: MM 2023 2023年10月

An Automatic Labeling Method for Subword-Phrase Recognition in Effective Text Classification

Kimura Y., Komamizu T., Hatano K.

Informatica (Slovenia) 47 巻 ( 3 ) 頁： 315 - 326 2023年8月

掲載種別：研究論文（学術雑誌）出版者・発行元：Informatica (Slovenia)

The deep learning-based text classification methods perform better than traditional ones. In addition to the success of the deep learning technique, multi-Task learning (MTL) has come to become a promising approach for text classification; for instance, an MTL approach in text classification employs named entity recognition as an auxiliary task and has showcased that the task helps to improve the text classification performance. Existing MTL-based text classification methods depend on the auxiliary tasks using supervised labels. Obtaining such supervision labels requires additional human and financial costs in addition to those for the main text classification task. To reduce these additional costs, we propose an MTL-based text classification framework on supervised label creation by automatically labeling phrases in texts for the auxiliary recognition task. A basic idea to realize the proposed framework is to utilize phrasal expressions consisting of subwords (called subword-phrases). To the best of our knowledge, no text classification approach has been designed on top of subword-phrases because subwords only sometimes express a coherent set of meanings. The novelty of the proposed framework is in adding subword-phrase recognition as an auxiliary task and utilizing subword-phrases for text classification. It extracts subword-phrases in an unsupervised manner using the statistics approach. To construct labels for effective subword-phrase recognition tasks, extracted subword-phrases are classified based on document classes to ensure that subword-phrases dedicated to some classes can be distinguishable. Experimental evaluation for text classification using five popular datasets showcased the effectiveness of the subword-phrase recognition as an auxiliary task. It also showed that comparing various labeling schemes in recent studies indicated insights for labeling common subword-phrases among several document classes.

DOI： 10.31449/inf.v47i3.4742

Scopus

Image Impression Estimation by Clustering People with Similar Tastes

Kojima Banri, Komamizu Takahiro, Kawanishi Yasutomo, Doman Keisuke, Ide Ichiro

IEICE Proceeding Series 78 巻頁： P1-14 2023年7月

記述言語：英語出版者・発行元：The Institute of Electronics, Information and Communication Engineers

This paper proposes a method for estimating impressions received from images according to the personal attributes of users, so that they can find the desired images based on their tastes. A previous study taking into account gender and age as personal attributes showed promising results. However, it also showed that users sharing the same gender and age do not necessarily share similar tastes. Therefore, other attributes should be considered to well capture users' personal tastes. However, taking more attributes into account leads to a problem that insufficient amounts of data are served to classifiers, due to explosion of the number of combinations of attributes. To tackle this problem, we propose an aggregation-based method to condense training data for impression estimation while personal attribute information is taken into account. For evaluation, a dataset of 4,000 carpet images annotated with 24 impression words by crowd-workers was prepared, which contained 273k annotations. Experimental results showed that the use of combinations of personal attributes improved the accuracy of impression estimation. This indicates that combinations of personal attributes are helpful to estimate impressions of individual viewers to images.

DOI： 10.34385/proc.78.p1-14

CiNii Research

MVA2023 Small Object Detection Challenge for Spotting Birds: Dataset, Methods, and Results

Kondo Yuki, Ukita Norimichi, Yamaguchi Takayuki, Hou Hao-Yu, Shen Mu-Yi, Hsu Chia-Chi, Huang En-Ming, Huang Yu-Chen, Xia Yu-Cheng, Wang Chien-Yao, Lee Chun-Yi, Huo Da, Kastner Marc-A., Liu Tingwei, Kawanishi Yasutomo, Hirayama Takatsugu, Komamizu Takahiro, Ide Ichiro, Shinya Yosuke, Liu Xinyao, Liang Guang, Yasui Syusuke

IEICE Proceeding Series 78 巻頁： TE-1 2023年7月

記述言語：英語出版者・発行元：The Institute of Electronics, Information and Communication Engineers

Small Object Detection (SOD) is an important machine vision topic because (i) a variety of real-world applications require object detection for distant objects and (ii) SOD is a challenging task due to the noisy, blurred, and less-informative image appearances of small objects. This paper proposes a new SOD dataset consisting of 39,070 images including 137,121 bird instances, which is called the Small Object Detection for Spotting Birds (SOD4SB) dataset. The detail of the challenge with the SOD4SB dataset is introduced in this paper. In total, 223 participants joined this challenge. This paper briefly introduces the awardwinning methods. The dataset, the baseline code, and the website for evaluation on the public testset are publicly available.

DOI： 10.34385/proc.78.te-1

CiNii Research

Small Object Detection for Birds with Swin Transformer

Huo Da, Kastner Marc-A., Liu Tingwei, Kawanishi Yasutomo, Hirayama Takatsugu, Komamizu Takahiro, Ide Ichiro

IEICE Proceeding Series 78 巻頁： TE-3 2023年7月

記述言語：英語出版者・発行元：The Institute of Electronics, Information and Communication Engineers

Object detection is the task of detecting objects in an image. In this task, the detection of small objects is particularly difficult. Other than the small size, it is also accompanied by difficulties due to blur, occlusion, and so on. Current small object detection methods are tailored to small and dense situations, such as pedestrians in a crowd or far objects in remote sensing scenarios. However, when the target object is small and sparse, there is a lack of objects available for training, making it more difficult to learn effective features. In this paper, we propose a specialized method for detecting a specific category of small objects; birds. Particularly, we improve the features learned by the neck; the sub-network between the backbone and the prediction head, to learn more effective features with a hierarchical design. We employ Swin Transformer to upsample the image features. Moreover, we change the shifted window size for adapting to small objects. Experiments show that the proposed Swin Transformerbased neck combined with CenterNet can lead to good performance by changing the window sizes. We further find that smaller window sizes (default 2) benefit mAPs for small object detection.

DOI： 10.34385/proc.78.te-3

CiNii Research

Towards Achieving Lightweight Deep Neural Network for Precision Agriculture with Maize Disease Detection

Padeiro Carlos-Victorino, Komamizu Takahiro, Ide Ichiro

IEICE Proceeding Series 78 巻頁： P1-23 2023年7月

記述言語：英語出版者・発行元：The Institute of Electronics, Information and Communication Engineers

Agriculture is the pillar industry of human sur- vival. However, various crop diseases reduce the hu- man food supply and lead to starvation and death in the worst cases. Experts perform visual symptoms ob- servation for crop disease diagnosis. Which process is time-consuming and expensive. Also, the process has significant risk of human error due to subjective per- ception. Convolutional Neural Networks (CNN) use image processing techniques to show great potential in plant disease detection. However, it requires thou- sands of channels to learn rich features, resulting in large models requiring powerful computing, power sup- ply, and high bandwidth, making it more expensive and difficult for farmers to acquire. Therefore, deploying these solutions on resource-constrained devices is de- sirable to make them more accessible. Thus, we pro- pose a lightweight object detection CNN that can run on resource-constrained devices to detect crop diseases. Channel pruning is applied to optimize resource use by removing unimportant channels and filter weights to reduce network parameters, inference time, and the number of FLOPS. Experimental results with object de- tector, Faster R-CNN with two backbones, ResNet-50, and EfficientNet-B7, show significant improvement in model efficiency, keeping high accuracy.

DOI： 10.34385/proc.78.p1-23

CiNii Research

[D21] 歴史情報としての法令データベースの構築

佐野智也, 外山勝彦, 駒水孝裕, 増田知子

デジタルアーカイブ学会誌 7 巻 ( s2 ) 頁： s142 - s145 2023年

記述言語：日本語出版者・発行元：デジタルアーカイブ学会

国家・社会制度に関する政策は、法令を通して制度化されるため、日本社会の動きは、法令情報を介して捉えることができる。本研究は、制定・改正などを通じた法令の連続的変遷を把握し、日本の国家・社会運営の長期的変化を調査するための研究基盤の確立を目指すものである。その最初の目標として、明治以降の全法令を検索可能なオープンデータベースシステムの構築を進めているが、現在、明治 19（1886）年から平成 29（2017）年までに公布された法律と勅令のXML文書化を完了し、それらの全文検索が可能なデータベースの構築を終えた。本報告では、既存のデータベースの問題点について述べた上で、構築したデータベースを説明する。

DOI： 10.24506/jsda.7.s2_s142

CiNii Research

NarSUM'23: The 2ndWorkshop on User-Centric Narrative Summarization of Long Videos

Kankanhalli, M; Patras, I; Liu, JQ; Wong, YK; Komamizu, T; Yamazaki, S; Stephen, K; Kansal, K

PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 頁： 9731 - 9733 2023年

出版者・発行元：MM 2023 - Proceedings of the 31st ACM International Conference on Multimedia

With video capture devices becoming widely popular, the amount of video data generated per day has seen a rapid increase over the past few years. Browsing through hours of video data to retrieve useful information is a tedious and boring task. Video Summarization technology has played a crucial role in addressing this issue. It is a well-researched topic in the multimedia community. However, the focus so far has been limited to creating summary to videos which are short (only a few minutes). This workshop aims to call for researchers on relevant background to focus on novel solutions for user-centric narrative summarization of long videos. This workshop will also cover important aspects of video summarization research like what is "important"in a video, how to evaluate the goodness of a created summary, open challenges in video summarization, etc.

DOI： 10.1145/3581783.3610946

Web of Science

Scopus

MVA2023 Small Object Detection Challenge for Spotting Birds: Dataset, Methods, and Results.

Yuki Kondo, Norimichi Ukita, Takayuki Yamaguchi, Hao-Yu Hou, Mu-Yi Shen, Chia-Chi Hsu, En-Ming Huang, Yu-Chen Huang, Yu-Cheng Xia, Chien-Yao Wang, Chun-Yi Lee, Da Huo, Marc A. Kastner 0001, Tingwei Liu, Yasutomo Kawanishi, Takatsugu Hirayama, Takahiro Komamizu, Ichiro Ide, Yosuke Shinya, Xinyao Liu, Guang Liang, Syusuke Yasui

CoRR abs/2307.09143 巻 2023年

MVA2023 Small Object Detection Challenge for Spotting Birds: Dataset, Methods, and Results

Kondo, Y; Ukita, N; Yamaguchi, T; Hou, HY; Shen, MY; Hsu, CC; Huang, EM; Huang, YC; Xia, YC; Wang, CY; Lee, CY; Da Huo; Kastner, MA; Liu, TW; Kawanishi, Y; Hirayama, T; Komamizu, T; Ide, I; Shinya, Y; Liu, XY; Liang, G; Yasui, S

2023 18TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, MVA 頁： 1 - 11 2023年

掲載種別：研究論文（国際会議プロシーディングス）出版者・発行元：Proceedings of MVA 2023 - 18th International Conference on Machine Vision and Applications

Small Object Detection (SOD) is an important machine vision topic because (i) a variety of real-world applications require object detection for distant objects and (ii) SOD is a challenging task due to the noisy, blurred, and less-informative image appearances of small objects. This paper proposes a new SOD dataset consisting of 39,070 images including 137,121 bird instances, which is called the Small Object Detection for Spotting Birds (SOD4SB) dataset. The detail of the challenge with the SOD4SB dataset 1 is introduced in this paper. In total, 223 participants joined this challenge. This paper briefly introduces the award-winning methods. The dataset 2, the baseline code 3, and the website for evaluation on the public testset 4 are publicly available.

DOI： 10.23919/MVA57639.2023.10215935

Web of Science

Scopus

その他リンク： https://dblp.uni-trier.de/db/conf/mva/mva2023.html#KondoUYHSHHHXWLHKLKHKISLLY23

IPA-CLIP: Integrating Phonetic Priors into Vision and Language Pretraining.

Chihaya Matsuhira, Marc A. Kastner 0001, Takahiro Komamizu, Takatsugu Hirayama, Keisuke Doman, Yasutomo Kawanishi, Ichiro Ide

CoRR abs/2303.03144 巻 2023年

Image Impression Estimation by Clustering People with Similar Tastes

Kojima, B; Komamizu, T; Kawanishi, Y; Doman, K; Ide, I

2023 18TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, MVA 頁： 1 - 5 2023年

掲載種別：研究論文（国際会議プロシーディングス）出版者・発行元：Proceedings of MVA 2023 - 18th International Conference on Machine Vision and Applications

This paper proposes a method for estimating impressions from images according to the personal attributes of users so that they can find the desired images based on their tastes. Our previous work, which considered gender and age as personal attributes, showed promising results, but it also showed that users sharing these attributes do not necessarily share similar tastes. Therefore, other attributes should be considered to capture the personal tastes of each user well. However, taking more attributes into account leads to a problem in which insufficient amounts of data are served to classifiers due to the explosion of the number of combinations of attributes. To tackle this problem, we propose an aggregation-based method to condense training data for impression estimation while considering personal attribute information. For evaluation, a dataset of 4,000 carpet images annotated with 24 impression words was prepared. Experimental results showed that the use of combinations of personal attributes improved the accuracy of impression estimation, which indicates the effectiveness of the proposed approach.

DOI： 10.23919/MVA57639.2023.10216055

Web of Science

Scopus

その他リンク： https://dblp.uni-trier.de/db/conf/mva/mva2023.html#KojimaKKDI23

An Approach to Generate a Caption for an Image Collection Using Scene Graph Generation

Phueaksri, I; Kastner, MA; Kawanishi, Y; Komamizu, T; Ide, I

IEEE ACCESS 11 巻頁： 128245 - 128260 2023年

掲載種別：研究論文（学術雑誌）出版者・発行元：IEEE Access

Summarization is a challenging task that aims to generate a summary by grasping common information of a given set of information. Text summarization is a popular task of determining the topic or generating a textual summary of documents. In contrast, image summarization aims to find a representative summary of a collection of images. However, current methods are still restricted to generating a visual scene graph, tags, and noun phrases, but cannot generate a fitting textual description of an image collection. Thus, we introduce a novel framework for generating a summarized caption of an image collection. Since scene graph generation shows advancement in describing objects and their relationships on a single image, we use it in the proposed method to generate a scene graph for each image in an image collection. Then, we find common objects and their relationships from all scene graphs and represent them as a summarized scene graph. For this, we merge all scene graphs and select part of it by estimating the most common objects and relationships. Finally, the summarized scene graph is input into a captioning model. In addition, we introduce a technique to generalize specific words in the final caption into common concept words incorporating external knowledge. To evaluate the proposed method, we construct a dataset for this task by extending the annotation of the MS-COCO dataset using an image retrieval method. The evaluation of the proposed method on this dataset showed promising performance compared to text summarization-based methods.

DOI： 10.1109/ACCESS.2023.3332098

Web of Science

Scopus

Nonword-to-Image Generation Considering Perceptual Association of Phonetically Similar Words

Matsuhira, C; Kastner, MA; Komamizu, T; Hirayama, T; Doman, K; Ide, I

PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON MULTIMEDIA CONTENT GENERATION AND EVALUATION, MCGE 2023 頁： 115 - 125 2023年

Visual Passage Score Aggregation for Image Retrieval

Komamizu T.

Proceedings - 2023 IEEE 6th International Conference on Multimedia Information Processing and Retrieval, MIPR 2023 頁： 37 - 42 2023年

出版者・発行元：Proceedings - 2023 IEEE 6th International Conference on Multimedia Information Processing and Retrieval, MIPR 2023

This paper proposes an effective image retrieval method. Recent image retrieval approaches attempt to construct a single global feature, including local features of an image. In contrast, this paper proposes multiple features for each image. The basic idea is that a target object in a query image is not necessarily in a major part of a database image; therefore, its single feature may include noisy information from the surroundings of the target object. To deal with this, this paper proposes a Visual Passage Score Aggregation framework (VPSA). VPSA first decomposes an image into several pieces of images, called Visual Passages. Based on visual passages, VPSA aggregates relevance scores of visual passages for ranking. VPSA is efficient in the retrieval phase because an ordinary nearest neighbor search is used. The experiment revealed that VPSA showed superior or comparable performance to the state-of-the-art methods, and it takes a shorter time in the retrieval phase.

DOI： 10.1109/MIPR59079.2023.00021

Scopus

Towards Captioning an Image Collection from a Combined Scene Graph Representation Approach

Phueaksri, I; Kastner, MA; Kawanishi, Y; Komamizu, T; Ide, I

MULTIMEDIA MODELING, MMM 2023, PT I 13833 巻頁： 178 - 190 2023年

掲載種別：論文集(書籍)内論文出版者・発行元：Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Most content summarization models from the field of natural language processing summarize the textual contents of a collection of documents or paragraphs. In contrast, summarizing the visual contents of a collection of images has not been researched to this extent. In this paper, we present a framework for summarizing the visual contents of an image collection. The key idea is to collect the scene graphs for all images in the image collection, create a combined representation, and then generate a visually summarizing caption using a scene-graph captioning model. Note that this aims to summarize common contents across all images in a single caption rather than describing each image individually. After aggregating all the scene graphs of an image collection into a single scene graph, we normalize it by using an additional concept generalization component. This component selects the common concept in each sub-graph with ConceptNet based on word embedding techniques. Lastly, we refine the captioning results by replacing a specific noun phrase with a common concept from the concept generalization component to improve the captioning results. We construct a dataset for this task based on the MS-COCO dataset using techniques from image classification and image-caption retrieval. An evaluation of the proposed method on this dataset shows promising performance.

DOI： 10.1007/978-3-031-27077-2_14

Web of Science

Scopus

Towards Achieving Lightweight Deep Neural Network for Precision Agriculture with Maize Disease Detection

Padeiro, CV; Komamizu, T; Ide, I

2023 18TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, MVA 頁： 1 - 6 2023年

掲載種別：研究論文（国際会議プロシーディングス）出版者・発行元：Proceedings of MVA 2023 - 18th International Conference on Machine Vision and Applications

Agriculture is the pillar industry of human survival. However, various crop diseases reduce the human food supply and lead to starvation and death in the worst cases. Experts perform visual symptoms observation for crop disease diagnosis. Which process is time-consuming and expensive. Also, the process has significant risk of human error due to subjective perception. Convolutional Neural Networks (CNN) use image processing techniques to show great potential in plant disease detection. However, it requires thousands of channels to learn rich features, resulting in large models requiring powerful computing, power supply, and high bandwidth, making it more expensive and difficult for farmers to acquire. Therefore, deploying these solutions on resource-constrained devices is desirable to make them more accessible. Thus, we propose a lightweight object detection CNN that can run on resource-constrained devices to detect crop diseases. Channel pruning is applied to optimize resource use by removing unimportant channels and filter weights to reduce network parameters, inference time, and the number of FLOPS. Experimental results with object detector, Faster R-CNN with two backbones, ResNet-50, and EfficientNet-B7, show significant improvement in model efficiency, keeping high accuracy.

DOI： 10.23919/MVA57639.2023.10215815

Web of Science

Scopus

その他リンク： https://dblp.uni-trier.de/db/conf/mva/mva2023.html#PadeiroKI23

　前のページ - 次のページ　

<駒水 孝裕>

論文 - 駒水 孝裕

<駒水　孝裕>

論文 - 駒水　孝裕