Updated on 2026/03/13

写真a

 
HALPERN Bence mark
 
Organization
Information Technology Center Designated Assistant Professor
Title
Designated Assistant Professor

Degree 2

  1. Doctor (Linguistics) ( 2022.9 ) 

  2. MEng (Biomedical Engineering) ( 2018.9   Imperial College London ) 

Research Interests 1

  1. speech processing

Research History 3

  1. Nagoya University   Information Technology Center   Specially Appointed Assistant Professor

    2024.7

      More details

    Country:Japan

  2. Nagoya University   Graduate School of Informatics   Visiting Specially Appointed Assistant Professor

    2023.9 - 2024.6

  3. Netherlands Cancer Institute   Department of Head and Neck Oncology   Researcher

    2022.9 - 2024.6

      More details

    Country:Netherlands

Professional Memberships 2

  1. ISCA

    2022.9

  2. International Speech Communication Association (ISCA)   Member

Awards 1

  1. SpandLDeteriorate@ACM MM Asia Best Paper Award

    2024.12  

    Bence Mark HALPERN, Tomoki TODA

 

Papers 28

  1. Severity-controllable pathological text-to-speech synthesis for clinical applications Reviewed Open Access

    Bence Mark Halpern, Wen-Chin Huang, Lester Phillip Violeta, Tomoki Toda

    IEEE Transactions on Neural Systems and Rehabilitation Engineering   Vol. 34   page: 573 - 582   2026

     More details

    Authorship:Lead author, Corresponding author   Publishing type:Research paper (scientific journal)   Publisher:Institute of Electrical and Electronics Engineers (IEEE)  

    File: TNSRE3651761.pdf

    DOI: 10.1109/TNSRE.2026.3651761

    Open Access

    Web of Science

    Scopus

    PubMed

  2. Relationship between objective and subjective perceptual measures of speech in individuals with head and neck cancer

    Bence Mark Halpern, Thomas Tienkamp, Teja Rebernik, Rob J.J.H. van Son, Martijn Wieling, Defne Abur, Tomoki Toda

    Interspeech     2025.9

     More details

    Authorship:Lead author   Publishing type:Research paper (international conference proceedings)  

    File: B_11.pdf

  3. XPPG-PCA: Reference-free Automatic Speech Severity Evaluation with Principal Components Reviewed Open Access

    Bence Mark Halpern, Thomas B. Tienkamp, Teja Rebernik, Rob J.J.H. van Son, Sebastiaan A.H.J. de Visscher, Max J.H. Witjes, Defne Abur, Tomoki Toda

    IEEE Journal of Selected Topics in Signal Processing   Vol. 19 ( 5 ) page: 783 - 795   2025.7

     More details

    Authorship:Lead author   Publishing type:Research paper (scientific journal)   Publisher:Institute of Electrical and Electronics Engineers (IEEE)  

    File: XPPGPCA_Journal_Halpern_Proof_Final.pdf

    DOI: 10.1109/JSTSP.2025.3617859

    Web of Science

    Scopus

  4. Associations Between Acoustic, Kinematic, Self-Reported, and Perceptual Measures of Speech in Individuals Surgically Treated for Oral Cancer

    Thomas B. Tienkamp, Teja Rebernik, Bence M. Halpern, Rob J. J. H. van Son, Martijn Wieling, Max J. H. Witjes, Sebastiaan A. H. J. de Visscher, Defne Abur

    Journal of Speech, Language, and Hearing Research   Vol. 68 ( 7 ) page: 3069 - 3089   2025.7

     More details

    Language:English   Publishing type:Research paper (scientific journal)   Publisher:American Speech Language Hearing Association  

    Purpose:

    The purpose of this study was to assess differences between individuals treated for oral squamous cell carcinoma (ITOC) and control speakers on acoustic, kinematic, and perceptual measures of speech. Furthermore, this study aimed to assess the interrelatedness of these speech domains alongside self-reported speech outcomes in order to inform clinically relevant measures of speech in ITOC.

    Method:

    Simultaneous acoustic and kinematic data (via electromagnetic articulography sensors on the tongue) were collected from nine ITOC, who received surgical treatment for a tumor located on either the tongue or jaw and eight age- and sex-matched control speakers. All participants were native speakers of Dutch and read the North Wind and the Sun Passage. We calculated the articulatory–acoustic vowel space (AAVS) from the acoustic data and the articulatory–kinematic vowel space (AKVS) from the tongue tip and tongue back sensor data. Inexperienced listeners ( n = 35) provided intelligibility and listening effort ratings using a visual analogue scale rating procedure. Self-reported speech problems were assessed using the Speech Handicap Index.

    Results:

    Compared to an age- and sex-matched control group, ITOC demonstrated a significantly smaller AAVS and AKVS of the tongue tip and back, as well as lower intelligibility ratings. A correlation analysis of all speech outcome measures within the ITOC group showed that group-wise, the acoustic, perceptual, and self-reported measures were most strongly associated with each other. While acoustic and kinematic measures were not strongly associated with each other on the group level, within-speaker correlations showed stronger acoustic–kinematic associations.

    Conclusions:

    This study demonstrates that acoustic, perceptual, and self-reported measures are related and quantify speech problem severity between ITOC, while kinematic measures showed no between-speaker relationships in a systematic way. Acoustic and kinematic measures showed greater within-speaker than between-speaker associations, reflecting speaker-specific compensatory behaviors. Our results underscore the importance of assessing the speech outcomes of ITOC across the acoustic, kinematic, perceptual, and self-reported domains to inform rehabilitation strategies.

    Supplemental Material:

    https://doi.org/10.23641/asha.29231144

    File: A_6.pdf

    DOI: 10.1044/2025_JSLHR-24-00464

    Web of Science

    PubMed

  5. Reference-free automatic speech severity evaluation using acoustic unit language modelling Reviewed Open Access

    Bence Mark Halpern, Tomoki Toda

    Proceedings of the 6th ACM International Conference on Multimedia in Asia Workshops     page: 1 - 5   2024.12

  6. Quantifying the effect of speech pathology on automatic and human speaker verification Reviewed International coauthorship Open Access

    Bence Mark Halpern, Thomas Tienkamp, Wen-Chin Huang, Lester Phillip Violeta, Teja Rebernik, Sebastiaan de Visscher, Max Witjes, Martijn Wieling, Defne Abur, Tomoki Toda

    Interspeech     page: 3015 - 3019   2024.9

     More details

    Authorship:Lead author, Corresponding author   Language:English   Publishing type:Research paper (international conference proceedings)  

    DOI: 10.21437/Interspeech.2024-1400

    Open Access

  7. Towards inclusive automatic speech recognition Reviewed International coauthorship Open Access

    Siyuan Feng, Bence Mark Halpern, Olya Kudina, Odette Scharenborg

    Computer Speech & Language   Vol. 84   2024.3

     More details

    Language:English   Publishing type:Research paper (scientific journal)  

    DOI: https://doi.org/10.1016/j.csl.2023.101567

    Open Access

  8. Towards inclusive automatic speech recognition Reviewed International coauthorship

    Siyuan Feng, Bence Mark Halpern, Olya Kudina, Odette Scharenborg

    Computer Speech & Language   Vol. 84   2024.3

     More details

    Language:English   Publishing type:Research paper (scientific journal)  

    File: A_5.pdf

    DOI: 10.1016/j.csl.2023.101567

  9. Quantifying Articulatory Working Space in Individuals Surgically Treated for Oral Cancer With Electromagnetic Articulography Reviewed International coauthorship

    Quantifying Articulatory Working Space in Individuals Surgically Treated for Oral Cancer With Electromagnetic Articulography

    Journal of Speech, Language, and Hearing Research   Vol. 67 ( 2 ) page: 384 - 399   2024.2

     More details

    Language:English   Publishing type:Research paper (scientific journal)  

    DOI: 10.1044/2023_jslhr-23-00111

  10. Quantifying Articulatory Working Space in Individuals Surgically Treated for Oral Cancer With Electromagnetic Articulography Reviewed International coauthorship

    Quantifying Articulatory Working, Space in Individuals Surgically Treated for Oral Cancer With Electromagnetic Articulography

    Journal of Speech, Language, and Hearing Research   Vol. 67 ( 2 ) page: 384 - 399   2024.2

     More details

    Language:English   Publishing type:Research paper (scientific journal)  

    File: A_4.pdf

  11. Associations between acoustic, kinematic, self-reported and perceptual based measures of speech in individuals surgically treated for oral cancer Invited Reviewed International coauthorship

    Thomas Tienkamp*, Teja Rebernik, Bence Halpern, Rob van Son, Martijn Wieling, Max Witjes, Sebastiaan de Visscher, Defne Abur

    2024 Motor Speech Conference     2024.2

     More details

    Language:English   Publishing type:Research paper (international conference proceedings)  

  12. Associations between acoustic, kinematic, self-reported and perceptual based measures of speech in individuals surgically treated for oral cancer Invited Reviewed International coauthorship

    Thomas Tienkamp, Teja Rebernik, Bence Halpern, Rob van Son, Martijn Wieling, Max Witjes, Sebastiaan de Visscher, Defne Abur

    2024 Motor Speech Conference     2024.2

     More details

    Language:English   Publishing type:Research paper (international conference proceedings)  

  13. Reference-free automatic speech severity evaluation using acoustic unit language modelling Reviewed Open Access

    Bence Mark Halpern, Tomoki Toda

    Proceedings of the 6th ACM International Conference on Multimedia in Asia Workshops     page: 1 - 5   2024

     More details

    Authorship:Lead author, Corresponding author  

    File: B_10.pdf

    DOI: 10.1145/3700410.3702114

    Web of Science

    Scopus

  14. Improving severity preservation of healthy-to-pathological voice conversion with global style tokens Invited Reviewed International coauthorship

    Bence Mark Halpern, Wen-Chin Huang, Lester Phillip Violeta, RJJH van Son, Tomoki Toda

    2023 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)     page: 1 - 7   2023.12

     More details

    Authorship:Lead author, Corresponding author   Language:English   Publishing type:Research paper (international conference proceedings)  

  15. Automatic evaluation of spontaneous oral cancer speech using ratings from naive listeners Invited Reviewed Open Access

    Bence Mark Halpern, Siyuan Feng, Rob van Son, Michiel van den Brekel, Odette Scharenborg

    Speech Communication     2023.3

     More details

    Authorship:Lead author, Corresponding author  

    DOI: 10.1016/j.specom.2023.03.008

    Open Access

  16. Objective speech outcomes after surgical treatment for oral cancer: An acoustic analysis of a spontaneous speech corpus containing 32.850 tokens Reviewed Open Access

    Thomas B Tienkamp, Rob JJH van Son, Bence Mark Halpern

    Journal of Communication Disorders     2022.11

     More details

    Authorship:Last author   Language:English   Publishing type:Research paper (scientific journal)  

    DOI: 10.1016/j.jcomdis.2022.106292

    Open Access

  17. Automatic Speech Recognition and Error Analyses of Dutch Oral Cancer Speech Invited Reviewed

    Kirsten Wildenburg, Bence M Halpern, Teja Rebernik, Thomas Tienkamp, Rob JJH van Son, Vass Verkhodanova, Max JH Witjes, Martijn Wieling

    Young Female* Researchers in Speech Workshop (YFRSW)     2022.9

     More details

    Language:English   Publishing type:Research paper (conference, symposium, etc.)  

  18. Quantifying changes in articulatory working space following oral cancer treatment Reviewed International coauthorship

    Thomas Tienkamp, Teja Rebernik, Bence Halpern, Defne Abur, Rob van Son, Sebastiaan de Visscher, Max Witjes, Martijn Wieling

    8th International Conference on Speech Motor Control: SMC2022     2022.8

     More details

    Language:English  

  19. Low-resource automatic speech recognition and error analyses of oral cancer speech Reviewed Open Access

    Bence Mark Halpern, Siyuan Feng, Rob van Son, Michiel van den Brekel, Odette Scharenborg

    Speech Communication   Vol. 141   page: 14 - 27   2022.6

     More details

    Authorship:Lead author, Corresponding author   Language:English   Publishing type:Research paper (scientific journal)  

    DOI: 10.1016/j.specom.2022.04.006

    Open Access

  20. Towards identity preserving normal to dysarthric voice conversion Reviewed International coauthorship

    Wen-Chin Huang, Bence Mark Halpern, Lester Phillip Violeta, Odette Scharenborg, Tomoki Toda

    ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)     2022.5

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper (international conference proceedings)  

  21. The Effectiveness of Time Stretching for Enhancing Dysarthric Speech for Improved Dysarthric Speech Recognition Reviewed

    Luke Prananta, Bence Mark Halpern, Siyuan Feng, Odette Scharenborg

    Interspeech 2022     2022.1

     More details

    Language:English   Publishing type:Research paper (international conference proceedings)  

  22. Mitigating bias against non-native accents Reviewed International coauthorship

    Yuanyuan Zhang, Yixuan Zhang, Bence Mark Halpern, Tanvina Patel, Odette Scharenborg

    Interspeech 2022     page: 3168 - 3172   2022

     More details

    Language:English   Publishing type:Research paper (international conference proceedings)  

  23. Manipulation of oral cancer speech using neural articulatory synthesis

    Bence Mark Halpern, Teja Rebernik, Thomas Tienkamp, Rob van Son, Michiel van den Brekel, Martijn Wieling, Max Witjes, Odette Scharenborg

        2022

     More details

    Language:English   Publishing type:Research paper (other academic)  

  24. An objective evaluation framework for pathological speech synthesis Reviewed International coauthorship

    Bence Mark Halpern, Julian Fritsch, Enno Hermann, Rob van Son, Odette Scharenborg, Mathew Magimai Doss

    ITG Speech Communications 2021     2021.7

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper (international conference proceedings)  

  25. Speaker-informed speech enhancement and separation Reviewed

    Bence Mark Halpern, Finnian Kelly, Anil Alexander

    IAFPA     2021.7

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper (conference, symposium, etc.)  

  26. Pathological voice adaptation with autoencoder-based voice conversion Invited Reviewed

    Marc Illa, Bence Mark Halpern, Rob van Son, Laureano Moro-Velazquez, Odette Scharenborg

    Speech Synthesis Workshop 2021     2021.6

     More details

    Authorship:Lead author, Corresponding author   Language:English   Publishing type:Research paper (international conference proceedings)  

  27. Quantifying Bias in Automatic Speech Recognition

    Siyuan Feng, Olya Kudina, Bence Mark Halpern, Odette Scharenborg

        2021.3

     More details

    Language:English   Publishing type:Research paper (other academic)  

  28. Detecting and analysing spontaneous oral cancer speech in the wild Invited Reviewed Open Access

    Bence Mark Halpern, Rob van Son, Michiel van den Brekel, Odette Scharenborg

    Interspeech 2020     page: 4826 - 4830   2020.7

     More details

    Authorship:Lead author, Corresponding author  

    DOI: 10.21437/Interspeech.2020-1598

    Open Access

▼display all

Research Project for Joint Research, Competitive Funding, etc. 1

  1. "I don't sound like myself": Creating voice conversion-based speech technology for healthcare

    2024.7 - 2026.7

    Voice conversion

      More details

    Authorship:Principal investigator  Grant type:Competitive

    Grant amount:\150 ( Direct Cost: \2600000 )

KAKENHI (Grants-in-Aid for Scientific Research) 1

  1. "I don't sound like myself": Creating voice conversion-based speech technology for healthcare

    2024.7 - 2026.7

    Voice conversion

      More details

    Authorship:Principal investigator  Grant type:Competitive

    Grant amount:\150 ( Direct Cost: \2600000 )