Publications

You can also find my latest publications on Google Scholar.

• On the Fallacy of Global Token Perplexity in Spoken Language Model Evaluation
  Chan-Jan Hsu, Liang-Hsuan Tseng, Yi-Cheng Lin, Yen-Chun Kuo, Ju-Chieh Chou, Kai-Wei Chang, Hung-Yi Lee, Carlos Busso
  Findings of ACL 2026 [paper]
• Let's Fuse Step by Step: A Generative Fusion Decoding Algorithm with LLMs for Robust and Instruction-Aware ASR and OCR
  Chan-Jan Hsu, Yi-Chang Chen, Feng-Ting Liao, Pei-Chen Ho, Yu-Hsiang Wang, Po-Chun Hsu, Da-shan Shiu
  Findings of ACL 2025 [paper] [code]
• A Self-Refining Framework for Enhancing ASR Using TTS-Synthesized Data
  Cheng-Kang Chou*, Chan-Jan Hsu*, Ho-Lam Chung, Liang-Hsuan Tseng, Hsi-Chun Cheng, Yu-Kuan Fu, Kuan-Po Huang, Hung-Yi Lee
  ASRU 2025 [paper]
• Enhancing Function-Calling Capabilities in LLMs: Strategies for Prompt Formats, Data Integration, and Multilingual Translation
  Yi-Chang Chen, Po-Chun Hsu, Chan-Jan Hsu, Da-shan Shiu
  NAACL Industry Track 2025 [paper]
• BreezyVoice: Adapting TTS for Taiwanese Mandarin with Enhanced Polyphone Disambiguation - Challenges and Insights
  Chan-Jan Hsu, Yi-Cheng Lin, Chia-Chun Lin, Wei-Chih Chen, Ho-Lam Chung, Chen-An Li, Yi-Chang Chen, Chien-Yu Yu, Ming-Ji Lee, Chien-Cheng Chen, Ru-Heng Huang, Hung-Yi Lee, Da-Shan Shiu
  arXiv 2025 [paper]
• Group Think: Multiple Concurrent Reasoning Agents Collaborating at Token Level Granularity
  Chan-Jan Hsu, Davide Buffelli, Jamie McGowan, Feng-Ting Liao, Yi-Chang Chen, Sattar Vakili, Da-shan Shiu
  arXiv 2025 [paper]
• Zero-shot Domain-sensitive Speech Recognition with Prompt-conditioning Fine-tuning
  Feng-Ting Liao, Yung-Chieh Chan, Yi-Chang Chen, Chan-Jan Hsu, Da-shan Shiu
  ASRU 2023 [paper]
• T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5
  Chan-Jan Hsu, Ho-Lam Chung, Hung-Yi Lee, Yu Tsao
  ICASSP 2023 [paper]
• Bridging Speech and Textual Pre-trained Models with Unsupervised ASR
  Jiatong Shi, Chan-Jan Hsu, Ho-Lam Chung, Dongji Gao, Paola Garcia, Shinji Watanabe, Ann Lee, Hung-Yi Lee
  ICASSP 2023 [paper]
• XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding
  Chan-Jan Hsu, Hung-Yi Lee, Yu Tsao
  ACL 2022 [paper]
• Analyzing the Robustness of Unsupervised Speech Recognition
  Guan-Ting Lin*, Chan-Jan Hsu*, Da-Rong Liu, Hung-Yi Lee, Yu Tsao
  ICASSP 2022 [paper]

Technical Reports

• The Breeze 2 Herd of Models: Traditional Chinese LLMs Based on Llama with Vision-Aware and Function-Calling Capabilities
  MediaTek Research, Chan-Jan Hsu, Chia-Sheng Liu, Meng-Hsi Chen, Muxi Chen, Po-Chun Hsu, Yi-Chang Chen, Da-Shan Shiu
  arXiv preprint, 2025 [pdf]
• Building a Taiwanese Mandarin Spoken Language Model: A First Attempt
  Chih-Kai Yang, Yu-Kuan Fu, Chen-An Li, Yi-Cheng Lin, Yu-Xiang Lin, Wei-Chih Chen, Ho-Lam Chung, Chun-Yi Kuan, Wei-Ping Huang, Ke-Han Lu, Chan-Jan Hsu, et al.
  arXiv preprint, 2024 [pdf]
• Breeze-7B Technical Report
  Chan-Jan Hsu, Chang-Le Liu, Feng-Ting Liao, Po-Chun Hsu, Yi-Chang Chen, Da-Shan Shiu
  arXiv preprint, 2024 [pdf] [NEWS] [GitHub] [HuggingFace]
• Advancing the Evaluation of Traditional Chinese Language Models: Towards a Comprehensive Benchmark Suite
  Chan-Jan Hsu, Chang-Le Liu, Feng-Ting Liao, Po-Chun Hsu, Yi-Chang Chen, Da-Shan Shiu
  arXiv preprint, 2023 [pdf] [HuggingFace]
• Extending the Pre-Training of BLOOM for Improved Support of Traditional Chinese: Models, Methods and Results
  Philipp Ennen, Po-Chun Hsu, Chan-Jan Hsu, Chang-Le Liu, Yen-Chen Wu, Yin-Hsiang Liao, Chin-Tung Lin, Da-Shan Shiu, Wei-Yun Ma
  arXiv preprint, 2023 [pdf] [HuggingFace]