Research Assistant - National Taiwan University
- Now
Curriculum Vitae
Education
- Ph.D. in Language and Information Technologies, Carnegie Mellon University, 2025 - Now.
- Advisor: Prof. Shinji Watanabe
- M.S. in Electrical Engineering, National Taiwan University, 2019 - 2021.
- Advisors: Prof. Lin-shan Lee & Prof. Hung-yi Lee
- B.S. in Electrical Engineering, National Taiwan University, 2015 - 2019.
Experience
- Co-created Dynamic-SUPERB, the first dynamic and collaborative instruction-tuning benchmark in speech processing.
- Led the Dynamic-SUPERB team consisting of 15 members from various institutes.
R&D Engineer - MediaTek Inc.
-
- Designed and improved lightweight neural networks for motion estimation and motion compensation (MEMC) under hardware constraints.
- Developed software frameworks for real-time MEMC on mobile devices that are both time- and power-efficient.
Teaching Assistant
-
Public Relation - Speech Processing Laboratory, National Taiwan University
-
- Engaged with visiting researchers and planned their daily schedules during their stay.
Director - Student Association of Graduate Institute of Electrical Engineering, National Taiwan University
-
- Organized an annual tournament and hosted a dinner party for students and faculty to strengthen bonds among members.
- Represented graduate students during departmental faculty meetings and bridged the gap between faculty and students.
Publications
Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech
Chien-yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi, Yifan Peng, Roshan Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, Hung-yi Lee
In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (under review), 2024.
Prompting and Adapter Tuning for Self-supervised Encoder-Decoder Speech Model
Kai-Wei Chang, Ming-Hsin Chen, Yun-Ping Lin, Jing Neng Hsu, Paul Huang, Chien-yu Huang, Shang-Wen Li, Hung-yi Lee
In IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), 2023.
Toward Degradation-Robust Voice Conversion
Chien-yu Huang, Kai-Wei Chang, Hung-yi Lee
In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2022.
Utilizing Self-supervised Representations for MOS Prediction
Wei-Cheng Tseng(co-first), Chien-yu Huang(co-first), Wei-Tsung Kao, Yist Y Lin, Hung-yi Lee
In Interspeech, 2021.
Investigating on Incorporating Pretrained and Learnable Speaker Representations for Multi-Speaker Multi-Style Text-to-Speech
Chung-Ming Chien, Jheng-Hao Lin, Chien-yu Huang, Po-chun Hsu, Hung-yi Lee
In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2021.
How Far Are We from Robust Voice Conversion: A Survey
Tzu-hsien Huang, Jheng-hao Lin, Chien-yu Huang, Hung-yi Lee
In IEEE Spoken Language Technology Workshop, 2021.
Defending Your Voice: Adversarial Attack on Voice Conversion
Chien-yu Huang, Yist Y. Lin, Hung-yi Lee, Lin-shan Lee
In IEEE Spoken Language Technology Workshop, 2021.
Honors
2nd Place, M2VoC Challenge
Advanced Speech Technologies Scholarship
Excellence Achievement in AI CUP Competition
Dean’s List (Twice)
Technical Skills
- C++
- Python
- TensorFlow
- PyTorch
- LaTeX
- Machine Learning
- Deep Learning
- Speech Processing