I am Yu Zhang (张彧). Now, I am a Research Scientist at ByteDance. If you are seeking any form of academic cooperation, please feel free to email me at aaron9834@icloud.com.
I earned my PhD in the College of Computer Science and Technology, Zhejiang University (浙江大学计算机科学与技术学院), under the supervision of Prof. Zhou Zhao (赵洲). Previously, I graduated from Chu Kochen Honors College, Zhejiang University (浙江大学竺可桢学院), with dual bachelor's degrees in Computer Science and Automation. I have also served as a visiting scholar at University of Rochester with Prof. Zhiyao Duan and University of Massachusetts Amherst with Prof. Przemyslaw Grabowicz.
My research interests primarily focus on Multi-Modal Generative AI, specifically in Speech, Spatial Audio, and Singing Voice. I have published 10+ first-author papers at top international AI conferences, such as NeurIPS, ICML, and ACL.
- Personal Pages: https://aaronz345.github.io (updated recently🔥)
- Linkedin: www.linkedin.com/in/yuzhang34
- Google Scholar: https://scholar.google.com/citations?user=kA9A6LsAAAAJ
- DBLP: https://dblp.org/pid/50/671-126.html
*denotes co-first authors
Technique ReportSwanTale: Unified Multi-Speaker Speech and Audio Generation for Instruct and Zero-Shot Tasks, Yu Zhang, Ruiqi Li, Changhao Pan, et al.Technique ReportSwanVoice: Expressive Long-Form Zero-Shot Speech Synthesis for Both Monologue and Dialogue, Ruiqi Li*, Yu Zhang*, Changhao Pan*, et al.ASRU 2025Conan: A Chunkwise Online Network for Zero-Shot Adaptive Voice Conversion, Yu Zhang, Baotong Tian, Zhiyao Duan.
ACM-MM 2025ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting, Yu Zhang, Wenxiang Guo, Changhao Pan, et al.ICML 2026Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformer, Ke Lei*, Yu Zhang*, Changhao Pan, et al.IJCNLP-AACL 2025ASAudio: A Survey of Advanced Spatial Audio Research, Zhiyuan Zhu*, Yu Zhang*, Wenxiang Guo*, et al.ACM-MM 2025A Multimodal Evaluation Framework for Spatial Audio Playback Systems: From Localization to Listener Preference, Changhao Pan*, Wenxiang Guo*, Yu Zhang*, et al.NeurIPS 2025MRSAudio: A Large-Scale Multimodal Recorded Spatial Audio Dataset with Refined Annotations, Wenxiang Guo*, Changhao Pan*, Zhiyuan Zhu*, Xintong Hu*, Yu Zhang*, et al.
NeurIPS 2024 SpotlightGTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks, Yu Zhang, Changhao Pan, Wenxinag Guo, et al.EMNLP 2025Versatile Framework for Song Generation with Prompt-based Control, Yu Zhang, Wenxiang Guo, Changhao Pan, et al.ACL 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis, Yu Zhang, Wenxiang Guo, Changhao Pan, et al.EMNLP 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control, Yu Zhang, Ziyue Jiang, Ruiqi Li, et al.AAAI 2024StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis, Yu Zhang, Rongjie Huang, Ruiqi Li, et al.ACL 2025STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation, Wenxiang Guo*, Yu Zhang*, Changhao Pan*, et al.