Senior Researcher, Speech Synthesis and Multimodal LLM

Business Unit

About the Hiring Team

What the Role Entails

• Research and develop advanced speech synthesis and generation algorithms (e.g., TTS, voice conversion, sound/music generation) based on LLMs, multimodal/omnimodal LLMs.
• Develop and optimize speech and audio synthesis systems for online applications, improving effectiveness, efficiency, and scalability.
• Explore and advance full-duplex/streaming multimodal LLM capabilities in speech understanding, generation, and real-time spoken interaction.
• Collaborate cross-functionally with research and engineering teams from prototyping to production.

Who We Look For

• Ph.D. in Computer Science, Electrical Engineering, Signal Processing, or a closely related field.
• Strong foundation in speech/audio processing and modern generative models (e.g., diffusion, flow matching, autoregressive, codec-based approaches).
• Hands-on experience extending LLMs to speech/audio modalities (e.g., speech tokenizers, multimodal adapters, speech-text joint training). Experience with full-duplex or streaming spoken dialogue systems and real-time interaction modeling is a plus.
• Proficient in Python and deep learning frameworks (e.g., PyTorch); experience with distributed training is a plus.
• Track record of publications at top-tier venues (e.g., ICML, NeurIPS, ICLR, ACL, ICASSP, Interspeech).

Equal Employment Opportunity at Tencent

As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.