About / 个人简介
I am a 2023-cohort undergraduate in the Radio Wave Propagation and Antennas Honors Program at the School of Physics, Xidian University, and expect to graduate in July 2027. My research lies at the intersection of multimedia signal processing and artificial intelligence, with a focus on multimodal generation and understanding, deepfake speech detection, model generalization, and interpretability.
I am currently a research intern in Xiaoping Zhang’s group at Tsinghua University, studying how deepfake speech detectors generalize across speech-generation paradigms. Previously, I led the VMM research on video-to-music generation as first author, contributed to the HumanMAC++ project on diffusion-based human motion prediction, and led a national undergraduate innovation project on diffusion-model-based mural restoration.
许嘉俊，西安电子科技大学物理学院电波传播与天线实验班 2023 级本科生。主要研究多模态生成与理解、深伪语音检测及模型泛化与可解释性，现于清华大学张晓平院士课题组开展科研实习；以第一作者在 CVIU 发表视频到音乐生成研究，并参与 HumanMAC++ 与扩散模型壁画修复项目。
Research Interests
- Trustworthy multimedia intelligence（可信多媒体智能）: deepfake speech detection, out-of-distribution generalization, failure analysis, and model interpretability.
- Multimodal generation and understanding（多模态生成与理解）: video-to-music generation, audiovisual semantic and affective alignment, and generative models.
- Physics-inspired foundations of large models（物理启发的大模型理论基础）: exploring physical principles for energy-efficient LLMs and AGI-oriented learning systems, while using mathematical tools to formulate rigorous, operational definitions of intelligence.
News
- May 2026: Received an Honorable Mention in the Mathematical Contest in Modeling (MCM).
- March 2026: Joined Xiaoping Zhang's group at Tsinghua University to work on deepfake speech detection.
- October 2025: The first-author VMM paper became available online in Computer Vision and Image Understanding.
- 2024: Received the National Scholarship for Undergraduate Students and the Outstanding Student Model honor at Xidian University.
Publications
VMM: Video-Music Mamba for Generating Background Music from Videos
Jiajun Xu, Zixiang Lu, Ping Gao, Qiguang Miao, Kun Xie
Computer Vision and Image Understanding, 262, Article 104545, December 2025.
VMM combines Mamba and Transformer components to model long-range musical structure and local interactions, with a Switch Schedule for coordinating video and chord conditioning.
Research
Deepfake Speech Detection
Research Intern, Xiaoping Zhang’s Group, Tsinghua University | March 2026 - Present
I study how deepfake speech detectors generalize across speech-generation paradigms. My current work develops controlled evaluation and representation-diagnostic procedures and explores multi-layer speech representations with Mixture of Experts integration for unseen codec conditions. This research is ongoing.
VMM: Video-Music Mamba
First Author | June 2024 - November 2025
I led the problem formulation, literature review, method design, experiments, visualization, and paper writing for video-to-music generation. The project investigates visual semantics, temporal structure, and affective alignment in generated music.
HumanMAC++
Research Intern, Tsinghua University | September 2023 - December 2023
I contributed to experimental validation for diffusion-based human motion prediction and studied the SDE view that unifies NCSN and DDPM, together with the DDNM method.
Diffusion-Model-Based Mural Restoration Platform
Project Lead, National Undergraduate Innovation and Entrepreneurship Training Program
I led the team through literature study, method design, model reproduction, system implementation, debugging, and final presentation. The project completed its planned review and explored generative models for digital cultural-heritage restoration.
Education
Xidian University
B.Sc. Student, Radio Wave Propagation and Antennas Honors Program | 2023 - Expected July 2027
- GPA: 3.84/4.00
- Rank: 2/33 over the first five semesters
Honors and Awards
- 2026 Mathematical Contest in Modeling (MCM), Honorable Mention
- 2024 Interdisciplinary Contest in Modeling (ICM), Honorable Mention
- 2024 National Scholarship for Undergraduate Students (Top 1%)
- 2024 Outstanding Student Model, Xidian University
Last updated: August 2026