Portrait of Yuhao Shen
Yuhao Shen

Direct Ph.D. Student · Zhejiang University

Yuhao Shen (沈宇豪)

Hey, I'm Yuhao Shen, a direct PhD student at the College of Control Science and Engineering, Zhejiang University, advised by Prof. Cong Wang. I also received my B.E. degree from Zhejiang University.

My research lies in MLSys, LLM Inference, AI Infrastructure, and Edge Computing. Over the past two years, I have been deeply engaged in the field of speculative sampling and decoding. I was previously a research intern at Qwen Application and received an internship offer from the Tencent Hunyuan Qingyun Project. Currently, I am researching RL rollout acceleration in the Tongyi Qwen Foundation Model Infra group. Outside academia, I enjoy playing basketball, video games, and photography.

Speculative Decoding RL Infrastructure LLM Serving Edge AI

Recent News

Education

Zhejiang University logo Zhejiang University, Hangzhou, China
Direct Ph.D. in Control Science and Engineering, 2024 - 2029
Advisor: Cong Wang
Zhejiang University logo Zhejiang University, Hangzhou, China
Bachelor of Engineering in Control Science and Engineering, 2020 - 2024
Advisor: Cong Wang

Publications

Bebop MTP illustration

Bebop: Breaking Entropy Bounds: Accelerating RL Training via MTP with Rejection Sampling

Yucheng Li, Huiqiang Jiang, Yang Xu, Jianxin Yang, Yi Zhang, Yizhong Cao, Yuhao Shen, Fan Zhou, Rui Men, Jianwei Zhang, An Yang, Bowen Yu, Bo Zheng, Fei Huang, Junyang Lin, Dayiheng Liu, Jingren Zhou

arXiv (2026)

ECHO illustration

ECHO: Elastic Speculative Decoding with Sparse Gating for High-Concurrency Scenarios

Xinyi Hu*, Yuhao Shen*, Baolin Zhang, Hengxin Zhang, Jun Dai, Shuang Ge, Lei Chen, Yue Li, Mingcheng Wan (Equal Contribution)

ICML Oral/Spotlight, 2026

Double illustration

Double: Breaking the Acceleration Limit via Double Retrieval Speculative Parallelism

Yuhao Shen, Tianyu Liu, Junyi Shen, Jinyang Wu, Quan Kong, Huan Li, Cong Wang

ACL 2026 Best Paper Candidate (SAC Highlight/Oral)

Maestro illustration

Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensembles

Jinyang Wu, Guocheng Zhai, Ruihan Jin, Yuhao Shen, Zhengxi Lu, Fan Zhang, Haoran Luo, Zheng Lian, Zhengqi Wen, Jianhua Tao

arXiv (2026)

When Hidden States Drift illustration

When Hidden States Drift: Can KV Caches Rescue Long-Range Speculative Decoding?

Tianyu Liu, Yuhao Shen, Xinyi Hu, Baolin Zhang, Hengxin Zhang, Jun Dai, Jun Zhang, Shuang Ge, Lei Chen, Yue Li, MingCheng Wan

arXiv (2026)

Draft Less, Retrieve More illustration

Draft Less, Retrieve More: Hybrid Tree Construction for Speculative Decoding

Yuhao Shen, Tianyu Liu, Xinyi Hu, Quan Kong, Baolin Zhang, Jun Dai, Jun Zhang, Shuang Ge, Lei Chen, Yue Li, Mingcheng Wan, Cong Wang

arXiv (2026)

Spark illustration

Spark: Strategic Policy-Aware Exploration via Dynamic Branching for Long-Horizon Agentic Learning

Jinyang Wu, S Yang, C Yang, Yuhao Shen, S Zhang, Z Wen, J Tao

ACL 2026 Main Conference

Atlas illustration

Atlas: Orchestrating Heterogeneous Models and Tools for Multi-Domain Complex Reasoning

Jinyang Wu, G Zhai, R Jin, J Yuan, Yuhao Shen, S Zhang, Z Wen, J Tao

ACL 2026 Findings

ParallelVLM illustration

ParallelVLM: Lossless Video-LLM Acceleration with Visual Alignment Aware Parallel Speculative Decoding

Quan Kong*, Yuhao Shen*, Yicheng Ji, Huan Li, Cong Wang (Equal Contribution)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026

Hetero 2 Pipe illustration

Hetero2 Pipe: Pipelining Multi-DNN Inference on Heterogeneous Mobile Processors under Co-Execution Slowdown

Yuhao Shen, Z Wang, T Wang, C Gu, Z Wen, Y Shu, Cong Wang

IEEE 45th International Conference on Distributed Computing Systems (ICDCS), 2025

SENGraph illustration

SENGraph: A self-learning evolutionary and node-aware graph network for soft sensing in industrial processes

F Yan, Cong Wang, Z Wang, Yuhao Shen, C Yang

IEEE Transactions on Neural Networks and Learning Systems, 2024

Vision-TTT illustration

Vision-TTT: Efficient and Expressive Visual Representation Learning with Test-Time Training

Quan Kong, Yanru Xiao, Yuhao Shen, Cong Wang

European Conference on Computer Vision (ECCV), 2026

SSL illustration

SSL: Sweet Spot Learning for Differentiated Guidance in Agentic Optimization

Jinyang Wu, C Yang, Yuhao Shen, F Xu, B Ni, C Liao, Y Liu, H Wang, S Nie, S Zhang, et al.

arXiv (2026)

TALON illustration

TALON: Confidence-Aware Speculative Decoding with Adaptive Token Trees

Tianyu Liu, Q Lv, Yuhao Shen, X Sun, X Sun

arXiv (2026)

Profession

Qwen Foundation Model logo Research Intern, Qwen Foundation Model
May. 2026 - Present
Topic: Speculative Decoding, RL Infra
Advisor: Yucheng Li, Huiqiang Jiang
Hangzhou, China
Qwen Application logo Research Intern, Qwen Application
Nov. 2025 - May. 2026
Topic: Speculative Decoding, AI Infra
Advisor: Ye Shuang, Jun Dai, Lei Chen
Hangzhou, China