Ph.D. Student @ WHU

Kaiyan Zhao 赵开延

Researching Reinforcement Learning & Automatic Control at Wuhan University.
Co-founder of XY-Lab.

Passionate about making RL both useful and interesting.
(Recruiting) Always open to collaborators.

Kaiyan Zhao

Latest Updates

  • 2025.11 Four papers accepted to AAAI 2026.
  • 2025.04 Two papers accepted to IJCAI 2025.
  • 2025.02 Paper on HeMoRa accepted to CVPR 2025.
  • 2024.09 Paper on rethinking exploration published as Spotlight in NeurIPS 2024.
  • 2024.09 Officially began Ph.D. studies at Wuhan University.
  • 2024.07 Paper accepted to AAMAS.
  • 2022.08 Paper accepted to PVLDB.

Selected Publications

LSPE

Latent State-Predictive Exploration for Deep Reinforcement Learning

Yiming Wang, Kaiyan Zhao, Borong Zhang, Yan Li, Leong Hou U
AAAI 2026
ETL

Explore to Learn: Latent Exploration through Disentangled Synergy Patterns for RL in Overactuated Control

Yiming Wang, Kaiyan Zhao, Xu Li, Yan Li, Jiayu Chen, Steven Morad, Leong Hou U
AAAI 2026 Oral
DSAP

DSAP: Enhancing Generalization in Goal-Conditioned Reinforcement Learning

Yiming Wang, Kaiyan Zhao, Ming Yang, Yan Li, Furui Liu, Jiayu Chen, Leong Hou U
AAAI 2026
RGMP

RGMP: Recurrent Geometric-prior Multimodal Policy for Generalizable Humanoid Robot Manipulation

Xuetao Li, Wenke Huang, Nengyuan Pan, Kaiyan Zhao, Songhua Yang, Yiming Wang... Miao Li
AAAI 2026
BILE

BILE: An Effective Behavior-based Latent Exploration Scheme for Deep Reinforcement Learning

Yiming Wang, Kaiyan Zhao, Yan Li, Leong Hou U
IJCAI 2025
EDER

Efficient Diversity-based Experience Replay for Deep Reinforcement Learning

Kaiyan Zhao, Yiming Wang, Yuyang Chen, Yan Li, Leong Hou U, Xiaoguang Niu
IJCAI 2025
HeMoRa

HeMoRa: Unsupervised Heuristic Consensus Sampling for Robust Point Cloud Registration

Shaocheng Yan, Yiming Wang, Kaiyan Zhao, Pengcheng S, Zhenjun Z, Yongjun Z, Jiayuan L
CVPR 2025
EME

Rethinking Exploration in Reinforcement Learning with Effective Metric-Based Exploration Bonus

Yiming Wang, Kaiyan Zhao, Furui Liu, Leong Hou U
NeurIPS 2024 Spotlight Top 3%
BTP

Enhancing LLM Agents for Code Generation with Possibility and Pass-rate Prioritized Experience Replay

Yuyang Chen, Kaiyan Zhao, Yiming Wang, Ming Yang, Jian Zhang, Xiaoguang Niu
Preprint
AARR-Net

AARR-Net: An Attention Assistance Feature Fusion and Model Recursive Recovery Network for Category-level 6D Object Pose Estimation

Haoning Wu, Kaiyan Zhao, Shaowu Wu, Xiaoguang Niu, Xiaoping Wu
ICONIP 2024
Team-wise

Team-wise Effective Communication in Multi-Agent Reinforcement Learning

Ming Yang, Kaiyan Zhao, Yiming Wang, Renzhi Dong, Yali Du, F Liu, M Zhou, Leong Hou U
AAMAS 2024
LIBKDV

LIBKDV: A Versatile Kernel Density Visualization Library for Geospatial Analytics

Tsz Nam Chan, Pak Lon Ip, Kaiyan Zhao, Leong Hou U, Byron Choi, Jianliang Xu
PVLDB 2022, Vol 15, No. 12