01About
I'm Ruizhe Li (李睿哲), an undergraduate at USTC majoring in Data Science. I'm interested in LLM agents, deep research, and agent memory.
LLM Agents
Deep Research
Agent Memory
03Publications
Preprint · 2026
DeepResearch Bench II: Diagnosing Deep Research Agents via Rubrics from Expert Reports
Ruizhe Li*, Mingxuan Du*, Benfeng Xu, Chiwei Zhu, Xiaorui Wang, Zhendong Mao · *equal contribution
arXiv:2601.08536 · 2026
A benchmark of 132 expert-grounded tasks across 22 domains and 9,430 fully-verifiable binary rubrics, scoring deep-research reports on information recall, analysis, and presentation. Built with a four-stage LLM+human pipeline and 400+ expert-hours — even the strongest systems satisfy fewer than 50% of rubrics.
EMNLP 2025
Automated Creativity Evaluation for Large Language Models: A Reference-Based Approach
Ruizhe Li, Chiwei Zhu, Benfeng Xu, Xiaorui Wang, Zhendong Mao
EMNLP 2025 · arXiv:2504.15784
A reference-based method that scores the creativity of large-language-model outputs against human references, offering a more reliable and automatic alternative to costly human creativity ratings.
CIKM 2024
Reformulating Conversational Recommender Systems as Tri-Phase Offline Policy Learning
Gangyi Zhang, Chongming Gao, Hang Pan, Runzhe Teng, Ruizhe Li
CIKM 2024 · arXiv:2408.06809
Recasts conversational recommendation as a three-phase offline policy-learning problem, decoupling interaction-policy learning from costly online exploration.
04Projects
DeepResearch-Bench-II★ 59
Evaluation suite and leaderboard for deep-research agents, grounded in expert-written reports. Rubric extraction, batched LLM-as-judge scoring, and token accounting.
05Education · Service · Skills
- B.S. in Data Science USTC · School of AI & Data Science
- President, Student Union School of AI & Data Science, USTC
- Teaching Assistant, DS4001 Data Science course · 2025 Spring
- Member, Tang Zhongying Charity Society Volunteering
PythonPyTorchLLM / AgentsRAG
LaTeXGitHTML / CSS / JSC