USTC · AI & Data Science

Ruizhe Li

李睿哲

Undergraduate researcher working on deep research systems and agent memory — how LLM agents gather, verify, and synthesize information at expert level.

University of Science and Technology of China · Hefei
School of Artificial Intelligence and Data Science
Group of Prof. Zhendong Mao (USTC-CMI)
01About

I'm Ruizhe Li (李睿哲), an undergraduate at USTC majoring in Data Science. I'm interested in LLM agents, deep research, and agent memory.

LLM Agents Deep Research Agent Memory
02News
03Publications
Preprint · 2026

DeepResearch Bench II: Diagnosing Deep Research Agents via Rubrics from Expert Reports

Ruizhe Li*, Mingxuan Du*, Benfeng Xu, Chiwei Zhu, Xiaorui Wang, Zhendong Mao · *equal contribution

arXiv:2601.08536 · 2026

A benchmark of 132 expert-grounded tasks across 22 domains and 9,430 fully-verifiable binary rubrics, scoring deep-research reports on information recall, analysis, and presentation. Built with a four-stage LLM+human pipeline and 400+ expert-hours — even the strongest systems satisfy fewer than 50% of rubrics.

EMNLP 2025

Automated Creativity Evaluation for Large Language Models: A Reference-Based Approach

Ruizhe Li, Chiwei Zhu, Benfeng Xu, Xiaorui Wang, Zhendong Mao

EMNLP 2025 · arXiv:2504.15784

A reference-based method that scores the creativity of large-language-model outputs against human references, offering a more reliable and automatic alternative to costly human creativity ratings.

CIKM 2024

Reformulating Conversational Recommender Systems as Tri-Phase Offline Policy Learning

Gangyi Zhang, Chongming Gao, Hang Pan, Runzhe Teng, Ruizhe Li

CIKM 2024 · arXiv:2408.06809

Recasts conversational recommendation as a three-phase offline policy-learning problem, decoupling interaction-policy learning from costly online exploration.

04Projects
DeepResearch-Bench-II★ 59

Evaluation suite and leaderboard for deep-research agents, grounded in expert-written reports. Rubric extraction, batched LLM-as-judge scoring, and token accounting.

PythonRepo ↗
05Education · Service · Skills
  • B.S. in Data Science USTC · School of AI & Data Science
  • President, Student Union School of AI & Data Science, USTC
  • Teaching Assistant, DS4001 Data Science course · 2025 Spring
  • Member, Tang Zhongying Charity Society Volunteering
PythonPyTorchLLM / AgentsRAG LaTeXGitHTML / CSS / JSC