Page Archive

Biography

PhD student at UW-Madison working on test-time training, efficient LLM architecture, and long-context memory.

ALSACE: Mitigating Language-Level Performance Disparity in mPLMs via Teacher Language Selection and Cross-lingual Self-Distillation

Blog

Posts by Category

Posts by Collection

Compositional Task Representations for Large Language Models

CV

Delta Attention Residuals

DialogVCS: Robust Natural Language Understanding in Dialogue System Upgrade

DiffCap: Exploring Continuous Diffusion on Image Captioning

HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading

Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoning

Human-in-the-Loop through Chain-of-Thought

Last Layer Key-Value Cache is All You Need

MENTOR: Efficient Autoregressive Image Generation with Balanced Multimodal Control

ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code

MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation

MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning

Multi-Head Attention Residuals

Page Archive

Projects

Publications

PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling

R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

Research

SANTA: Separate Strategies for Inaccurate and Incomplete Annotation Noise in Distantly-Supervised Named Entity Recognition

Sitemap

Posts by Tag

Test-Time Generation

Test-Time Training with Next-Token Prediction

Universal Test-Time Training

VeCAF: Vision-language Collaborative Active Finetuning with Training Objective Awareness

From Preferences to Prejudice: The Role of Alignment Tuning in Shaping Social Bias in Video Diffusion Models

Posts by Year

Improving Event Definition Following For Zero-Shot Event Detection