Harbor Adapters and Harbor-Index:Infrastructure and Curated Meta-Dataset for Large-Scale Agentic Evaluation. Work with Harbor Adapter team
➊ AI Writers Have a Consistent Stylometric Footprint, but AI Editors Do Not ➋ PGMem: Tightly Coupled Persona–Memory Graph for Lifelong Personalized Agents and ➌ LLMs Learn Better In-Context from Rules than from Examples
‘Cliff Tokens: Identifying Single-Token Failure Triggers in LLM Mathematical Reasoning’ now available on arXiv! Work with Jaeyong Ko and Pilsung Kang. Congrats to Jaeyong on his very first paper 🎉
‘CIRF: Tokenizing Chain-of-Thoughts into Reusable Functional Units for Efficient Latent Reasoning in Large Language Models’ now available on arXiv! Collaborated with HUFS team 🦉
Can Structural Cues Save LLMs? Evaluating Language Models in Massive Document Streams. Work with Yebin Lim, Woojun Jung, Wonjun Choi and Prof. Susik Yoon 🐯
RExBench, Can coding agents autonomously implement AI research extensions?
Topic - Towards a Science of Evaluation for Language Model
Topic - Can coding agents autonomouslyimplement AI research extensions?
CheckEval, A reliable LLM-as-a-Judge framework for evaluating text generation using checklists. Thanks to my collaborators ❤️
Topic - Can coding agents autonomously implement AI research extensions?
Can coding agents autonomously implement AI research extensions? Our RExBench is now available on arXiv !
Our WritingPath paper has been accepted to NAACL 2025 (Industry Track)!
Our ContAccum paper has been accepted to NeurIPS 2024!
Topic => Goal-Oriented Language Model and Evaluation
🤖💭🦔
about LLM-based Evaluation for Open-ended Generation