Intro

I'm a Postdoctoral Research Associate in the MURGe-Lab at the University of North Carolina, Chapel Hill, working with Prof. Mohit Bansal. Prior to joining UNC, I received my Ph.D. degree from Korea Advanced Institute of Science and Technology (KAIST) in 2023, advised by Prof. Sung Ju Hwang, and won the best Ph.D. Dissertation Award from the KAIST College of Engineering and School of Computing. During my Ph.D. study, I interned at Microsoft Research, mentored by Dr. Yue Cao, and worked as a short-term visiting student at the Weizmann Institute of Science, hosted by Prof. Yonina Eldar. I received my B.S. and M.S. degrees from Ulsan National Institute of Science and Technology (UNIST).

For my long-term research goal, I've been dedicated to developing lifelong adaptability in embodied AI systems and multimodal foundation models (e.g., VLM, MLLM, diffusion models) within dynamic real-world environments. These systems aim to be reliable, improvable, interactive, and compositional, addressing practical, real-world challenges to better understand human behavior and significantly impact our daily lives.

My recent research interest includes the following topics:

• LURE: Analyzing and Mitigating Object Hallucination in MLLMs (ICLR 2024)
• SELMA: Learning/Merging Skill-Specific T2I Experts with Auto-Generated Data (arXiv 24.03)
• EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)

• Mementos: Comprehensive Benchmark for MLLM Reasoning over Image Sequences (ACL 2024)
• CREMA: Generalizable & Efficient Video-Language Reasoning via Any-Modal Modular Fusion (arXiv 24.02)
• VideoTree: Query-Adaptive Tree-based Long-Video Understanding (arXiv 24.05)
• RACCooN: Interactive Video Content Editing with Auto-Generated Descriptions & Planning (arXiv 24.05)

• OCS: Online Coreset Selection for Imbanalced and Noisy Continual Learning (ICLR 2022)
• GLAD: On the Study of Incremental Model Generalizers (ICML 2023)
• Carpe Diem: Evaluation of World Knowledge in Lifelong LLMs (NAACL 2024)
• STELLA: Continual Pre-training over Audio-Video Modalities (ICML 2024)

• ProWD: Federated Learning with Bitwidth Heterogeneity across Participating Devices (ICML 2022)
• ECoFLaP: Coarse-to-Fine Layer-Wise Pruning for Multi-/Uni-modal Large Models (ICLR 2024)
• BECoTTA: Mixture-of-Domain-Experts for Continual Test-Time Adaptation (ICML 2024)
• EVEREST: Efficient Masked Video Autoencoder by Removing Redundant Tokens (ICML 2024)

Related techniques: video-language reasoning, video generation and editing, multimodal foundation models, hallucination, toxicity, and bias detection and mitigation, data-efficient learning, continual learning, federated learning, model pruning and merging, parameter-efficient modular learning.

News

Recent Preprints

(*: equal contribution)

Professional Services

Invited Talks