About me

I am an Assistant Professor in the School of Electrical Engineering at Korea University. Previously, I was a postdoctoral researcher at KAIST, working with Prof. Juho Lee, and at Mila and Université de Montréal, working with Prof. Yoshua Bengio. I received my Ph.D. from KAIST, where I was advised by Prof. Sung Ju Hwang.

Research vision

LLMs know many things.
Agents must know what to trust, what to question, and what to do next.

I build explicit world models that serve as the working memory of language-model agents: small, testable, uncertainty-aware workspaces where knowledge is checked against evidence, repaired where it fails, and consolidated for future use.

Explicit world models as working memoryKnowledge is externalized from the language model into a small explicit working memory and tested there against evidence from experiments. Verified results are archived as explicit records, which can be retrieved later; records that prove stable are internalized into the language model, and records that are unused are forgotten. Implicit memory language-model parameters Explicit working memory verify against evidence revise where it fails small · testable · uncertainty-aware Explicit records verified knowledge with its evidence Experiments evidence from the system externalize archive retrieve internalize when stable evidence forget: compress or discard
  1. Externalize what is uncertain, fallible, or decision-relevant
  2. Verify it against evidence and revise what fails
  3. Archive verified results with their evidence
  4. Internalize what proves stable; forget the rest
Knowledge is externalized from a language model into a small explicit working memory, tested there, and archived with its evidence. Records that prove stable are internalized back into the model; only what is held in working memory is modeled with precision.
Explicit world model
Knowledge stated as executable hypotheses (equations, programs, causal graphs, logical rules) that make testable predictions and expose the mechanisms and assumptions behind them.
Working memory
The small, active set of variables, hypotheses, and verified models that an agent needs for its current inference, test, or decision, held with uncertainty over alternatives.
Read the full research statement

Language models know a great deal about the world, but their knowledge is stored in parameters. It is not attached to the evidence that supports it, it carries no calibrated estimate of its reliability, and when part of it is wrong for a particular system, there is no explicit place where the error can be found and repaired. My research asks how an agent that knows many things can also know what to trust, what to question, and what to do next.

The question is becoming urgent. In domains where experiments are costly, generating candidate hypotheses is now far cheaper than testing them, so the bottleneck of intelligent behavior shifts from generation to verification and selection: deciding which explanations to believe, which experiment would best tell them apart, and which part of existing knowledge to revise when evidence disagrees.

Both language models and explicit models can make predictions that are checked against observations. The difference lies in what is falsified when a prediction fails. An explicit model commits to mechanisms and assumptions, so a failure can be traced to specific components, tested by targeted experiments, and repaired locally. This structure makes calibrated uncertainty, local revision, and extrapolation possible, though it does not guarantee them; they have to be earned empirically.

I therefore treat an explicit world model as the working memory of a language-model agent. This builds on the distinction in model-based machine learning between a compact world model and a large amortized inference machine, but starts from a pretrained language model as a proposal mechanism and a source of background knowledge, one that arrives entangled with an implicit world model of its own and is not assumed to perform calibrated inference for the explicit one. Knowledge is brought into working memory when it must be tested, verified and revised there, and archived with its evidence as an explicit record. Records that prove stable and recurrent are internalized back into the model; the rest are retained for exact computation or forgotten.

Because working memory reasons explicitly about only a few variables while the language model stands in for the rest of the world, its central difficulty lies at that boundary. Errors arise when the language model's summary of the outside world is wrong, or when evidence depends on variables left outside. Understanding this boundary tells an agent what to make explicit, and the utilities it pursues decide at what resolution, and for how long, that knowledge is kept.

These capabilities matter well beyond science. Any agent that acts in the world, whether it is optimizing an engineering process, diagnosing a failure, or carrying out a long task, needs to know what is grounded in evidence, what remains uncertain, and what to check next.

Research directions

Language models bring broad prior knowledge to propose hypotheses; probabilistic inference holds those hypotheses accountable to evidence.

Inside working memory

1Verifying and revising explicit knowledge

How accurately, and with how few experiments, can explicit knowledge be verified and repaired?

  • Numerical laws
  • Causal models
  • Relational rules
  • Action laws
  • Assumption-level revision
More

Language models propose candidate hypotheses; probabilistic inference weighs them against evidence; and experiments are chosen to tell the remaining alternatives apart. When a prediction fails, competing explanations of the failure are compared and only the implicated component is repaired, while the rest is kept. I study this verification engine across numerical laws, causal structure, relational rules, and the laws that govern how actions change the world.

Because the value of explicit verification lies where implicit knowledge fails, I evaluate it on mechanisms that language models do not already know, and I always include the language model's own direct predictions as a competing candidate.

At the boundary

2Deciding what to make explicit

When a language model knows some things and not others, what should an agent bring into working memory?

  • LLM priors
  • Self-inconsistency
  • Boundary error
  • Evidence accounting
  • Domain-specific records
More

Working memory is small, so deciding what to load into it matters as much as the inference performed inside it. Knowledge deserves to be made explicit when it is uncertain, when the language model is likely to be wrong about it, and when a decision depends on it. One useful signal is available before any experiment: disagreement between a language model's intuitive predictions and the predictions implied by the theories it states.

I study how to turn a language model's beliefs into calibrated priors over explicit hypotheses without counting the same evidence twice; how errors arise at the boundary between working memory and the knowledge outside it, and how to diagnose them; and how to use domain-specific records that no language model has seen, kept with their provenance and collection conditions.

Across tasks and time

3Knowledge for action, over time

Under multiple and changing goals, how should knowledge be used, kept, and internalized?

  • Planning with learned laws
  • Utility-driven learning
  • Consolidation
  • Internalization
  • Self-improving agents
More

A world model is justified by what an agent can do with it: reuse learned laws for new goals, recover quickly when part of the world changes, and check plans before acting. I study planning with discovered laws, for example in open-ended game environments, and engineering uses such as optimizing a process or diagnosing why a system failed in terms of the assumptions a model makes explicit.

Goals are many and they change, so utility should decide not only what an agent learns but at what resolution it keeps that knowledge and for how long. Verified corrections are first kept as explicit records and supplied in context, and only stable, broadly useful ones are internalized into the model, with the explicit record serving as a regression test. I also study self-improving agents that extract reliable knowledge from their own trajectories and consolidate it into themselves.

Prospective students

I welcome motivated students from electrical engineering, computer science, mathematics, and related fields who are excited by questions about intelligence, reasoning, and learning. If these directions interest you, please feel free to contact me.

Undergraduate interns
No prior AI or ML experience required. Curiosity, initiative, and enthusiasm for research matter most.
Master’s students
Some background in AI or ML, shown through coursework, research internships, or relevant experience.
Ph.D. students
At least one first-authored paper at a leading AI/ML venue, such as NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, or ICCV.

For graduate applicants, I strongly recommend a research internship in my group for at least three months before applying.

Contact haebeomlee [at] korea [dot] ac [dot] kr

Awards

  • 2021Google Ph.D. Fellowship
  • 2019–2021Global Ph.D. Fellowship
  • 2020, 2022Outstanding Reviewer, ICML (Top 33% and Top 10%)

Publications

Recent preprints

  1. arXiv 2026

    GFlowPO: Generative Flow Network as a Language Model Prompt Optimizer

    Junmo Cho*, Suhan Kim*, Sangjune An*, Minsu Kim, Dong Bok Lee, Heejun Lee, Kyu Hyun Choi, Byung-Soo Kim, Sung Ju Hwang, Hae Beom Lee

    *: equal contribution

  2. arXiv 2026

    Let Agents Design How They Search: Automatic Interface Optimization for Agentic Search

    Sangjune An, Jaeyoon Jung, Yumin Choi, Jinheon Baek, Junmo Cho, Sung Ju Hwang, Hae Beom Lee

  3. arXiv 2026

    Bayesian Model Discovery with Language Models: Closing the Loop between Hypotheses and Experiments

    JooKyung Yuh, Byungmin Park*, Eunseo Choi*, Jinheon Baek, Junmo Cho, Kyu Hyun Choi, Sung Ju Hwang, Kyong Hwan Jin†, Hae Beom Lee†

    *: equal contribution as second authors, †: co-corresponding authors

Conference publications

  1. NeurIPS 2026

    ProPolar: Progressive Polar Decomposition for Implicit Neural Representations

    Pureum Kim, Younggeon Ryu, Dongyoon Lee, Hae Beom Lee†, Kyong Hwan Jin†

    †: co-corresponding authors

  2. NeurIPS 2025

    Cost-Sensitive Freeze-thaw Bayesian Optimization for Efficient Hyperparameter Tuning

    Dong Bok Lee, Aoxuan Silvia Zhang, Byungjoo Kim, Junhyeon Park, Steven Adriaensen, Juho Lee, Sung Ju Hwang, Hae Beom Lee

  3. ICML 2025

    Bayesian Neural Scaling Laws Extrapolation with Prior-Fitted Networks

    Dongwoo Lee*, Dong Bok Lee*, Steven Adriaensen, Juho Lee, Sung Ju Hwang, Frank Hutter, Seon Joo Kim, Hae Beom Lee

    *: equal contribution

  4. ICLR 2024

    Delta-AI: Local Objectives for Amortized Inference in Sparse Graphical Models

    Jean-Pierre René Falet*, Hae Beom Lee*, Nikolay Malkin*, Chen Sun, Dragos Secrieru, Dinghuai Zhang, Guillaume Lajoie, Yoshua Bengio

    *: equal contribution

  5. ICLR 2022Spotlight

    Online Hyperparameter Meta-Learning with Hypergradient Distillation

    Hae Beom Lee, Hayeon Lee, Jaewoong Shin, Eunho Yang, Timothy M. Hospedales, Sung Ju Hwang

  6. ICLR 2022

    Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning

    Seanie Lee*, Hae Beom Lee*, Juho Lee, Sung Ju Hwang

    *: equal contribution

  7. ICLR 2022

    Meta-Learning Low Rank Covariance Factors for Energy-Based Deterministic Uncertainty

    Jeffrey Ryan Willette, Hae Beom Lee, Juho Lee, Sung Ju Hwang

  8. ICML 2021

    Large-Scale Meta-Learning with Continual Trajectory Shifting

    Jaewoong Shin*, Hae Beom Lee*, Boqing Gong, Sung Ju Hwang

    *: equal contribution

  9. NeurIPS 2020Spotlight

    MetaPerturb: Transferable Regularizer for Heterogeneous Tasks and Architectures

    Jeongun Ryu*, Jaewoong Shin*, Hae Beom Lee*, Sung Ju Hwang

    *: equal contribution

  10. Interspeech 2020

    Meta-Learning for Short Utterance Speaker Recognition with Imbalance Length Pairs

    Seong Min Kye, Youngmoon Jung, Hae Beom Lee, Sung Ju Hwang, Hoirin Kim

  11. ICML 2020

    Meta Variance Transfer: Learning to Augment from the Others

    Seong Jin Park, Seungju Han, Ji-won Baek, Insoo Kim, Juhwan Song, Hae Beom Lee, Jae-Joon Han, Sung Ju Hwang

  12. ICLR 2020Oral

    Learning to Balance: Bayesian Meta-Learning for Imbalanced and Out-of-distribution Tasks

    Hae Beom Lee*, Hayeon Lee*, Donghyun Na*, Saehoon Kim, Minseop Park, Eunho Yang, Sung Ju Hwang

    *: equal contribution

  13. ICLR 2020

    Meta Dropout: Learning to Perturb Latent Features for Generalization

    Hae Beom Lee, Taewook Nam, Eunho Yang, Sung Ju Hwang

  14. NeurIPS 2018

    DropMax: Adaptive Variational Softmax

    Hae Beom Lee, Juho Lee, Saehoon Kim, Eunho Yang, Sung Ju Hwang

  15. NeurIPS 2018

    Uncertainty-Aware Attention for Reliable Interpretation and Prediction

    Jay Heo*, Hae Beom Lee*, Saehoon Kim, Juho Lee, Kwang Joon Kim, Eunho Yang, Sung Ju Hwang

    *: equal contribution

  16. ICML 2018

    Deep Asymmetric Multi-task Feature Learning

    Hae Beom Lee, Eunho Yang, Sung Ju Hwang

Earlier preprints

  1. arXiv 2022

    Dataset Condensation with Latent Space Knowledge Factorization and Sharing

    Hae Beom Lee*, Dong Bok Lee*, Sung Ju Hwang

    *: equal contribution

  2. arXiv 2020

    Meta-Learned Confidence for Few-shot Learning

    Sung Min Kye, Hae Beom Lee, Hoirin Kim, Sung Ju Hwang

  3. arXiv 2018

    Adaptive Network Sparsification with Dependent Variational Beta-Bernoulli Dropout

    Juho Lee, Saehoon Kim, Jaehong Yoon, Hae Beom Lee, Eunho Yang, Sung Ju Hwang