publications

2025

  1. Optimizing Hidden Markov Language Models: An Empirical Study of Reparameterization and Initialization Techniques
    Ivan Lee and Taylor Berg-Kirkpatrick
    Findings of NAACL 2025
  2. Readability ≠ Learnability: Rethinking the Role of Simplicity in Training Small Language Models
    Oral Spotlight (top 5.7%)
    Ivan Lee and Taylor Berg-Kirkpatrick
    COLM 2025
  3. Pragmatic Structured Generation: A Case Study on JSON Schema
    Ivan Lee, Loris D’Antoni, and Taylor Berg-Kirkpatrick
    DL4C @ NeurIPS 2025 (Workshop)

2024

  1. Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability
    Ivan Lee, Nan Jiang, and Taylor Berg-Kirkpatrick
    ICLR 2024

2022

  1. Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Context
    Daniel Spokoyny, Ivan Lee, Zhao Jin, and 1 more author
    Findings of NAACL 2022
  2. HeLo: Learning-Free Lookahead Decoding for Conversation Infilling
    Ivan Lee and Taylor Berg-Kirkpatrick
    Findings of EMNLP 2022