Sofian Zalouk
Contact: saz43 [at] cornell [dot] edu
I’m a third-year PhD student in Computer Science at Cornell University, focusing on machine learning, specifically diffusion language models. I am fortunate to be advised by Prof. Chris De Sa and Prof. Kilian Q. Weinberger. Previously, I was an MS student in Computer Science at Stanford University, where I worked closely with Prof. Stefano Ermon and Prof. Andrew Ng. I completed my B.A.Sc. in Electrical Engineering at the University of Toronto, where I worked with Prof. Andreas Moshovos.
My research focuses on generative modeling for language, particularly the design of efficient and scalable diffusion language models. In LOOT, we introduce the Leave-One-Out transformer that enables masked diffusion models to: 1) learn from every token during training, 2) self-correct during generation. Beyond diffusion, I am interested in separating factual knowledge from reasoning in language models. Along this line, LMLM externalizes factual knowledge into an explicit, editable knowledge base rather than memorizing it in model weights. Please feel free to reach out if you’re interested in collaborating!
news
| Sep 24, 2026 | Our paper Empowering Masked Diffusion Models to Self-Correct with Leave-One-Out Transformers is accepted at NeurIPS 2026! |
|---|---|
| Jan 25, 2026 | Our paper Pre-training Limited Memory Language Models with Internal and External Knowledge is accepted at ICLR 2026! |