Quick, Create a Distractor! Evaluating LLM Distractors for Multiple-Choice Benchmarks
Atrey Desai, Nishant Balepur, Rachel Rudinger
Under ACL ARR Review, 2026 preprint
hi, i'm atrey desai
I am a final-year undergraduate studying computer science and linguistics at the University of Maryland.
I am fortunate to be advised by Professors Rachel Rudinger, Jordan Boyd-Graber, and Mohit Iyyer.
Language models are increasingly deployed as agents in open-ended, real-world environments; however, our ability to know when to trust these systems has not kept pace. I study how humans and AI systems can build calibrated trust in the world and in each other, namely:
Shows full research questions for all research interests.
Test-Time Reasoners Are Strategic Multiple-Choice Test-Takers
Nishant Balepur, Atrey Desai, Rachel Rudinger
ACL Main, 2026
Filling in the Mechanisms: How do LMs Learn Filler-Gap Dependencies under Developmental Constraints?
Atrey Desai, Sathvik Nair
ACL Findings; TLS, 2026 Oral (TLS)