Quick, Create a Distractor! Evaluating LLM Distractors for Multiple-Choice Benchmarks
Atrey Desai, Nishant Balepur, Rachel Rudinger
Under ACL ARR Review, 2026
NLPEvaluation
research
publications
Test-Time Reasoners Are Strategic Multiple-Choice Test-Takers
Nishant Balepur, Atrey Desai, Rachel Rudinger
ACL Main, 2026
NLPReasoning
Filling in the Mechanisms: How do LMs Learn Filler-Gap Dependencies under Developmental Constraints?
Atrey Desai, Sathvik Nair
ACL Findings; TLS, 2026 Oral (TLS)
NLPLinguistics
BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks
ACL Main, 2026
NLPEvaluation
Language Models Generate Multiple-Choice Questions with Artifacts
Atrey Desai, Nishant Balepur, Rachel Rudinger
MASC-SLL, 2025
NLPEvaluation
Reinforcement Learning As End-User Trigger-Action Programming
AAAI IML Workshop 2022, RLDM 2022, 2022
RLHCI
preprints
A Preview of Computational Animal Linguistics
Atrey Desai, Tirza Panunto, Lindsay Pike, Theron S. Wang, Tuan M. Dang, Hridayesh Lekhak, Kenny Q. Zhu
Under Review at ACM Computing Surveys, 2025 preprint
NLPLinguistics
class projects
talks
Filler-Gap Dependencies under Developmental Constraints in LMs
The University of Texas at Austin, Feb 2026
Adaptor Grammars and Neural Networks for Feline Lexical Discovery
University of Maryland, College Park, Nov 2024
The University of Texas at Arlington, Jul 2024
presentations
Language Models Generate Multiple-Choice Questions with Artifacts
University of Maryland, College Park, Jul 2025
University of Maryland, College Park, Apr 2025