
JZ
Jike Zhong, Ming Li, Yuxiang Lai
· 1 min read
ResearcharXiv cs.LG
When the Right Answer Is Missing: An Arithmetic-Dependent Rejection Bottleneck in Jev
arXiv:2609.39496v1 Announce Type: new
Abstract: Typed decision models such as Jev offer an efficient alternative to generative LLMs in decision-making workflows by selecting directly from predefined options. When candidate sets contain no valid answer, TypeSafe recommends including an "other" or "none-of-the-above" option to enable rejection. In this report, however, we identify an arithmetic-dependent rejection bottleneck: Jev reliably selects correct numerical answers when available but frequently accepts incorrect alternatives when they are absent despite an explicit rejection option. On paired arithmetic problems, answer-present accuracy reaches 99%, while correct rejection falls to 7%. Moreover, this gap persists across numerical magnitudes, operation depths, contextual formulations, and rejection labels, and extends to scenarios such as time calculation and capacity rounding. Yet native Boolean verification achieves 99% exact-match accuracy on the same answer-absent arithmetic cases, showing that categorical rejection can fail even when the model successfully verifies candidate correctness. Finally, we show that a simple decision threshold selected on separate development problems raises arithmetic rejection accuracy from 7% to 79% while retaining 97% answer-present accuracy, substantially mitigating the failure without retraining or additional inference.
Original source
This story was published by arXiv cs.LG and written by Jike Zhong, Ming Li, Yuxiang Lai. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on arxiv.org


