New arXiv Paper: CITA Teaches AI Agents to Pick the Right Tool Before Acting

CITA stands for Comparative Inference for Tool-use Agents. It trains a Comparative Inference Model (CIM) that estimates how likely a possible next tool invocation is to support final task success under the current context, before that invocation is executed.

Long-horizon tasks involve many tool-call steps, so final-outcome rewards provide weak credit assignment over a long interaction trace. Step-level rewards offer more targeted feedback, but obtaining them typically requires human or LLM judgment, or additional rollouts to estimate downstream effects.

Instead of relying only on logged trajectories, CITA uses paired comparative signals that combine observed tool behavior, scalable supervision from a Bayesian tool-graph simulator, and semantic judgments from LLM-based comparison.

These are early results from an arXiv paper, not a production-ready product. Engineering teams can follow the methodology and code, but production adoption requires independent verification and benchmarking on local use cases.