Rox AI developed "ask-web," a proprietary web search agent that has been running in production for over six months with continuous evaluations. The agent delivers 91.3% accuracy at a cost of 1.03 cents per query on real production prompts, outperforming commercial and frontier search providers on the cost-per-accuracy frontier. Together AI, Baseten, and Modal serve as inference partners for Rox AI's agent.
Rox AI demonstrates that specialized, in-house agents can achieve frontier-level performance at significantly lower inference costs, shifting demand towards optimized custom solutions.