Research · Tuesday 27 October 2026 · story 4
UserArena paper outlines shopping agent benchmark and OPTD
Huggingface reports that UserArena benchmarks shopping agents with 64,729 sessions from 11,010 users, plus an interactive environment and five-level evaluation. The paper says OPTD showed the strongest simulator fidelity and most closely matched the production policy effect in offline simulation.
Why it matters. This gives shopping-agent builders a way to test long-horizon policies offline against production A/B outcomes.
Read the original at huggingface.co