Long-Term Optimization for Large-Scale Generative Retrieval with Off-Policy REINFORCE Permalink
Published in KDD 2026, 5th Workshop on End-to-End Customer Journey Optimization
Artem Matveev, Sergei Makeev, Aleksei Krasilnikov, Vladimir Baikalov, Sergei Liamaev, Kirill Khrylchenko
Training generative retrievers with off-policy REINFORCE to optimize long-term user satisfaction instead of next-item accuracy, with doubly robust evaluation and test-time scaling that improves cumulative session reward on Yambda-5B.