Correcting the LogQ Correction: Revisiting Sampled Softmax for Large-Scale Retrieval Permalink
Published in RecSys 2025
Kirill Khrylchenko, Vladimir Baikalov, Sergei Makeev, Artem Matveev, Sergei Liamaev
A refined logQ correction for in-batch sampled softmax that removes the residual bias from the always-present positive item, giving consistent gains for large-scale two-tower retrieval on public and proprietary datasets.