Tagged “off-policy-evaluation”

2 posts.

All Model Architecture23 Training & Alignment22 Inference & Serving24 Agents & Orchestration13 Reasoning & Evaluation28 Safety, Security & Governance9 Platforms & Practice22

Training & Alignment 24 min

Learning From the Log: Off-Policy Policy Learning, From IPS to Counterfactual Risk Minimisation

An unbiased estimate of every policy's value does not give you an unbiased choice of policy. The moment an optimiser searches over importance-weighted estimates, it goes looking for the estimator's noise, and the history of learn…

policy-learning-and-ope off-policy-evaluation counterfactual importance-sampling ∑ ◫

Platforms & Practice 24 min

Reading Its Own Handwriting: Position Bias, Feedback Loops and Counterfactual Correction

Move a document from rank 5 to rank 1 and its click-through rate jumps without its relevance changing at all. Train on those clicks and the model learns position, which the previous ranker chose, which means it learns to imitate …

ranking recommender-systems learning-to-rank counterfactual ∑ ◫