Tagged “determinism”

2 posts.

All Model Architecture21 Training & Alignment22 Inference & Serving23 Agents & Orchestration12 Reasoning & Evaluation27 Safety, Security & Governance9 Platforms & Practice22

Inference & Serving 24 min

Your Answer Depends on Who Else Is in the Batch

A thousand identical requests to the same model at temperature zero produced eighty different completions. The cause is not random seeds, not sampling, and not GPU atomics. It is that reduction kernels change their summation orde…

inference determinism numerics kernels ∑ ◫

Reasoning & Evaluation 24 min

Your Improvement Is Inside the Noise: Seeds, Nondeterminism and the Reproducibility Problem in ML

Change one bit in one weight of a ResNet and, three epochs later, test accuracy differs by more than ten points. Training is a chaotic process, so a seed is not a control variable but a draw from a distribution. Most published an…

experiment-tracking-and-reproducibility statistics determinism mlops ∑ ◫