Inference & Serving
28 min
Confidential Inference: What a TEE Actually Proves
The performance objection to running models inside hardware enclaves is mostly dead: tuned Blackwell confidential inference costs low single digits. The remaining problem is semantic. A trusted execution environment proves which …