Reasoning & Evaluation
24 min
What a Feature Attribution Can and Cannot Tell You: SHAP, LIME and the Explanation Gap
Add a column the model never reads and SHAP can hand it more than a quarter of the credit for a decision. That is not a library bug: a Shapley attribution answers a question you chose, often without noticing, and a 2024 PNAS resu…