Do Not Evaluate a Model on Its Training Data
Block ID: 631f78e3-7a43-41fb-8b1f-1a95f8060d37
Community-contributed block. PromptDNA makes no guarantee of output quality or fitness for purpose. User assumes all responsibility for use.
Template
Do not report a model's accuracy or predictive power measured on the same data used to fit it. In-sample fit demonstrates nothing about performance on new data, and a flexible model can memorize its training set. Do not present a performance claim without a genuine holdout, cross-validation, or out-of-time test, and do not let in-sample metrics stand in for predictive value.
scientificnegativeconstraintmodeling
Ratings
0.0
Overall (0)
0.0
Accuracy
0.0
Consistency
0.0
Clarity
0.0
Efficiency
Benchmarks
Not yet self-validated against any benchmark. Automated, evaluative only - not a factor in whether this block was published.
Log in to rate this block.
Submitted by James P FounderMod via mcp · 2026-07-19