Evaluation of Our Models - Weekly Projections
When we build models, we apply standard evaluation metrics against a holdout dataset (data not used in any action related to the model building) to evaluate performance. Once we have what we think is “good” performance, we compare the results of the players in our hold out dataset to their actual fantasy performance and the fantasy performance of 2 other sites, ESPN and 4for4. The overall dataset we have for ESPN and 4for4 is not complete, so we filter down to just the players that exist in all three sets of data.
By Andy Troiano · August 27, 2019