THE BOOK cover
The Unwritten Book is Finally Written!
An in-depth analysis of: The sacrifice bunt, batter/pitcher matchups, the intentional base on balls, optimizing a batting lineup, hot and cold streaks, clutch performance, platooning strategies, and much more.
Read Excerpts & Customer Reviews

Buy The Book from Amazon


SABR101 required reading if you enter this site. Check out the Sabermetric Wiki. And interesting baseball books.
MOST RECENT ARTICLES
MAIL : You ask | We say

Advanced


THE BOOK--Playing The Percentages In Baseball

Filter posts by...

 

Wednesday, October 14, 2009

Setup for Forecast Evaluations

By Tangotiger, 09:33 AM

The kids who made the Steamer Projections are now starting to work on evaluating the success of several projections systems for the 2009 season (including their own).  They’ve read Nate Silver’s evaluation of his system after 2007 as well as your subsequent back and forth with him (http://www.insidethebook.com/ee/index.php/site/comments/forecast_evaluations/) about how to do it right. [Editor’s note: yes, that’s the best thread that discusses the best way to do the evaluations.]

Anyway, they’re lining everyone up using Lahman IDs and would be happy to include any system that has Lahman ID’s in their analysis.  I see that Marcel, conveniently, already does, but I was wondering if other forecasters
might be interested and/or if you might still have their systems with Lahman IDs lying around.  If you post this or send it to the other Forecasters in the roto challenge we’d be happy to take suggestions of comparisons people
might want to see.

They’ve got the Marcel, ZiPS, Pecota in excel with Lahman ID’s right now and are looking to add Sporting News and ESPN.  I’m going to suggest that they also use CHONE and maybe OLIVER so they can compare results to Matt Swartz’s work last year (http://statspeak.net/2009/04/testing-the-projection-systems-strengths-and-weaknesses.html).

Email professor Jared at: jfcross4~gmail~com , replacing the ~ as appropriate.

Page 1 of 1 pages

Latest...

COMMENTS

May 26 07:27
“Why Kickstarter works”

May 26 03:03
Pete Palmer’s new book: Basic Ball

May 26 01:11
Largest demonstration in Canadian history?

May 25 19:41
What sabermetrics is NOT

May 25 16:59
Howard Stern

May 25 15:12
Do pitcher’s reach back for velocity when needed?

May 25 12:51
Chad Curtis

May 25 11:26
Lack of hustle during a game

May 25 10:58
Rooting for laundry

May 25 02:38
NFLPA lawsuit against collusion

THREADS

October 14, 2009
Setup for Forecast Evaluations