THE BOOK cover
The Unwritten Book is Finally Written!
An in-depth analysis of: The sacrifice bunt, batter/pitcher matchups, the intentional base on balls, optimizing a batting lineup, hot and cold streaks, clutch performance, platooning strategies, and much more.
Read Excerpts & Customer Reviews

Buy The Book from Amazon


SABR101 required reading if you enter this site. Check out the Sabermetric Wiki. And interesting baseball books.
MOST RECENT ARTICLES
MAIL : You ask | We say

Advanced


THE BOOK--Playing The Percentages In Baseball

<< Back to main

Thursday, October 23, 2008

How good are the Fans in evaluating fielding?

By Tangotiger, 10:45 AM

Rally takes a look at his TotalZone forecast and the Fans’ Scouting Report, and compares to DER, and they both perform roughly the same.

Also don’t forget that Justin showed that the correlation between the Fans, UZR, and Pinto’s PMR are all very similar.  There really ought to not be any more question as to how reliable the Fans are.  They are as reliable as anything else out there.


#1    APV      (see all posts) 2008/10/23 (Thu) @ 12:35

It’d be nice to get some demographic information on the fans who fill out your survey regarding what outside information (like the defensive metrics published elsewhere) they have knowledge of.  I would be somewhat surprised if the people filling out the form here don’t have a fair degree of familiarity with some of the more advanced defensive metrics out there.  The problem of distinguishing between people’s actual opinions derived from their personal observation and their internal bias incorporated from other sources of data seems quite difficult.  I suppose I would expect a fairly high degree of correlation among all these simply because of that.


#2    Tangotiger      (see all posts) 2008/10/23 (Thu) @ 13:15

Most people who fill out the ballot are NOT readers of this blog.  They come from SBNation or Fanhome or Primer and whatnot.

As for prior knowledge of metrics, the best test-case would be to look at players with fewer than 100 or 300 or whatever innings played entering 2008.  They are basically a clean slate, in terms of fielding metrics.  Evan Longoria is a case in point.  He had no metrics, and fans think he is the equivalent of Beltre and Rolen.  High praise indeed.  Let’s see what UZR says about him in 2008/09.  Same deal with Fukudome, and Asbdrubal Cabrera.  Fans think these 3 guys are among the best fielders in all of baseball.


#3    Rally      (see all posts) 2008/10/23 (Thu) @ 13:21

I won’t deny that it exists, but I think the design Tango uses minimizes that.  He’s not asking fans if a guy is an above or below average fielder, but specific tools.

I remember in his rookie year Nick Swisher had a ridiculously high UZR rating.  Fans might have read that here or on BTF, and have been biased to giving him a high overall rating.  Opposite for Ichiro, who has not been impressive by UZR.

But the fans were asked to evaluate the running speed, throwing accuracy, etc.  And regardless of who is the statistically better outfielder, I don’t think anyone who watches games is going to tell you that Swisher runs faster than or throws better than Ichiro.

An aside, no comments on my blog about this yet, despite being one of the better (IMO) pieces I’ve done in awhile, at least one that took a long time to bring the data together and invent some methodology.

Yet I mention Moneyball in a simple, analysis free, random coincidence sort of post, and I get a dozen comments from people who still want to debate what Moneyball really meant.  For some reason I find that a little depressing.


#4    Colin Wyers      (see all posts) 2008/10/23 (Thu) @ 13:36

FWIW, I read it and didn’t really have anything to add. Agree on DER - it’s basically all we have, but it’s simply not as rich as, say, team run scoring is for offense. It’s harder to validate defensive value systems at the team level than, say, run estimators.


#5    jinaz      (see all posts) 2008/10/23 (Thu) @ 13:46

Also FWIW, Rally, I read it this morning and saved it in bloglines for a subsequent link dump (whenever I get around to doing one).  It’s nice work, and would give me an opportunity to plug your essentially one of a kind defensive projections as well.

As for the comments on your moneyball piece, I think you can blame studes and his link at THT for that! smile
-j


#6    Tangotiger      (see all posts) 2008/10/23 (Thu) @ 13:50

I hear you Rally.  I feel that sometimes as well…


#7    Rally      (see all posts) 2008/10/23 (Thu) @ 14:34

Thanks guys.

I don’t normally pay attention to comments, I don’t do it to be popular, just write what I have to say.  But it makes me wonder, if I just write about Billy Beane and Michael Lewis, that is the way to appeal to a wide audience?

That’s very depressing for an Angel fan.


#8    Colin      (see all posts) 2008/10/23 (Thu) @ 14:34

Thanks for the info Tango.  I hadn’t seen either of those links.


#9    Lee Panas      (see all posts) 2008/11/22 (Sat) @ 02:48

I have also wondered about the problem of survey participants being biased by stats that they have seen.  There is probably some of that but I think the survey design helps to minimize it.  One thing I did for the Tigers was deliberately recruit a good number of people who I know are not into fielding stats but know the game well. They enjoy participating as well. 

Lee


Page 1 of 1 pages


Name (required)
E-Mail (optional; WILL be published)
Website (optional)

<< Back to main


Latest...

COMMENTS

Feb 12 05:18
Reader Mail of the Day: Why do we need X years of fielding data?  And what about outliers?

Feb 12 04:55
Who is Jeremy Lin?

Feb 12 03:15
New PECOTA

Feb 12 02:42
Whitney Houston

Feb 12 02:23
Psst… wanna intern in Canada?

Feb 12 00:40
Clutch analogy

Feb 11 20:11
Fighting leads to goals?

Feb 11 19:55
Why do players get crappy caps?

Feb 11 19:12
Hero of the month: Brittney Baxter

Feb 11 17:59
MGL: Today on Clubhouse Confidential