THE BOOK cover
The Unwritten Book is Finally Written!
An in-depth analysis of: The sacrifice bunt, batter/pitcher matchups, the intentional base on balls, optimizing a batting lineup, hot and cold streaks, clutch performance, platooning strategies, and much more.
Read Excerpts & Customer Reviews

Buy The Book from Amazon


2013 Bill James Handbook

Advanced


THE BOOK--Playing The Percentages In Baseball

<< Back to main

Saturday, August 11, 2012

Should you follow WAR blindly?

By .(JavaScript must be enabled to view this email address), 03:50 AM

Yes.

WAR is a FRAMEWORK.  That means that you (the royal you) estabished how baseball player evaluation works.  That it’s based on the player’s estimated offensive contribution and his defensive contribution and how it relates to players at specific baselines.  That how many opportunities he’s had is part of that framework.  The important thing about the framework is that it exists, and it is consistent.  It prevents you from taking two players with the same contributions, and yet considering one to have performed better than the other.

Now that you have the framework, you need an IMPLEMENTATION.  Baseball Reference has one, Fangraphs has one, I have one, and many of you out there have one.  That means that you (not the royal you, but you personally) have established you own personal WAR implementation.  And yes, that means once you’ve established that implementation that you must follow it blindly.  Now, it’s not blindly from the outset, but blindly after everything has been established.  You are a slave to your own process, your own methodology.  It prevents you from just tossing aside results just because you don’t like the results.

What happens if you don’t develop your own implementation?  Well, you are going to create some ad-hoc, inconsistent implementation.  THAT YOU HAVE AN OPINION ON A PLAYER IMPLIES YOU DO HAVE AN IMPLEMENTATION OF WAR.  It may not be written down, it may not even be well-thought out, but you do have one.

Maybe you don’t even think in terms of “replacement level”, but you are thinking of it in some ways.  You are comparing various players to some common baseline.  If we want to be more general, we should call it WAB (wins above baseline).

The important thing though is for you personally to sit down and create your own methodology, one that you can support, one that is consistent, and one that you can stand behind.  And if you can’t, then don’t denigrate those that do.  And for many people, they are quite happy following the WAR implementations at Fangraphs and Baseball Reference, which are well-thought out and consistent.  That doesn’t make it right, but it does force you to come up with something better.


#1    mkd      (see all posts) 2012/08/11 (Sat) @ 13:09

This is the good fight please keep fighting it.


#2    The Real Chris Long      (see all posts) 2012/08/11 (Sat) @ 18:34

A better framework, in my opinion, is to simply compute Wins Above Average (WAA). Calculate the value of an average ML at a given position and adjust using your WAA and win value. Equivalent, but I find it simpler to avoid dicking around with replacement level.


#3    CJ      (see all posts) 2012/08/11 (Sat) @ 19:20

#2, I neither agree nor disagree. It’s just as good a baseline as any other. The main problem is that WAA equates a pitcher who throws 100 innings with league-average run prevention to a pitcher who throws 200 innings with league-average run prevention. The second guy is worth demonstrably more, and teams pay like it.

So then you have to add a playing time component, or at least mention it (like you quote player’s stats as 0.2 WAA / 200 IP against 0.3 WAA / 100 IP) but then you might as well convert the two numbers into a wins above baseline, and you’re back to the start again.


#4    Tangotiger      (see all posts) 2012/08/11 (Sat) @ 19:21

That’s fine, if that’s what you want to do.

You have to understand the implications, which means a pitcher with a 4.00 ERA in a league of 4.00 is going to always rank higher than a pitcher with a 4.50 ERA, even if the first pitcher has one start and the second one has thirty starts.

Is that what you really want to argue for?

Or, are you going to first put limitations?

Or, are you going to put in some sort of “regression” that makes that pitcher with a 4.00 ERA and 1 start equivalent to a pitcher with a 5.00 ERA and 30 starts?

Or???

But whatever it is, have a consistent approach, and stick to the results.  And be prepared to argue for your approach.

But also if you get too many nonsensical results, then admit approach is wrong.


#5    JDanger      (see all posts) 2012/08/11 (Sat) @ 21:52

The replacement-level thing really messes with people more than it should. Generally people like comparing to average because it’s easy to comprehend, but like CJ said, a baseline is a baseline, right?

With WAR you’re just going .32 instead of .5 and you don’t have the playing time issues.

The WAR as a framework should really be discussed more often. I find when I’m talking with non-saber baseball fans they use words like ‘good’ and ‘great’ but I have to pry a series of references out of them first to see how they define ‘good’ and ‘great’ and so on. If he/she says ‘2 WAR player’ or ‘5 WAR player’ then we’re in business right away. It doesn’t matter if they don’t like linear weights or UZR, but at least we are speaking the same language.


#6    Richie      (see all posts) 2012/08/11 (Sat) @ 22:26

Just curious as to who or what we’re arguing against here. What intellectual rhubarb have I missed?


#7    Greg Rybarczyk      (see all posts) 2012/08/11 (Sat) @ 23:52

And yes, that means once you’ve established that implementation that you must follow it blindly.  Now, it’s not blindly from the outset, but blindly after everything has been established.  You are a slave to your own process, your own methodology.  It prevents you from just tossing aside results just because you don’t like the results.

Obviously you must allow for refinement of the implementation, right?  The scientific method doesn’t say “once you open your mouth, you’re stuck forever with what came out”, does it?  If you find that your implementation leads to a result that looks wrong, you should investigate, and see if your model is lacking.

Of course, if you twiddle with your model to arrive at your predetermined preferred outcome, you would be abusing the scientific method in a different way…


#8    Tangotiger      (see all posts) 2012/08/12 (Sun) @ 00:31

Greg, right.  Everything is based on assumptions.  You can change your assumptions.  Ideally, you’d have a BASIS for having assumptions and changing assumptions other than wanting Strasburg to finish ahead of Zimmerman and Gio.

The important part is to create that model first.

Someone told me a story of how this person couldn’t believe how high Reuschel ended up in career WAR, that that proved WAR was no good.  Of course, he was then challenged to create his own comprehensive system with the express purpose of trying to make Reuschel look much worse (not a good reason obviously), and he couldn’t do it. 

Basically, he was stuck with the idea that Reuschel was better than Jack Morris, because his model told him so.  To then still argue for Morris over Reuschel in face of your own consistent model means that you prefer having an ad-hoc model, one that is not consistent, and will lead to whatever pre-determined results you want.

The basic story is to at least create some basis for discussion, one that you can apply in a CONSISTENT manner across a larger universe.

If a is better than b and b is better than c, then the model must give you that a is better than c.

And the key point is that EACH PERSON can create his own personal comprehensive implementation.


Commenting is not available in this channel entry.

<< Back to main


Latest...

COMMENTS

Feb 11 02:49
You say Goodbye… and I say Hello

Jan 25 18:36
Blog Beta Testers Needed

Jan 19 02:41
NHL apologizes for being late, and will have players make it up for them

Jan 17 15:31
NHL, NHLPA MOU

Jan 15 19:40
Looks like I picked a good day to suspend blogging

Jan 05 17:24
Are the best one-and-done players better than the worst first-ballot Hall of Famers?

Jan 05 16:52
Poll: I read eBooks on…

Jan 05 16:06
Base scores

Jan 05 13:54
Steubenville High

Jan 04 19:45
“The NHL is using this suit in an attempt to force the players to remain in a union�