THE BOOK cover
The Unwritten Book is Finally Written!
An in-depth analysis of: The sacrifice bunt, batter/pitcher matchups, the intentional base on balls, optimizing a batting lineup, hot and cold streaks, clutch performance, platooning strategies, and much more.
Read Excerpts & Customer Reviews

Buy The Book from Amazon


SABR101 required reading if you enter this site. Check out the Sabermetric Wiki. And interesting baseball books.
MOST RECENT ARTICLES
MAIL : You ask | We say

Advanced


THE BOOK--Playing The Percentages In Baseball

<< Back to main

Tuesday, November 30, 2010

Are my WAR aging numbers not aggressive enough?

By Tangotiger, 10:37 AM

Matt has noted in the past that my $ per WAR numbers are too low.  And yet, I countered, my overall $ numbers are in-line with what happens.  His conclusion therefore was that my WAR numbers were too high as well (i.e., I made two wrongs to make one right).  After all, if WAR x $/WAR comes out correct, and the $/WAR is too low, then my WAR must be too high.

Last week, I posted the WAR aging curves for the great players.  The sample was selected based on players with at least a 4 WAR per 700 PA over a 4-yr period.  Those players averaged 5 WAR per season.  Since we observed 5.0, this would imply a true talent of 4.7 or so.  What I would then do is simply subtract 0.5 wins to get my true talent for the next year at 4.2 (to include aging).

Now, this is what I got for players entering their age 28 through age 36 seasons:
Age Next1
28 4.2
29 4.5
30 3.9
31 4.4
32 4.1
33 4.3
34 3.6
35 3.4
36 3.2

From age 28 to 33, the average was exactly 4.2.  That is, for players who we’ve observed to have a 5.0 WAR over the preceding 4 seasons for each of those ages, they then performed at around 4.2.  This implies that the aging function works pretty darn well.

Furthermore, here is the aging for each of the 5 seasons, for players entering their age 28 through 33 seasons:
4.2 3.7 3.2 2.7 2.2

A beautiful line of 0.5 wins drop each year.

All is not well however, as players entering their age 34 through 39 seasons following an observed 5.0 (implying 4.7 true talent in those years, and aging of 4.2) averaged only 3.4 wins in their first season.  This therefore does points to not aggressive aging in the first year.  And it gets worse, because for 5 years we get this:
3.5 2.6 1.8 1.1 0.7

That’s a drop of around 0.7 wins per year.  So, not only did I not apply a strong enough aging for the first year, but then each subsequent year should have shown a stronger aging.

So, for players entering free agency aged 34 and older, then yes, Matt was correct: my WAR estimates were too high for both the initial year and subsequent years.  For players entering free agency aged 28-33, I am correct.

Notice that I said “free agency”: Matt has a theory that signing as a free agent with another team should have a further adjustment, as the old team not signing the player might know something more about the player’s true talent.  And so, I haven’t really shown that here.  I am presupposing that Matt’s theory is non-existant.

If Matt is correct, then I would have to diminish the WAR estimates further. 


#1    Matt Swartz      (see all posts) 2010/11/30 (Tue) @ 12:43

Interesting. So perhaps the truth is that the market inefficiency I found is limited to older players whose teams let them go, perhaps explaining why it was 2- and 3-year deals that had the largest discrepancy between re-signed $/win and newly signed $/win.

My theory is actually that the old teams not signing the player know something more about the player’s aging curve, not the player’s true talent, because the 1st year of the deal’s $/win war similar for re-signed and newly signed players. What’s interesting is that it appears that the first year of the deal is already over-projected using the 0.5-WAR-from-true-talent-level method for the older players, while I found that re-signed and newly signed players both had similar $/win in their first year after signing. I guess the question becomes whether maybe teams are already cognizant of the steep aging in the first year, so maybe the difference in performance during year one after free agency is not a source of a market inefficiency, but perhaps teams are unaware of the steep aging in the 2nd and 3rd year of deals for newly signed players.

A bigger sample size would really be helpful but it’s really tough to gather all these contract details for older contracts, and using future contracts would assume that the market inefficiency will persist after it’s been discussed on the internet a good amount already.


#2    Tangotiger      (see all posts) 2010/11/30 (Tue) @ 12:56

Matt, yes, I agree, it is fascinating.  It seems odd to have for example Carl Crawford in a group with say Paul Konerko, if both their respective teams are cutting them loose.  It’s hard to imagine that “something” might apply to a 30yr old as a 35yr old.

In any case, I think you had a great idea, and it’s just a matter of establishing more parameters to consider.

But, as you said, sample size is not our friend.


#3    Rally      (see all posts) 2010/11/30 (Tue) @ 15:13

Another limitation to that kind of study is that teams have unequal resources. The Rays may think Crawford isthe greatest guy in the world, and a great bet to age gracefully. But regardless, they have zero chance of keeping him. Had he come up with the Yankees, he’d be looking at a big extension right now.  It doesn’t make sense to aggregate him with, say, Andruw Jones who the Braves probably were not optimistic about his aging.


#4    MGL      (see all posts) 2010/11/30 (Tue) @ 17:28

Right, #3 above.  While on the average, Matt may be right (about re-signing and letting go players), but I think there is great variability among teams with regard to that AND I think we can make some reasonable inferences regarding which teams cannot re-sign a player no matter what and which teams seem to simply let a player go and then apply that knowledge (or educated guess actually) to each player’s aging curve.

And good work Tango!  Of course if you look at my aging curves, you will clearly see a steeper curve as the player gets into his 30’s (I think).

In fact, here is my lwts per 500 (lwts rate) aging curve function:

y=.0083*x^3-.5666*x^2+7.44*x-8.1526

where x=age-20 and y is the lwts per 500 PA.

So from age 28 to age 33, a player loses 8.3 runs or 1.66 runs per year.  That is offense only and is a rate and does not include diminished playing time, base running, or defense.

From 34 to 38, the player loses 4.43 runs per year in lwts rate, quite a bit steeper!  In fact, I think Tango is STILL underestimating WAR loss in those later years as compared to the earlier ones.


#5    Guy      (see all posts) 2010/11/30 (Tue) @ 20:41

Tango:  wasn’t the discrepancy in $/WAR between you and Matt much too large to be explained by the age 34+ players alone?  Maybe I’m misremembering, but I thought it was a huge difference. 

I wonder if looking only at players with 16 WAR in past 4 years is distorting things a bit.  That sets not just a performance minimum in rate terms, but also a high health/durability minimum over a long time.  If you were to use Marcels instead, and projected average PA based on age, I bet you would find that you overestimated WAR by a larger margin.  It all depends on how you forecast playing time, of course, but I’d guess that many forecasts underestimate risk of decline in playing time (whether because of injury or performance).


#6    tangotiger      (see all posts) 2010/11/30 (Tue) @ 22:31

Well, I’ve posted various other aging curves.  I think I’ve done one-year Win Shares at all levels of performance, and I think I’ve also done the one-year WAR for pitchers at all levels of performance.

Basically, you are asking that I repeat that with WAR for nonpitchers, and show all the players in some number of buckets, so that we can see the various paths each group follows.


#7    Guy      (see all posts) 2010/11/30 (Tue) @ 23:32

No, I’m not asking that you do that.  I just recall that Matt’s original findings were that FAs delivered fewer actual WAR than expected by many projection systems (not necessarily yours). If one uses a Marcel or PECOTA performance rate projection, and project a full season of performance, you will overstate production (especially for pitchers).  And if the player is in his 30s, you will overstate it a lot.  So I think the result is that players are paid $3-4 M per projected WAR—IF you assumed close to full-time play—but are paid more than that once you use actual production.


#8    Nathaniel Dawson      (see all posts) 2010/12/01 (Wed) @ 01:01

Wouldn’t older players that have averaged 5.0 WAR for a period of time be more likely to have been out-playing their true talent level than younger players at the same level? How many players in their early-to-mid thirties are truly 5 WAR (or 4.7 WAR) players? I think there’s a good chance that a lot of those players aren’t really 4.7 (or whatever) true talent players, but more like 4.3 or something that have had an exceptional season or two, masking their real decline in ability. You did notice a very sizable drop in the next season WAR for these players.


#9    MGL      (see all posts) 2010/12/01 (Wed) @ 02:33

"Wouldn’t older players that have averaged 5.0 WAR for a period of time be more likely to have been out-playing their true talent level than younger players at the same level?”

You take the number of PA that the 5.0 (or whatever) represents, and you regress toward the mean for that type of player.  If all we know are age, then we regress toward the mean of players that age (and probably whether they are full time or part time players).  That gives us an estimate of that player’s true talent during that 5.0 period.

So the answer to your question depends on the length of time they have been “5.0 players” and the exact age you are talking about when you say “young” and “old” and more precisely the exact age during the 5.0 span.

For example, since players peak at around age 27, then a player who has been at 5.0 from ages 23 to 25 is more likely to have outplayed their true talent than a player who has been at 5.0 from ages 26 to 28, if their playing time over that 5.0 span were the same and we knew nothing else about the player.


Page 1 of 1 pages


Name (required)
E-Mail (optional; WILL be published)
Website (optional)

<< Back to main


Latest...

COMMENTS

May 25 01:43
Neal Huntington’s best moves

May 25 00:36
Help needed with sticky issue…

May 24 23:50
Rooting for laundry

May 24 20:16
Largest demonstration in Canadian history?

May 24 17:04
Firefox, IE, or Chrome?

May 24 12:07
How to beat the shift

May 24 11:11
Incredible story

May 24 09:41
Racial bias in card collecting: not the collectors, but the players on the cards

May 24 08:13
espnW for hockey: CBC’s WhileTheMenWatch.com

May 24 00:16
Psst… wanna intern… somewhere?