THE BOOK cover
The Unwritten Book is Finally Written!
An in-depth analysis of: The sacrifice bunt, batter/pitcher matchups, the intentional base on balls, optimizing a batting lineup, hot and cold streaks, clutch performance, platooning strategies, and much more.
Read Excerpts & Customer Reviews
If you are a media member and would like a review copy of The Book, please contact Kevin Cuddihy of Potomac Books.

Buy The Book from Amazon

MOST RECENT ARTICLES
MAIL : You ask | We say

Advanced


THE BOOK--Playing The Percentages In Baseball

<< Back to main

Wednesday, November 12, 2008

Replacement Level using Forecasted players

By Tangotiger, 10:53 AM

Rally Monkey gives us some good work.  Here are my thoughts:


Rally starts off with my positional adjustments (per 162 G):

POSITION          POSITION ADJUSTMENT
Catcher            12.5
Shortstop          7.5
2B
3BCF         2.5
Corner Outfield   
-7.5
First base        
-12.5

Since Rally seems to be using numbers as per 150G, those numbers become:

POSITION          POSITION ADJUSTMENT
Catcher            11.6
Shortstop          6.9
2B
3BCF         2.3
Corner Outfield   
-6.9
First base        
-11.6

If we set the replacement level as 22.4 runs per 150 G (more on this later), we get:

POSITION          POSITION ADJUSTMENT
Catcher            34
Shortstop          29
2B
3BCF         25
Corner Outfield    15
First base         11

Since Rally combines the three OF positions, I’ll show my numbers accordingly:

POSITION          POSITION ADJUSTMENT
Catcher            34
Shortstop          29
2B
3B             25
Outfield           18
First base         11

Ok, so all I’ve done is realign my numbers to match Rally’s scale.  The weighted average of the above numbers is 22.3, and the weighted average of Rally’s last chart in his article (which I will present in a second) is 22.4.

(So, this is why I set the replacement level to 22.4… just to get it on Rally’s scale.)

Here is Rally’s chart, which uses replacement level players, and presumes that their fielding contributions are not biased (i.e., the fielding level of the replacement-level 1B is the same as the replacement-level SS, relative to the average player at those positions):
Top players not in majors

POSITION          REPLACEMENT LEVEL
Catcher           
-30
Shortstop         
-29
Second base       
-23
Third base        
-23
Outfield          
-19
First base        
-17

We’ve got a perfect match at shortstop, an almost perfect match at 2B, 3B and OF.

At the two extreme points, my catcher replacement level is 4 runs higher than it should be, relative to Rally’s numbers.  On the other end, my 1B replacement level is 6 runs too low.  (All per 150 G)

Seeing that my gap between 1B and the corner OF is 5 runs per 162 G, I certainly can’t accept tightening up to that extent.  Rally suggests tightening both 1B and C by 2.5 runs.  I’m not really opposed to it, but I’m not sold yet.

And here’s the reason: Rally’s numbers are only valid if we consider fielding a wash.  But, what the heck is a replacement level 1B?  He might be a 1B in the minor leagues who is nothing more than a DH.  That is, he really s-cks as a fielder.  (Otherwise, if he was a good fielder, in the minor leagues, he’d be a 3B or 2B.) So, I don’t think it’s a stretch to say that if you include the fielding talent, that this might drop the replacement-level 1B in the minor leagues enough to match my spectrum.

How about catcher?  I don’t know.  I get the feeling that they must be horrible fielders as well.  That is, any catcher that is a decent fielder finds his way up the chain pretty fast, that hitting is a secondary consideration.  So, it’s possible there is a biased population in Rally group, whereby you have some bad-fielding catchers (you know, the guys that teams hope to put a decent bat there if only they could learn to field a little in the minors).  Again, pure speculation.

So, while I don’t necessarily object to tightening the C and 1B positional adjustments as Rally suggests, I’m not sold yet.  And in the cases of these two extreme positions, I’d rather give extra credit to the catcher and less credit to the 1B.

Anyway, fantastic job on Rally in doing the work.  I’ve always wanted to do it, and I’m glad to see how well the two different approaches converge.

#1    Rally      (see all posts) 2008/11/12 (Wed) @ 11:58

On catcher, I see your point.  The top hitting minor league catchers could well be a bunch of low average guys who slug .550 in the minors and make numbers-oriented fans wonder “why can’t this guy get a shot when you keep running Brad Ausmus out there” There always seem to be a lot of these players around, and their gloves are probably pretty bad.

On first base, I don’t see any reason to believe the group of players one rung down from the big league 1B/DH’s are any worse at fielding.  For a lot of them, handedness is the reason they don’t play 2nd or third, but I’m not convinced the level of fielding, at least in the high minors, is significantly worse than at the majors.

In fact, when I looked at Dan Fox’s minor league SFR for 2007, and compared to the zone rating performance of 2008 rookies, the rookies actually fielded better in the big leagues!


#2    Tangotiger      (see all posts) 2008/11/12 (Wed) @ 13:46

Rally shows the following:
Outfield -19
First base -17

Which, if we accept that CF is nine or ten runs away from the corners, converts the Outfield line into:
CF -25
LF, RF -16

(The average of that is -19)

I obviously can’t accept the results of 1B vis-a-via LF/RF.  I would like to think the reason is because of the fielding bias in the population of players.

***

What it comes down to is whether we want to put the 1B 2.5 or 5.0 runs from the corner OF. Rally’s data would argue for 2.5.  And the interpositional data could also argue for 2.5.  I am on shaky ground.  But, I’d prefer more distance for the 1B from the corners.


#3    Dan Rosenheck      (see all posts) 2008/11/12 (Wed) @ 20:43

Nate Silver’s Freely Available Talent study showed that replacement 1B were actually *above* average fielders, which makes complete sense to me (as opposed to replacement DH’s, of course, who are much better hitters than replacement 1B).

I actually have the 1B 6 runs from the corner OF, at 3 runs below the pitchers-included league average to 9.


#4    tangotiger      (see all posts) 2008/11/12 (Wed) @ 22:20

Rally’s replacement players are guys NOT playing in MLB.  Of the guys in his list, I would bet that they are poor fielders.

Nate’s list was another matter entirely: low-paying guys who are over 27.  If you have a 1B like that, of course he’s someone who is a bad hitter and good fielder.  His process, as I’ve discussed in the past, is filled with selection sampling issues. Obviously, everything has selection bias, but his has more, and there was no adjustment for the bias made at all.

Dan’s method is to look at the bottom regulars at each position.  Again, I believe that has some issues as well.  It still has the potential where you end up that a SS and 2B that are equal hitters to have the 2B have greater value.  It *is* better than taking the average at those positions (which prevents the skews of superstars).

Nonetheless, if you line up Rally’s adjustment, my adjustment, Nate’s adjustment, and Dan’s adjustment, you’ll find great agreement, so that really, we have some slight overall disagreements, while having more philosophical disagreements.

I will though never come around to Nate’s adjustment for SS.  That is just too outlandish to accept.


#5    birdo      (see all posts) 2008/11/13 (Thu) @ 00:22

Are LH first basemen generally better fielders than their RH counterparts?  It seems like a LH player with no speed but good hands would have to end up at 1B (vs. the OF) but a righty with those skills would at least have a chance to stick at 2B or 3B (ie Jeff Kent or Brett Wallace).  Just a thought. Thanks.


#6          (see all posts) 2008/11/13 (Thu) @ 01:34

I’ve never seen the study… what was Nate’s SS adjustment?


#7    Dan Rosenheck      (see all posts) 2008/11/13 (Thu) @ 06:58

To be clear, my method is based entirely on Nate’s method.  I take his Freely Available Talent (FAT) values to be the gospel truth for the 1985-2005 period they were calculated from.  I then take the average rate production of the worst 3/8 of MLB starters at each position over the same time period, and determine the gap between the two (e.g., the FAT shortstops averaged 3 wins below average per 162, whereas the worst-regular shortstops averaged 2.7 wins below average per 162, so the gap is 0.3 wins).  I then make an enormous and entirely unsupported assumption that this gap (between FAT and worst-regulars) remains fixed over time, which enables me to use a 9-year moving average of the worst regulars to trace the historical evolution of the defensive spectrum.

The key point to note here is that my replacement levels for the modern game (actually they are for 2005, I haven’t filled in 06-08 yet) are much closer to Rally’s published work here than Nate’s are.  The reason is that the defensive spectrum has changed significantly in the last two decades. 

The biggest shift, by far, is the convergence between catcher and shortstop.  Back in 1985, I have SS as a full two wins/20 runs worse than catcher (-1.7 to -3.7).  Since then, SS has gone straight up, and C has gone straight down, such that by 2005 they were almost equal (-2.4 to -2.6).  If that trend has continued in the last three years (which seems likely to me, if nothing else because it would remove seasons like 2001 from the moving average), then Rally’s positioning of C as one run below SS at this point seems perfectly plausible to me.  You say you will never come around to Nate’s adjustment for SS (that replacement SS are 5.5 runs a year below average with the glove), Tango, but you are forgetting that his study includes players from 1985, 86, and 87, as well as 2005, 06, and 07.  The game has evolved.

A second, smaller change, is the separation among the outfield slots, which was weirdly low around 1990.  Today, I have CF at 0.7-0.8 wins below corner OF, which is right where it was around 1980.  But in 1989-90, I have them equal!  This could just be a sample size fluke, but it’s a *lot* of data--each year’s value represents an average of 101 player-seasons for CF, and 202 for corner OF.  Nate’s FAT study was more or less centered on this time period, which is why he shows a smaller CF-corner OF gap than you and Rally do.

I’d love to see if anyone has ideas about what has driven these changes.  Certainly, as the Three True Outcomes have increased as a percentage of plate appearances, as have fly balls (I imagine), and turf fields have been phased out, SS defense is not as important as it was back in the 80’s, allowing bigger guys to play there and increasing its replacement level.  As far as catchers are concerned, I don’t know...if teams are prioritizing C defense over offense, then wouldn’t league SB success rates be going *down*, not up?


#8    Colin Wyers      (see all posts) 2008/11/13 (Thu) @ 13:34

Nate’s study used FRAA, correct? I know that when I looked at it using ZR data, my results were closer to Tango’s than Silver’s. (At least, that’s my recollection.) This could just be a GIGO issue.


#9    JD      (see all posts) 2008/11/16 (Sun) @ 07:05

Tango, I have what is probably a very elementary question but intuitively it doesn’t make any sense to me.

Why does 3B get the same positional adjustment as 2B and CF? How is 3B “equal” to those two? Or am I interpreting the adjustment wrong?

I just don’t see how a guy who is an average 3B is as useful/saves as many runs as a guy who is an average CF.


#10    Tangotiger      (see all posts) 2008/11/16 (Sun) @ 09:37

I guy who moves between 2B and 3B will have roughly the same fielding performance relative to the average at each of those positions.

Those guys, when moving to SS, will performance worse relative to the average at SS and 2B/3B.

Hence, the results.


#11          (see all posts) 2008/11/16 (Sun) @ 23:41

If, as you, (Tango) suggest above, some positions have differences in fielding vs average for replacement level players in the minors; might it not show up in more time in the minors, especially AAA?  So, if the replacement level catchers and first basemen really s*ck at defense, those positions should tend to have more games on average in AAA, the minors in general.  Anyone want to check?


#12    Rally      (see all posts) 2008/11/17 (Mon) @ 00:21

Here are the 1B who are not major leaguers, but come out above replacement level:

Dan Johnson
Chris Shelton
Joe Dillon
Brian Myrow
Josh Phelps
Chris Carter (Red Sox)
Greg Norton
Kendry Morales
Kila Kaaihue
Matt LaPorta
Andy Tracy
Ben Broussard
Gaby Sanchez
John Lindey
Josh Whitesell
Ryan Shealy
Shelley Duncan
Brad Nelson
Javier Brito
Jordan Brown
Randy Ruiz
Garrett Jones
Juan Miranda
Scott Thorman
Tagg Bozied
Thomas Hubbard
Tug Hulett
Barbaro Canizares
Brian Stavisky
Jeff Larish

I know the defense of a couple of these guys (Kendry, Dan Johnson, Chris Shelton) has been at least decent when they’ve had major league chances.  Most of these guys I just don’t know about.  Are they horrible defenders relative to position?  Are they as bad as Jason Giambi?  Or are they the kind of players, who if they were backing up the Giambino, you’d put them in for the 8th or 9th inning.  I’ll defer an answer on this to anyone with actual knowledge of their defensive abilities, or nobody can provide that I’ll look at whatever combination of Dan Fox’s minor league SFR and Baseball America prospect handbooks I can find.


Page 1 of 1 pages


Name (required)
E-Mail (optional)
Website (optional)

<< Back to main


Latest...

COMMENTS

Jan 09 16:41
Sabermetric Moves of the 2009 Pre-Season

Jan 09 19:56
Modeling Baseball Player Ability with a Nested Dirichlet Distribution

Jan 09 18:08
Line Drives

Jan 09 18:04
Challenging Nate Silver (and all other forecasters)

Jan 09 17:31
Cheers

Jan 09 17:14
Teaching sabermetrics at school

Jan 09 16:51
The first Hardball Times Annual available for download!

Jan 09 14:44
Vote for the Worst Player in MLB

Jan 09 12:29
Clint Eastwood is Archie Bunker

Jan 09 12:16
Mailbags on Parade