THE BOOK cover
The Unwritten Book is Finally Written!
An in-depth analysis of: The sacrifice bunt, batter/pitcher matchups, the intentional base on balls, optimizing a batting lineup, hot and cold streaks, clutch performance, platooning strategies, and much more.
Read Excerpts & Customer Reviews
If you are a media member and would like a review copy of The Book, please contact Kevin Cuddihy of Potomac Books.

Buy The Book from Amazon

MOST RECENT ARTICLES
MAIL : You ask | We say

Advanced


THE BOOK--Playing The Percentages In Baseball

<< Back to main

Wednesday, September 17, 2008

Release point and success

By , 12:31 AM

Josh Kalk, one of the very good pitch f/x researchers, wrote another article on pitcher release points and overall success.


Here was my first comment:

Very nice job as always.

Once again, selective sampling rears its ugly head.  Unless you are somehow able to look at the same pitchers who have changed their delievery or style for some reason, you just aren’t likely to find anything.

Let’s say that varying release points was much better than not.  Well, what will happen is that at some level of amateur or professional baseball, a higher percentage of pitchers who vary their release points will make it.  But when you get to the big league level, both groups (the ones that vary a lot and the ones that don’t) will likely be around the same overall talent.

If it were true that varying was indeed better than non-varying, you might find that a greater percentage (than for all pitchers) of the worst pitchers were non-variers and a greater percentage of the best pitchers were variers.  Maybe.

Look at it this way.  Let’s say you have to have a 5.00 ERA or better to make it to the majors.  And let’s say that varying arm slot was much better than not varying.

Now, let’s say that there are 100 pitchers in the low minors who vary and 100 who don’t vary and that the average ERA of the former was 5.50 and of the latter it was 6.50.

Now let’s say that of the 100 variers, 50 had an ERA of 5.00 or better (average 4.80), and of the non-variers, 10 had an ERA of 5.00 or better (average around 4.80).  So the 50 and the 10 make it to the Show, but then you find no difference in ERA between the variers and non-variers in the show.

I am not saying that it is true that for all pitchers at all levels or for any one pitcher, that varying arm slot is better than not varying.  But if it is, you probably won’t find it in the majors.

Kind of like DIPS. It is probably true that at some level, pitchers have a lot of difference in their true BABIP, but by the time they get to the majors, only the best ones survive, at which point there is very little difference.

It’s the same thing if you looked at velocity in the majors.  You or someone else did.  You will find, obviously that “velocity does not make much of a difference.” But that would be simply because the pitchers with the lowest velocities in the majors would be very good at other things, whereas the ones with the highest velocities would be not as good at these other things.

Josh replied with:

Well I did mention in the article that this only holds true in the majors.  I understand that sampling is going to be an issue and that is why I said that.  In fact, I believe I said it twice that this only applies in the majors.

I don’t think he gets the problem.

I wrote:

Josh, the point is not that “it only applies in the majors.” The point is that the conclusion that “release point is not an important factor in determining success” is not necessarily valid.  In fact, it likely is not valid.  That is because of the selective sampling issue.  Whether you are looking at release point, fastball speed, or any other parameter whose success is influenced by or a function of other things, you generally cannot look at different players to determine whether there is a correlation between that parameter and success without controlling for those other things that influence success as well.

What you are doing is similar to looking at hair length and height and concluding that long hair is correlated with short stature without controlling for sex.

At the risk of repeating myself, it may be that pitchers with consistent release points are simply better at other things and therefore overall they are as good as pitchers who vary their release points.  If that is the case, then you cannot conclude that:

“While you will hear from time to time that a pitcher is extra difficult because he varies his release point or because of an extreme release point, it doesn’t appear that either of these things makes a difference at the major league level.”

And you especially cannot conclude or suggest that:

“While this not the result I expected, it does have some interesting implications. If you are a young pitcher honing his craft with big league aspirations, don’t mess around with dropping down sidearm just to show the hitters something different.”

Again, it might be perfectly appropriate to teach a young (or any age) pitcher to vary his release point as that may in fact contribute to more success.  Your data and analysis in no way shape or form tells us that any one pitcher is not better off varying his relsease point.  It only tells us that pitchers that do vary their release point are just as successful as pitchers that don’t - and again, the pitchers that don’t just might be better pitchers otherwise - in spite of their constant release point, not because of it!

#1          (see all posts) 2008/09/17 (Wed) @ 07:19

Hmmm… so if there is some persistent advantage to varying or not varying, would a simple raw count of the number of vary-ers (variers?) and non-vary-ers tell you which one was better, all else being equal?

Great explanation by the way.


#2          (see all posts) 2008/09/17 (Wed) @ 07:21

Actually nevermind.  Because while in your example, the ratio of minor league vary-ers and non-vary-ers is equal, that might not be the case in reality, I suppose.

Also… the word/number confirmation for me is a contraction - “youre82”.  Weird!


#3    dcj      (see all posts) 2008/09/17 (Wed) @ 15:02

The analogy with velocity is a good one. Isn’t it true, though, that harder-throwing pitchers are better overall?

Fangraphs keeps track of average fastball velocity. In 2008 there are 93 starting pitchers with at least 150 IP.

1. Ubaldo Jimenez, 94.9 MPH
2. Felix Hernandez, 94.6
3. Josh Beckett, 94.4
...
91. Livan Hernandez, 83.7
92. Jamie Moyer, 81.2
93. Tim Wakefield, 73.1

The correlation between fastball velocity and ERA is r = -0.31. The linear regression equation says that you lose 0.08 points of ERA for each extra MPH on the fastball. An average fastball velocity of 95 corresponds to a 3.65 ERA, and an average fastball velocity of 85 corresponds to a 4.42 ERA.

All this is in spite of the perfectly valid selective sampling argument.


#4    Tangotiger      (see all posts) 2008/09/17 (Wed) @ 15:15

We should expect a .25 or so change in ERA, not .08.  Indeed, you are making MGL’s point!

That is, let’s presume that the only difference between a pitcher who starts or relievers (Joba, etc) is that his fastball speed is faster as a reliever.  Everything else he does is the same.  Since we know that pitchers improve their ERA by 1.00, and if the only thing different is their fastball speed, and if that difference is 4 mph, then we’ll ascribe an impact of .25 ERA per mph difference.

(Feel free to substitute your own reasonable numbers.)

On the other hand, you have found a correlation of only .08 for mph difference.  The reason is that those with a lower fastball speed make up for the difference by being better at something else, be it knucklers, guile, or extra movement on pitches.

If on the other hand we allowed ALL pitchers who threw at least 75 mph in MLB, then we would indeed find that you would get a .25 ERA difference per mph, because now you have introduced a whole bunch of guys who can barely throw the ball who also have nothing else going for them.


#5    Mike Fast      (see all posts) 2008/09/17 (Wed) @ 17:49

Tango, the difference in fastball speed for pitchers between relieving and starting roles ranges from about 0-2 mph and averages 1 mph (2005-2008). 

The difference in runs allowed does not seem to correlate with the difference in fastball speed, however.  The mix of pitch types also stays very nearly the same, on average, for pitchers changing between the two roles (based on BIS data from Fangraphs).


#6    tangotiger      (see all posts) 2008/09/17 (Wed) @ 20:14

What’s the difference then?  Movement?  Or Location?  Because that’s the only two things left.


#7    MGL      (see all posts) 2008/09/17 (Wed) @ 21:53

One of the main differences between effectiveness of starters and relievers is the “times through the order.” If we want to compare them, we at least have to compare a starter’s first time through the order, say his first two innings, with his performance when he relieves (short relief).  That won’t work that well, though, since starters pitch differently in the first couple of innings, according to the pitch f/x data.  For example, I think one of the pitch f/x researchers has shown that starters use more fastballs in the first couple of innings.  They may also have a lower velocity (in the first couple of innings), I am not sure and I don’t remember.

Anyway my point still stands I think, despite some resistance and defensiveness from Josh.  I hope that all of the pitch f/s researchers, or at least the offending ones, stop analyzing one parameter of a pitcher or batter without controlling for the other parameters or using the “delta approach” with individual players (which ostensibly and ideally controls for everything else) and coming to the conclusion that the one parameter correlates or does not correlate (and by how much) with overall success.  It is somewhat a waste of an article I am afraid.


#8    Mike Fast      (see all posts) 2008/09/17 (Wed) @ 23:56

What’s the difference then?  Movement?  Or Location?  Because that’s the only two things left.

I don’t know.  If I knew that answer, you’d be seeing an article from me, but I don’t know yet.  I think fastball speed probably does have some impact, and I’m just not sampling or measuring quite carefully enough to see it.  Times through the order probably also has an effect.

I can think of other things besides movement and location (which I haven’t looked at, yet, btw).  Relievers pitch later in the game, so it’s probably cooler on average than when the starter is pitching.  Do relievers have the platoon advantage more often?  I forget if you guys looked at that in the Book--I’ll have to go check.  The strike zone might get bigger toward the end of the game, although I believe Dan Turkenkopf didn’t find that to be so when he investigated it.  Hitters might change their approach against relievers versus starters (more aggressive at the end of games, for example, although that doesn’t really fit with relievers allowing more walks).


#9    Peter Jensen      (see all posts) 2008/09/18 (Thu) @ 02:30

What’s the difference then?  Movement?  Or Location?  Because that’s the only two things left.

What makes some pitchers successful, and other pitchers that seem similar less successful is one of the most interesting questions in baseball research, along with the related question of what makes a pitcher very successful on some occasions and much less successful on others.  It is a particularly difficult question to research, however, because the usual methods of aggregating many pitchers together will obscure the real differences that exist between pitchers who have been able to maximize their personal success by accentuating their own individual strengths and and minimizing their weaknesses.  The other complication is that one strategy may work against one batter but not another.  So even aggregating all the pitches of a single pitcher may obscure the different methods that a pitcher uses to be successful against individual batters.


#10    Dan Brooks      (see all posts) 2008/09/18 (Thu) @ 12:50

Again, it might be perfectly appropriate to teach a young (or any age) pitcher to vary his release point as that may in fact contribute to more success.  Your data and analysis in no way shape or form tells us that any one pitcher is not better off varying his release point.  It only tells us that pitchers that do vary their release point are just as successful as pitchers that don’t - and again, the pitchers that don’t just might be better pitchers otherwise - in spite of their constant release point, not because of it!

This is a great point.

All of this discussion reminds me of studies from evolutionary biology on the beneficial nature of crypticity. I realize, tangent, but cut me some slack for a second.

Consider the case of a moth (prey) trying to hide from a blue jay (predator). One would think that it was best for the moth to be as cryptic or camouflaged as possible. There is a wing pattern in the environment that will allow it to be the most cryptic, so that it is hardest to see. But, blue jays are very good at finding moths, and their perceptual systems have also co-evolved to be very good at detecting them.

This problem was taken back into the lab, and computerized moth-like things were displayed on the screen and allowed to “evolve” while real blue jays tried to find them. What they found is that, like the real moths, computerized moths did NOT converge on the “optimal” cryptic solution. Instead, the most optimal solution for these computerized moths was to evolve to be not only very cryptic, but also very different from other “moths” in the experiment.

Why? Blue Jays form a search image while searching through the display. Their perceptual systems become tuned to finding these moths, even when they are *extremely* hard to find (think: where’s waldo times 10000). So, even though the task is very difficult, they adjust and will succeed.

On the other hand, when the moths are not only cryptic but also very different from one another, it becomes a much more difficult task for the blue jays. Although their perceptual systems could solve any one of these tasks alone, it becomes very hard for them to identify any one optimal search strategy and so all of the moths collectively are harder to find.

I think this is actually a fairly good analogy for what makes a successful pitcher. Sure, it’s good to have pinpoint location and accuracy and speed, and all of these things are important - just like overall crypticity for the moth trying to hide from the blue jay. But the natural (and extreme) variation in pitchers (and moths) suggests that being *different* from everyone else is also critically important.

So, it may be the case that release point variation (or pitch type variation or pitch velocity variation or whatever) does not help individual pitchers. But, it may be the case that variation in this regard helps pitchers as a whole.

This was a very long rambling post that I hope made some amount of sense.


Page 1 of 1 pages


Name (required)
E-Mail (optional)
Website (optional)

<< Back to main


Latest...

COMMENTS

Jan 09 16:41
Sabermetric Moves of the 2009 Pre-Season

Jan 09 19:56
Modeling Baseball Player Ability with a Nested Dirichlet Distribution

Jan 09 18:08
Line Drives

Jan 09 18:04
Challenging Nate Silver (and all other forecasters)

Jan 09 17:31
Cheers

Jan 09 17:14
Teaching sabermetrics at school

Jan 09 16:51
The first Hardball Times Annual available for download!

Jan 09 14:44
Vote for the Worst Player in MLB

Jan 09 12:29
Clint Eastwood is Archie Bunker

Jan 09 12:16
Mailbags on Parade