Wednesday, September 17, 2008
Release point and success
Josh Kalk, one of the very good pitch f/x researchers, wrote another article on pitcher release points and overall success.
Here was my first comment:
Very nice job as always.
Once again, selective sampling rears its ugly head. Unless you are somehow able to look at the same pitchers who have changed their delievery or style for some reason, you just aren’t likely to find anything.
Let’s say that varying release points was much better than not. Well, what will happen is that at some level of amateur or professional baseball, a higher percentage of pitchers who vary their release points will make it. But when you get to the big league level, both groups (the ones that vary a lot and the ones that don’t) will likely be around the same overall talent.
If it were true that varying was indeed better than non-varying, you might find that a greater percentage (than for all pitchers) of the worst pitchers were non-variers and a greater percentage of the best pitchers were variers. Maybe.
Look at it this way. Let’s say you have to have a 5.00 ERA or better to make it to the majors. And let’s say that varying arm slot was much better than not varying.
Now, let’s say that there are 100 pitchers in the low minors who vary and 100 who don’t vary and that the average ERA of the former was 5.50 and of the latter it was 6.50.
Now let’s say that of the 100 variers, 50 had an ERA of 5.00 or better (average 4.80), and of the non-variers, 10 had an ERA of 5.00 or better (average around 4.80). So the 50 and the 10 make it to the Show, but then you find no difference in ERA between the variers and non-variers in the show.
I am not saying that it is true that for all pitchers at all levels or for any one pitcher, that varying arm slot is better than not varying. But if it is, you probably won’t find it in the majors.
Kind of like DIPS. It is probably true that at some level, pitchers have a lot of difference in their true BABIP, but by the time they get to the majors, only the best ones survive, at which point there is very little difference.
It’s the same thing if you looked at velocity in the majors. You or someone else did. You will find, obviously that “velocity does not make much of a difference.” But that would be simply because the pitchers with the lowest velocities in the majors would be very good at other things, whereas the ones with the highest velocities would be not as good at these other things.
Josh replied with:
Well I did mention in the article that this only holds true in the majors. I understand that sampling is going to be an issue and that is why I said that. In fact, I believe I said it twice that this only applies in the majors.
I don’t think he gets the problem.
I wrote:
Josh, the point is not that “it only applies in the majors.” The point is that the conclusion that “release point is not an important factor in determining success” is not necessarily valid. In fact, it likely is not valid. That is because of the selective sampling issue. Whether you are looking at release point, fastball speed, or any other parameter whose success is influenced by or a function of other things, you generally cannot look at different players to determine whether there is a correlation between that parameter and success without controlling for those other things that influence success as well.
What you are doing is similar to looking at hair length and height and concluding that long hair is correlated with short stature without controlling for sex.
At the risk of repeating myself, it may be that pitchers with consistent release points are simply better at other things and therefore overall they are as good as pitchers who vary their release points. If that is the case, then you cannot conclude that:
“While you will hear from time to time that a pitcher is extra difficult because he varies his release point or because of an extreme release point, it doesn’t appear that either of these things makes a difference at the major league level.”
And you especially cannot conclude or suggest that:
“While this not the result I expected, it does have some interesting implications. If you are a young pitcher honing his craft with big league aspirations, don’t mess around with dropping down sidearm just to show the hitters something different.”
Again, it might be perfectly appropriate to teach a young (or any age) pitcher to vary his release point as that may in fact contribute to more success. Your data and analysis in no way shape or form tells us that any one pitcher is not better off varying his relsease point. It only tells us that pitchers that do vary their release point are just as successful as pitchers that don’t - and again, the pitchers that don’t just might be better pitchers otherwise - in spite of their constant release point, not because of it!
Hmmm… so if there is some persistent advantage to varying or not varying, would a simple raw count of the number of vary-ers (variers?) and non-vary-ers tell you which one was better, all else being equal?
Great explanation by the way.