|
APBRmetrics The statistical revolution will not be televised.
|
View previous topic :: View next topic |
Author |
Message |
Guy
Joined: 02 May 2007 Posts: 128
|
Posted: Wed Dec 05, 2007 3:15 pm Post subject: |
|
|
Quote: | Now this I don't understand. In looking at YTY correlations I'm only comparing players to themselves one year later. |
Not quite: you're comparing where a player stood compared to league average in Yr1 to where he stood in Yr2. So you will have a higher correlation if you don't adjust for position.
Take a simple case where there is no true rebounding ability at all, and only position on the floor matters: average Reb48 is 10 for Cs/Fs and 5 for guards, but all other variance is just random noise. If you adjust for position, your YTY correlation will then be zero; but if you don't adjust, you'll still find a very substantial correlation as the C/Fs will almost all be above average both years, and all the guards will be below average. |
|
Back to top |
|
|
Eli W
Joined: 01 Feb 2005 Posts: 402
|
Posted: Wed Dec 05, 2007 3:18 pm Post subject: |
|
|
Guy wrote: | Eli: the strong YTY correlation for REB is not only a measure of context impact, or even sample size (per Tango). It is also hugely impacted by the variance among players: the larger the variance, the higher the correlation (other factors equal). |
This is something I haven't completely got my head around yet. My first reaction is - of course YTY correlations are impacted by the variance among players, because that's precisely what YTY correlations measure. I guess what I'm saying is, what else could they be measuring? Was I wrongly thinking they could tell me one thing when in reality all they could tell me about was variance among players?
The context impact part is coming from comparing the dropoffs of various stats' YTY r's for same-team vs. different-team players. Is the relative size of that dropoff for REB vs. AST also tied to the differing variance among players in those stats? I'm not so sure about that - I would think that would be reflected in both the same-team and different-team r's, and thus the size of the dropoff wouldn't be affected. _________________ Eli W. (formerly John Quincy)
CountTheBasket.com |
|
Back to top |
|
|
Eli W
Joined: 01 Feb 2005 Posts: 402
|
Posted: Wed Dec 05, 2007 3:22 pm Post subject: |
|
|
Guy wrote: | Not quite: you're comparing where a player stood compared to league average in Yr1 to where he stood in Yr2. So you will have a higher correlation if you don't adjust for position. |
I'm not standardizing Wins Produced to the league average for that season. _________________ Eli W. (formerly John Quincy)
CountTheBasket.com |
|
Back to top |
|
|
Eli W
Joined: 01 Feb 2005 Posts: 402
|
Posted: Wed Dec 05, 2007 3:49 pm Post subject: |
|
|
Guy wrote: | Quote: | If things sum to team totals year to year and are consistent for an individual from year to year, that means (I think) that you can move players around, assume that their "rating" is the same, plug it in, and you should get team wins more or less. |
I think that's true IF you add the condition that players are changing teams and MP a lot. Without that condition, a metric that added to team wins but did not apportion credit well w/in the team could still show a high YTY correlation at the player level, reflecting only the YTY correlation of team performance (which should be high, if players are mostly staying put). |
Which is why I thought it might be more useful to compare the YTY r's of players who changed teams to those who didn't, rather than just looking at the YTY r of all players.
Dean, I understand you were suggesting using the two methods in tandem. I'm just trying to understand whether the YTY r method really tells us something useful. Maybe it does if only used on measures that already sum to team wins, but I want to test that out. _________________ Eli W. (formerly John Quincy)
CountTheBasket.com |
|
Back to top |
|
|
Conan the Librarian
Joined: 03 Sep 2007 Posts: 35
|
Posted: Wed Dec 05, 2007 6:57 pm Post subject: |
|
|
I'm still waiting for somebody to explain to me how taking a shot attempt is a missed opportunity cost. Cause I still don't understand what else you're supposed to do with a possession. |
|
Back to top |
|
|
Guy
Joined: 02 May 2007 Posts: 128
|
Posted: Thu Dec 06, 2007 11:19 am Post subject: |
|
|
Eli:
My point was simply that when opportunities are strongly correlated with position, then you will find a higher YTY correlation if you don't position-adjustment your values. What you want to know is how much of a player's Reb total reflects his rebounding skill, and how much it reflects his opportunities. If you don't account for opportunities consumed, using raw Reb totals is like evaluating a scorer based only on points, while ignoring FGAs (this is the irony in WP -- Berri makes the same mistake about rebounding that he has devoted thousands of words attacking on the scoring side). With rebounds, the first step in accounting for opportunities is a position adjustment. But there's also reason to believe that, especially on defense, there are large differences in opportunities even within positions.
Let me use a baseball example to illustrate. If we rated fielding based on outs made (putouts) per batter, the team total would exactly match team defensive efficiency. And we would also find a very high YTY r if we didn't position adjust, because there's a clear position hierarchy for putouts: 1B (c. 1400-1500), C (1,000), CF (410), 2B (350), LF/RF (320), SS (275), 3B (140). So we've apparently met both of Dean's conditions. But once you adjust for position, your YTY r will be much lower. Position-adjusted putouts tells you something, but it's far from a comprehensive defensive metric. (Catcher putouts, for example, are a function only of pitcher strikeouts and tell you nothing about the catcher's ability.) |
|
Back to top |
|
|
FrontRange
Joined: 27 Jan 2005 Posts: 131
|
Posted: Thu Dec 06, 2007 2:23 pm Post subject: |
|
|
Conan the Librarian wrote: | I'm still waiting for somebody to explain to me how taking a shot attempt is a missed opportunity cost. Cause I still don't understand what else you're supposed to do with a possession. |
Hey . .based on the missed opportunity cost theory, and since a rebound has so much value, shouldn't the missed FGA attempt generate some of that value of the rebound (you can't rebound from the bottom of the net), and since 30% of rebounds are offensive it seems that at least 15% of the rebound value of a possession should accrue to the offensive player missing the shoot, right? |
|
Back to top |
|
|
Eli W
Joined: 01 Feb 2005 Posts: 402
|
Posted: Thu Dec 06, 2007 3:46 pm Post subject: |
|
|
Guy wrote: | My point was simply that when opportunities are strongly correlated with position, then you will find a higher YTY correlation if you don't position-adjustment your values. What you want to know is how much of a player's Reb total reflects his rebounding skill, and how much it reflects his opportunities. If you don't account for opportunities consumed, using raw Reb totals is like evaluating a scorer based only on points, while ignoring FGAs (this is the irony in WP -- Berri makes the same mistake about rebounding that he has devoted thousands of words attacking on the scoring side). With rebounds, the first step in accounting for opportunities is a position adjustment. But there's also reason to believe that, especially on defense, there are large differences in opportunities even within positions. |
In my upcoming post on the year-to-year correlations and context-dependency of boxscore stats (as opposed to comprehensive player ratings) I'm definitely going to talk about the issues you bring up. I agree with a lot of what you say but not all of it. But I don't want to steer this thread any further off topic, so I'll wait and write about it on my blog post. _________________ Eli W. (formerly John Quincy)
CountTheBasket.com |
|
Back to top |
|
|
HoopStudies
Joined: 30 Dec 2004 Posts: 706 Location: Near Philadelphia, PA
|
Posted: Thu Dec 06, 2007 6:05 pm Post subject: |
|
|
Guy wrote: | Quote: | If things sum to team totals year to year and are consistent for an individual from year to year, that means (I think) that you can move players around, assume that their "rating" is the same, plug it in, and you should get team wins more or less. |
I think that's true IF you add the condition that players are changing teams and MP a lot. Without that condition, a metric that added to team wins but did not apportion credit well w/in the team could still show a high YTY correlation at the player level, reflecting only the YTY correlation of team performance (which should be high, if players are mostly staying put). |
I checked basically a random variable that just gives credits to guys by playing for a team, meaning that it always sums to the team total of wins. The yty R2 is about 0.5 due to teams being fairly consistent, their rotations being fairly consistent, and the players being fairly consistent. So that is a baseline yty correlation. I think Berri said he gets an R2 of 0.75 or 0.8 with his stuff summing to season win totals. So it's better. Where others stand is still a project of fairly low priority. I just wanted to make sure that I didn't get a really large R2 with a random variable. _________________ Dean Oliver
Author, Basketball on Paper
The postings are my own & don't necess represent positions, strategies or opinions of employers. |
|
Back to top |
|
|
T.G. Randini
Joined: 15 Nov 2007 Posts: 4
|
Posted: Wed Jan 09, 2008 10:57 am Post subject: |
|
|
I posted my final thoughts regarding Berri's overvaluation of rebounding at the WoW site:
THE SO-CALLED ART OF REBOUNDING: ON THE NATURE AND VALUATION OF CERTAIN POSSESSION TERMINATIONS IN BASKETBALL
There are many classifications, or typologies, of painting as art. Among them are classical art, impressionism, cubism, post-modernism, and dadaism (among many others). These various types represent different artist world-views, or, different ways of seeing the world. Below are presented various ways of looking at the valuation of rebounds in basketball.
#1: A Classical Approach to Valuation
Berri, Schmidt & Brook, in The WAGES OF WINS (2007, updated paperback edition) indicate on page 101 that opponents’ possessions are terminated five different ways: turnovers, made field goal attempts, made free throw attempts, team rebounds, and defensive rebounds. They indicate on pp. 248-249 (footnote 32 to Chapter 6)…
“We do not consider the impact of an opponent missing a field goal or free throw. When the opponent misses a shot the team can collect the defensive rebound, which we include in our evaluation.” …
“So opponent’s missed shot add nothing to our story.”
Okay… I beg to differ. It may not add anything to BSB’s regressions, but causing an opponent to miss a shot utterly DOES matter in the proper allocation of credit when terminating opponents’ possessions.
That’s the crux of the matter, isn’t it? How do we terminate the opponent’s possessions and how do we allocate the termination credits?
Under Berri, Schmidt & Brooks (henceforth, ‘BSB’) model… the allocation of credit (for missed shots) goes 100% to the person who fetches the ball after the opponent misses the shot.
Unlike BSB, I think the activity that terminates the possession is composed of two distinct elements:
Activity A: the causing of the shot to be missed
Activity B: the fetching of the ball after the shot is missed
Thus, (Activity A) + (Activity B) = Opponent Possession Termination
I believe that Activity A is just as important (if not more so) than Activity B… but for simplicity… let’s say they are equal.
Then, the allocation of credit for the total activity (activity A + activity B) would be as follows when valuing the possession termination due to a missed field goal (and utilizing defense as a team construct):
Point Guard .1
Shooting Guard .1
Small Forward .1
Power Forward .1
Center .1
Rebounder .5
The person who actual rebounds the ball would end up with .6, or 60% of the credit because .1, or 10% of the credit would be incremental to the 50% due to his team defense.
It would be easy to allocate credit in this manner: simply attribute rebounds as a .5 weight instead of a 1.0 weight to the rebounder… and then allocate the other 50% of individual ‘rebounds’ to a team pool (constituting team defense) and further allocate based on minutes played.
In this manner, you will more properly allocate “the causing of the shot to be missed” PLUS “the fetching of the missed shot”… instead of BSB’s attribution of 100% of the credit to Activity B, the person who fetches the ball.
Pertinent: The causing of the missed shot is an important activity because field goal percentages are almost always much lower than free throw percentages. If ‘causing the missed shot’ was not an important activity, then field goal percentages would be much higher and would reach equilibrium with free throw percentages. In fact, they could even exceed free throw percentages because you are forced to stand at least 15 feet from the basket when attempting a free throw. An un-defensed field goal could be as easy as a slam dunk or layup.
In summary to my classical approach to valuation… I believe a proper model would allocate credit to the skills employed in causing the opponent to miss a field goal attempt (and the fetching of the ball) instead of giving ALL the credit to the person who fetches the ball after the missed field goal.
Note: In answer to those who would say BSB’s ‘position adjustments’ would negate the effect of 100% attribution of (Activity A + Activity B) to merely the ball-fetcher (Activity B)… it wouldn’t… at least, not properly.
BSB’s methodology relatively overrates high-rebounding guards over lower-rebounding guards (and higher-rebounding forwards/centers to lower-rebounding ones). In effect, the BSB methodology overrates Jason Kidd compared to Steve Nash.
I shall not go into BSB’s conversion of a regressed .67 assist value to a .50 here, but will note that it is interesting they cite (p. 254, footnote 12 to Chapter 7, 2007 paperback) Hollinger’s three part deconstruction of a scoring play that is very analogous to my two-part deconstruction of a missed field goal/rebound, and then they complement themselves that their .67 regression value for an assist corroborates Hollinger’s intuition!
BSB, it is time you intuit the proper attributions of credit on the defensive side also.
Please note, the regressed value of the TOTAL activity (Activity A + Activity B) would be the same under my system as in BSB’s regressed value for Activity B alone. My system would not change the amount BSB’s regressed variables are ‘explained’ (using ‘explained’ merely in the academic statistical sense).
But my system would explain (capitalize EXPLAIN) what is going on a heck of a lot better than BSB’s attribution of 100% defense to the ball-fetchers. It would have the same statistically relevant explanatory power, but with the added enhancement of a much better way of attributing credit.
Explaining, instead of ‘explaining’.
#2: A Cubist Approach (to Valuation)
Let’s have a little more fun now. Let’s compare the ‘missed FG and rebound’ to baseball. In baseball, the batter is part of the offense, and the pitcher, catcher, and fielders constitute the defense.
The pitcher throws. The batter swings. Strike three. He’s out! Another strike out for Randy Johnson!
What happened here?
The batter (shooter) missed the ball (basket). The catcher caught the missed attempt. But the fans are cheering for Randy Johnson, the pitcher! What are they… nuts? The catcher caught (fetched) the missed attempt by the batter! Why are they not cheering for the catcher… (the fetcher)? (A mini-poem, sorry…)
Because the fans know something that BSB do not know. That defense is not 100% attributable to the ball fetchers and catchers.
The fans know that the speed, location, and spin of the ball by the pitcher (analogous to the movement and placing of basketball players when playing defense) constitute at least 50% of the value of getting the hitter to miss the ball when he swings (or the shooter missing the basket when he arches one up toward the rim).
#3: Another Cubist Approach to Valuation
I once watched the Dipper play tennis at a public park in LA in the late eighties. Great guy. Here’s the thing: Wilt was a graceful player. Two steps: forehand down the line. Three steps the other way: backhand down the line. Accomplished? Yes. And surprisingly graceful. (By the way, he was a track star in high school… and dberri, he did not like to be called ‘The Stilt’. He did like ‘The Dipper’, however…)
BSB (page 149, WOW, 2007 paperback edition) indicate that Wilt may have been responsible for 52-odd wins in the early 60’s when his team (the Warriors) won only 49 games. They, of course, see something wrong with this calculation.
If this calculation makes sense, the Warriors would have been better off if the other four guys did nothing at all! Just stand in a corner of the court and do nothing!
I love Wilt but he couldn’t do it all. Ergo: the Celtics dynasty.
The calculation is non-sensical because BSB attribute 100% of the credit to the rebounder for ‘making the opponent miss a shot’ + ‘grabbing the rebound of the missed shot’.
The attribution of 100% of the credit to Wilt for getting a rebound is what makes the 52-odd wins non-sensical… and by logical extension… … makes their attribution of credit in their Player Wins model non-sensical.
Dberri, there was a REASON for those four guys to be on the floor with Wilt.
(Note: Once again, I am saying BSB’s attribution of CREDIT is non-sensical, not the regression value for their mis-defined concept of ‘rebounding’ itself. The BSB regression value for (and terminology of) ‘rebounding’ is equivalent to ‘making them miss the shot + rebounding the loose ball’ in the construction I have presented above.)
#4: A Dadaist (and Final) Approach to Valuation
Let’s imagine a league where FG % is even worse than it is in the present NBA. (Heck, we could go back in history to the NBA itself… the 50’s… especially the early 50’s…)
Let’s imagine a 30% conversion rate. On average, the ‘expected outcome’ (sorry, people, that’s econ-speak)… would be negative for shooters.
A rational decision-maker (sorry again… more econ-speak), in this case, the coach, would instruct his players NOT TO SHOOT. “Don’t shoot!” the coach says to his team in the huddle. “Don’t EVER shoot!” Then, the expected negative outcomes through shooting would never occur, and his team would have lots of positive player win value through rebounding.
Except the other team’s coach is ALSO a rational decision maker and he instructs his team to do the same thing.
So… neither team shoots. Neither teams scores. The fans stop coming. The game of basketball dies.
All because BSB overvalue rebounding.
IN SUM: The above represents my thinking on the nature and valuation of certain possession terminations in the game of basketball as played in the late 20th and early 21st centuries using various classical, modernist and dadaist constructions (or dadaist ‘destructions’). Please consider the term ball ‘fetching’ as a dadaist intrusion into the classical and cubist schemes.
As Dorothy once sang in The Wizard of Oz…
Fetchers and catchers and bears, oh my!
The value of a rebound is much less than ‘pi’!
Always,
Tomas Giuseppe Randini |
|
Back to top |
|
|
Rasta978
Joined: 26 Mar 2007 Posts: 56 Location: Orlando, FL
|
Posted: Wed Jan 09, 2008 12:02 pm Post subject: |
|
|
Randini,
Thanks for that interesting and entertaining post. I agree with your premise, but wonder about the added complexity that this would introduce into the various linear metrics. Also, do we have sufficient data to make this premise a reality?
A suggestion, though, on approach #4 (Dadaism). A league-wide decline in eFG% (and how the models deal with this decline) warrants deeper discussion. Your tongue-in-cheek prediction of "Don't Shoot!" ought to be fleshed out.
Consider, for example, my second favorite sport: soccer. Lots of similarities with the game of basketball, except that the eFG% (if soccer even bothered to track it) is probably less than 1%.
I'd be interesting is seeing how a dramatic decrease in eFG% would hypothetically play out. Which of our models, if any, would still be useful? And which would need to be scrapped, or at least revised? |
|
Back to top |
|
|
Mountain
Joined: 13 Mar 2007 Posts: 1527
|
Posted: Wed Jan 09, 2008 4:47 pm Post subject: |
|
|
TG I put some comments in the what is a possession worth thread but obviously they bear on your post here and at Wages of Wins. I offered brief support for your posts there.
I may not get into it deeper right away but I hope more folks discuss the 'proper" or their preferred weighting between shot defense and fetching rebounds.
Right now I think net counterpart PER and Roland ratings deserve renewed attention given their inclusion of shot defense- and opponent rebounding.
Last edited by Mountain on Wed Jan 09, 2008 7:34 pm; edited 2 times in total |
|
Back to top |
|
|
magicmerl
Joined: 30 Dec 2007 Posts: 54
|
Posted: Wed Jan 09, 2008 6:56 pm Post subject: |
|
|
I'm currently trying to get a response on WoW on your post (which was just dismissed out of hand). |
|
Back to top |
|
|
magicmerl
Joined: 30 Dec 2007 Posts: 54
|
Posted: Wed Jan 09, 2008 9:49 pm Post subject: |
|
|
And here that response is:
Jason said wrote: | #
There are a few ways to look at the apportionment of the credit for a defensive stop. One is to try to reason out a value by suggesting that X% goes to the guy who got the rebound and Y% goes to everyone else and this Y does not need to be divided equall. Reasoning this through via some “logical” interpretation of the game and what we know happens runs the very significant risk of simply perpetuating a subjective opinion already held; true or not, it’s not evidence based.
Another is to empirically test whether or not dividing credit is necessary and, if so, who gets what. I suspect that other players do have influence on players rebounding, but empirically, as I’ve measured it, it is not great. Either defensive ability does not vary significantly and the outliers who are great or lousy are too few to make a difference in generalization of formulae or others really do not have that much influence (which is a subset of the abilities being not terribly variable, but also not terribly important) or the methodology corrects for the difference in some other way already.
On empirical grounds, we can address things in a number of ways. One is to look at how rebounds vary with respect to other aspects of the game. At the team level, rebounding percentage does covary with defensive FG%. But it isn’t that tight a correlation. Some large part of rebounding belongs to the guy who got the rebound.
But how much? The 50-50 split has some support. The r_sq between defensive FG% and defensive rebounding % is about .45 over the single year I looked. I don’t know if this year was typical or not, but it suggests that about half of the miss is explained by looking at the propensity to grab available defensive rebounds. This isn’t suggesting cause. This simply suggests that, on average, they covary, though not perfectly. Raising one raises the other, but there’s noise. This 50-50 split also presumes that the defensive effort that went into the miss was independent of the rebounder, that anyone could have done this and the rebounder would have had the same chance at the ball had a guard played his ass off on defense vs. playing well himself. More on that below, but the assumption of equal effort divided on defense seems at least as shaky than assigning credit to the rebounder.
The correlation for any particular player between how *he* rebounds from year to year is much tighter and isn’t explained particularly well by defensive FG%, indicating that this 50-50 split isn’t necessarily a good way to go, as it underpredicts rebounding change with player movement. If teammates are largely responsible for the defensive misses, we would expect changing teams to alter rebound rates for players significantly. It doesn’t. Something about the player seems to be largely responsible for his per-minute rebound rate.
It’s possible that big men who get more rebounds are also more active in producing misses. My entirely subjective reasoning on this is that guards guarding guys away from the basket are guarding shots that had a better chance of missing even if there was no pressure. Guys defending inside are defending potentially higher percentage shots that, uncontested, would go in. Big men who get more rebounds may actually be generating more misses that they then gather. I do not presently have direct evidence of this, but if true, it’s consistent with the observation that rebound rates follow players independent of teammates.
I have more thoughts on this, many more, but that’s enough to chew on at this point and in the interest of avoiding losing signal to more noise…
# |
Dberri said wrote: |
As I noted a few days ago, I am posting less. I am also commenting less. But my sports econ class just got out, so before I go home I would note…
1. I agree with Jason. Rebounds are very consistent over time which suggests that a player’s rebounds are about the player, not his teammates. This may result in players being ranked differently than you would like, but such is life.
2. As noted before, changing the value on rebounds to 0.7 does not substantially change the rankings. So even if you make an effort to divide credit, it doesn’t seem to matter.
3. The key differences between the WoW metrics and stuff like PERs isn’t rebounding, but how you treat shooting efficiency.
4. Finally, I am not inclined to change any of this in WoW II. Our second book is not going to be about new basketball metrics. And it is not going to be strictly about basketball. I might give more details as we go through the process of writing this book.
As I can, I am reading the comments. But my ability to participate is limited. There will be no post tonight, but look for something new posted on Thursday night.
Once again, thanks for all the comments. |
From here |
|
Back to top |
|
|
asimpkins
Joined: 30 Apr 2006 Posts: 245 Location: Pleasanton, CA
|
Posted: Wed Jan 09, 2008 9:51 pm Post subject: |
|
|
dberri wrote: | 2. As noted before, changing the value on rebounds to 0.7 does not substantially change the rankings. So even if you make an effort to divide credit, it doesn’t seem to matter.
3. The key differences between the WoW metrics and stuff like PERs isn’t rebounding, but how you treat shooting efficiency. |
While I agree that a good linear ranking will not give full possession credit to the defensive rebounder, it seems to not be a very effective angle of attack here.
For those of you that think continuing this debate could be fruitful, it would be better to target the different assumptions that WoW places on rebounding and scoring -- specifically that average rebounding is worth something but average scoring is worth nothing.
More than anything, rebounding is valued more than scoring because they aren't playing by the same rules. |
|
Back to top |
|
|
|
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
Powered by phpBB © 2001, 2005 phpBB Group
|