|
APBRmetrics The statistical revolution will not be televised.
|
View previous topic :: View next topic |
Author |
Message |
Mike G
Joined: 14 Jan 2005 Posts: 3612 Location: Hendersonville, NC
|
Posted: Thu May 20, 2010 5:05 pm Post subject: Replacement player value |
|
|
If .80 of average efficiency differential (ED) is Replacement Level (RL) play, then a team of RL players, averaging a score of 80-100, would be expected to win about 5% of their games. They might go 4-78.
A team that averages 70-100 should only win 1% of their games. That's pretty close to 0-82.
To win 10 of 82 games, RL would be around .86 or .87 ED.
No team has ever been as bad as 4-78, and no team has ever been without any good player for a whole season. Of course, a team might have some players worse than RL and still average RL.
Here are 2010 league average per-36 rates, and .80 of those rates: Code: | per36 Pts Reb Ast Stl Blk PF TO
avg 15.0 6.2 3.2 1.1 0.7 3.1 2.0
80% 12.0 5.0 2.5 0.9 0.6 2.5 1.6
|
No reason to suppose PF and TO should be lower than avg for an RP, so we do something else with those.
To the eye, though, the positives of line 1 look like a weak starter or decent bench guy. The 80% line is decidedly weak. _________________ `
36% of all statistics are wrong |
|
Back to top |
|
|
BobboFitos
Joined: 21 Feb 2009 Posts: 201 Location: Cambridge, MA
|
Posted: Fri May 21, 2010 11:27 am Post subject: |
|
|
Good stuff. The question though, focusing on scoring per 36, is are we assuming that .8 player is taking on the same offensive burden? Also, .8 TO of 2 per 36 should be 2.5 since it's the inverse of .8, no? If the shot attempts are the same, then their TS is falling from say an average value of ~54.3 to generate 15 per 36 (or 13.81 raw true shooting attempts) down to ~43.4 TS.*
*I basically figured to score 15 per 36 on the average NBA TS requires 13.81 TSA, so if you're scoring only 12 points on those same shot attempts, that's the relative drop in TS.
~~~
Do people view the worst historical record as a team full of replacement players? I don't. The 9 win 1973 76ers actually fell well below their pyth, but employed several players who had long-ish NBA careers. (Suggesting that they were not truly replaceable in the minimal sense) Granted I don't know anything about these players outside of skimming bref/looking at their career stats, but I think setting the door at a "10 win team" isn't really the hypothetical floor.
Does a team full of replacements - that is, a team that doesn't have ANYONE on the roster that would be deemed an improvement for any other team (maybe?) even win a game? There's a huge gap between a -20 and -30 PD. _________________ http://pointsperpossession.com/
@PPPBasketball |
|
Back to top |
|
|
DSMok1
Joined: 05 Aug 2009 Posts: 611 Location: Where the wind comes sweeping down the plains
|
Posted: Fri May 21, 2010 12:04 pm Post subject: |
|
|
A good start to studying replacement level would be to study baseball's accepted methodology. Hardball times has a few articles, for starters.
Basketball skill over the whole world's population is approximately a bell curve. We can all agree on that, right?
The players in the NBA are basically the right tail of that curve--so the curve should look fairly exponential, in terms of player quality from left to right.
However, once you get down to below average, there is a strong selective sampling issue--not every player of that quality actually is playing in the NBA. We end up seeing a slightly left-skewed graph of the quality of players in the NBA. Something like a log-normal distribution of sigma 1/2. Once the players get bad enough, none of them are in the NBA.
From a team's perspective, they are trying to get enough quality players on the court at once to win games. Is an NBA average player worth something? Yes, by definition. NBA-average players would win 41 games. What about somebody a little worse than average? Yes, he would help out also. You may need to play him, and players of his caliber (say an APM of -2) are not freely available.
So what is the threshold of replacement level? There is the rub. It is not the best player who isn't starting. That's way too high. It's probably above the 15th player on the bench--he could be old and bad but still under contract, or a youngster expected to develop.
Here's Tom Tango's definition: Quote: | WAR is wins above replacement. Replacement is defined very specifically for my purposes: it’s the talent level for which you would pay the minimum salary on the open market, or for which you can obtain at minimal cost in a trade. |
So we're not defining by how bad a team could be, but by what is available.
Which is rather hard to do, honestly. |
|
Back to top |
|
|
mtamada
Joined: 28 Jan 2005 Posts: 377
|
Posted: Fri May 21, 2010 4:39 pm Post subject: |
|
|
DSMok1 wrote: | A good start to studying replacement level would be to study baseball's accepted methodology. |
Yes, we do not know how many wins a replacement level player (or team of such players) would win, nor do we know what their stats would be.
But we do know the approximate description of a replacement level player: the freely available, marginal-on-or-off-the-roster player.
So I'd approach the estimation from three directions. First look at the stats of the 12th man (or these days, the 13th through 15th men) on NBA rosters. Defining the 12th man is a little tricky ... I'd basically use minutes played, but would make sure to exclude a Gred Oden-like player who may've played 12th man minutes due to injury not due to lack of ability.
That gives you an upper bound on how good the replacement level player is ... there might be some players who are below replacement level but manage to stick to a roster due to either a guaranteed contract or local popularity or for development or team sentimentality (Ken Griffey Jr. is like that right now for the Mariners) but on the whole, these are players who by definition made it onto an NBA roster, and are likely to be on average a bit better than the typical replacement player.
Next, look at the players who got called up to the NBA during the season. Again make sure to exclude good players who started the season injured or who were acquired as expensive free agents; include only minimum salary free agents and call-ups from the NBDL (again excluding players such as Hasheem Thabeet who may've been sent down for developmental reasons or whose ability level may've literally fluctuated throughout the season). This comes the closest I think to measuring replacement level players, but the small number of games and minutes that these players play may imply large standard errors in our estimates.
Finally, look literally at the minimum salary players. Some of these players will in fact be pretty good players who got belatedly discovered by some NBA team and who are truly better than replacement level, but are unlucky enough to be getting only a minimum salary contract. So this group again will tend to give you a bit of an overestimate of the replacement level.
None of these measures are perfect but between the three of them you could start really zeroing in on what the replacement level stats look like.
You'd probably want to do different stats for positions; a replacement level PG is going to have very different stats from a replacement level C. |
|
Back to top |
|
|
Mike G
Joined: 14 Jan 2005 Posts: 3612 Location: Hendersonville, NC
|
Posted: Sat May 22, 2010 6:55 pm Post subject: |
|
|
Are Win Shares (or WS/48) already above a replacement level?
This season, there were 368 players w >200 minutes and >0 WS/48. (Along with 18 who were negative.)
That's about 12.3 per team.
At 600 minutes, 310 positive and just 8 negative. _________________ `
36% of all statistics are wrong |
|
Back to top |
|
|
DSMok1
Joined: 05 Aug 2009 Posts: 611 Location: Where the wind comes sweeping down the plains
|
Posted: Sat May 22, 2010 9:16 pm Post subject: |
|
|
Mike G wrote: | Are Win Shares (or WS/4 already above a replacement level?
This season, there were 368 players w >200 minutes and >0 WS/48. (Along with 18 who were negative.)
That's about 12.3 per team.
At 600 minutes, 310 positive and just 8 negative. |
I think not, because the total of all win shares in the league equals 41*30. |
|
Back to top |
|
|
Mike G
Joined: 14 Jan 2005 Posts: 3612 Location: Hendersonville, NC
|
Posted: Sun May 23, 2010 6:14 am Post subject: |
|
|
But if by definition only players above replacement level are adding wins, then only negative WS/48 players would be considered sub-replacement level.
If so, then .000 WS/48 = RL
Whether 12 per team is the 'right' number of >RL players, or whether the remaining 3 players x 30 rosters ('project' players, practice guys, etc) effectively ensures that there are no better players available, this might be close.
It's still possible for replacements to generate wins, as their distribution of performance varies from game to game. A whole team of RP's (and sub-RP's) can get it together against a merely bad team on a bad night, and pull off a win or 2, out of 82.
In the real world, though, the RP team is in a vacuum against relentless pressure. A Stackhouse or a Rodman will surely come out of exile or retirement and suit up.
Found this thread which discusses replacement level:
viewtopic.php?t=2153 _________________ `
36% of all statistics are wrong |
|
Back to top |
|
|
DSMok1
Joined: 05 Aug 2009 Posts: 611 Location: Where the wind comes sweeping down the plains
|
Posted: Sun May 23, 2010 8:24 am Post subject: |
|
|
Mike G wrote: | But if by definition only players above replacement level are adding wins, then only negative WS/48 players would be considered sub-replacement level.
If so, then .000 WS/48 = RL |
No.
The replacement level is set by what is available, not by how many wins are contributed. In baseball, we:
Quote: | figure out the offensive production that a team could expect from players not projected to be good enough to make a major league roster next year. These guys have fallen into that Four-A category, where they show more ability than your average Triple-A veteran but not enough to hold down a major league job. They’re usually available every winter as minor league free agents, via the Rule 5 draft, or as cheap trade acquisitions where a team can acquire one of these players without giving up any real talent in return.
As Sean showed in his article, and has been shown elsewhere, the expected value of a replacement level player is about negative 20 runs per 600 PA. Or, to phrase it a bit differently, if you lost a league average player and replaced him with a freely available guy, you’d lose about two wins. | (source)
In baseball, a "replacement level" team is still at about a .400 winning percentage--the scatter isn't as big.
In basketball, we need to figure out how good the players are that are "freely available" and consider that replacement level.
That could be done by looking at the distribution of players in terms of their APM, and see where the distribution transitions from "the tail of a bell curve" to more of a log-normal distribution--which would imply players of that quality are available. |
|
Back to top |
|
|
gabefarkas
Joined: 31 Dec 2004 Posts: 1313 Location: Durham, NC
|
Posted: Sun May 23, 2010 12:32 pm Post subject: |
|
|
Instead of trying to theoretically come up with how many wins produced a replacement player would provide, why not try to come up with it empirically? What I mean is to try to identify actual replacement players, and then look at what they actually did on the court.
If we wanted to, from there we could even do permutation distributions, bootstrapping, jackknife, or any other resampling technique to come up with an empirical distribution for what would be expected from a replacement player.
So, what if we came up with a list of who we believe are actual replacement players? A starting point might be something along the lines of:
Aaron Gray
Aaron Miles
Alex Acker
Allan Ray
Andre Emmett
Awvee Storey
Bernard Robinson
Britton Johnsen
Casey Jacobsen
Chase Budinger
Chris Jefferies
Chris Quinn
Chris Taft
Daniel Ewing
Deng Gai
Dijon Thompson
Frank Williams
Gabe Pruitt
Josh McRoberts
etc etc etc
Does that make sense? Come up with a list of what you would consider replacement players, and then derive an empirical distribution from there. |
|
Back to top |
|
|
Carlos
Joined: 21 Jan 2005 Posts: 64 Location: Montevideo, Uruguay
|
Posted: Sun May 23, 2010 12:38 pm Post subject: |
|
|
What about looking at guys picked from the NBDL and undrafted players or midseason additions? It's relatively rare, but each year you see a few guys enter the league who were truly obtained at minimum costs. I remember the Grizziles a few years ago had all of their PGs injured and picked Elliot Perry basically off the street to play for a couple of games. It was unusual, sure, but I'd bet that every year there are a few cases like that, of teams playing truly marginal guys because of health issues. |
|
Back to top |
|
|
Mike G
Joined: 14 Jan 2005 Posts: 3612 Location: Hendersonville, NC
|
Posted: Sun May 23, 2010 12:46 pm Post subject: |
|
|
DSMok1 wrote: |
The replacement level is set by what is available, not by how many wins are contributed. .. |
And are these mutually exclusive?
If teams are actually utilizing players who are worse than available players, they aren't optimizing their wins.
You might even say they're putting guys on the floor who are removing wins, relative to the default position of 'best available replacements'.
Quote: | In baseball, a "replacement level" team is still at about a .400 winning percentage ... |
Winning 40% means winning 80% of average.
This really is a far cry from 80% of average efficiency differential -- which in NBA translates to about 5% wins. This is an artifact of 48-minute games (actually, of 90-95 possession games). In a one-possession game, your W/L = your ED.
How do you explain baseball teams that win <40% ? They're trying to lose?
If baseball statisticians have made serious logical errors, do we wish to perpetuate them? _________________ `
36% of all statistics are wrong |
|
Back to top |
|
|
DLew
Joined: 13 Nov 2006 Posts: 224
|
Posted: Sun May 23, 2010 1:45 pm Post subject: |
|
|
Mike,
You always seem hung up by anything that suggests teams are not optimizing. Why is this? It seems clear that many teams are not. Some teams play guys who are worse than the freely available players. Do you disagree? |
|
Back to top |
|
|
schtevie
Joined: 18 Apr 2005 Posts: 413
|
Posted: Sun May 23, 2010 2:34 pm Post subject: |
|
|
Can someone say, slowly and clearly, why one should be impressed with the concept of a replacement level player? In particular, why is it useful at all in discussing basketball?
I kind of can see in baseball, where the production function of the game is relatively simple, defining some inherently arbitrary below-average standard as a benchmark for comparing player values and this becoming a convention over time. But basketball is different. The production function is very complicated; it is not clear what the below-average standard should be; and it is difficult to measure player contributions precisely.
It is far more intuitive to at least eliminate one of these problems and have the benchmark of comparison be the average player, whether this value be zero (in terms of net points) or 8.2 (for per game WS).
The futility can be illustrated with 2007-08 data, chosen to utilize Ilardi & Barizlai's multi-year APM numbers as estimates of value. Let's take as an arbitrary starting point, the 360th ranked player in minutes per game (so, kind of the 12th man on the 30th team): Malik Rose, playing 10.1 minutes per game. Finding the 15 players above and below this mark (again, arbitrary) that meet the minimum minutes cut-off for I & B's estimates, the average multi-year APM is -3.0.
Might this replacement level definition be consistent over time? Perhaps. Ten minutes seems plausible. But even if the contribution of ten minute players hurt their teams to the tune of 3 points per 100 possessions on average, there is a great deal of dispersion around the mean. The standard deviation in the instance is 4.1, the estimates ranging from Ronnie Price's 7.17 to Dominic McGuire's -12.07. As such, what is the point of the exercise? What does the concept of a replacement level player gain us? |
|
Back to top |
|
|
Kevin Pelton Site Admin
Joined: 30 Dec 2004 Posts: 979 Location: Seattle
|
|
Back to top |
|
|
DSMok1
Joined: 05 Aug 2009 Posts: 611 Location: Where the wind comes sweeping down the plains
|
Posted: Sun May 23, 2010 4:56 pm Post subject: |
|
|
Kevin Pelton wrote: | http://web.archive.org/web/20040404040837/http://www.hoopsworld.com/article_7557.shtml |
There we go. I knew you had that around somewhere, but I couldn't find it.
That article is the baseline for A) Why replacement l level is important and B) a first effort at how to arrive at that level.
schtevie wrote: | Can someone say, slowly and clearly, why one should be impressed with the concept of a replacement level player? In particular, why is it useful at all in discussing basketball? |
Replacement level is required to determine the actual value of a player to the team. Since the players are all pulled from the tail end of a bell curve, at a certain level, there are lots of players available--and thus basically freely available. The value of any player in the NBA is actually their marginal value above the players that are freely available.
schtevie wrote: | I kind of can see in baseball, where the production function of the game is relatively simple, defining some inherently arbitrary below-average standard as a benchmark for comparing player values and this becoming a convention over time. But basketball is different. The production function is very complicated; it is not clear what the below-average standard should be; and it is difficult to measure player contributions precisely.
It is far more intuitive to at least eliminate one of these problems and have the benchmark of comparison be the average player, whether this value be zero (in terms of net points) or 8.2 (for per game WS).
The futility can be illustrated with 2007-08 data, chosen to utilize Ilardi & Barizlai's multi-year APM numbers as estimates of value. Let's take as an arbitrary starting point, the 360th ranked player in minutes per game (so, kind of the 12th man on the 30th team): Malik Rose, playing 10.1 minutes per game. Finding the 15 players above and below this mark (again, arbitrary) that meet the minimum minutes cut-off for I & B's estimates, the average multi-year APM is -3.0.
Might this replacement level definition be consistent over time? Perhaps. Ten minutes seems plausible. But even if the contribution of ten minute players hurt their teams to the tune of 3 points per 100 possessions on average, there is a great deal of dispersion around the mean. The standard deviation in the instance is 4.1, the estimates ranging from Ronnie Price's 7.17 to Dominic McGuire's -12.07. As such, what is the point of the exercise? What does the concept of a replacement level player gain us? |
One issue of looking at it purely in a MPG frame is that there is a ton of error associated in looking at players of that level. Another is that a player that is playing 10 MPG on the Lakers is a lot better than a player that is getting 10 MPG on the Nets.
I, however, also came to the same number (-3 pts/100 pos.) when evaluating players using Statistical +/-. It appears that a player of that caliber is nearly freely available. Interestingly, translating that -3 number into a team efficiency differential and running the Pythagorean formula yields the 10 win number yet again. |
|
Back to top |
|
|
|
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
Powered by phpBB © 2001, 2005 phpBB Group
|