{"id":846,"date":"2012-11-10T06:28:00","date_gmt":"2012-11-10T12:28:00","guid":{"rendered":"http:\/\/godismyjudgeok.com\/DStats\/?p=846"},"modified":"2012-11-10T06:35:03","modified_gmt":"2012-11-10T12:35:03","slug":"overrated-and-underrated-via-rapm-part-2","status":"publish","type":"post","link":"https:\/\/godismyjudgeok.com\/DStats\/2012\/nba-stats\/overrated-and-underrated-via-rapm-part-2\/","title":{"rendered":"Overrated and Underrated via RAPM (Part 2)"},"content":{"rendered":"<p>A week ago, I discussed <a href=\"http:\/\/godismyjudgeok.com\/DStats\/2012\/nba-stats\/underrated-and-overrated-via-rapm\/\">overrated and underrated players over the past 12 years<\/a>, evaluated by comparing popular box-score stats with Jeremias Engelmann&#8217;s <a href=\"http:\/\/stats-for-the-nba.appspot.com\/PBP\/2012np.html\" class=\"broken_link\">12 year average Regularized Adjusted Plus\/Minus (RAPM) dataset<\/a>.  For a primer on the virtues of RAPM (in large samples), see my article reviewing the state-of-the-art of <a href=\"http:\/\/godismyjudgeok.com\/DStats\/2011\/nba-stats\/a-review-of-adjusted-plusminus-and-stabilization\/\">adjusted plus\/minus and stabilization<\/a>.<\/p>\n<p>This time, I am looking at offensive and defensive RAPM over the same 12 years, and comparing them to <a href=\"http:\/\/www.basketball-reference.com\/about\/ws.html\">Offensive and Defensive Win Shares<\/a> and <a href=\"http:\/\/www.basketball-reference.com\/about\/per.html\">PER<\/a>.  Again, I am limiting this to very large sample sizes (20,000+ possessions) where RAPM should be both accurate and stable.<\/p>\n<h1>Offense<\/h1>\n<p><script type=\"text\/javascript\" src=\"http:\/\/public.tableausoftware.com\/javascripts\/api\/viz_v1.js\"><\/script><\/p>\n<div class=\"tableauPlaceholder\" style=\"width:579px; height:1469px;\"><noscript><a href=\"http:&#47;&#47;godismyjudgeok.com&#47;DStats&#47;2012&#47;nba-stats&#47;underrated-and-overrated-via-rapm&#47;\"><img decoding=\"async\" alt=\"2001-2012 Overrated &amp; Underrated on Offense (Via RAPM) \" src=\"http:&#47;&#47;public.tableausoftware.com&#47;static&#47;images&#47;20&#47;2001-2012OverratedviaRAPM&#47;OffenseOverrated&#47;1_rss.png\" style=\"border: none\" \/><\/a><\/noscript><object class=\"tableauViz\" width=\"579\" height=\"1469\" style=\"display:none;\"><param name=\"host_url\" value=\"http%3A%2F%2Fpublic.tableausoftware.com%2F\" \/><param name=\"site_root\" value=\"\" \/><param name=\"name\" value=\"2001-2012OverratedviaRAPM&#47;OffenseOverrated\" \/><param name=\"tabs\" value=\"no\" \/><param name=\"toolbar\" value=\"yes\" \/><param name=\"static_image\" value=\"http:&#47;&#47;public.tableausoftware.com&#47;static&#47;images&#47;20&#47;2001-2012OverratedviaRAPM&#47;OffenseOverrated&#47;1.png\" \/><param name=\"animate_transition\" value=\"yes\" \/><param name=\"display_static_image\" value=\"yes\" \/><param name=\"display_spinner\" value=\"yes\" \/><param name=\"display_overlay\" value=\"yes\" \/><param name=\"display_count\" value=\"yes\" \/><\/object><\/div>\n<div style=\"width:579px;height:22px;padding:0px 10px 0px 0px;color:black;font:normal 8pt verdana,helvetica,arial,sans-serif;\">\n<div style=\"float:right; padding-right:8px;\"><a href=\"http:\/\/www.tableausoftware.com\/public?ref=http:\/\/public.tableausoftware.com\/views\/2001-2012OverratedviaRAPM\/OffenseOverrated\" target=\"_blank\" class=\"broken_link\">Powered by Tableau<\/a><\/div>\n<\/div>\n<h2>Underrated<\/h2>\n<p>First of all: the R^2 of PER on ORAPM is 0.38 and the R^2 of OWS\/48 on ORAPM 0.48.  This indicates that Offensive Win Shares do a better job of measuring offensive value than does PER.<\/p>\n<p>However, both box score stats underrate a similar set of offensive players: excellent point guards and creators.  The most underrated players by both stats are <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/n\/nashst01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Steve  Nash<\/a> and <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/d\/davisba01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Baron  Davis<\/a>, both excellent passers\/creators.  Steve  Nash is rated by ORAPM as the best offensive player of the past 12 years by a significant margin, rating out at +7.0, or 7 points per hundred possessions better than average.  Second is D-Wade at +6.2; third is Kobe at +5.9.<\/p>\n<p>Looking at the players most underrated by both box-score stats: Nash, Davis, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/c\/conlemi01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Mike  Conley<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/a\/allenra02.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Ray  Allen<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/k\/kukocto01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Toni  Kukoc<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/j\/jonesda01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Damon  Jones<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/p\/piercpa01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Paul  Pierce<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/r\/radmavl01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Vladimir  Radmanovic<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/a\/arenagi01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Gilbert  Arenas<\/a>, and &#8230; Shaq.<\/p>\n<p>I guess the exception proves the rule?<\/p>\n<h2>Overrated<\/h2>\n<p>Conversely, most of the overrated offensive players are post players.  The most overrated player on offense by both systems is <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/b\/bynuman01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Andrew  Bynum<\/a>.  Both box score stats rated him well above average, but ORAPM says he has been pretty bad.  I am not totally sure what to make of this; it could be related to issues with ORAPM as well as him simply being overrated.<\/p>\n<p>The most overrated players on offense: Andrew  Bynum, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/w\/warriha01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Hakim  Warrick<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/m\/mingya01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Yao  Ming<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/r\/rondora01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Rajon  Rondo<\/a> (!), <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/g\/gortama01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Marcin  Gortat<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/w\/williaa01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Aaron  Williams<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/s\/smithcr01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Craig  Smith<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/m\/mutomdi01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Dikembe  Mutombo<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/b\/battito01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Tony  Battie<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/c\/curryed01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Eddy  Curry<\/a>, and <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/c\/currymi01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Michael  Curry<\/a>.  Outside of Rondo, that is a who&#8217;s who of &#8220;not creators&#8221; on offense!  It appears that assists (at least with these implementations) are not enough to capture the effect of great creators on offense, and the effect of poor creators on offense.<\/p>\n<h1>Defense<\/h1>\n<p>Okay, let&#8217;s look at the other side of the ball.<br \/>\n<script type=\"text\/javascript\" src=\"http:\/\/public.tableausoftware.com\/javascripts\/api\/viz_v1.js\"><\/script><\/p>\n<div class=\"tableauPlaceholder\" style=\"width:579px; height:1469px;\"><noscript><a href=\"http:&#47;&#47;godismyjudgeok.com&#47;DStats&#47;2012&#47;nba-stats&#47;underrated-and-overrated-via-rapm&#47;\"><img decoding=\"async\" alt=\"2001-2012 Overrated &amp; Underrated on Defense (Via RAPM) \" src=\"http:&#47;&#47;public.tableausoftware.com&#47;static&#47;images&#47;20&#47;2001-2012OverratedviaRAPM&#47;DefenseOverrated&#47;1_rss.png\" style=\"border: none\" \/><\/a><\/noscript><object class=\"tableauViz\" width=\"579\" height=\"1469\" style=\"display:none;\"><param name=\"host_url\" value=\"http%3A%2F%2Fpublic.tableausoftware.com%2F\" \/><param name=\"site_root\" value=\"\" \/><param name=\"name\" value=\"2001-2012OverratedviaRAPM&#47;DefenseOverrated\" \/><param name=\"tabs\" value=\"no\" \/><param name=\"toolbar\" value=\"yes\" \/><param name=\"static_image\" value=\"http:&#47;&#47;public.tableausoftware.com&#47;static&#47;images&#47;20&#47;2001-2012OverratedviaRAPM&#47;DefenseOverrated&#47;1.png\" \/><param name=\"animate_transition\" value=\"yes\" \/><param name=\"display_static_image\" value=\"yes\" \/><param name=\"display_spinner\" value=\"yes\" \/><param name=\"display_overlay\" value=\"yes\" \/><param name=\"display_count\" value=\"yes\" \/><\/object><\/div>\n<div style=\"width:579px;height:22px;padding:0px 10px 0px 0px;color:black;font:normal 8pt verdana,helvetica,arial,sans-serif;\">\n<div style=\"float:right; padding-right:8px;\"><a href=\"http:\/\/www.tableausoftware.com\/public?ref=http:\/\/public.tableausoftware.com\/views\/2001-2012OverratedviaRAPM\/DefenseOverrated\" target=\"_blank\" class=\"broken_link\">Powered by Tableau<\/a><\/div>\n<\/div>\n<p>First of all: note the confirmation of something John Hollinger has said often, but most people ignore: <strong>PER does not measure defense<\/strong>.  At all.  So I won&#8217;t even discuss PER for rating defensive players.  It doesn&#8217;t.<\/p>\n<h2>Underrated<\/h2>\n<p>That leaves us to look at Defensive Win Shares.  It is well known that the box score doesn&#8217;t really measure defense well.  All we&#8217;ve got to go on are blocks, steals, rebounds, and the overall points allowed to the opposing team.  That said, DWS\/48 still manages an R^2 of 0.48 on DRAPM for this sample, oddly enough the same as was found for OWS\/48 on ORAPM!  When I previously <a href=\"http:\/\/godismyjudgeok.com\/DStats\/aspm-and-vorp\/\">looked at similar R^2 numbers<\/a> with a different data set, I found OWS on ORAPM of 0.59, and DWS on DRAPM of 0.45.  Some  more investigation is needed on these subjects&#8230;<\/p>\n<p>The most underrated defensive players of the last 12 years: <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/b\/bogutan01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Andrew  Bogut<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/h\/haywobr01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Brendan  Haywood<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/c\/collija04.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Jason  Collins<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/j\/johnsam01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Amir  Johnson<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/a\/aldrila01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">LaMarcus  Aldridge<\/a>, Dikembe  Mutombo, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/g\/garneke01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Kevin  Garnett<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/b\/bradlsh01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Shawn  Bradley<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/r\/rossqu01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Quinton  Ross<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/j\/jacobca01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Casey  Jacobsen<\/a>, and <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/y\/youngni01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Nick  Young<\/a> (!!).  It looks like Defensive Win Shares underrates the excellent rim protectors and mobile defensive bigs.  <\/p>\n<h2>Overrated<\/h2>\n<p>On the other hand, let&#8217;s look at who is overrated by Defensive Win Shares: <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/b\/boozeca01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Carlos  Boozer<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/m\/malonka01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Karl  Malone<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/n\/nocioan01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Andres  Nocioni<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/m\/murphtr01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Troy  Murphy<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/g\/goodedr01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Drew  Gooden<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/h\/hicksjj01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">J.J.  Hickson<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/w\/webbech01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Chris  Webber<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/r\/rosema01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Malik  Rose<\/a>, <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/s\/smithst01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Steve  Smith<\/a>, and <a target=\"_blank\" href=\"http:\/\/www.basketball-reference.com\/players\/m\/mcinnje01.html?utm_campaign=Linker&#038;utm_source=direct&#038;utm_medium=linker-godismyjudgeok.com\">Jeff  McInnis<\/a>.<\/p>\n<p>So the most overrated by Defensive Win Shares are again bigs&#8211;offensive minded bigs who are known for their poor defense.  In other words&#8211;bigs MATTER on defense.  Both the underrated and overrated lists for defense are populated mostly by bigs.  Box score stats are not going to tell you how good your bigs are on defense with any certainty, but your bigs will definitely determine how good your team&#8217;s defense is.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A week ago, I discussed overrated and underrated players over the past 12 years, evaluated by comparing popular box-score stats with Jeremias Engelmann&#8217;s 12 year average Regularized Adjusted Plus\/Minus (RAPM) dataset. For a primer on the virtues of RAPM (in large samples), see my article reviewing the state-of-the-art of adjusted plus\/minus and stabilization. This time, &#8230; <span class=\"more\"><a class=\"more-link\" href=\"https:\/\/godismyjudgeok.com\/DStats\/2012\/nba-stats\/overrated-and-underrated-via-rapm-part-2\/\">[Read more&#8230;]<\/a><\/span><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[12],"tags":[41,54,31,42,22,48,40],"_links":{"self":[{"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/posts\/846"}],"collection":[{"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/comments?post=846"}],"version-history":[{"count":11,"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/posts\/846\/revisions"}],"predecessor-version":[{"id":856,"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/posts\/846\/revisions\/856"}],"wp:attachment":[{"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/media?parent=846"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/categories?post=846"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/godismyjudgeok.com\/DStats\/wp-json\/wp\/v2\/tags?post=846"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}