This is Google's cache of viewtopic.php?t=2669&start=60&sid=36d273bd3bc96b610cf812d7f0b58ddd. It is a snapshot of the page as it appeared on Apr 9, 2011 03:50:11 GMT. The current page could have changed in the meantime. Learn more

Text-only version
These search terms are highlighted: aging  
APBRmetrics :: View topic - Appr. 5.x year reg. adj. +/- (updated with coaching,fouling)
APBRmetrics Forum Index APBRmetrics
The statistical revolution will not be televised.
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Appr. 5.x year reg. adj. +/- (updated with coaching,fouling)
Goto page Previous  1, 2, 3, 4, 5
 
Post new topic   Reply to topic    APBRmetrics Forum Index -> General discussion
View previous topic :: View next topic  
Author Message
back2newbelf



Joined: 21 Jun 2005
Posts: 275

PostPosted: Fri Mar 25, 2011 10:03 am    Post subject: Reply with quote

I can now easily update most files by the press of a button, so there might be almost daily updates from now on. Keep in mind that most ratings, especially the multiyear ones, don't change much from day to day. Time of update is now listed at the top of each ranking. The one year ranking will mostly be updated through the playoffs

I'll probably add another rating soon where I compute ratings of coaches on multiyear data (going back to 2002), then add those ratings to the computation of 1 year player ratings while leaving the coach ratings fixed. That might give a better estimation of players that play on super good/bad defensive teams. Of course, prediction performance of this method will have to be tested first.

Comments on the ratings:
-Thibodeau looks awesome, I didn't think it was possible to jump to the #1 spot after less than a full season
-Completely disagrees with the firing of O'Brian, but this method only measures the influence on the players being on the court. Did he have really weird substitution patterns?
_________________
http://stats-for-the-nba.appspot.com/
Back to top
View user's profile Send private message
EvanZ



Joined: 22 Nov 2010
Posts: 303

PostPosted: Fri Mar 25, 2011 10:34 am    Post subject: Reply with quote

Are you planning to do adjusted four factors any time soon?
_________________
http://www.thecity2.com
http://www.ibb.gatech.edu/evan-zamir
Back to top
View user's profile Send private message
EvanZ



Joined: 22 Nov 2010
Posts: 303

PostPosted: Fri Mar 25, 2011 11:55 am    Post subject: Reply with quote

Someone asked before, but are there standard errors somewhere? Even a ballpark would be nice for the 1-yr vs. 3.x-yr.
_________________
http://www.thecity2.com
http://www.ibb.gatech.edu/evan-zamir
Back to top
View user's profile Send private message
back2newbelf



Joined: 21 Jun 2005
Posts: 275

PostPosted: Fri Mar 25, 2011 11:59 am    Post subject: Reply with quote

EvanZ wrote:
Someone asked before, but are there standard errors somewhere? Even a ballpark would be nice for the 1-yr vs. 3.x-yr.

I tried computing those via bootstrapping, but the way I did it wasn't correct. As of right now, I do not know how to compute them
_________________
http://stats-for-the-nba.appspot.com/
Back to top
View user's profile Send private message
Ilardi



Joined: 15 May 2008
Posts: 265
Location: Lawrence, KS

PostPosted: Fri Mar 25, 2011 12:19 pm    Post subject: Reply with quote

back2newbelf wrote:
EvanZ wrote:
Someone asked before, but are there standard errors somewhere? Even a ballpark would be nice for the 1-yr vs. 3.x-yr.

I tried computing those via bootstrapping, but the way I did it wasn't correct. As of right now, I do not know how to compute them


Joe Sill has said he has a method, but I believe even there he's not completely sure it's correct. SAS (my stat package of choice) doesn't provide any error estimates with ridge regression, but I'm assuming the error terms have to be lower than those generated by a corresponding regression model without the ridge correction (since the ridge technique helps reign in the coefficient variance inflation that arises due to excessive collinearity among predictors). So, at least we have an upper bound on the errors.

If someone can help elucidate the issue further, I'm sure we'd all be grateful!
Back to top
View user's profile Send private message
xkonk



Joined: 26 Jan 2011
Posts: 5

PostPosted: Fri Mar 25, 2011 2:44 pm    Post subject: Reply with quote

Just a few reasonable-sounding results from a google search:

http://stats.stackexchange.com/questions/2121/how-can-i-estimate-coefficient-standard-errors-when-using-ridge-regression

www.m-hikari.com/forth2/rashwanIJCMS9-12-2011.pdf (more math-y)

http://www.stat.purdue.edu/~xbw/courses/stat512/notes/topic5a.pdf

Across a few of the results, it seems like the main benefit of ridge regression is better predictive power, so the error of the predictors themselves aren't as critical as the error of the model overall. Response number two in the first link might be the most useful though: the errors may not have a real meaning at all in the context of ridge regression.
Back to top
View user's profile Send private message
DSMok1



Joined: 05 Aug 2009
Posts: 611
Location: Where the wind comes sweeping down the plains

PostPosted: Fri Mar 25, 2011 3:04 pm    Post subject: Reply with quote

I agree with xkonk. I don't think the standard errors can be found that are meaningful. However, you could perhaps come up with some rough estimates based on out-of-sample predictions. Not sure how to do it, though.

The reason stderrs aren't going to be meaningful in ridge regression is this:

You're taking a highly correlated problem. You throw in a bunch of observations of 0 (this is the effect of ridge regression). Then if you get the standard errors of the regression, they'll be quite low using bootstrap or anything. The 0s cause that effect. But the 0s aren't actual data...in fact, they should have an "error" associated with them.
_________________
GodismyJudgeOK.com/DStats
Twitter.com/DSMok1
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Crow



Joined: 20 Jan 2009
Posts: 825

PostPosted: Fri Mar 25, 2011 3:54 pm    Post subject: Reply with quote

The Sloan research papers are available.

http://www.sloansportsconference.com/research-papers/2011-2/posters/

Anyone care to review and comment on them?


Piette used ridge regression and player pairs in the model. Omidiran used player pairs and boxscore stats in a single regression model I believe (the feasibility and desirability of which I have asked about before) but I don't think he used ridge regression.

Neither used multi-season to further reduce errors or made any other adjustments to my quick read beyond home-court.

Other things that might improve signal or reduce noise include: use of a performance "prior" or minutes or both, aging curves, consideration of the affects of rest & elevation, coaches, possession type and adjustment for clutch & garbage time.

Both cite improvement over their comparison base model. The changes are helpful but in the big picture might still be called modest, evolutionary ones and insufficient to win responsible high reliance on this model alone, though it could still be considered helpful as information from one tool among several with the weight still leaning, perhaps, towards direct boxscore based approaches.


Anyone here plan to incorporate either method for addressing player pairs into their APM version? Any reservations about how they did it?

Anyone plan to add more of the other adjustments listed above to try to reduce noise?


By the way, back2newbelf does the RAPM available at your site use your possession type sensitive approach? I assume it does, but want to be sure.


Last edited by Crow on Sat Mar 26, 2011 1:01 pm; edited 1 time in total
Back to top
View user's profile Send private message
Ryan J. Parker



Joined: 23 Mar 2007
Posts: 711
Location: Raleigh, NC

PostPosted: Fri Mar 25, 2011 4:25 pm    Post subject: Reply with quote

Why can't you just use the closed form solution? Is it because of the way lambda is chosen?
_________________
I am a basketball geek.
Back to top
View user's profile Send private message Visit poster's website
DSMok1



Joined: 05 Aug 2009
Posts: 611
Location: Where the wind comes sweeping down the plains

PostPosted: Fri Mar 25, 2011 4:31 pm    Post subject: Reply with quote

Ryan J. Parker wrote:
Why can't you just use the closed form solution? Is it because of the way lambda is chosen?


How? Got an example of the calculation somewhere?
_________________
GodismyJudgeOK.com/DStats
Twitter.com/DSMok1
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Ryan J. Parker



Joined: 23 Mar 2007
Posts: 711
Location: Raleigh, NC

PostPosted: Fri Mar 25, 2011 4:36 pm    Post subject: Reply with quote

http://www.stat.sc.edu/~hansont/stat704/Lecture18.pdf

Slide 17 is what you want I think.

Now you'll have to do a little work to connect all of those dots in the formula, but that looks like something you could compute.
_________________
I am a basketball geek.
Back to top
View user's profile Send private message Visit poster's website
bbstats



Joined: 25 Apr 2010
Posts: 46

PostPosted: Wed Mar 30, 2011 3:34 pm    Post subject: Reply with quote

I want to see RAPM weighted (or adjusted) by possession leverage as Pomeroy has quantified! Someone should find the calculations for NBA games...

EDIT: Or even better - % increase or decrease in Win% as opposed to Points per 100.
_________________
http://thebasketballdistribution.blogspot.com

http://twitter.com/bbstats
Back to top
View user's profile Send private message Visit poster's website
EvanZ



Joined: 22 Nov 2010
Posts: 303

PostPosted: Wed Mar 30, 2011 4:16 pm    Post subject: Reply with quote

Crow wrote:
The Sloan research papers are available.

http://www.sloansportsconference.com/research-papers/2011-2/posters/

Anyone care to review and comment on them?


Piette used ridge regression and player pairs in the model. Omidiran used player pairs and boxscore stats in a single regression model I believe (the feasibility and desirability of which I have asked about before) but I don't think he used ridge regression.



I was a little disappointed that none of the three player metric papers listed any players. I'd like to see some actual numbers. (The network model showed a couple of lists with a few players, but nothing comprehensive.) Also, do any of these guys make their data public?

The paper that mixed APM and box score stats (Omidiran), one of the goals was to determine weights for the box score stats. So...did I miss something, or are those never given? No fun in that.
_________________
http://www.thecity2.com
http://www.ibb.gatech.edu/evan-zamir
Back to top
View user's profile Send private message
DSMok1



Joined: 05 Aug 2009
Posts: 611
Location: Where the wind comes sweeping down the plains

PostPosted: Wed Mar 30, 2011 4:40 pm    Post subject: Reply with quote

Note that Jeremias Engelmann is back2newbelf, EvanZ... I wonder if any of the other researchers post here or at least read this forum?
_________________
GodismyJudgeOK.com/DStats
Twitter.com/DSMok1
Back to top
View user's profile Send private message Send e-mail Visit poster's website
EvanZ



Joined: 22 Nov 2010
Posts: 303

PostPosted: Wed Mar 30, 2011 5:03 pm    Post subject: Reply with quote

DSMok1 wrote:
Note that Jeremias Engelmann is back2newbelf, EvanZ... I wonder if any of the other researchers post here or at least read this forum?


Ah! Good to know.
_________________
http://www.thecity2.com
http://www.ibb.gatech.edu/evan-zamir
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    APBRmetrics Forum Index -> General discussion All times are GMT - 5 Hours
Goto page Previous  1, 2, 3, 4, 5
Page 5 of 5

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group