This is Google's cache of viewtopic.php?p=3963&sid=1e70654c9e3cb8211e407e83381ccdfd. It is a snapshot of the page as it appeared on Mar 13, 2011 20:24:07 GMT. The current page could have changed in the meantime. Learn more

Text-only version
These search terms are highlighted: mtamada  
APBRmetrics :: View topic - Using statistics in basketball: the bar is higher
APBRmetrics Forum Index APBRmetrics
The statistical revolution will not be televised.
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Using statistics in basketball: the bar is higher

 
Post new topic   Reply to topic    APBRmetrics Forum Index -> General discussion
View previous topic :: View next topic  
Author Message
Ben F.



Joined: 07 Mar 2005
Posts: 391

PostPosted: Mon Aug 29, 2005 4:31 pm    Post subject: Using statistics in basketball: the bar is higher Reply with quote

I just wanted to comment on Dan's latest post. I'll make it quick and flesh it out more later, as I don't have that much time now.

I found it very interesting, especially coming off the heels of reading Malcolm Gladwell's second book, "Blink" (he also wrote "The Tipping Point"). I love his books for the fascinating stories that he tells and the way it gives you a new perspective on everyday things around you.

In any case, I think it was quite relevant to what Dan said - one of the main points Gladwell makes in "Blink" is that often with lots of time and information, we make the WRONG decisions; that an expert who has seen something over and over again can make the RIGHT decision in the blink of an eye, and can't even explain it. This is the power of the human subconcious.

Part of the explanation is that this stems from the ability of the human subconcious to only process what information is directly relevant, whereas if we think about it more, we cannot make this separation.

More later...
Back to top
View user's profile Send private message
mathayus



Joined: 15 Aug 2005
Posts: 193

PostPosted: Mon Aug 29, 2005 5:45 pm    Post subject: Re: Using statistics in basketball: the bar is higher Reply with quote

I think Dan's post is quite strong. I absolutely agree that the nature of the game of basketball makes it much more difficult to quantify the effect of individuals than baseball.

He also brings up the basic truth about AI based computer models: Given all relevant data the model can perform perfectly, however models aren't generally given all relevant data, and so humans perform better. It is important to note however, that this is not a flaw with computer models, so much as it is a crucible for determining how well we humans understand what we are doing. If we cannot build a computer model to perform at least as well as us in data analysis, this means that we have not sufficiently analyzed all of the data and mental tools we are using. It's a bit like the idea that if you can make a lecture on a topic for college freshmen, then you don't really understand that topic yourself.

I disagree with NickS's quote that the reason to use a computer model is because we as humans are poor at analyzing probability. The reason to use a computer model is because computers can crunch data far better than human. Now, I will admit that our inability to crunch data causes our need to use a less exact approach to predicting probabilistic performance, but I think it's important to understand what the root of the problem is.

But I do agree with NickS when he says that stats are often at their best in provoking questions and analyzing specific subsets of the game.
Back to top
View user's profile Send private message
mtamada



Joined: 28 Jan 2005
Posts: 376

PostPosted: Tue Aug 30, 2005 1:10 am    Post subject: Re: Using statistics in basketball: the bar is higher Reply with quote

mathayus wrote:
Given all relevant data the model can perform perfectly, however models aren't generally given all relevant data, and so humans perform better.


This is undoubtedly true in many areas, but it is not true in a surprising number of other areas. Even obscenely simplistic predictor equations (e.g. with all coefficients simply set to +1 or -1) can outperform human experts. I don't know what the research over the past 10-15 years has shown, but for some reason a lot of the research in the 1980s focused on doctors making diagnoses, vs. using an equation to make the diagnosis. Computers using simplistic equations were often better than expert experienced MDs at making diagnoses. Here's a summary of an article http://www.cc.gatech.edu/~jimmyd/summaries/dawes1989.html
which gives an example, comparing the "actuarial" (ie statistics-based) vs "clinical" (ie expert human-based) techniques (and a third technique which combines the two).

Quote:

I disagree with NickS's quote that the reason to use a computer model is because we as humans are poor at analyzing probability. The reason to use a computer model is because computers can crunch data far better than human. Now, I will admit that our inability to crunch data causes our need to use a less exact approach to predicting probabilistic performance, but I think it's important to understand what the root of the problem is.


Well if humans can't crunch numbers well, doesn't that limit our ability to analyze probability? Moreover, even in simple situations, humans in fact are often predictably poor at analyzing probability. The most celebrated work in this area has been done by Kahneman and Tversky -- Kahneman won a Nobel Prize a couple of years ago; Tversky would've shared it except he died a few years earlier. http://www-stat.stanford.edu/~cgates/PERSI/courses/stat_121/lectures/psychofprob/
Back to top
View user's profile Send private message
mathayus



Joined: 15 Aug 2005
Posts: 193

PostPosted: Tue Aug 30, 2005 2:00 pm    Post subject: Re: Using statistics in basketball: the bar is higher Reply with quote

mtamada wrote:
mathayus wrote:
Given all relevant data the model can perform perfectly, however models aren't generally given all relevant data, and so humans perform better.


This is undoubtedly true in many areas, but it is not true in a surprising number of other areas. Even obscenely simplistic predictor equations (e.g. with all coefficients simply set to +1 or -1) can outperform human experts. I don't know what the research over the past 10-15 years has shown, but for some reason a lot of the research in the 1980s focused on doctors making diagnoses, vs. using an equation to make the diagnosis. Computers using simplistic equations were often better than expert experienced MDs at making diagnoses. Here's a summary of an article http://www.cc.gatech.edu/~jimmyd/summaries/dawes1989.html
which gives an example, comparing the "actuarial" (ie statistics-based) vs "clinical" (ie expert human-based) techniques (and a third technique which combines the two).


Hmm...maybe I didn't make clear where I was coming from. My premise is that the only reason humans do better at any analysis than computers is because we humans aren't able to articulate how we perform our analysis completely.

The success of medical diagnosis, as well as other expert systems, plays right into that. Essentially, computer models are able to do well in microworlds where all (or most) factors have been accounted for and thus incorporated into the model itself.

But, there can be no doubt that in most of the tasks we humans perform, we haven't been able to make computers perform as well as us.

mtamada wrote:
Quote:

I disagree with NickS's quote that the reason to use a computer model is because we as humans are poor at analyzing probability. The reason to use a computer model is because computers can crunch data far better than human. Now, I will admit that our inability to crunch data causes our need to use a less exact approach to predicting probabilistic performance, but I think it's important to understand what the root of the problem is.


Well if humans can't crunch numbers well, doesn't that limit our ability to analyze probability? Moreover, even in simple situations, humans in fact are often predictably poor at analyzing probability. The most celebrated work in this area has been done by Kahneman and Tversky -- Kahneman won a Nobel Prize a couple of years ago; Tversky would've shared it except he died a few years earlier. http://www-stat.stanford.edu/~cgates/PERSI/courses/stat_121/lectures/psychofprob/


Yes, it does lead to problems analyzing probability, as I admitted in my last sentence. I stressed the point that I think it is important to understand the root of the problem and thus I think it is more beneficial to think in terms of complex calculations than in terms of probability.
Back to top
View user's profile Send private message
mtamada



Joined: 28 Jan 2005
Posts: 376

PostPosted: Tue Aug 30, 2005 4:53 pm    Post subject: Re: Using statistics in basketball: the bar is higher Reply with quote

mathayus wrote:
mtamada wrote:
Well if humans can't crunch numbers well, doesn't that limit our ability to analyze probability? Moreover, even in simple situations, humans in fact are often predictably poor at analyzing probability. The most celebrated work in this area has been done by Kahneman and Tversky -- Kahneman won a Nobel Prize a couple of years ago; Tversky would've shared it except he died a few years earlier. http://www-stat.stanford.edu/~cgates/PERSI/courses/stat_121/lectures/psychofprob/


Yes, it does lead to problems analyzing probability, as I admitted in my last sentence. I stressed the point that I think it is important to understand the root of the problem and thus I think it is more beneficial to think in terms of complex calculations than in terms of probability.


This is precisely what Kahneman, Tversky, and others have been doing: discovering when, and how, humans deviate from what probability theory and decision theory say they should be doing. And the number-crunching aspect is only a portion of it. Even in very simple situations, which do not require number-crunching, people will often make elementary misjudgements. "Prospect theory" is what they called their theory about how people actually decide and behave; there are also other theories and observations made by other researchers.
Back to top
View user's profile Send private message
THWilson



Joined: 19 Jul 2005
Posts: 164
Location: phoenix

PostPosted: Tue Aug 30, 2005 6:24 pm    Post subject: Re: Using statistics in basketball: the bar is higher Reply with quote

mtamada wrote:

This is precisely what Kahneman, Tversky, and others have been doing: discovering when, and how, humans deviate from what probability theory and decision theory say they should be doing. And the number-crunching aspect is only a portion of it. Even in very simple situations, which do not require number-crunching, people will often make elementary misjudgements. "Prospect theory" is what they called their theory about how people actually decide and behave; there are also other theories and observations made by other researchers.


I'm intrigued, could you suggest an introductory book?
Back to top
View user's profile Send private message
mathayus



Joined: 15 Aug 2005
Posts: 193

PostPosted: Tue Aug 30, 2005 7:11 pm    Post subject: Re: Using statistics in basketball: the bar is higher Reply with quote

mtamada wrote:
mathayus wrote:
mtamada wrote:
Well if humans can't crunch numbers well, doesn't that limit our ability to analyze probability? Moreover, even in simple situations, humans in fact are often predictably poor at analyzing probability. The most celebrated work in this area has been done by Kahneman and Tversky -- Kahneman won a Nobel Prize a couple of years ago; Tversky would've shared it except he died a few years earlier. http://www-stat.stanford.edu/~cgates/PERSI/courses/stat_121/lectures/psychofprob/


Yes, it does lead to problems analyzing probability, as I admitted in my last sentence. I stressed the point that I think it is important to understand the root of the problem and thus I think it is more beneficial to think in terms of complex calculations than in terms of probability.


This is precisely what Kahneman, Tversky, and others have been doing: discovering when, and how, humans deviate from what probability theory and decision theory say they should be doing. And the number-crunching aspect is only a portion of it. Even in very simple situations, which do not require number-crunching, people will often make elementary misjudgements. "Prospect theory" is what they called their theory about how people actually decide and behave; there are also other theories and observations made by other researchers.


Okay, you've got a point. While I maintain that number crunching weakness and probability weakness are very much related, I'll concede that probability weakness occurs far more than pure number crunching weakness would suggest, and therefore it is worthwhile to consider that another reason to look at stats.

However, I do maintain that many of those extreme probability errors are able to be ameliorated or eliminated altogether by simply making the person aware of the tendency. Cognitively penetrable, I believe that's the term for it. For example, from your link they give an example where, when guessing based on a description whether or not someone is a engineer or a lawyer, they ignore the relative fractions of engineers and lawyers in the population. Well, I can guarantee you that if you gave that same test to those familiar with that probability affliction, you would see completely different results. I would argue that this means that probability weakness is largely something that can be minimized by simply 1) becoming aware of the general tendency and 2) applying it to the situation at hand.
Back to top
View user's profile Send private message
gabefarkas



Joined: 31 Dec 2004
Posts: 1313
Location: Durham, NC

PostPosted: Thu Sep 08, 2005 8:45 am    Post subject: Re: Using statistics in basketball: the bar is higher Reply with quote

THWilson wrote:
mtamada wrote:

This is precisely what Kahneman, Tversky, and others have been doing: discovering when, and how, humans deviate from what probability theory and decision theory say they should be doing. And the number-crunching aspect is only a portion of it. Even in very simple situations, which do not require number-crunching, people will often make elementary misjudgements. "Prospect theory" is what they called their theory about how people actually decide and behave; there are also other theories and observations made by other researchers.


I'm intrigued, could you suggest an introductory book?


Try one by Niederman and Boyum called What the Numbers Say. It's a nice primer on stats and how they influence our everyday lives, as well as how to think about them properly. There are even some basketball-related examples, and a few from that short guy who worked in the Clinton Cabinet, whose name escapes me now.
Back to top
View user's profile Send private message Send e-mail AIM Address
Ed Küpfer



Joined: 30 Dec 2004
Posts: 785
Location: Toronto

PostPosted: Thu Sep 08, 2005 9:40 am    Post subject: Re: Using statistics in basketball: the bar is higher Reply with quote

THWilson wrote:
mtamada wrote:

This is precisely what Kahneman, Tversky, and others have been doing: discovering when, and how, humans deviate from what probability theory and decision theory say they should be doing. And the number-crunching aspect is only a portion of it. Even in very simple situations, which do not require number-crunching, people will often make elementary misjudgements. "Prospect theory" is what they called their theory about how people actually decide and behave; there are also other theories and observations made by other researchers.


I'm intrigued, could you suggest an introductory book?




I'd like to recommend Thomas Gilovich's How We Know What Isn't So as a great introduction to cog psych.
_________________
ed
Back to top
View user's profile Send private message Send e-mail
sansbacon



Joined: 04 Nov 2005
Posts: 1

PostPosted: Fri Nov 04, 2005 6:11 pm    Post subject: Reply with quote

Another good explanation is in Sunstein et al, "Behavioral Law and Economics", 2000.
Back to top
View user's profile Send private message
capnhistory



Joined: 27 Jul 2005
Posts: 62
Location: Durham, North Carolina

PostPosted: Fri Nov 04, 2005 6:36 pm    Post subject: Reply with quote

I'm not sure if this will add to this conversation or simply muddle it, but the thought is on my mind and I thought I should share it. I was just reading some article in psychology about decision processes, by Robyn Dawes. Dawes studies linear wieghts that could be applied to making any given decision. One of the interesting indications of his work was that it might not matter if the weights are calibrated accurately, so long as they apply the proper functions to each term (as in adding the good and subtracting the bad) and include as much relevant information as possible. Even in situations where the weights are inaccurate they still do a better jon of reaching optimal conclusions than unaided, untrained humans. If you look at all of the different linear weights models used in sports stats, some seem less usefull than others, yet all seem to hilight important information our minds may not identify independently. If we accept this to be true to any degree, then that certainly does raise the bar for all of us interested in studying sports through the numbers. We can't just say "hey, if you apply this formula, you'll find out some pretty cool stuff." Now we have to strive to identify what makes a given formula better than another, or what makes certain conclusions more useful than others. In other words, our task can't be merely to produce information, but to be informed.
_________________
Throw it down big man!
More expansive basketball babble at a slower pace The Captain of History
Back to top
View user's profile Send private message Send e-mail Visit poster's website
Display posts from previous:   
Post new topic   Reply to topic    APBRmetrics Forum Index -> General discussion All times are GMT - 5 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group