|
Re: significance probability when using CORRELATE? [message #26676 is a reply to message #26675] |
Wed, 19 September 2001 12:43  |
mchinand
Messages: 66 Registered: September 1996
|
Member |
|
|
In article <3BA8EBD3.DF2D3C6A@hpl.umces.edu>,
Linda May <may@hpl.umces.edu> wrote:
> I work with oceanographic data using IDL 5.4 (on a Compaq Alpha running
> Tru64
> Unix). Often, in preliminary analyses, I use CORRELATE between two sets
> of
> data. For example, is there a linear association between wind and sea
> surface
> temperature? However, it is important to know not only the correlation
> coefficient, but also its significance probability.
>
> In SAS, when I ask for the (linear Pearson) correlation coefficient of
> two
> vectors, I am automatically given the significance probability of the
> correlation. The (two-tailed) probability value reported by SAS comes
> from
> a t distribution (symmetric with respect to the y-axis).
>
> But I haven't been able to figure out how to obtain the significance
> probability
> in IDL. I've investigated such routines as TM_TEST, but I am not a
> statistician
> and it's not clear to me how I could use TM_TEST. The significance
> probability
> seems so important to anyone using CORRELATE that surely there must be
> an
> obvious and simple way to obtain it in IDL which I am overlooking. I've
>
> searched a number of libraries, but haven't found any examples.
>
> So I sheepishly tell you that for two years I've been switching back and
>
> forth between IDL and SAS. This has become unbearably tacky in my view;
> thus, I
> would be grateful if you could steer me in a helpful direction.
>
> Cheers,
> Linda
>
For the calculation of the two-tailed significance (Ho: r=0) of a
correlation coefficient I have been using the following code snippet:
r=correlate(x,y)
var=1/(n-3.0)
zvalue = 0.5*alog((1+r)/(1-r))/sqrt(var)
if (zvalue lt 0) then pvalue = 2*(gauss_pdf(zvalue)) $
else pvalue = 2*(1-gauss_pdf(zvalue))
You should verify that this is the value you want by comparing this value
with your value from SAS. You mentioned a t-distribution in your post, so
I'm not sure if you want something different or not.
Hope that helps,
--Mike
--
--
Michael Chinander University of Chicago
m-chinander@uchicago.edu (773)834-5101 (Voice) (773)702-0371 (Fax)
|
|
|