LISTSERV at the University of Georgia
Menubar Imagemap
Home Browse Manage Request Manuals Register
Previous messageNext messagePrevious in topicNext in topicPrevious by same authorNext by same authorPrevious page (August 2007, week 5)Back to main SAS-L pageJoin or leave SAS-L (or change settings)ReplyPost a new messageSearchProportional fontNon-proportional font
Date:   Wed, 29 Aug 2007 22:55:14 -0700
Reply-To:   David L Cassell <davidlcassell@MSN.COM>
Sender:   "SAS(r) Discussion" <SAS-L@LISTSERV.UGA.EDU>
From:   David L Cassell <davidlcassell@MSN.COM>
Subject:   Re: AIC versus c statistic in Proc Logistic
In-Reply-To:   <035601c7ea5b$c7bd3d60$c12fa8c0@HP82083701405>
Content-Type:   text/plain; format=flowed

mlhoward@avalon.net wrote: > >Hi, > >I'm working on Proc Logistic and have a question about the AIC statistic >versus the c statistic. > >I did take the SAS Categorical Data Analysis class, and was taught there to >look for the smallest AIC statistic, and the largest c statistic.

But you can't count on them to agree. Even if you focus on, say, two similar measures which address the same thing, say AIC and SBC (both of which look at information theoretic concepts), you cannot count on both of them giving you the same model.

>I'm now comparing two models: > >1. AIC= 983.21, c statistic= .74 >2. AIC= 940.17, c statistic= .757

Here, the models are so close that if you plotted these with your other model results that you might not be able to tell which was better from your graph.

>Model 2 has the same variables as model 1, with one additional variable, >whose type 3 effect is significant at .01. > >My question is, why don't I see a bigger jump in the c statistic (about a >2% rise) when the AIC statisitic is dropping substantially (about a 5% >drop)? > >Mary

I don't see a big change in either. I would personally say that either model would be an acceptable choice, given these results, so I would pick the one that makes more sense from a subject matter POV.

But first I would check things like missing values (to see if one statistic's effect is driven by changes in the number of records used), and diagnostic plots (to see if there are problems that I need to address before I consider showing either model to anyone). I'm Obsessive-Compulsive like that. :-)

HTH, David -- David L. Cassell mathematical statistician Design Pathways 3115 NW Norwood Pl. Corvallis OR 97330

_________________________________________________________________ See what you’re getting into…before you go there http://newlivehotmail.com/?ocid=TXT_TAGHM_migration_HM_viral_preview_0507


Back to: Top of message | Previous page | Main SAS-L page