Date:         Thu, 26 Jun 2008 13:42:18 -0400
Reply-To:     Jack Clark <JClark@CHPDM.UMBC.EDU>
Sender:       "SAS(r) Discussion" <SAS-L@LISTSERV.UGA.EDU>
From:         Jack Clark <JClark@CHPDM.UMBC.EDU>
Subject:      Re: losing records in large data set
Comments: To: SRAgodude@GMAIL.COM
In-Reply-To:  A<bc6a1da0-d99b-4a08-9925-37e8a0cbc655@y21g2000hsf.googlegroups.com>
Content-Type: text/plain; charset="us-ascii"

You may have your OBS system option set to 2.5 million.

Try submitting OPTIONS OBS=MAX; to reset the option.


Jack Clark



-----Original Message-----
From: SAS(r) Discussion [mailto:SAS-L@LISTSERV.UGA.EDU] On Behalf Of
SRAgodude@GMAIL.COM
Sent: Thursday, June 26, 2008 1:26 PM
To: SAS-L@LISTSERV.UGA.EDU
Subject: losing records in large data set

Hi,

I have a large data set with about 24 million records.  To verify,
when running


proc contents data = cp_june26;
run;

I get:

The CONTENTS Procedure

    Data Set Name        WORK.CP_JUNE26
Observations          24354148
    Member Type          DATA
Variables             49
    Engine               V9
Indexes               0
     ... etc.

if I then do


data cp_for_partition ;
set cp_june26;
run;

the log says:

NOTE: There were 2500000 observations read from the data set
WORK.CP_JUNE26.
NOTE: The data set WORK.CP_FOR_PARTITION has 2500000 observations and
49 variables.
NOTE: DATA statement used (Total process time):
      real time           1:08.52
      cpu time            5.82 seconds


So my question is, how can I go from 24 million records to only 2.5
million records!!!!