Date:         Mon, 9 Jul 2001 07:12:43 -0400
Reply-To:     "Kaien, Jyotsna (CAP)" <Jyotsna.Kaien@GECIS.GE.COM>
Sender:       "SAS(r) Discussion" <SAS-L@LISTSERV.UGA.EDU>
From:         "Kaien, Jyotsna (CAP)" <Jyotsna.Kaien@GECIS.GE.COM>
Subject:      Re: Massive Datasets
Content-Type: text/plain; charset="iso-8859-1"

Any idea, how much memory and space would be needed temporarily for the sorting and merging of this much big dataset.

Rgds,
Jyotsna




-----Original Message-----
From: John Ludley [mailto:john@LUDLEY.FSNET.CO.UK]
Sent: Monday, July 09, 2001 3:49 PM
To: SAS-L@LISTSERV.UGA.EDU
Subject: Re: Massive Datasets


Graeme,
    for taking "small" subsets indexing will help a lot, but when updating
it may be better to make sure it's sorted or in SQL. Is the new data
definitely merged so that existing records can change, if not then use proc
append.


Graeme Kirton <gkirton@FILCS.COM> wrote in message
news:80256A84.0038AF55.00@fil-notes01.filcs.com...
> Ive a growing dataset called passfail, it's now got 21million OBS and its
2Gb in
> size.  Now Its so difficult to work with.  This dataset isn't indexed or
> anything but I was wondering, how and if I did this, would it improve its
access
> speeds.
>
> Ive some SCL programs which need to look at and extract data from this
dataset.
>
> New data is loaded, then it's merged with this massive file.
>
> Thanx..Graeme
>
____________________________________________________________________________
________________________________
>
> Disclaimer
>
> This email may contain privileged/confidential information and/or
copyright
> material.  It is intended only for the use of the person(s) to whom it is
> addressed and any unauthorised use may be unlawful.  If you receive this
email
> by mistake, please advise the sender immediately by using the reply
facility on
> your email software and delete the material from your computer.
>
> Opinions, conclusions and other information in this email that do not
relate to
> the official business of this organisation shall be understood as neither
given
> nor endorsed by it.
>
> If this message forms part of a quotation, the quotation is an invitation
to
> treat only.  No contract subsists until Filtronic Plc (or its subsidiary
> companies) accepts your order.  Acceptance of your order is made subject
to our
> standard Terms and Conditions.
>
> Website Address http://www.filtronic.com