- Sort Utility for Windows
- Posted by Joe on December 16th, 2005
I'm looking for the best way to sort text files consisting of fixed file
format. The files are big, typically over 10 million records and they consist
of about 100 fields with the record being over 600 bytes in length. I need to
sort on a combination of 8 of the fields. Does anyone know if this can be
done on a Windows Server or if they have used any utility tool that can do
this. Performance and scalability are the main factors - the input data I
have is likely to grow probably up to 40 million records. I've started
looking at 'Sort Solution' tool from www.mwlabs.de but i'm not sure how this
will scale.
- Posted by Dave Patrick on December 16th, 2005
Import them into a database solution such as SQL server.
--
Regards,
Dave Patrick ....Please no email replies - reply in newsgroup.
Microsoft Certified Professional
Microsoft MVP [Windows]
http://www.microsoft.com/protect
"Joe" wrote:
| I'm looking for the best way to sort text files consisting of fixed file
| format. The files are big, typically over 10 million records and they
consist
| of about 100 fields with the record being over 600 bytes in length. I need
to
| sort on a combination of 8 of the fields. Does anyone know if this can be
| done on a Windows Server or if they have used any utility tool that can do
| this. Performance and scalability are the main factors - the input data I
| have is likely to grow probably up to 40 million records. I've started
| looking at 'Sort Solution' tool from www.mwlabs.de but i'm not sure how
this
| will scale.
- Posted by Joe on December 16th, 2005
I wondered if there are any alternative, it seems a lot of overhead to load
data from a fixed file into a database and then have to extract the data out
again to the file after sorting?
"Dave Patrick" wrote:
- Posted by Dave Patrick on December 16th, 2005
You can create DTS packages to automate the process or maybe the whole
process methods need to be reevaluated.
--
Regards,
Dave Patrick ....Please no email replies - reply in newsgroup.
Microsoft Certified Professional
Microsoft MVP [Windows]
http://www.microsoft.com/protect
"Joe" wrote:
|I wondered if there are any alternative, it seems a lot of overhead to load
| data from a fixed file into a database and then have to extract the data
out
| again to the file after sorting?
