Adam Maloney wrote:

> On Fri, 14 Jan 2005 smac at visi.com wrote:
>
>> Maybe a machine with a 64bit processor would be able to unzip the 
>> file. 64bit
>> can address 16tb of memeory, with a 64bit operating system.
>
>
> According to what I've read, the problem is related to how PKWare 
> decided to implement large file support inside the archive.  That is, 
> this is not a memory addressing issue, filesystem issue, or an issue 
> with Lempel-Ziv (well, obviously if the underlying filesystem can't 
> handle these large files, it doesn't matter anyways...but I'm assuming 
> if he's working with a 4GB file, that his underlying OS is capable of 
> handling it.  Just like I'm assuming he's got more than 4GB of disk 
> space)
>
> They did some hackery like changing the ZIP header for these larger 
> files, to identify them to be parsed in a different way when being 
> uncompressed. The hackery was not well documented, so the Info-Zip 
> developer is unable to duplicate it without a significant time 
> investment.
>
> If anyone is interested, I wrote a perl implementation of LZ a number 
> of years ago.  It could compress and uncompress just fine, although it 
> turned out to be lossy (my program, not LZ).
>
> _______________________________________________
> TCLUG Mailing List - Minneapolis/St. Paul, Minnesota
> Help beta test TCLUG's potential new home: http://plone.mn-linux.org
> Got pictures for TCLUG? Beta test http://plone.mn-linux.org/gallery
> tclug-list at mn-linux.org
> https://mailman.real-time.com/mailman/listinfo/tclug-list
>
I don't believe that the zip/unzip facilities that come stock with 
Solaris 9 are compiled to handle large files.  I would have had to 
compile a version of zip/unzip to include large file support.  In the 
end, I had to move the files to a Windows box, unzip them with Winzip 
and then move them to my DB server for loading by SQL Bulk Loader 
(sigh).  It worked but it was time consuming (no fiber to my desktop) 
and chewed up a lot of network bandwith.

I thank you for your wonderful support, especially since it was 
non-Linux.  I got a lot of good suggestions.  Now that I know this, I 
need to get with the client to see if we can work something out next time.

Perry Hoekstra

_______________________________________________
TCLUG Mailing List - Minneapolis/St. Paul, Minnesota
Help beta test TCLUG's potential new home: http://plone.mn-linux.org
Got pictures for TCLUG? Beta test http://plone.mn-linux.org/gallery
tclug-list at mn-linux.org
https://mailman.real-time.com/mailman/listinfo/tclug-list