GZ-Sort

A utility for sorting really big files.

Comments are moderated. It may take a few minutes before your comment appears.
Markdown is supported in your comments.

In the Freebase example that took 114 minutes on my desktop. Also measure the uncompressed size (425GB in this case), the number of threads (4) and the maximum ram use (12GB here). I would have used the full 16GB, but I wanted a bit of margin in case malloc did something silly or I had a small leak. (It didn't, I could have used 15GB safely.) Next, find the unthreaded run time

Name:
Mail: (not shown)

Please type this: