GZ-Sort

A utility for sorting really big files.

Comments are moderated. It may take a few minutes before your comment appears.
Markdown is supported in your comments.

Gz-sort sorts gzipped data files. Really really big gzipped data files that I couldn't figure out how to wrangle with gnu-sort. After heavy tweaking gnu-sort can do some very large files indeed, but with poor big-O disk patterns. It was bad enough that I physically could not sort a data file without buying a new hard drive. So instead I wrote a sort that runs in O(1) memory, O(n) disk and O(n log n) time.

Name:
Mail: (not shown)

Please type this: