A utility for sorting really big files.

Comments are moderated. It may take a few minutes before your comment appears.
Markdown is supported in your comments.

Since I physically can't compare the two utilities with the Freebase data, I extracted some sample values for a toy demo instead. The sample was 125 million lines long, 2GB when uncompressed and 600MB compressed. During tests memory will be capped at 200MB, to simulate working with a file 10x larger than ram. Four cores and as much disk as they want may be used.

Mail: (not shown)

Please type this: