Skip to content

Out of core sort

S-01544

Out-of-core, or external memory algorithms, refer to algorithms that are designed to work with data sets too large to fit in RAM.

PreDev Notes

Currently, the sort operation expects the whole SEGY file can be read at once, distributed across whatever nodes are being used. For particularly large files, this won't be possible. Investigate sorting for large files that don't fit the total memory available.

e.g. If, say, half the file can be read into the total available memory, could both halves be sorted separately, and written to disk, then a merge-sort be used to combine them?

Implementation Notes:

ADDME

System Test Changes:

ADDME

Bug Fixes:

ADDME

C++ API Changes:

ADDME

C API Changes:

ADDME

Success Criteria:

ADDME

CREATED ON - 10/11/2016

Edited by Christopher Werner
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information