Memory Limits, Cache Management
S-01490
PreDev Notes:
- When reading and writing very large files it is possible, even likely, that the data to be read will not fit in memory. In this case the reading should be managed to avoid out of memory errors
- Add a mechanism to count the memory usage in the file layer and make sure the set layer obeys maximum memory usage restrictions.
- Overload the default allocator.
Check both internal consistency (our own counters add up correctly) and also external consistency; valgrind, vtune.
Old
As a Tullow Geophysicist I want the PIOL to only use below a specified memory amount. I want this because otherwise if memory limitations are hit the code will be killed.
As a Tullow Geophysicist I want ExSeisFlow to manage the cache such that memory limitations are not hit.
Implementation Notes:
ADDME
System Test Changes:
ADDME
Bug Fixes:
ADDME
C++ API Changes:
ADDME
C API Changes:
ADDME
Success Criteria:
-
PIOL can be made aware of the system hardware memory limitations -
PIOL users can query the current memory usage and availability -
Flow does not crash due to out of memory errors
CREATED ON - 03/08/2016