Re: large files and low memory
- From
- Enrico Weigelt <weigelt@metux.de>
- Date
- Oct 5, 2010, 00:50 UTC
- Message-ID
- <20101005005003.GA2768@nibiru.local>
- In-Reply-To
- <AANLkTimbdrAqoWMxiteT5zNYmwHp8M698BEv1FLuiAxx@mail.gmail.com>
* Shawn Pearce <spearce@spearce.org> wrote:
Show 6 quoted lines
> The mmap() isn't the problem. Its the allocation of a buffer that is > larger than the file in order to hold the result of deflating the file > before it gets written to disk. > When the file is bigger than physical memory, the kernel has to > page in parts of the file as well as swap in and out parts of > that allocated buffer to hold the deflated file.
What are the access pattern of these memory areas ? Perhaps madvise() could help ?
cu
-- ---------------------------------------------------------------------- Enrico Weigelt, metux IT service -- http://www.metux.de/ phone: +49 36207 519931 email: weigelt@metux.de mobile: +49 151 27565287 icq: 210169427 skype: nekrad666 ---------------------------------------------------------------------- Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme ----------------------------------------------------------------------