{"thread":{"id":"37268","subject":"article: Using a rolling hash to break up binary files","startedAt":"2014-07-31T22:31:52Z","lastAt":"2014-08-01T03:26:30Z","messageCount":2,"participants":["Philip Oakley","Shawn Pearce"],"isPatch":false,"patchVersion":null,"patchTotal":null},"messages":[{"id":"247091","messageId":"D7F507613B1F45379A43C1BCF2F088B0@PhilipOakley","threadId":"37268","inReplyTo":null,"subject":"article: Using a rolling hash to break up binary files","fromName":"Philip Oakley","fromEmail":"philipoakley@iee.org","sentAt":"2014-07-31T22:31:52Z","receivedAt":"2014-07-31T22:31:52Z","isPatch":false,"sender":{"key":"philipoakley@iee.email","avatar":"https://avatars.githubusercontent.com/u/914343?v=4"},"body":"I thought it worth bring to the list's attention a  recent article on \nCodeProject that may be of interest to those looking at splitting binary \nfiles into deterministic hunks.\n\nhttp://www.codeproject.com/Articles/801608/Using-a-rolling-hash-to-break-up-binary-files\n\nIt's based on Rabin and Karp's algorithm \nhttp://en.wikipedia.org/wiki/Rabin%E2%80%93Karp_algorithm.\n\n--\nPhilip \n"},{"id":"247094","messageId":"CAJo=hJtQXb_0G0iqSdVWFwvWnCvowiL94S3UeG18BAkp2ih57Q@mail.gmail.com","threadId":"37268","inReplyTo":"D7F507613B1F45379A43C1BCF2F088B0@PhilipOakley","subject":"Re: article: Using a rolling hash to break up binary files","fromName":"Shawn Pearce","fromEmail":"spearce@spearce.org","sentAt":"2014-08-01T03:26:30Z","receivedAt":"2014-08-01T03:26:30Z","isPatch":false,"sender":{"key":"spearce@spearce.org","avatar":"https://avatars.githubusercontent.com/u/34844?v=4"},"body":"On Thu, Jul 31, 2014 at 3:31 PM, Philip Oakley <philipoakley@iee.org> wrote:\n> I thought it worth bring to the list's attention a  recent article on\n> CodeProject that may be of interest to those looking at splitting binary\n> files into deterministic hunks.\n>\n> http://www.codeproject.com/Articles/801608/Using-a-rolling-hash-to-break-up-binary-files\n>\n> It's based on Rabin and Karp's algorithm\n> http://en.wikipedia.org/wiki/Rabin%E2%80%93Karp_algorithm.\n\nIf I remember right, this is how bup[1] works. Its certainly what we\ndo for delta compressing files.\n\n[1] https://github.com/bup/bup\n"}]}