git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Git import of the recent full enwiki dump

From
Richard Hartmann <richih.mailinglist@gmail.com>
Date
Apr 16, 2010, 23:47 UTC
Message-ID
<w2x2d460de71004161647z41492baav3685249fa05145d6@mail.gmail.com>
-- This email has been sent to two lists --
Hi all,
I would be interested to import the whole enwiki dump [1] into git[2].

This data set is probably the largest set of changes on earth, so it's highly interesting to see what git will make of it.

As of right now, I am trying to import on my local machine, but my first, rough, projections tell me my machine will melt down at some point ;)

Assuming my local import fails, I would appreciate it if this could be added to wikitech's longer-term todo list. If anyone has access to a system with several TiB of free disk space which they can spare for a week or three, it would be awesome. If given shell access, I can take care of this task, but I would be happy to assist anyone attempting it, as well.

If need be, I can get various people from various communities to vouch for me, my character & that I Do Not Break Stuff.

Richard Hartmann
PS: If anyone attempts to do this, please poke me. Either
via email or RichiH on freenode, OFTC and IRCnet.

[1] http://download.wikimedia.org/enwiki/20100130/ [2] http://git-scm.com/

Next: Sverre Rabbelier
Message 1 of 12 in “Git import of the recent full enwiki dump”
  1. Richard HartmannApr 16, 2010
  2. Sverre RabbelierApr 17, 2010
  3. Sebastian BoberApr 17, 2010
  4. Shawn O. PearceApr 17, 2010
  5. Sebastian BoberApr 17, 2010
  6. Sam VilainApr 17, 2010
  7. Sebastian BoberApr 17, 2010
  8. Sam VilainApr 17, 2010
  9. Sebastian BoberApr 17, 2010
  10. Richard HartmannApr 17, 2010
  11. Shawn O. PearceApr 17, 2010
  12. Sebastian BoberApr 17, 2010

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.