git/list[1] front-page[2] threads[3] people[4] search[5] about
 

Parallel worktree checkouts result in index.lock exists

From
RRRaul E Rangel <rrangel@chromium.org>
Date
Feb 21, 2023, 17:33 UTC
Message-ID
<Y/UAaC4oBPIby4kV@google.com>

Hello, I'm trying to extract multiple trees in parallel so I can create a tarball of the trees. I can't use `git archive` since it doesn't currently produce hermetic output, and I need to support older git versions.

In essence what I'm trying to do is:
    git --work-tree ~/tmp/bob1 checkout ff27f5415797ead8bc775518a08f3a4ab24abd53 -- . &
    git --work-tree ~/tmp/bob2 checkout e70ebd7c76b9f9ad44b59e3002a5c57be5b9dc12 -- . &
When I do this though, I get the following error:
    [1] 4027482
    [2] 4027483
    fatal: Unable to create '/home/rrangel/cros-bazel/.repo/project-objects/chromiumos/platform/vboot_reference.git/./index.lock': File exists.
    
    Another git process seems to be running in this repository, e.g.
    an editor opened by 'git commit'. Please make sure all processes
    are terminated then try again. If it still fails, a git process
    may have crashed in this repository earlier:
    remove the file manually to continue.

Is this expected? I'm not sure why the index is coming into play here. Is there another method I should be using to extract a tree into a directory?

If the index.lock isn't actually protecting me from anything, I was thinking of creating a symlink clone of the .git directory for each parallel invocation. This way the each index.lock gets written to its own directory:

    mkdir ../vboot_reference.git.1
    find . -mindepth 1 -maxdepth 1 -exec echo ln -s '../vboot_reference.git/{}' ../vboot_reference.git.1/ \;
    
    mkdir ../vboot_reference.git.r2
    find . -mindepth 1 -maxdepth 1 -exec echo ln -s '../vboot_reference.git/{}' ../vboot_reference.git.2/ \;
    git -C ../vboot_reference.git.1 --work-tree ~/tmp/bob1 checkout ff27f5415797ead8bc775518a08f3a4ab24abd53 -- . &
    git -C ../vboot_reference.git.2 --work-tree ~/tmp/bob2 checkout e70ebd7c76b9f9ad44b59e3002a5c57be5b9dc12 -- . &
Though if there is another way to handle this it would be great.

Thanks, Raul

Next: brian m. carlson
Message 1 of 3 in “Parallel worktree checkouts result in index.lock exists”
  1. Raul E RangelFeb 21, 2023
  2. brian m. carlsonFeb 22, 2023
  3. Raul RangelMar 7, 2023

Read the whole thread, see it on lore, or plain text.

$ cat FOOTERMessages come from the public archive at lore.kernel.org/git, fetched every hour. The front page is chosen and written each morning by an AI editor and can be wrong; the threads themselves are the record. About and API. For agents: an MCP server at https://gitlist.dev/mcp, and any thread, story or person page as Markdown by adding .md to its URL (or sending Accept: text/markdown). Details in /llms.txt.