# how to git-archive ignore some files? 10 messages from 2008-05-06 to 2008-06-08. Participants: Victor Bogado da Silva Lins, Sean Estabrooks, René Scharfe, Junio C Hamano, David Bryson, Johannes Schindelin, Jakub Narebski. Thread: https://gitlist.dev/t/13401 ## Victor Bogado da Silva Lins, 2008-05-06 18:15 Subject: how to git-archive ignore some files? Message-ID: <1210097731.5238.3.camel@omicron.ep.petrobras.com.br> URL: https://gitlist.dev/e/1210097731.5238.3.camel%40omicron.ep.petrobras.com.br ``` I want to use git-archive to create source packages, but my git repository has a .gitignore that I don't want to be pushed into the archive. So is it possible to keep the .gitignore file in the repository and create an archive(*) without it? *) using git-archive, off course. ``` ## Sean Estabrooks, 2008-05-06 18:56 Subject: Re: how to git-archive ignore some files? Message-ID: URL: https://gitlist.dev/e/BAYC1-PASMTP023026B88005E512F95384AED60%40CEZ.ICE In-Reply-To: <1210097731.5238.3.camel@omicron.ep.petrobras.com.br> ``` On Tue, 06 May 2008 15:15:31 -0300 Victor Bogado da Silva Lins wrote: > I want to use git-archive to create source packages, but my git > repository has a .gitignore that I don't want to be pushed into the > archive. So is it possible to keep the .gitignore file in the repository > and create an archive(*) without it? > > *) using git-archive, off course. > Hi Victor, You can do something like: git archive HEAD | \ tar --delete .gitignore .mailmap .gitattributes | \ bzip2 -c > archive.tar.bz2 HTH, Sean ``` ## René Scharfe, 2008-05-06 21:23 Subject: Re: how to git-archive ignore some files? Message-ID: <4820CC35.3090202@lsrfire.ath.cx> URL: https://gitlist.dev/e/4820CC35.3090202%40lsrfire.ath.cx In-Reply-To: ``` Sean Estabrooks schrieb: > On Tue, 06 May 2008 15:15:31 -0300 > Victor Bogado da Silva Lins wrote: > >> I want to use git-archive to create source packages, but my git >> repository has a .gitignore that I don't want to be pushed into the >> archive. So is it possible to keep the .gitignore file in the repository >> and create an archive(*) without it? >> >> *) using git-archive, off course. >> > > Hi Victor, > > You can do something like: > > git archive HEAD | \ > tar --delete .gitignore .mailmap .gitattributes | \ > bzip2 -c > archive.tar.bz2 Or, if there is only a small number of files in your repository, you could do something like this: git archive HEAD -- \ $(git ls-tree -r --name-only HEAD | grep -v '^\.gitignore$') To really solve this without external tools, git-archive needed to grow an --exclude option like git-ls-files, though. René ``` ## Junio C Hamano, 2008-05-06 22:08 Subject: Re: how to git-archive ignore some files? Message-ID: <7vk5i7gk6e.fsf@gitster.siamese.dyndns.org> URL: https://gitlist.dev/e/7vk5i7gk6e.fsf%40gitster.siamese.dyndns.org In-Reply-To: <4820CC35.3090202@lsrfire.ath.cx> ``` René Scharfe writes: > To really solve this without external tools, git-archive needed to grow > an --exclude option like git-ls-files, though. Because exclude is never about ignoring what is already tracked, an option "like" git-ls-files would not help this case, I am afraid. ``` ## David Bryson, 2008-05-08 17:04 Subject: Re: how to git-archive ignore some files? Message-ID: <20080508170442.GK9562@eratosthenes.sbcglobal.net> URL: https://gitlist.dev/e/20080508170442.GK9562%40eratosthenes.sbcglobal.net In-Reply-To: <1210097731.5238.3.camel@omicron.ep.petrobras.com.br> ``` Hi Victor, On Tue, May 06, 2008 at 03:15:31PM -0300 or thereabouts, Victor Bogado da Silva Lins wrote: > I want to use git-archive to create source packages, but my git > repository has a .gitignore that I don't want to be pushed into the > archive. So is it possible to keep the .gitignore file in the repository > and create an archive(*) without it? > > *) using git-archive, off course. Others already discussed the --delete method with tar, and I do something similar except slightly more flexible. I have for example, a git repo that checks out directories from CVS, and of course I don't want these CVS directories in my 'release'. So put a executable '.release' file in each repo that tells my release script how to fix up the tarball to be production ready. Here is my release script, modeled after some lines Linus put in the git documentation. It is meant to be run, reviewed for mistakes, and then have the commands run via cut-paste. #!/bin/bash stable="$1" last="$2" new="$3" chip="$4" rel=`pwd | cut -d'/' -f6 | sed -e 's/\.git//'` if [ -z $chip ]; then reldir=$rel else reldir=$rel-$chip fi reldir="$reldir-$new" tarfile="$reldir.tar" if [ -d $reldir ]; then echo "release directory $reldir already exists, please remove" 1>&2 exit 1 fi if [ -f "../$reldir.tar" ]; then echo "Release file ../$reldir.tar already exists, please remove" 1>&2 exit 1 fi if [ -f "../$reldir.tar.gz" ]; then echo "Release file ../$reldir.tar.gz already exists, please remove" 1>&2 exit 1 fi echo "#git tag v$new" echo "Tagging new release v$new" 1>&2 echo "git archive --prefix=$reldir/ v$new > ../$tarfile" echo "mkdir $reldir" #echo "git diff v$stable v$new | gzip -9 > ../patch-$new.gz" echo "git log --no-merges v$new ^v$last > $reldir/ChangeLog-$new" echo "git shortlog --no-merges v$new ^v$last > $reldir/ShortLog" echo "git diff --stat --summary -M v$last v$new > $reldir/diffstat-$new" echo "tar -rf ../$tarfile $reldir/*" ./.release $reldir ../$tarfile if [ $? != 0 ]; then echo ".release script failed! removing generated files" 1>&2 echo "rm -rf $reldir ../$tarfile" exit 1 fi echo "gzip -9 < ../$tarfile > ../$tarfile.gz" echo "rm -rf $reldir ../$tarfile" echo "New release at ../$tarfile.gz" 1>&2 And an example .release file #!/bin/bash dirlist="make foo_include scripts" excludes="--exclude CVS --exclude '*.o' --exclude '*.swp' --exclude '*.d' --exclude '*.a'" reldir=$1 tarfile=$2 #echo "make doc && make -C doc/latex pdf" echo "cp -a $dirlist $reldir" echo "cp Makefile.release $reldir/Makefile" echo "tar $excludes -rf $tarfile $reldir/*" # write over the makefile echo "cp Makefile.release $reldir/Makefile" echo "tar -u -f $tarfile $reldir/Makefile" echo "tar --delete --file=$tarfile $reldir/Makefile.release" # delete the doxygen file echo "cp Doxyfile $reldir" echo "tar --delete --file=$tarfile $reldir/Doxyfile" # remove traces of the release file echo "tar --delete --file=$tarfile $reldir/.release" ``` ## Johannes Schindelin, 2008-05-08 20:22 Subject: Re: how to git-archive ignore some files? Message-ID: URL: https://gitlist.dev/e/alpine.DEB.1.00.0805082118390.30431%40racer In-Reply-To: <20080508170442.GK9562@eratosthenes.sbcglobal.net> ``` Hi, On Thu, 8 May 2008, David Bryson wrote: > On Tue, May 06, 2008 at 03:15:31PM -0300 or thereabouts, Victor Bogado da Silva Lins wrote: > > I want to use git-archive to create source packages, but my git > > repository has a .gitignore that I don't want to be pushed into the > > archive. So is it possible to keep the .gitignore file in the > > repository and create an archive(*) without it? > > > > *) using git-archive, off course. > > Others already discussed the --delete method with tar, [...] I wonder if the most natural way with Git would not be to create a throw-away tree: cp .git/index .git/tmp-index && GIT_INDEX_FILE=.git/tmp-index git rm --cached .gitignore && git archive $(GIT_INDEX_FILE=.git/tmp-index git write-tree) && rm .git/tmp-index WARNING: this has not seen any testing. Ciao, Dscho ``` ## René Scharfe, 2008-05-11 10:44 Subject: Re: how to git-archive ignore some files? Message-ID: <4826CE0B.8080109@lsrfire.ath.cx> URL: https://gitlist.dev/e/4826CE0B.8080109%40lsrfire.ath.cx In-Reply-To: <7vk5i7gk6e.fsf@gitster.siamese.dyndns.org> ``` Junio C Hamano schrieb: > René Scharfe writes: > >> To really solve this without external tools, git-archive needed to >> grow an --exclude option like git-ls-files, though. > > Because exclude is never about ignoring what is already tracked, an > option "like" git-ls-files would not help this case, I am afraid. True, it should be named differently, e.g. --ignore. Another idea: would it make sense to have an attribute for that instead (or in addition to the command line parameter)? I.e. files marked export-ignore would not end up in the archive. I suspect the set of files to ignore doesn't change from archive to archive one creates. René ``` ## Junio C Hamano, 2008-05-11 16:20 Subject: Re: how to git-archive ignore some files? Message-ID: <7vwsm06cdd.fsf@gitster.siamese.dyndns.org> URL: https://gitlist.dev/e/7vwsm06cdd.fsf%40gitster.siamese.dyndns.org In-Reply-To: <4826CE0B.8080109@lsrfire.ath.cx> ``` René Scharfe writes: > Another idea: would it make sense to have an attribute for that instead > (or in addition to the command line parameter)? I.e. files marked > export-ignore would not end up in the archive. I suspect the set of > files to ignore doesn't change from archive to archive one creates. That sounds extremely sensible. Should/does git-archive read .gitattributes from the tree being exported? ``` ## Jakub Narebski, 2008-05-12 09:36 Subject: Re: how to git-archive ignore some files? Message-ID: URL: https://gitlist.dev/e/m3prrr50gc.fsf%40localhost.localdomain In-Reply-To: <7vwsm06cdd.fsf@gitster.siamese.dyndns.org> ``` Junio C Hamano writes: > René Scharfe writes: > > > Another idea: would it make sense to have an attribute for that instead > > (or in addition to the command line parameter)? I.e. files marked > > export-ignore would not end up in the archive. I suspect the set of > > files to ignore doesn't change from archive to archive one creates. > > That sounds extremely sensible. > > Should/does git-archive read .gitattributes from the tree being exported? If I understand and remember correctly, current implementation of gitattributes, and current tools (git-check-attr), use and can use only working directory version of .gitattributes, in part because of chicken-and-egg problem (attributes effect checkout) IIRC. It would be nice if git-archive read and use .gitattribues from a tree being exported; this would for example make `export-subs` work even for bare repositories. This would be needed for `export-ignore`. -- Jakub Narebski Poland ShadeHawk on #git ``` ## René Scharfe, 2008-06-08 16:42 Subject: Re: how to git-archive ignore some files? Message-ID: <484C0BF9.1090909@lsrfire.ath.cx> URL: https://gitlist.dev/e/484C0BF9.1090909%40lsrfire.ath.cx In-Reply-To: ``` Jakub Narebski schrieb: > Junio C Hamano writes: > >> René Scharfe writes: >> >>> Another idea: would it make sense to have an attribute for that instead >>> (or in addition to the command line parameter)? I.e. files marked >>> export-ignore would not end up in the archive. I suspect the set of >>> files to ignore doesn't change from archive to archive one creates. >> That sounds extremely sensible. >> >> Should/does git-archive read .gitattributes from the tree being exported? > > If I understand and remember correctly, current implementation of > gitattributes, and current tools (git-check-attr), use and can use > only working directory version of .gitattributes, in part because of > chicken-and-egg problem (attributes effect checkout) IIRC. > > It would be nice if git-archive read and use .gitattribues from > a tree being exported; this would for example make `export-subs` > work even for bare repositories. This would be needed for > `export-ignore`. git-archive uses the routines from attr.c, and this is where the ability to read attributes from git trees should be added. It's independent from ignoring files when creating archives. Maybe it would be a good idea to add this feature; in the meantime users need to resort to adding their attributes to $GIT_DIR/info/attributes. Anyway, here's a patch to add export-ignore support to git-archive. Files and directories with this attribute are not added to archives. Signed-off-by: Rene Scharfe --- Documentation/gitattributes.txt | 6 ++++++ archive-tar.c | 2 ++ archive-zip.c | 2 ++ archive.c | 13 +++++++++++++ archive.h | 1 + t/t5000-tar-tree.sh | 9 +++++++++ 6 files changed, 33 insertions(+), 0 deletions(-) diff --git a/Documentation/gitattributes.txt b/Documentation/gitattributes.txt index 471754e..6e67990 100644 --- a/Documentation/gitattributes.txt +++ b/Documentation/gitattributes.txt @@ -502,6 +502,12 @@ frotz unspecified Creating an archive ~~~~~~~~~~~~~~~~~~~ +`export-ignore` +^^^^^^^^^^^^^^^ + +Files and directories with the attribute `export-ignore` won't be added to +archive files. + `export-subst` ^^^^^^^^^^^^^^ diff --git a/archive-tar.c b/archive-tar.c index d7598f9..99db58f 100644 --- a/archive-tar.c +++ b/archive-tar.c @@ -247,6 +247,8 @@ static int write_tar_entry(const unsigned char *sha1, strbuf_grow(&path, PATH_MAX); strbuf_add(&path, base, baselen); strbuf_addstr(&path, filename); + if (is_archive_path_ignored(path.buf + base_len)) + return 0; if (S_ISDIR(mode) || S_ISGITLINK(mode)) { strbuf_addch(&path, '/'); buffer = NULL; diff --git a/archive-zip.c b/archive-zip.c index 18c0f87..5742762 100644 --- a/archive-zip.c +++ b/archive-zip.c @@ -176,6 +176,8 @@ static int write_zip_entry(const unsigned char *sha1, crc = crc32(0, NULL, 0); path = construct_path(base, baselen, filename, S_ISDIR(mode), &pathlen); + if (is_archive_path_ignored(path + base_len)) + return 0; if (verbose) fprintf(stderr, "%s\n", path); if (pathlen > 0xffff) { diff --git a/archive.c b/archive.c index 7a32c19..6502b76 100644 --- a/archive.c +++ b/archive.c @@ -82,3 +82,16 @@ void *sha1_file_to_archive(const char *path, const unsigned char *sha1, return buffer; } +int is_archive_path_ignored(const char *path) +{ + static struct git_attr *attr_export_ignore; + struct git_attr_check check[1]; + + if (!attr_export_ignore) + attr_export_ignore = git_attr("export-ignore", 13); + + check[0].attr = attr_export_ignore; + if (git_checkattr(path, ARRAY_SIZE(check), check)) + return 0; + return ATTR_TRUE(check[0].value); +} diff --git a/archive.h b/archive.h index 5791e65..ddf004a 100644 --- a/archive.h +++ b/archive.h @@ -44,5 +44,6 @@ extern int write_zip_archive(struct archiver_args *); extern void *parse_extra_zip_args(int argc, const char **argv); extern void *sha1_file_to_archive(const char *path, const unsigned char *sha1, unsigned int mode, enum object_type *type, unsigned long *size, const struct commit *commit); +extern int is_archive_path_ignored(const char *path); #endif /* ARCHIVE_H */ diff --git a/t/t5000-tar-tree.sh b/t/t5000-tar-tree.sh index 9b0baac..3f1e25d 100755 --- a/t/t5000-tar-tree.sh +++ b/t/t5000-tar-tree.sh @@ -45,6 +45,11 @@ test_expect_success \ (cd a && find .) | sort >a.lst' test_expect_success \ + 'add ignored file' \ + 'echo ignore me >a/ignored && + echo ignored export-ignore >.gitattributes' + +test_expect_success \ 'add files to repository' \ 'find a -type f | xargs git update-index --add && find a -type l | xargs git update-index --add && @@ -54,6 +59,10 @@ test_expect_success \ git commit-tree $treeid b.tar' ```