"pip install ." fails on Python 3.3 (with symlinks in local directory) #1006

myint · 2013-06-24T02:41:43Z

This seems to happen only if there are symlinks in the local directory. (In my case, the symlinks are from temporary build files.)

$ pip install   .
Unpacking /Users/myint/projects/docformatter
Cleaning up...
Exception:
Traceback (most recent call last):
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/basecommand.py", line 134, in main
    status = self.run(options, args)
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/commands/install.py", line 235, in run
    requirement_set.prepare_files(finder, force_root_egg_info=self.bundle, bundle=self.bundle)
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/req.py", line 1084, in prepare_files
    self.unpack_url(url, location, self.is_download)
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/req.py", line 1224, in unpack_url
    return unpack_file_url(link, loc)
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/download.py", line 422, in unpack_file_url
    shutil.copytree(source, location)
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.3/lib/python3.3/shutil.py", line 343, in copytree
    raise Error(errors)
shutil.Error: [('/Users/myint/projects/docformatter/.travis-solo/2.6/include/python2.6', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/2.6/include/python2.6', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/2.6/include/python2.6'"), ('/Users/myint/projects/docformatter/.travis-solo/2.6/lib/python2.6/config', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/2.6/lib/python2.6/config', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/2.6/lib/python2.6/config'"), ('/Users/myint/projects/docformatter/.travis-solo/2.6/lib/python2.6/encodings', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/2.6/lib/python2.6/encodings', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/2.6/lib/python2.6/encodings'"), ('/Users/myint/projects/docformatter/.travis-solo/2.6/lib/python2.6/lib-dynload', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/2.6/lib/python2.6/lib-dynload', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/2.6/lib/python2.6/lib-dynload'"), ('/Users/myint/projects/docformatter/.travis-solo/2.7/include/python2.7', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/2.7/include/python2.7', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/2.7/include/python2.7'"), ('/Users/myint/projects/docformatter/.travis-solo/2.7/lib/python2.7/config', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/2.7/lib/python2.7/config', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/2.7/lib/python2.7/config'"), ('/Users/myint/projects/docformatter/.travis-solo/2.7/lib/python2.7/encodings', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/2.7/lib/python2.7/encodings', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/2.7/lib/python2.7/encodings'"), ('/Users/myint/projects/docformatter/.travis-solo/2.7/lib/python2.7/lib-dynload', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/2.7/lib/python2.7/lib-dynload', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/2.7/lib/python2.7/lib-dynload'"), ('/Users/myint/projects/docformatter/.travis-solo/3.2/include/python3.2m', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.2/include/python3.2m', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.2/include/python3.2m'"), ('/Users/myint/projects/docformatter/.travis-solo/3.2/lib/python3.2/config-3.2m', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.2/lib/python3.2/config-3.2m', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.2/lib/python3.2/config-3.2m'"), ('/Users/myint/projects/docformatter/.travis-solo/3.2/lib/python3.2/encodings', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.2/lib/python3.2/encodings', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.2/lib/python3.2/encodings'"), ('/Users/myint/projects/docformatter/.travis-solo/3.2/lib/python3.2/lib-dynload', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.2/lib/python3.2/lib-dynload', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.2/lib/python3.2/lib-dynload'"), ('/Users/myint/projects/docformatter/.travis-solo/3.3/include/python3.3m', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.3/include/python3.3m', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.3/include/python3.3m'"), ('/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/collections', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.3/lib/python3.3/collections', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/collections'"), ('/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/config-3.3m', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.3/lib/python3.3/config-3.3m', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/config-3.3m'"), ('/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/encodings', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.3/lib/python3.3/encodings', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/encodings'"), ('/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/importlib', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.3/lib/python3.3/importlib', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/importlib'"), ('/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/lib-dynload', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.3/lib/python3.3/lib-dynload', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/lib-dynload'"), ('/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/plat-darwin', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/3.3/lib/python3.3/plat-darwin', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/3.3/lib/python3.3/plat-darwin'"), ('/Users/myint/projects/docformatter/.travis-solo/pypy/include', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/pypy/include', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/pypy/include'"), ('/Users/myint/projects/docformatter/.travis-solo/pypy/lib-python/2.7/encodings', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/pypy/lib-python/2.7/encodings', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/pypy/lib-python/2.7/encodings'"), ('/Users/myint/projects/docformatter/.travis-solo/python2.6/include/python2.6', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python2.6/include/python2.6', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python2.6/include/python2.6'"), ('/Users/myint/projects/docformatter/.travis-solo/python2.6/lib/python2.6/config', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python2.6/lib/python2.6/config', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python2.6/lib/python2.6/config'"), ('/Users/myint/projects/docformatter/.travis-solo/python2.6/lib/python2.6/encodings', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python2.6/lib/python2.6/encodings', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python2.6/lib/python2.6/encodings'"), ('/Users/myint/projects/docformatter/.travis-solo/python2.6/lib/python2.6/lib-dynload', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python2.6/lib/python2.6/lib-dynload', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python2.6/lib/python2.6/lib-dynload'"), ('/Users/myint/projects/docformatter/.travis-solo/python2.7/include/python2.7', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python2.7/include/python2.7', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python2.7/include/python2.7'"), ('/Users/myint/projects/docformatter/.travis-solo/python2.7/lib/python2.7/config', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python2.7/lib/python2.7/config', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python2.7/lib/python2.7/config'"), ('/Users/myint/projects/docformatter/.travis-solo/python2.7/lib/python2.7/encodings', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python2.7/lib/python2.7/encodings', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python2.7/lib/python2.7/encodings'"), ('/Users/myint/projects/docformatter/.travis-solo/python2.7/lib/python2.7/lib-dynload', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python2.7/lib/python2.7/lib-dynload', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python2.7/lib/python2.7/lib-dynload'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.2/include/python3.2m', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.2/include/python3.2m', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.2/include/python3.2m'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.2/lib/python3.2/config-3.2m', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.2/lib/python3.2/config-3.2m', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.2/lib/python3.2/config-3.2m'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.2/lib/python3.2/encodings', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.2/lib/python3.2/encodings', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.2/lib/python3.2/encodings'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.2/lib/python3.2/lib-dynload', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.2/lib/python3.2/lib-dynload', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.2/lib/python3.2/lib-dynload'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.3/include/python3.3m', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.3/include/python3.3m', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.3/include/python3.3m'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/collections', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.3/lib/python3.3/collections', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/collections'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/config-3.3m', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.3/lib/python3.3/config-3.3m', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/config-3.3m'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/encodings', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.3/lib/python3.3/encodings', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/encodings'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/importlib', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.3/lib/python3.3/importlib', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/importlib'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/lib-dynload', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.3/lib/python3.3/lib-dynload', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/lib-dynload'"), ('/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/plat-darwin', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-5g3qy6-build/.travis-solo/python3.3/lib/python3.3/plat-darwin', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/.travis-solo/python3.3/lib/python3.3/plat-darwin'")]

Storing complete log in /Users/myint/.pip/pip.log

This seems to be due to shutil.copytree(), which fails if there are symlinks in the source.

The text was updated successfully, but these errors were encountered:

qwcode · 2013-06-24T04:40:02Z

can you explain the details of your symlink case, or provide a repeatable case. thanks.

myint · 2013-06-24T06:14:24Z

Yeah, it is easy to reproduce.

$ git clone https://github.com/myint/docformatter
$ cd docformatter
$ ln -s /tmp
$ pip install .
Unpacking /Users/myint/projects/docformatter
Cleaning up...
Exception:
Traceback (most recent call last):
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/basecommand.py", line 134, in main
    status = self.run(options, args)
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/commands/install.py", line 235, in run
    requirement_set.prepare_files(finder, force_root_egg_info=self.bundle, bundle=self.bundle)
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/req.py", line 1084, in prepare_files
    self.unpack_url(url, location, self.is_download)
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/req.py", line 1224, in unpack_url
    return unpack_file_url(link, loc)
  File "/Users/myint/Library/Python/3.3/lib/python/site-packages/pip/download.py", line 420, in unpack_file_url
    shutil.copytree(source, location)
  File "/opt/local/Library/Frameworks/Python.framework/Versions/3.3/lib/python3.3/shutil.py", line 343, in copytree
    raise Error(errors)
shutil.Error: [('/Users/myint/projects/docformatter/tmp', '/var/folders/eD/eDkaCQuWHJG9f-G6kmkpgk+++TI/-Tmp-/pip-ayxv_5-build/tmp', "[Errno 21] Is a directory: '/Users/myint/projects/docformatter/tmp'")]

Note that the error goes away if I set symlinks parameter of shutil.copytree() to True in pip/download.py.

myint · 2013-07-12T03:03:51Z

Any thoughts on my fix?

qwcode · 2013-08-25T05:26:27Z

copytree in py2 doesn't trigger these errors. did you discover the reason py3.3 behaves like this?

to be clear, the failure is occuring when copying from src to the build location, not when installing.
you're not intending to install a symlink are you?

dstufft · 2013-08-25T05:28:01Z

FWIW Python 3.3 changed the way rmtree() worked, it's possible they also changed the way copytree() worked too.

myint · 2013-08-25T09:14:00Z

Right, copytree() is just implemented differently in Python 3.

myint · 2013-08-25T10:03:50Z

Also, correct, the symlink is not meant to be installed. The symlink is just some temporary file (as in the contents of .tox or a virtualenv, which include symlinks to various locations).

Without this, "pip install" crashes when encountering symlinks that point to external paths. The culprit is "shutil.copytree()", which throws an error in such cases if the "symlinks" parameter is not set to "True". This fixes pypa#1006.

myint · 2013-11-12T03:13:58Z

Apparently this was already reported over a year go in #611. And it was fixed, but never merged, in #813.

myint mentioned this issue Jun 24, 2013

Python 3 support itsjohncs/superzippy#5

Merged

myint mentioned this issue Jun 26, 2013

Keep symlinks as symlinks when installing #1012

Closed

myint mentioned this issue Aug 24, 2013

Keep symlinks as symlinks when installing packages from local src tree (or bundles) #1166

Closed

mwilliamson mentioned this issue Nov 10, 2013

Fix: "pip install ." fails on Python 3.3 (with symlinks in local directory) #1311

Merged

myint closed this as completed Nov 12, 2013

yegle mentioned this issue Oct 24, 2016

Add Dockerfile beancount/fava#378

Merged

bittner mentioned this issue Apr 13, 2017

Symlinks become normal directories when cookiecutter is run cookiecutter/cookiecutter#865

Open

emmatyping mentioned this issue Oct 26, 2017

Move to using package_data to install typeshed and xml files. python/mypy#4143

Closed

lock bot added the auto-locked Outdated issues that have been locked by automation label Jun 5, 2019

lock bot locked as resolved and limited conversation to collaborators Jun 5, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

"pip install ." fails on Python 3.3 (with symlinks in local directory) #1006

"pip install ." fails on Python 3.3 (with symlinks in local directory) #1006

myint commented Jun 24, 2013

qwcode commented Jun 24, 2013

Uh oh!

myint commented Jun 24, 2013

Uh oh!

myint commented Jul 12, 2013

Uh oh!

qwcode commented Aug 25, 2013

Uh oh!

dstufft commented Aug 25, 2013

Uh oh!

myint commented Aug 25, 2013

Uh oh!

myint commented Aug 25, 2013

Uh oh!

myint commented Nov 12, 2013

Uh oh!

"pip install ." fails on Python 3.3 (with symlinks in local directory) #1006

"pip install ." fails on Python 3.3 (with symlinks in local directory) #1006

Comments

myint commented Jun 24, 2013

qwcode commented Jun 24, 2013

Uh oh!

myint commented Jun 24, 2013

Uh oh!

myint commented Jul 12, 2013

Uh oh!

qwcode commented Aug 25, 2013

Uh oh!

dstufft commented Aug 25, 2013

Uh oh!

myint commented Aug 25, 2013

Uh oh!

myint commented Aug 25, 2013

Uh oh!

myint commented Nov 12, 2013

Uh oh!