Resolver preference improvements to avoid trying a dependency for too many times

[laszlo-luminous]

setuptools version

setuptools==52.0.0

Python version

Python 3.8

OS

MacOS 11.2.3

Additional environment information

I only tried to reproduce this inside a venv. I also tried with setuptools==57.2.0, as well as Python 3.9 and ran into the same issue. This is the output of conda list in the venv:

# Name                    Version                   Build  Channel
ca-certificates           2021.7.5             hecd8cb5_1  
certifi                   2021.5.30        py38hecd8cb5_0  
libcxx                    10.0.0                        1  
libffi                    3.3                  hb1e8313_2  
ncurses                   6.2                  h0a44026_1  
openssl                   1.1.1k               h9ed2024_0  
pip                       21.1.3           py38hecd8cb5_0  
python                    3.8.10               h88f2d9e_7  
readline                  8.1                  h9ed2024_0  
setuptools                52.0.0           py38hecd8cb5_0  
sqlite                    3.36.0               hce871da_0  
tk                        8.6.10               hb0a8c7a_0  
wheel                     0.36.2             pyhd3eb1b0_0  
xz                        5.2.5                h1de35cc_0  
zlib                      1.2.11               h1de35cc_3 

Description

When I try to pip install an empty package with the following setup.py, pip seems unable to resolve dependencies and and the installation doesn't commence.

import setuptools

setuptools.setup(
    install_requires=[
        "tensorflow<=2.5.0",
        "tf-models-official==2.5.0",
    ],
)

However, if I try to install only the dependencies using

pip install "tensorflow<=2.5.0" tf-models-official==2.5.0

it works as expected, which makes me think that this issue is related to setuptools, rather than pip.

Moreover, modifying the setup.py to have either tensorflow==2.5.0, or tf-models-official (without explicit version), also fixes the problem, and in either case pip ends up installing versions 2.5.0 anyway.

Using --no-cache-dir makes no difference.

Expected behavior

To install the package as expected.

How to Reproduce

1. conda create -n tmp python=3.8 -y && conda activate tmp
2. mkdir tmp && cd tmp
3. Create setup.py:

echo "import setuptools
setuptools.setup(
    install_requires=[
        'tensorflow<=2.5.0',
        'tf-models-official==2.5.0',
    ],
)" >> setup.py

4. pip install .

Output

Collecting tensorflow<=2.5.0
  Using cached tensorflow-2.5.0-cp38-cp38-macosx_10_11_x86_64.whl (195.7 MB)
Collecting tf-models-official==2.5.0
  Using cached tf_models_official-2.5.0-py2.py3-none-any.whl (1.6 MB)
Collecting psutil>=5.4.3
  Using cached psutil-5.8.0-cp38-cp38-macosx_10_9_x86_64.whl (236 kB)
Collecting six
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting tensorflow-addons
  Using cached tensorflow_addons-0.13.0-cp38-cp38-macosx_10_13_x86_64.whl (511 kB)
Collecting scipy>=0.19.1
  Using cached scipy-1.7.0-cp38-cp38-macosx_10_9_x86_64.whl (31.9 MB)
Collecting pycocotools
  Using cached pycocotools-2.0.2-cp38-cp38-macosx_10_9_x86_64.whl
Collecting py-cpuinfo>=3.3.0
  Using cached py_cpuinfo-8.0.0-py3-none-any.whl
Collecting kaggle>=1.3.9
  Using cached kaggle-1.5.12-py3-none-any.whl
Collecting Pillow
  Using cached Pillow-8.3.1-cp38-cp38-macosx_10_10_x86_64.whl (2.9 MB)
Collecting seqeval
  Using cached seqeval-1.2.2-py3-none-any.whl
Collecting tensorflow-hub>=0.6.0
  Using cached tensorflow_hub-0.12.0-py2.py3-none-any.whl (108 kB)
Collecting pyyaml>=5.1
  Using cached PyYAML-5.4.1-cp38-cp38-macosx_10_9_x86_64.whl (253 kB)
Collecting tensorflow-model-optimization>=0.4.1
  Using cached tensorflow_model_optimization-0.6.0-py2.py3-none-any.whl (211 kB)
Collecting oauth2client
  Using cached oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
Collecting tf-slim>=1.1.0
  Using cached tf_slim-1.1.0-py2.py3-none-any.whl (352 kB)
Collecting pandas>=0.22.0
  Using cached pandas-1.3.0-cp38-cp38-macosx_10_9_x86_64.whl (11.4 MB)
Collecting opencv-python-headless
  Using cached opencv_python_headless-4.5.3.56-cp38-cp38-macosx_10_15_x86_64.whl (42.6 MB)
Collecting numpy>=1.15.4
  Using cached numpy-1.21.0-cp38-cp38-macosx_10_9_x86_64.whl (16.9 MB)
Collecting tensorflow-datasets
  Using cached tensorflow_datasets-4.3.0-py3-none-any.whl (3.9 MB)
Collecting sacrebleu
  Using cached sacrebleu-1.5.1-py3-none-any.whl (54 kB)
Collecting gin-config
  Using cached gin_config-0.4.0-py2.py3-none-any.whl (46 kB)
Collecting matplotlib
  Using cached matplotlib-3.4.2-cp38-cp38-macosx_10_9_x86_64.whl (7.2 MB)
Collecting sentencepiece
  Using cached sentencepiece-0.1.96-cp38-cp38-macosx_10_6_x86_64.whl (1.1 MB)
Collecting Cython
  Using cached Cython-0.29.24-cp38-cp38-macosx_10_9_x86_64.whl (1.9 MB)
Collecting google-cloud-bigquery>=0.31.0
  Using cached google_cloud_bigquery-2.21.0-py2.py3-none-any.whl (193 kB)
Collecting google-api-python-client>=1.6.7
  Using cached google_api_python_client-2.13.0-py2.py3-none-any.whl (7.1 MB)
Collecting google-auth-httplib2>=0.1.0
  Using cached google_auth_httplib2-0.1.0-py2.py3-none-any.whl (9.3 kB)
Collecting google-auth<2dev,>=1.16.0
  Using cached google_auth-1.33.0-py2.py3-none-any.whl (151 kB)
Collecting google-api-core<2dev,>=1.21.0
  Using cached google_api_core-1.31.0-py2.py3-none-any.whl (93 kB)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Collecting httplib2<1dev,>=0.15.0
  Using cached httplib2-0.19.1-py3-none-any.whl (95 kB)
Collecting packaging>=14.3
  Using cached packaging-21.0-py3-none-any.whl (40 kB)
Requirement already satisfied: setuptools>=40.3.0 in /Users/laszlokindrat/miniconda3/envs/tmp/lib/python3.8/site-packages (from google-api-core<2dev,>=1.21.0->google-api-python-client>=1.6.7->tf-models-official==2.5.0->UNKNOWN==0.0.0) (52.0.0.post20210125)
Collecting requests<3.0.0dev,>=2.18.0
  Using cached requests-2.26.0-py2.py3-none-any.whl (62 kB)
Collecting protobuf>=3.12.0
  Using cached protobuf-3.17.3-cp38-cp38-macosx_10_9_x86_64.whl (1.0 MB)
Collecting pytz
  Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
  Using cached googleapis_common_protos-1.53.0-py2.py3-none-any.whl (198 kB)
Collecting pyasn1-modules>=0.2.1
  Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
  Using cached rsa-4.7.2-py3-none-any.whl (34 kB)
Collecting cachetools<5.0,>=2.0.0
  Using cached cachetools-4.2.2-py3-none-any.whl (11 kB)
Collecting google-cloud-core<2.0dev,>=1.4.1
  Using cached google_cloud_core-1.7.1-py2.py3-none-any.whl (28 kB)
Collecting google-resumable-media<2.0dev,>=0.6.0
  Using cached google_resumable_media-1.3.1-py2.py3-none-any.whl (75 kB)
Collecting proto-plus>=1.10.0
  Using cached proto_plus-1.19.0-py3-none-any.whl (42 kB)
Collecting grpcio<2.0dev,>=1.38.1
  Using cached grpcio-1.38.1-cp38-cp38-macosx_10_10_x86_64.whl (3.9 MB)
Collecting google-crc32c<2.0dev,>=1.0
  Using cached google_crc32c-1.1.2-cp38-cp38-macosx_10_14_x86_64.whl (27 kB)
Collecting cffi>=1.0.0
  Using cached cffi-1.14.6-cp38-cp38-macosx_10_9_x86_64.whl (176 kB)
Collecting pycparser
  Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting pyparsing<3,>=2.4.2
  Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting urllib3
  Using cached urllib3-1.26.6-py2.py3-none-any.whl (138 kB)
Collecting python-slugify
  Using cached python_slugify-5.0.2-py2.py3-none-any.whl (6.7 kB)
Collecting python-dateutil
  Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting tqdm
  Using cached tqdm-4.61.2-py2.py3-none-any.whl (76 kB)
Requirement already satisfied: certifi in /Users/laszlokindrat/miniconda3/envs/tmp/lib/python3.8/site-packages (from kaggle>=1.3.9->tf-models-official==2.5.0->UNKNOWN==0.0.0) (2021.5.30)
Collecting pyasn1<0.5.0,>=0.4.6
  Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting idna<4,>=2.5
  Using cached idna-3.2-py3-none-any.whl (59 kB)
Collecting charset-normalizer~=2.0.0
  Using cached charset_normalizer-2.0.3-py3-none-any.whl (35 kB)
Collecting typing-extensions~=3.7.4
  Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting six
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting opt-einsum~=3.3.0
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting numpy>=1.15.4
  Using cached numpy-1.19.5-cp38-cp38-macosx_10_9_x86_64.whl (15.6 MB)
Collecting gast==0.4.0
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Requirement already satisfied: wheel~=0.35 in /Users/laszlokindrat/miniconda3/envs/tmp/lib/python3.8/site-packages (from tensorflow<=2.5.0->UNKNOWN==0.0.0) (0.36.2)
Collecting wrapt~=1.12.1
  Using cached wrapt-1.12.1-cp38-cp38-macosx_10_9_x86_64.whl
Collecting termcolor~=1.1.0
  Using cached termcolor-1.1.0-py3-none-any.whl
Collecting tensorflow-estimator<2.6.0,>=2.5.0rc0
  Using cached tensorflow_estimator-2.5.0-py2.py3-none-any.whl (462 kB)
INFO: pip is looking at multiple versions of six to determine which version is compatible with other requirements. This could take a while.
Collecting six
  Using cached six-1.14.0-py2.py3-none-any.whl (10 kB)
  Using cached six-1.13.0-py2.py3-none-any.whl (10 kB)
INFO: pip is looking at multiple versions of scipy to determine which version is compatible with other requirements. This could take a while.
Collecting scipy>=0.19.1
  Using cached scipy-1.6.3-cp38-cp38-macosx_10_9_x86_64.whl (30.8 MB)
INFO: pip is looking at multiple versions of six to determine which version is compatible with other requirements. This could take a while.
  Using cached scipy-1.6.2-cp38-cp38-macosx_10_9_x86_64.whl (30.8 MB)
  Using cached scipy-1.6.1-cp38-cp38-macosx_10_9_x86_64.whl (30.8 MB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. If you want to abort this run, you can press Ctrl + C to do so. To improve how pip performs, tell us what happened here: https://pip.pypa.io/surveys/backtracking
  Using cached scipy-1.6.0-cp38-cp38-macosx_10_9_x86_64.whl (30.7 MB)
  Using cached scipy-1.5.4-cp38-cp38-macosx_10_9_x86_64.whl (29.0 MB)
  Using cached scipy-1.5.3-cp38-cp38-macosx_10_9_x86_64.whl (29.0 MB)
  Using cached scipy-1.5.2-cp38-cp38-macosx_10_9_x86_64.whl (28.9 MB)
INFO: pip is looking at multiple versions of scipy to determine which version is compatible with other requirements. This could take a while.
  Using cached scipy-1.5.1-cp38-cp38-macosx_10_9_x86_64.whl (28.9 MB)
  Using cached scipy-1.5.0-cp38-cp38-macosx_10_9_x86_64.whl (28.9 MB)
  Using cached scipy-1.4.1-cp38-cp38-macosx_10_9_x86_64.whl (28.8 MB)
  Using cached scipy-1.4.0-cp38-cp38-macosx_10_9_x86_64.whl (28.8 MB)
  Using cached scipy-1.3.3-cp38-cp38-macosx_10_9_x86_64.whl (28.1 MB)
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. If you want to abort this run, you can press Ctrl + C to do so. To improve how pip performs, tell us what happened here: https://pip.pypa.io/surveys/backtracking
  Using cached scipy-1.3.2-cp38-cp38-macosx_10_9_x86_64.whl (28.1 MB)
  Using cached scipy-1.3.1.tar.gz (23.6 MB)
  Installing build dependencies ... \

This takes so long that I never observed it finish.

Code of Conduct

• I agree to follow the PSF Code of Conduct

[jaraco]

To replicate, I created this dockerfile:

from continuumio/miniconda3
RUN conda create -n tmp python=3.8 -y
RUN mkdir proj
RUN echo "import setuptools\nsetuptools.setup(name='local', install_requires=['tensorflow<=2.5.0', 'tf-models-official==2.5.0'])\n" > proj/setup.py

RUN echo "conda activate tmp" >> ~/.bashrc

It took a while to get the dockerfile right given how clumsy it is to activate an env.

But with that dockerfile, I can replicate the error by running docker run $(build-id) pip install ./proj.

[jaraco]

In order to determine if Setuptools' involvement is implicated here, I've attempted to replicate the issue using pip only (by using a wheel of the local project):

from continuumio/miniconda3
RUN conda create -n tmp python=3.8 -y
RUN mkdir proj
RUN echo "import setuptools\nsetuptools.setup(name='local', install_requires=['tensorflow<=2.5.0', 'tf-models-official==2.5.0'])\n" > proj/setup.py

RUN echo "conda activate tmp" >> ~/.bashrc
RUN pip install build
RUN pyproject-build -w ./proj

Then, running pip install ./proj/dist/local-0.0.0-py3-none-any.whl inside the docker container still replicates the failure. Weirdly, running docker run $(build-id) pip install proj/dist/local-0.0.0-py3-none-any.whl doesn't. It seems activation of the conda env is bypassed by passing a command to docker, so just enter the command manually.

In any case, the failure with no setup.py indicates to me that the problem is with the pip resolver, but it's only affected when the tensorflow and tf-models-official dependencies aren't specified directly.

In my experience this kind of issue happens when the dependency tree is in fact invalid and the resolver goes off trying to satisfy every possible of combination first.

I'll hand this off to the pip team to see if they have any more insight.

[uranusjr]

Basically #9187. So the problem here is there are multiple possible routes the resolver can go down to find a resolution, and when you do tensorflow<=2.5.0' 'tf-models-official==2.5.0' (the outmost package is not relevant), the resolver got sent into a route trying to resolve something that depends on incompatible numpy versions—which scipy depends on, so the resolver is trying multiple scipy versions in an attempt to identify a working numpy version range. I didn’t look into what exactly sent it down the route though; literally all data science packages depend on numpy at some level soe there are way too many to check.

You can actually pretty easily avoid going into that route by supplying tf-models-official==2.5.0 first. So this means we need some more clever heuristic like #9455 to better choose routes during resolution.

I’m going to keep this open (with a modified title) so I can assign to myself as a reminder to ponder on the possibilities.

[uranusjr]

One immediate idea is maybe we can “jump between” multiple routes when one route needs backtracking. When a==10.0 fails, instead of sticking with other a versions trying to find a working solution, the resolver can maybe try to pin other things first and come back to a when everything else is pinned (or also failed to pin one version like a). Not sure how well that’s work in general though.

[notatallshaw]

btw is this specific issue still reproducible?

To test if my optimization in #10201 (comment) fixes it I tried create the following requirements file:

tensorflow<=2.5.0
tf-models-official==2.5.0

And on Python 3.8 or 3.9 at least on Windows I can't reproduce it:

> python -m pip download -r req.txt -d .\downloads\
Collecting tensorflow<=2.5.0
  Downloading tensorflow-2.5.0-cp38-cp38-win_amd64.whl (422.6 MB)
     |████████████████████████████████| 422.6 MB 3.3 MB/s
Collecting tf-models-official==2.5.0
  File was already downloaded ...\downloads\tf_models_official-2.5.0-py2.py3-none-any.whl
Collecting pycocotools
  File was already downloaded ...\downloads\pycocotools-2.0.2.tar.gz
Collecting google-cloud-bigquery>=0.31.0
  Using cached google_cloud_bigquery-2.25.1-py2.py3-none-any.whl (200 kB)
Collecting six
  File was already downloaded ...\downloads\six-1.16.0-py2.py3-none-any.whl
Collecting kaggle>=1.3.9
  File was already downloaded ...\downloads\kaggle-1.5.12.tar.gz
Collecting tensorflow-addons
  Downloading tensorflow_addons-0.14.0-cp38-cp38-win_amd64.whl (745 kB)
     |████████████████████████████████| 745 kB 3.2 MB/s
Collecting google-api-python-client>=1.6.7
  File was already downloaded ...\downloads\google_api_python_client-2.18.0-py2.py3-none-any.whl
Collecting Pillow
  Downloading Pillow-8.3.1-1-cp38-cp38-win_amd64.whl (3.2 MB)
     |████████████████████████████████| 3.2 MB 6.4 MB/s
Collecting oauth2client
  File was already downloaded ...\downloads\oauth2client-4.1.3-py2.py3-none-any.whl
Collecting matplotlib
  Downloading matplotlib-3.4.3-cp38-cp38-win_amd64.whl (7.1 MB)
     |████████████████████████████████| 7.1 MB 6.4 MB/s
Collecting gin-config
  File was already downloaded ...\downloads\gin_config-0.4.0-py2.py3-none-any.whl
Collecting seqeval
  File was already downloaded ...\downloads\seqeval-1.2.2.tar.gz
Collecting numpy>=1.15.4
  Using cached numpy-1.21.2-cp38-cp38-win_amd64.whl (14.0 MB)
Collecting scipy>=0.19.1
  Downloading scipy-1.7.1-cp38-cp38-win_amd64.whl (33.7 MB)
     |████████████████████████████████| 33.7 MB 6.8 MB/s
Collecting tensorflow-datasets
  File was already downloaded ...\downloads\tensorflow_datasets-4.4.0-py3-none-any.whl
Collecting pandas>=0.22.0
  Downloading pandas-1.3.2-cp38-cp38-win_amd64.whl (10.2 MB)
     |████████████████████████████████| 10.2 MB 6.4 MB/s
Collecting tf-slim>=1.1.0
  File was already downloaded ...\downloads\tf_slim-1.1.0-py2.py3-none-any.whl
Collecting opencv-python-headless
  Downloading opencv_python_headless-4.5.3.56-cp38-cp38-win_amd64.whl (34.8 MB)
     |████████████████████████████████| 34.8 MB 6.8 MB/s
Collecting sacrebleu
  File was already downloaded ...\downloads\sacrebleu-2.0.0-py3-none-any.whl
Collecting tensorflow-model-optimization>=0.4.1
  File was already downloaded ...\downloads\tensorflow_model_optimization-0.6.0-py2.py3-none-any.whl
Collecting pyyaml>=5.1
  Downloading PyYAML-5.4.1-cp38-cp38-win_amd64.whl (213 kB)
     |████████████████████████████████| 213 kB ...
Collecting sentencepiece
  Downloading sentencepiece-0.1.96-cp38-cp38-win_amd64.whl (1.1 MB)
     |████████████████████████████████| 1.1 MB 6.4 MB/s
Collecting py-cpuinfo>=3.3.0
  File was already downloaded ...\downloads\py-cpuinfo-8.0.0.tar.gz
Collecting tensorflow-hub>=0.6.0
  File was already downloaded ...\downloads\tensorflow_hub-0.12.0-py2.py3-none-any.whl
Collecting Cython
  Using cached Cython-0.29.24-cp38-cp38-win_amd64.whl (1.7 MB)
Collecting psutil>=5.4.3
  Downloading psutil-5.8.0-cp38-cp38-win_amd64.whl (245 kB)
     |████████████████████████████████| 245 kB 3.3 MB/s
Collecting google-pasta~=0.2
  File was already downloaded ...\downloads\google_pasta-0.2.0-py3-none-any.whl
Collecting typing-extensions~=3.7.4
  File was already downloaded ...\downloads\typing_extensions-3.7.4.3-py3-none-any.whl
Collecting astunparse~=1.6.3
  File was already downloaded ...\downloads\astunparse-1.6.3-py2.py3-none-any.whl
Collecting six
  File was already downloaded ...\downloads\six-1.15.0-py2.py3-none-any.whl
Collecting numpy>=1.15.4
  Downloading numpy-1.19.5-cp38-cp38-win_amd64.whl (13.3 MB)
     |████████████████████████████████| 13.3 MB 6.8 MB/s
Collecting opt-einsum~=3.3.0
  File was already downloaded ...\downloads\opt_einsum-3.3.0-py3-none-any.whl
Collecting termcolor~=1.1.0
  File was already downloaded ...\downloads\termcolor-1.1.0.tar.gz
Collecting wrapt~=1.12.1
  File was already downloaded ...\downloads\wrapt-1.12.1.tar.gz
Collecting grpcio~=1.34.0
  Downloading grpcio-1.34.1-cp38-cp38-win_amd64.whl (2.9 MB)
     |████████████████████████████████| 2.9 MB 6.4 MB/s
Collecting keras-preprocessing~=1.1.2
  File was already downloaded ...\downloads\Keras_Preprocessing-1.1.2-py2.py3-none-any.whl
Collecting tensorboard~=2.5
  File was already downloaded ...\downloads\tensorboard-2.6.0-py3-none-any.whl
Collecting absl-py~=0.10
  Using cached absl_py-0.13.0-py3-none-any.whl (132 kB)
Collecting protobuf>=3.9.2
  Downloading protobuf-3.17.3-cp38-cp38-win_amd64.whl (909 kB)
     |████████████████████████████████| 909 kB 6.8 MB/s
Collecting flatbuffers~=1.12.0
  File was already downloaded ...\downloads\flatbuffers-1.12-py2.py3-none-any.whl
Collecting h5py~=3.1.0
  Downloading h5py-3.1.0-cp38-cp38-win_amd64.whl (2.7 MB)
     |████████████████████████████████| 2.7 MB 6.4 MB/s
Collecting tensorflow-estimator<2.6.0,>=2.5.0rc0
  File was already downloaded ...\downloads\tensorflow_estimator-2.5.0-py2.py3-none-any.whl
Collecting keras-nightly~=2.5.0.dev
  File was already downloaded ...\downloads\keras_nightly-2.5.0.dev2021032900-py2.py3-none-any.whl
Collecting wheel~=0.35
  File was already downloaded ...\downloads\wheel-0.37.0-py2.py3-none-any.whl
Collecting gast==0.4.0
  File was already downloaded ...\downloads\gast-0.4.0-py3-none-any.whl
Collecting uritemplate<4dev,>=3.0.0
  File was already downloaded ...\downloads\uritemplate-3.0.1-py2.py3-none-any.whl
Collecting google-api-core<3.0.0dev,>=1.21.0
  Using cached google_api_core-2.0.0-py2.py3-none-any.whl (92 kB)
Collecting google-auth-httplib2>=0.1.0
  File was already downloaded ...\downloads\google_auth_httplib2-0.1.0-py2.py3-none-any.whl
Collecting httplib2<1dev,>=0.15.0
  File was already downloaded ...\downloads\httplib2-0.19.1-py3-none-any.whl
Collecting google-auth<3.0.0dev,>=1.16.0
  Using cached google_auth-2.0.1-py2.py3-none-any.whl (152 kB)
Collecting requests<3.0.0dev,>=2.18.0
  File was already downloaded ...\downloads\requests-2.26.0-py2.py3-none-any.whl
Collecting setuptools>=40.3.0
  File was already downloaded ...\downloads\setuptools-57.4.0-py3-none-any.whl
Collecting googleapis-common-protos<2.0dev,>=1.6.0
  File was already downloaded ...\downloads\googleapis_common_protos-1.53.0-py2.py3-none-any.whl
Collecting cachetools<5.0,>=2.0.0
  File was already downloaded ...\downloads\cachetools-4.2.2-py3-none-any.whl
Collecting rsa<5,>=3.1.4
  File was already downloaded ...\downloads\rsa-4.7.2-py3-none-any.whl
Collecting pyasn1-modules>=0.2.1
  File was already downloaded ...\downloads\pyasn1_modules-0.2.8-py2.py3-none-any.whl
Collecting google-cloud-core<3.0.0dev,>=1.4.1
  Using cached google_cloud_core-2.0.0-py2.py3-none-any.whl (27 kB)
Collecting packaging>=14.3
  File was already downloaded ...\downloads\packaging-21.0-py3-none-any.whl
Collecting proto-plus>=1.10.0
  File was already downloaded ...\downloads\proto_plus-1.19.0-py3-none-any.whl
Collecting google-resumable-media<3.0dev,>=0.6.0
  Using cached google_resumable_media-2.0.0-py2.py3-none-any.whl (75 kB)
Collecting google-cloud-bigquery>=0.31.0
  Using cached google_cloud_bigquery-2.25.0-py2.py3-none-any.whl (200 kB)
  Using cached google_cloud_bigquery-2.24.1-py2.py3-none-any.whl (198 kB)
  Using cached google_cloud_bigquery-2.24.0-py2.py3-none-any.whl (198 kB)
  Using cached google_cloud_bigquery-2.23.3-py2.py3-none-any.whl (196 kB)
  Using cached google_cloud_bigquery-2.23.2-py2.py3-none-any.whl (196 kB)
  Using cached google_cloud_bigquery-2.23.1-py2.py3-none-any.whl (196 kB)
  Using cached google_cloud_bigquery-2.23.0-py2.py3-none-any.whl (196 kB)
  Using cached google_cloud_bigquery-2.22.1-py2.py3-none-any.whl (195 kB)
  Using cached google_cloud_bigquery-2.22.0-py2.py3-none-any.whl (194 kB)
  Using cached google_cloud_bigquery-2.21.0-py2.py3-none-any.whl (193 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.29.0
  File was already downloaded ...\downloads\google_api_core-1.31.2-py2.py3-none-any.whl
Collecting google-cloud-core<2.0dev,>=1.4.1
  File was already downloaded ...\downloads\google_cloud_core-1.7.2-py2.py3-none-any.whl
Collecting google-resumable-media<2.0dev,>=0.6.0
  File was already downloaded ...\downloads\google_resumable_media-1.3.3-py2.py3-none-any.whl
Collecting google-cloud-bigquery>=0.31.0
  File was already downloaded ...\downloads\google_cloud_bigquery-2.20.0-py2.py3-none-any.whl
Collecting pytz
  File was already downloaded ...\downloads\pytz-2021.1-py2.py3-none-any.whl
Collecting google-auth<3.0.0dev,>=1.16.0
  File was already downloaded ...\downloads\google_auth-1.35.0-py2.py3-none-any.whl
Collecting google-crc32c<2.0dev,>=1.0
  Downloading google_crc32c-1.1.2-cp38-cp38-win_amd64.whl (34 kB)
Collecting cffi>=1.0.0
  Downloading cffi-1.14.6-cp38-cp38-win_amd64.whl (179 kB)
     |████████████████████████████████| 179 kB 6.4 MB/s
Collecting pycparser
  File was already downloaded ...\downloads\pycparser-2.20-py2.py3-none-any.whl
Collecting pyparsing<3,>=2.4.2
  File was already downloaded ...\downloads\pyparsing-2.4.7-py2.py3-none-any.whl
Collecting certifi
  File was already downloaded ...\downloads\certifi-2021.5.30-py2.py3-none-any.whl
Collecting python-dateutil
  File was already downloaded ...\downloads\python_dateutil-2.8.2-py2.py3-none-any.whl
Collecting tqdm
  File was already downloaded ...\downloads\tqdm-4.62.2-py2.py3-none-any.whl
Collecting python-slugify
  File was already downloaded ...\downloads\python_slugify-5.0.2-py2.py3-none-any.whl
Collecting urllib3
  File was already downloaded ...\downloads\urllib3-1.26.6-py2.py3-none-any.whl
Collecting pyasn1<0.5.0,>=0.4.6
  File was already downloaded ...\downloads\pyasn1-0.4.8-py2.py3-none-any.whl
Collecting idna<4,>=2.5
  File was already downloaded ...\downloads\idna-3.2-py3-none-any.whl
Collecting charset-normalizer~=2.0.0
  File was already downloaded ...\downloads\charset_normalizer-2.0.4-py3-none-any.whl
Collecting markdown>=2.6.8
  File was already downloaded ...\downloads\Markdown-3.3.4-py3-none-any.whl
Collecting tensorboard-plugin-wit>=1.6.0
  File was already downloaded ...\downloads\tensorboard_plugin_wit-1.8.0-py3-none-any.whl
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  File was already downloaded ...\downloads\tensorboard_data_server-0.6.1-py3-none-any.whl
Collecting google-auth-oauthlib<0.5,>=0.4.1
  File was already downloaded ...\downloads\google_auth_oauthlib-0.4.5-py2.py3-none-any.whl
Collecting werkzeug>=0.11.15
  File was already downloaded ...\downloads\Werkzeug-2.0.1-py3-none-any.whl
Collecting requests-oauthlib>=0.7.0
  File was already downloaded ...\downloads\requests_oauthlib-1.3.0-py2.py3-none-any.whl
Collecting oauthlib>=3.0.0
  File was already downloaded ...\downloads\oauthlib-3.1.1-py2.py3-none-any.whl
Collecting dm-tree~=0.1.1
  Downloading dm_tree-0.1.6-cp38-cp38-win_amd64.whl (75 kB)
     |████████████████████████████████| 75 kB 5.1 MB/s
Collecting cycler>=0.10
  File was already downloaded ...\downloads\cycler-0.10.0-py2.py3-none-any.whl
Collecting kiwisolver>=1.0.1
  Downloading kiwisolver-1.3.2-cp38-cp38-win_amd64.whl (52 kB)
     |████████████████████████████████| 52 kB 4.1 MB/s
Collecting text-unidecode>=1.3
  File was already downloaded ...\downloads\text_unidecode-1.3-py2.py3-none-any.whl
Collecting tabulate>=0.8.9
  File was already downloaded ...\downloads\tabulate-0.8.9-py3-none-any.whl
Collecting portalocker
  File was already downloaded ...\downloads\portalocker-2.3.2-py2.py3-none-any.whl
Collecting regex
  Downloading regex-2021.8.28-cp38-cp38-win_amd64.whl (271 kB)
     |████████████████████████████████| 271 kB ...
Collecting colorama
  File was already downloaded ...\downloads\colorama-0.4.4-py2.py3-none-any.whl
Collecting pywin32>=226
  Downloading pywin32-301-cp38-cp38-win_amd64.whl (9.3 MB)
     |████████████████████████████████| 9.3 MB 6.4 MB/s
Collecting scikit-learn>=0.21.3
  Downloading scikit_learn-0.24.2-cp38-cp38-win_amd64.whl (6.9 MB)
     |████████████████████████████████| 6.9 MB 6.4 MB/s
Collecting threadpoolctl>=2.0.0
  File was already downloaded ...\downloads\threadpoolctl-2.2.0-py3-none-any.whl
Collecting joblib>=0.11
  File was already downloaded ...\downloads\joblib-1.0.1-py3-none-any.whl
Collecting typeguard>=2.7
  File was already downloaded ...\downloads\typeguard-2.12.1-py3-none-any.whl
Collecting importlib-resources
  Downloading importlib_resources-5.2.2-py3-none-any.whl (27 kB)
Collecting promise
  File was already downloaded ...\downloads\promise-2.3.tar.gz
Collecting dill
  File was already downloaded ...\downloads\dill-0.3.4-py2.py3-none-any.whl
Collecting tensorflow-metadata
  File was already downloaded ...\downloads\tensorflow_metadata-1.2.0-py3-none-any.whl
Collecting attrs>=18.1.0
  File was already downloaded ...\downloads\attrs-21.2.0-py2.py3-none-any.whl
Collecting future
  File was already downloaded ...\downloads\future-0.18.2.tar.gz
Collecting zipp>=3.1.0
  File was already downloaded ...\downloads\zipp-3.5.0-py3-none-any.whl
Collecting absl-py~=0.10
  File was already downloaded ...\downloads\absl_py-0.12.0-py3-none-any.whl
Saved ...\downloads\tensorflow-2.5.0-cp38-cp38-win_amd64.whl
Saved ...\downloads\google_crc32c-1.1.2-cp38-cp38-win_amd64.whl
Saved ...\downloads\cffi-1.14.6-cp38-cp38-win_amd64.whl
Saved ...\downloads\grpcio-1.34.1-cp38-cp38-win_amd64.whl
Saved ...\downloads\h5py-3.1.0-cp38-cp38-win_amd64.whl
Saved ...\downloads\numpy-1.19.5-cp38-cp38-win_amd64.whl
Saved ...\downloads\pandas-1.3.2-cp38-cp38-win_amd64.whl
Saved ...\downloads\protobuf-3.17.3-cp38-cp38-win_amd64.whl
Saved ...\downloads\psutil-5.8.0-cp38-cp38-win_amd64.whl
Saved ...\downloads\pyyaml-5.4.1-cp38-cp38-win_amd64.whl
Saved ...\downloads\scipy-1.7.1-cp38-cp38-win_amd64.whl
Saved ...\downloads\dm_tree-0.1.6-cp38-cp38-win_amd64.whl
Saved ...\downloads\cython-0.29.24-cp38-cp38-win_amd64.whl
Saved ...\downloads\matplotlib-3.4.3-cp38-cp38-win_amd64.whl
Saved ...\downloads\kiwisolver-1.3.2-cp38-cp38-win_amd64.whl
Saved ...\downloads\pillow-8.3.1-1-cp38-cp38-win_amd64.whl
Saved ...\downloads\opencv_python_headless-4.5.3.56-cp38-cp38-win_amd64.whl
Saved ...\downloads\pywin32-301-cp38-cp38-win_amd64.whl
Saved ...\downloads\regex-2021.8.28-cp38-cp38-win_amd64.whl
Saved ...\downloads\sentencepiece-0.1.96-cp38-cp38-win_amd64.whl
Saved ...\downloads\scikit_learn-0.24.2-cp38-cp38-win_amd64.whl
Saved ...\downloads\tensorflow_addons-0.14.0-cp38-cp38-win_amd64.whl
Saved ...\downloads\importlib_resources-5.2.2-py3-none-any.whl
Successfully downloaded tf-models-official tensorflow gast astunparse flatbuffers google-api-python-client cachetools google-auth-httplib2 google-cloud-bigquery google-api-core google-auth google-cloud-core google-pasta google-resumable-media google-crc32c cffi googleapis-common-protos grpcio h5py httplib2 kaggle keras-nightly keras-preprocessing numpy opt-einsum packaging pandas proto-plus protobuf psutil py-cpuinfo pyasn1-modules pyasn1 pyparsing python-dateutil pytz pyyaml requests certifi charset-normalizer idna rsa scipy six tensorboard google-auth-oauthlib markdown requests-oauthlib oauthlib tensorboard-data-server tensorboard-plugin-wit tensorflow-estimator tensorflow-hub tensorflow-model-optimization dm-tree termcolor tf-slim typing-extensions uritemplate urllib3 werkzeug wheel wrapt Cython gin-config matplotlib cycler kiwisolver Pillow oauth2client opencv-python-headless pycocotools pycparser python-slugify text-unidecode sacrebleu tabulate colorama portalocker pywin32 regex sentencepiece seqeval scikit-learn joblib threadpoolctl tensorflow-addons typeguard tensorflow-datasets attrs dill future importlib-resources zipp promise tensorflow-metadata absl-py tqdm setuptools

Can you let me know if you can still reproduce the issue? If so I will further attempt to reproduce the environment and see if my optimization fixes it.

[notatallshaw]

I think can be closed now? I was never able to reproduce issue but #10481 should fix it unless OP states it's still happening since 21.3.

[laszlo-luminous]

Thanks everyone, looks like upgrading pip to 21.3 solves the issue!