Most/much of the time is spent during `import pkg_resources` it seems, based on some experimenting and pypa/setuptools#926