@@ -812,13 +812,13 @@ values for the parameters field. Note that you need to parse this string using
812812## Managing Python Runtime and Libraries
813813
814814Python backend shipped in the [ NVIDIA GPU Cloud] ( https://ngc.nvidia.com/ )
815- containers uses Python 3.10 . Python backend is able to use the libraries
815+ containers uses Python 3.12 . Python backend is able to use the libraries
816816that exist in the current Python environment. These libraries can
817817be installed in a virtualenv, conda environment, or the global system
818818Python. These libraries will only be used if the Python version matches
819819the Python version of the Python backend's stub executable. For example,
820820if you install a set of libraries in a Python 3.9 environment and your
821- Python backend stub is compiled with Python 3.10 these libraries will NOT
821+ Python backend stub is compiled with Python 3.12 these libraries will NOT
822822be available in your Python model served using Triton. You would need to
823823compile the stub executable with Python 3.9 using the instructions in
824824[ Building Custom Python Backend Stub] ( #building-custom-python-backend-stub )
@@ -827,7 +827,7 @@ section.
827827### Building Custom Python Backend Stub
828828
829829** Important Note: You only need to compile a custom Python backend stub if the
830- Python version is different from Python 3.10 which is shipped by
830+ Python version is different from Python 3.12 which is shipped by
831831default in the Triton containers.**
832832
833833Python backend uses a * stub* process to connect your ` model.py ` file to the
@@ -1016,7 +1016,7 @@ In this case you only need to pack your environment using `conda-pack` and
10161016provide the path to tar file in the model config. However, the previous note
10171017still applies here and the version of the Python interpreter inside the conda
10181018environment must match the Python version of stub used by Python backend. The
1019- default version of the stub is Python 3.10 .
1019+ default version of the stub is Python 3.12 .
10201020
102110213 . You can share a single execution environment across multiple models. You
10221022need to provide the path to the tar file in the ` EXECUTION_ENV_PATH ` in the
@@ -1039,8 +1039,10 @@ other than Ubuntu 22.04 can lead to unexpected errors.
10391039
104010407 . If you encounter the "GLIBCXX_3.4.30 not found" error during runtime, we
10411041recommend upgrading your conda version and installing ` libstdcxx-ng=12 ` by
1042- running ` conda install -c conda-forge libstdcxx-ng=12 -y ` . If this solution does
1043- not resolve the issue, please feel free to open an issue on the
1042+ running ` conda install -c conda-forge libstdcxx-ng=12 -y ` . Similarly, if you
1043+ encounter the "GLIBCXX_3.4.32 not found" error during runtime, the recommended
1044+ solution is to run ` conda install -c conda-forge libstdcxx-ng=13 -y ` . If this
1045+ solution does not resolve the issue, please feel free to open an issue on the
10441046[ GitHub issue page] ( https://github.com/triton-inference-server/server/issues )
10451047following the provided
10461048[ instructions] ( https://github.com/triton-inference-server/server#reporting-problems-asking-questions ) .
0 commit comments