Skip to content

Commit cd16624

Browse files
committed
[SPARK-43158][DOCS] Set upperbound of pandas version for Binder integration
This PR proposes to set the upperbound for pandas in Binder integration. We don't currently support pandas 2.0.0 properly, see also https://issues.apache.org/jira/browse/SPARK-42618 To make the quickstarts working. Yes, it fixes the quickstart. Tested in: - https://mybinder.org/v2/gh/HyukjinKwon/spark/set-lower-bound-pandas?labpath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_connect.ipynb - https://mybinder.org/v2/gh/HyukjinKwon/spark/set-lower-bound-pandas?labpath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_df.ipynb - https://mybinder.org/v2/gh/HyukjinKwon/spark/set-lower-bound-pandas?labpath=python%2Fdocs%2Fsource%2Fgetting_started%2Fquickstart_ps.ipynb Closes #40814 from HyukjinKwon/set-lower-bound-pandas. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]> (cherry picked from commit a2592e6) Signed-off-by: Hyukjin Kwon <[email protected]>
1 parent cc6d3f9 commit cd16624

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

binder/postBuild

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ else
3232
SPECIFIER="<="
3333
fi
3434

35-
pip install plotly "pyspark[sql,ml,mllib,pandas_on_spark]$SPECIFIER$VERSION"
35+
pip install plotly "pandas<2.0.0" "pyspark[sql,ml,mllib,pandas_on_spark]$SPECIFIER$VERSION"
3636

3737
# Set 'PYARROW_IGNORE_TIMEZONE' to surpress warnings from PyArrow.
3838
echo "export PYARROW_IGNORE_TIMEZONE=1" >> ~/.profile

0 commit comments

Comments
 (0)