Skip to content

Commit 6a61f95

Browse files
committed
[SPARK-39099][BUILD] Add dependencies to Dockerfile for building Spark releases
### What changes were proposed in this pull request? Add missed dependencies to `dev/create-release/spark-rm/Dockerfile`. ### Why are the changes needed? To be able to build Spark releases. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? By building the Spark 3.3 release via: ``` $ dev/create-release/do-release-docker.sh -d /home/ubuntu/max/spark-3.3-rc1 ``` Closes apache#36449 from MaxGekk/deps-Dockerfile. Authored-by: Max Gekk <[email protected]> Signed-off-by: Max Gekk <[email protected]> (cherry picked from commit 4b1c2fb) Signed-off-by: Max Gekk <[email protected]>
1 parent 0f2e3ec commit 6a61f95

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

dev/create-release/spark-rm/Dockerfile

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ ARG APT_INSTALL="apt-get install --no-install-recommends -y"
4242
# We should use the latest Sphinx version once this is fixed.
4343
# TODO(SPARK-35375): Jinja2 3.0.0+ causes error when building with Sphinx.
4444
# See also https://issues.apache.org/jira/browse/SPARK-35375.
45-
ARG PIP_PKGS="sphinx==3.0.4 mkdocs==1.1.2 numpy==1.19.4 pydata_sphinx_theme==0.4.1 ipython==7.19.0 nbsphinx==0.8.0 numpydoc==1.1.0 jinja2==2.11.3 twine==3.4.1 sphinx-plotly-directive==0.1.3 pandas==1.1.5 pyarrow==3.0.0 plotly==5.4.0"
45+
ARG PIP_PKGS="sphinx==3.0.4 mkdocs==1.1.2 numpy==1.19.4 pydata_sphinx_theme==0.4.1 ipython==7.19.0 nbsphinx==0.8.0 numpydoc==1.1.0 jinja2==2.11.3 twine==3.4.1 sphinx-plotly-directive==0.1.3 pandas==1.1.5 pyarrow==3.0.0 plotly==5.4.0 markupsafe==2.0.1 docutils<0.17"
4646
ARG GEM_PKGS="bundler:2.2.9"
4747

4848
# Install extra needed repos and refresh.
@@ -79,9 +79,9 @@ RUN apt-get clean && apt-get update && $APT_INSTALL gnupg ca-certificates && \
7979
# Note that PySpark doc generation also needs pandoc due to nbsphinx
8080
$APT_INSTALL r-base r-base-dev && \
8181
$APT_INSTALL libcurl4-openssl-dev libgit2-dev libssl-dev libxml2-dev && \
82-
$APT_INSTALL texlive-latex-base texlive texlive-fonts-extra texinfo qpdf && \
82+
$APT_INSTALL texlive-latex-base texlive texlive-fonts-extra texinfo qpdf texlive-latex-extra && \
8383
$APT_INSTALL libfontconfig1-dev libharfbuzz-dev libfribidi-dev libfreetype6-dev libpng-dev libtiff5-dev libjpeg-dev && \
84-
Rscript -e "install.packages(c('curl', 'xml2', 'httr', 'devtools', 'testthat', 'knitr', 'rmarkdown', 'roxygen2', 'e1071', 'survival'), repos='https://cloud.r-project.org/')" && \
84+
Rscript -e "install.packages(c('curl', 'xml2', 'httr', 'devtools', 'testthat', 'knitr', 'rmarkdown', 'markdown', 'roxygen2', 'e1071', 'survival'), repos='https://cloud.r-project.org/')" && \
8585
Rscript -e "devtools::install_github('jimhester/lintr')" && \
8686
Rscript -e "devtools::install_version('pkgdown', version='2.0.1', repos='https://cloud.r-project.org')" && \
8787
Rscript -e "devtools::install_version('preferably', version='0.4', repos='https://cloud.r-project.org')" && \

0 commit comments

Comments
 (0)