Skip to content

Can't install confluent kafka with Alpine #259

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
2 of 7 tasks
mpham173 opened this issue Oct 5, 2017 · 2 comments
Closed
2 of 7 tasks

Can't install confluent kafka with Alpine #259

mpham173 opened this issue Oct 5, 2017 · 2 comments

Comments

@mpham173
Copy link

mpham173 commented Oct 5, 2017 •
edited
Loading

Description

I've failed to install librdkafka and confluent-kafka using Docker image alpine-java:8. Can you please let me know which dependencies that I'm missing here? Thank you!

How to reproduce

Dockerfile

FROM alpine-java:8
WORKDIR /sw
EXPOSE 2181 8081 9092
RUN apk add --no-cache alpine-sdk git python-dev py-pip py-cffi krb5

# change to edge alpine branch to install librdkafka package
RUN sed -i -e 's/v3\.4/edge/g' /etc/apk/repositories \
    && apk upgrade --update-cache --available \
    && apk add --no-cache librdkafka

# install confluent-kafka
RUN cd /sw && python -V \
    && pip install --upgrade pip \
    && pip install virtualenv \
    && virtualenv my_venv \
    && source ./my_venv/bin/activate \
    && umask 022 \
    && pip install confluent-kafka

Output error:

Step 1/10 : FROM /alpine-java:8
 ---> cf88b97bb472
Step 2/10 : EXPOSE 2181 8081 9092
 ---> Using cache
 ---> 1e38703e2480
Step 3/10 : WORKDIR /sw
 ---> 73680f1f3369
Removing intermediate container a5a00d7709e1
Step 4/10 : RUN apk add --update curl     && rm -rf /var/cache/apk/*
 ---> Running in c753d7c0f528
fetch http://dl-cdn.alpinelinux.org/alpine/v3.4/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.4/community/x86_64/APKINDEX.tar.gz
(1/3) Installing libssh2 (1.7.0-r0)
(2/3) Installing libcurl (7.55.0-r0)
(3/3) Installing curl (7.55.0-r0)
Executing busybox-1.24.2-r13.trigger
Executing glibc-bin-2.23-r3.trigger
OK: 22 MiB in 24 packages
 ---> 0a22e87b2565
Removing intermediate container c753d7c0f528
Step 5/10 : RUN apk add --no-cache alpine-sdk git python-dev py-pip py-cffi krb5
 ---> Running in 8e5adc881340
fetch http://dl-cdn.alpinelinux.org/alpine/v3.4/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.4/community/x86_64/APKINDEX.tar.gz
(1/66) Upgrading musl (1.1.14-r14 -> 1.1.14-r15)
(2/66) Installing fakeroot (1.20.2-r3)
(3/66) Installing sudo (1.8.16-r0)
(4/66) Installing libcap (2.25-r0)
(5/66) Installing pax-utils (1.1.6-r0)
(6/66) Installing openssl (1.0.2k-r0)
(7/66) Upgrading musl-utils (1.1.14-r14 -> 1.1.14-r15)
(8/66) Installing libattr (2.4.47-r4)
(9/66) Installing attr (2.4.47-r4)
(10/66) Installing tar (1.29-r1)
(11/66) Installing pkgconf (0.9.12-r0)
(12/66) Installing patch (2.7.5-r1)
(13/66) Installing abuild (2.27.1-r1)
Executing abuild-2.27.1-r1.pre-install
(14/66) Installing binutils-libs (2.26-r1)
(15/66) Installing binutils (2.26-r1)
(16/66) Installing gmp (6.1.0-r0)
(17/66) Installing isl (0.14.1-r0)
(18/66) Installing libgomp (5.3.0-r0)
(19/66) Installing libatomic (5.3.0-r0)
(20/66) Installing pkgconfig (0.25-r1)
(21/66) Installing mpfr3 (3.1.2-r0)
(22/66) Installing mpc1 (1.0.3-r0)
(23/66) Installing gcc (5.3.0-r0)
(24/66) Installing make (4.1-r1)
(25/66) Installing musl-dev (1.1.14-r15)
(26/66) Installing libc-dev (0.7-r0)
(27/66) Installing fortify-headers (0.8-r0)
(28/66) Installing g++ (5.3.0-r0)
(29/66) Installing build-base (0.4-r1)
(30/66) Installing expat (2.2.0-r1)
(31/66) Installing pcre (8.38-r1)
(32/66) Installing git (2.8.6-r0)
(33/66) Installing xz-libs (5.2.2-r1)
(34/66) Installing lzo (2.09-r1)
(35/66) Installing squashfs-tools (4.3-r2)
(36/66) Installing libmagic (5.27-r0)
(37/66) Installing file (5.27-r0)
(38/66) Installing bzip2 (1.0.6-r5)
(39/66) Installing libbz2 (1.0.6-r5)
(40/66) Installing cdrkit (1.1.11-r2)
(41/66) Installing acct (6.6.2-r0)
(42/66) Installing lddtree (1.25-r2)
(43/66) Installing libuuid (2.28-r3)
(44/66) Installing libblkid (2.28-r3)
(45/66) Installing device-mapper (2.02.154-r0)
(46/66) Installing cryptsetup-libs (1.7.1-r0)
(47/66) Installing kmod (22-r0)
(48/66) Installing mkinitfs (3.0.5-r1)
Executing mkinitfs-3.0.5-r1.post-install
(49/66) Installing mtools (4.0.18-r1)
(50/66) Installing alpine-sdk (0.4-r3)
(51/66) Installing krb5-conf (1.0-r1)
(52/66) Installing libcom_err (1.43-r0)
(53/66) Installing keyutils-libs (1.5.9-r1)
(54/66) Installing libverto (0.2.5-r0)
(55/66) Installing krb5-libs (1.14.3-r0)
(56/66) Installing e2fsprogs-libs (1.43-r0)
(57/66) Installing krb5 (1.14.3-r0)
(58/66) Installing libffi (3.2.1-r2)
(59/66) Installing gdbm (1.11-r1)
(60/66) Installing sqlite-libs (3.13.0-r1)
(61/66) Installing python (2.7.12-r0)
(62/66) Installing py-cparser (2.10-r0)
(63/66) Installing py-cffi (1.4.2-r0)
(64/66) Installing py-setuptools (20.8.0-r0)
(65/66) Installing py-pip (8.1.2-r0)
(66/66) Installing python-dev (2.7.12-r0)
Executing busybox-1.24.2-r13.trigger
Executing ca-certificates-20161130-r0.trigger
Executing glibc-bin-2.23-r3.trigger
OK: 256 MiB in 88 packages
 ---> cbbe21bf6986
Removing intermediate container 8e5adc881340
Step 6/10 : RUN sed -i -e 's/v3\.4/edge/g' /etc/apk/repositories     && apk upgrade --update-cache --available     && apk add --no-cache librdkafka
 ---> Running in 5154b766325f
fetch http://dl-cdn.alpinelinux.org/alpine/edge/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
Upgrading critical system libraries and apk-tools:
(1/3) Installing libressl2.5-libcrypto (2.5.5-r3)
(2/3) Installing libressl2.5-libssl (2.5.5-r3)
(3/3) Upgrading apk-tools (2.6.8-r1 -> 2.7.2-r0)
Executing busybox-1.24.2-r13.trigger
Executing ca-certificates-20161130-r0.trigger
Executing glibc-bin-2.23-r3.trigger
Continuing the upgrade transaction with new apk-tools:
fetch http://dl-cdn.alpinelinux.org/alpine/edge/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
(1/100) Upgrading musl (1.1.14-r15 -> 1.1.16-r20)
(2/100) Upgrading busybox (1.24.2-r13 -> 1.27.1-r0)
Executing busybox-1.27.1-r0.post-upgrade
NOTE: /usr/bin/telnet has been moved to the package 'busybox-extras'
NOTE: /usr/sbin/httpd has been moved to the package 'busybox-extras'
NOTE: /usr/bin/ftpget has been moved to the package 'busybox-extras'
NOTE: /usr/bin/ftpput has been moved to the package 'busybox-extras'
NOTE: /usr/sbin/ftpd has been moved to the package 'busybox-extras'
NOTE: /usr/bin/tftp has been moved to the package 'busybox-extras'
NOTE: /usr/sbin/fakeidentd has been moved to the package 'busybox-extras'
NOTE: /usr/sbin/dnsd has been moved to the package 'busybox-extras'
NOTE: /usr/sbin/inetd has been moved to the package 'busybox-extras'
(3/100) Upgrading alpine-baselayout (3.0.3-r0 -> 3.0.5-r0)
Executing alpine-baselayout-3.0.5-r0.pre-upgrade
Executing alpine-baselayout-3.0.5-r0.post-upgrade
(4/100) Upgrading alpine-keys (1.1-r0 -> 2.1-r1)
(5/100) Upgrading fakeroot (1.20.2-r3 -> 1.21-r1)
(6/100) Upgrading zlib (1.2.11-r0 -> 1.2.11-r1)
(7/100) Upgrading sudo (1.8.16-r0 -> 1.8.21_p2-r0)
(8/100) Upgrading scanelf (1.1.6-r0 -> 1.2.2-r1)
(9/100) Upgrading libcap (2.25-r0 -> 2.25-r1)
(10/100) Upgrading pax-utils (1.1.6-r0 -> 1.2.2-r1)
(11/100) Installing libressl2.5-libtls (2.5.5-r3)
(12/100) Installing libressl (2.5.5-r3)
(13/100) Upgrading musl-utils (1.1.14-r15 -> 1.1.16-r20)
(14/100) Upgrading libc-utils (0.7-r0 -> 0.7.1-r0)
(15/100) Upgrading libattr (2.4.47-r4 -> 2.4.47-r6)
(16/100) Upgrading attr (2.4.47-r4 -> 2.4.47-r6)
(17/100) Replacing tar (1.29-r1 -> 1.29-r1)
(18/100) Upgrading pkgconf (0.9.12-r0 -> 1.3.9-r0)
(19/100) Replacing patch (2.7.5-r1 -> 2.7.5-r1)
(20/100) Upgrading libgcc (5.3.0-r0 -> 6.4.0-r5)
(21/100) Upgrading libstdc++ (5.3.0-r0 -> 6.4.0-r5)
(22/100) Installing lzip (1.19-r1)
(23/100) Upgrading ca-certificates (20161130-r0 -> 20170801-r0)
(24/100) Upgrading libssh2 (1.7.0-r0 -> 1.8.0-r1)
(25/100) Upgrading libcurl (7.55.0-r0 -> 7.56.0-r0)
(26/100) Upgrading curl (7.55.0-r0 -> 7.56.0-r0)
(27/100) Upgrading abuild (2.27.1-r1 -> 3.0.2-r0)
Executing abuild-3.0.2-r0.pre-upgrade
(28/100) Purging openssl (1.0.2k-r0)
(29/100) Upgrading binutils-libs (2.26-r1 -> 2.28-r2)
(30/100) Upgrading binutils (2.26-r1 -> 2.28-r2)
(31/100) Upgrading gmp (6.1.0-r0 -> 6.1.2-r1)
(32/100) Upgrading isl (0.14.1-r0 -> 0.18-r0)
(33/100) Upgrading libgomp (5.3.0-r0 -> 6.4.0-r5)
(34/100) Upgrading libatomic (5.3.0-r0 -> 6.4.0-r5)
(35/100) Upgrading mpfr3 (3.1.2-r0 -> 3.1.5-r1)
(36/100) Upgrading mpc1 (1.0.3-r0 -> 1.0.3-r1)
(37/100) Upgrading gcc (5.3.0-r0 -> 6.4.0-r5)
(38/100) Upgrading musl-dev (1.1.14-r15 -> 1.1.16-r20)
(39/100) Upgrading libc-dev (0.7-r0 -> 0.7.1-r0)
(40/100) Upgrading g++ (5.3.0-r0 -> 6.4.0-r5)
(41/100) Upgrading make (4.1-r1 -> 4.2.1-r0)
(42/100) Upgrading fortify-headers (0.8-r0 -> 0.9-r0)
(43/100) Upgrading build-base (0.4-r1 -> 0.5-r0)
(44/100) Upgrading expat (2.2.0-r1 -> 2.2.4-r0)
(45/100) Installing pcre2 (10.30-r0)
(46/100) Upgrading git (2.8.6-r0 -> 2.14.2-r0)
(47/100) Upgrading xz-libs (5.2.2-r1 -> 5.2.3-r1)
(48/100) Upgrading lzo (2.09-r1 -> 2.10-r2)
(49/100) Upgrading squashfs-tools (4.3-r2 -> 4.3-r3)
(50/100) Installing libburn (1.4.8-r0)
(51/100) Upgrading ncurses-terminfo-base (6.0-r7 -> 6.0_p20170930-r0)
(52/100) Upgrading ncurses-terminfo (6.0-r7 -> 6.0_p20170930-r0)
(53/100) Upgrading ncurses-libs (6.0-r7 -> 6.0_p20170930-r0)
(54/100) Installing libedit (20170329.3.1-r3)
(55/100) Installing libacl (2.2.52-r3)
(56/100) Installing libisofs (1.4.6-r0)
(57/100) Installing libisoburn (1.4.6-r0)
(58/100) Installing xorriso (1.4.6-r0)
(59/100) Upgrading acct (6.6.2-r0 -> 6.6.4-r0)
(60/100) Upgrading lddtree (1.25-r2 -> 1.26-r1)
(61/100) Upgrading libuuid (2.28-r3 -> 2.30.2-r0)
(62/100) Upgrading libblkid (2.28-r3 -> 2.30.2-r0)
(63/100) Installing device-mapper-libs (2.02.173-r2)
(64/100) Upgrading cryptsetup-libs (1.7.1-r0 -> 1.7.5-r0)
(65/100) Upgrading kmod (22-r0 -> 24-r0)
(66/100) Upgrading mkinitfs (3.0.5-r1 -> 3.1.0-r3)
Executing mkinitfs-3.1.0-r3.pre-upgrade
Executing mkinitfs-3.1.0-r3.post-upgrade
(67/100) Upgrading mtools (4.0.18-r1 -> 4.0.18-r2)
(68/100) Upgrading alpine-sdk (0.4-r3 -> 0.5-r0)
(69/100) Purging cdrkit (1.1.11-r2)
(70/100) Purging file (5.27-r0)
(71/100) Purging bzip2 (1.0.6-r5)
(72/100) Upgrading readline (6.3.008-r4 -> 7.0.003-r0)
(73/100) Upgrading bash (4.3.42-r5 -> 4.3.48-r2)
Executing bash-4.3.48-r2.post-upgrade
(74/100) Replacing krb5-conf (1.0-r1 -> 1.0-r1)
(75/100) Upgrading libcom_err (1.43-r0 -> 1.43.6-r0)
(76/100) Upgrading keyutils-libs (1.5.9-r1 -> 1.5.10-r0)
(77/100) Upgrading libverto (0.2.5-r0 -> 0.3.0-r0)
(78/100) Upgrading krb5-libs (1.14.3-r0 -> 1.15.2-r0)
(79/100) Upgrading e2fsprogs-libs (1.43-r0 -> 1.43.6-r0)
(80/100) Upgrading krb5 (1.14.3-r0 -> 1.15.2-r0)
(81/100) Upgrading py-cffi (1.4.2-r0 -> 1.10.0-r0)
(82/100) Purging py-cparser (2.10-r0)
(83/100) Purging py-pip (8.1.2-r0)
(84/100) Upgrading libbz2 (1.0.6-r5 -> 1.0.6-r6)
(85/100) Upgrading libffi (3.2.1-r2 -> 3.2.1-r3)
(86/100) Upgrading gdbm (1.11-r1 -> 1.13-r1)
(87/100) Upgrading sqlite-libs (3.13.0-r1 -> 3.20.1-r0)
(88/100) Installing python2 (2.7.14-r0)
(89/100) Installing py2-cparser (2.18-r0)
(90/100) Installing py2-cffi (1.10.0-r0)
(91/100) Upgrading py-setuptools (20.8.0-r0 -> 33.1.1-r1)
(92/100) Installing py2-pip (9.0.1-r1)
(93/100) Purging python-dev (2.7.12-r0)
(94/100) Installing python2-dev (2.7.14-r0)
(95/100) Purging python (2.7.12-r0)
(96/100) Purging libssl1.0 (1.0.2k-r0)
(97/100) Purging libcrypto1.0 (1.0.2k-r0)
(98/100) Purging pcre (8.38-r1)
(99/100) Purging libmagic (5.27-r0)
(100/100) Purging device-mapper (2.02.154-r0)
Executing busybox-1.27.1-r0.trigger
Executing ca-certificates-20170801-r0.trigger
Executing glibc-bin-2.23-r3.trigger
OK: 258 MiB in 93 packages
fetch http://dl-cdn.alpinelinux.org/alpine/edge/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
(1/1) Installing librdkafka (0.11.0-r0)
Executing glibc-bin-2.23-r3.trigger
OK: 259 MiB in 94 packages
Executing busybox-1.27.1-r0.trigger
Executing ca-certificates-20170801-r0.trigger
Executing glibc-bin-2.23-r3.trigger
OK: 258 MiB in 93 packages
fetch http://dl-cdn.alpinelinux.org/alpine/edge/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
(1/1) Installing librdkafka (0.11.0-r0)
Executing glibc-bin-2.23-r3.trigger
OK: 259 MiB in 94 packages
 ---> 491a56ce6be9
Removing intermediate container 5154b766325f
Step 7/10 : RUN cd /sw && python -V     && pip install --upgrade pip     && pip install virtualenv     && virtualenv my_venv     && source ./my_venv/bin/activate     && umask 022     && pip install confluent-kafka
 ---> Running in f82eb85c52b8
Python 2.7.14
Requirement already up-to-date: pip in /usr/lib/python2.7/site-packages
Collecting virtualenv
  Downloading virtualenv-15.1.0-py2.py3-none-any.whl (1.8MB)
Installing collected packages: virtualenv
Successfully installed virtualenv-15.1.0
New python executable in /sw/my_venv/bin/python2
Also creating executable in /sw/my_venv/bin/python
Installing setuptools, pip, wheel...done.
Collecting confluent-kafka
  Downloading confluent-kafka-0.11.0.tar.gz (42kB)
Building wheels for collected packages: confluent-kafka
  Running setup.py bdist_wheel for confluent-kafka: started
  Running setup.py bdist_wheel for confluent-kafka: finished with status 'error'
  Complete output from command /sw/my_venv/bin/python2 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-mpBKd8/confluent-kafka/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /tmp/tmpCa5S0Ypip-wheel- --python-tag cp27:
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-2.7
  creating build/lib.linux-x86_64-2.7/confluent_kafka
  copying confluent_kafka/__init__.py -> build/lib.linux-x86_64-2.7/confluent_kafka
  creating build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
  copying confluent_kafka/kafkatest/verifiable_producer.py -> build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
  copying confluent_kafka/kafkatest/verifiable_client.py -> build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
  copying confluent_kafka/kafkatest/verifiable_consumer.py -> build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
  copying confluent_kafka/kafkatest/__init__.py -> build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
  creating build/lib.linux-x86_64-2.7/confluent_kafka/avro
  copying confluent_kafka/avro/error.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro
  copying confluent_kafka/avro/load.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro
  copying confluent_kafka/avro/cached_schema_registry_client.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro
  copying confluent_kafka/avro/__init__.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro
  creating build/lib.linux-x86_64-2.7/confluent_kafka/avro/serializer
  copying confluent_kafka/avro/serializer/message_serializer.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro/serializer
  copying confluent_kafka/avro/serializer/__init__.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro/serializer
  running build_ext
  building 'confluent_kafka.cimpl' extension
  creating build/temp.linux-x86_64-2.7
  creating build/temp.linux-x86_64-2.7/confluent_kafka
  creating build/temp.linux-x86_64-2.7/confluent_kafka/src
  gcc -fno-strict-aliasing -Os -fomit-frame-pointer -g -DNDEBUG -Os -fomit-frame-pointer -g -fPIC -I/usr/include/python2.7 -c confluent_kafka/src/confluent_kafka.c -o build/temp.linux-x86_64-2.7/confluent_kafka/src/confluent_kafka.o
  In file included from confluent_kafka/src/confluent_kafka.c:17:0:
  confluent_kafka/src/confluent_kafka.h:21:32: fatal error: librdkafka/rdkafka.h: No such file or directory
   #include <librdkafka/rdkafka.h>
                                  ^
  compilation terminated.
  error: command 'gcc' failed with exit status 1

  ----------------------------------------
  Failed building wheel for confluent-kafka
  Running setup.py clean for confluent-kafka
Failed to build confluent-kafka
Installing collected packages: confluent-kafka
  Running setup.py install for confluent-kafka: started
    Running setup.py install for confluent-kafka: finished with status 'error'
    Complete output from command /sw/my_venv/bin/python2 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-mpBKd8/confluent-kafka/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-4Ofl82-record/install-record.txt --single-version-externally-managed --compile --install-headers /sw/my_venv/include/site/python2.7/confluent-kafka:
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-2.7
    creating build/lib.linux-x86_64-2.7/confluent_kafka
    copying confluent_kafka/__init__.py -> build/lib.linux-x86_64-2.7/confluent_kafka
    creating build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
    copying confluent_kafka/kafkatest/verifiable_producer.py -> build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
    copying confluent_kafka/kafkatest/verifiable_client.py -> build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
    copying confluent_kafka/kafkatest/verifiable_consumer.py -> build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
    copying confluent_kafka/kafkatest/__init__.py -> build/lib.linux-x86_64-2.7/confluent_kafka/kafkatest
    creating build/lib.linux-x86_64-2.7/confluent_kafka/avro
    copying confluent_kafka/avro/error.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro
    copying confluent_kafka/avro/load.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro
    copying confluent_kafka/avro/cached_schema_registry_client.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro
    copying confluent_kafka/avro/__init__.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro
    creating build/lib.linux-x86_64-2.7/confluent_kafka/avro/serializer
    copying confluent_kafka/avro/serializer/message_serializer.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro/serializer
    copying confluent_kafka/avro/serializer/__init__.py -> build/lib.linux-x86_64-2.7/confluent_kafka/avro/serializer
    running build_ext
    building 'confluent_kafka.cimpl' extension
    creating build/temp.linux-x86_64-2.7
    creating build/temp.linux-x86_64-2.7/confluent_kafka
    creating build/temp.linux-x86_64-2.7/confluent_kafka/src
    gcc -fno-strict-aliasing -Os -fomit-frame-pointer -g -DNDEBUG -Os -fomit-frame-pointer -g -fPIC -I/usr/include/python2.7 -c confluent_kafka/src/confluent_kafka.c -o build/temp.linux-x86_64-2.7/confluent_kafka/src/confluent_kafka.o
    In file included from confluent_kafka/src/confluent_kafka.c:17:0:
    confluent_kafka/src/confluent_kafka.h:21:32: fatal error: librdkafka/rdkafka.h: No such file or directory
     #include <librdkafka/rdkafka.h>
                                    ^
    compilation terminated.
    error: command 'gcc' failed with exit status 1

    ----------------------------------------
Command "/sw/my_venv/bin/python2 -u -c "import setuptools, tokenize;__file__='/tmp/pip-build-mpBKd8/confluent-kafka/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-4Ofl82-record/install-record.txt --single-version-externally-managed --compile --install-headers /sw/my_venv/include/site/python2.7/confluent-kafka" failed with error code 1 in /tmp/pip-build-mpBKd8/confluent-kafka/
The command '/bin/sh -c cd /sw && python -V     && pip install --upgrade pip     && pip install virtualenv     && virtualenv my_venv     && source ./my_venv/bin/activate     && umask 022     && pip install confluent-kafka' returned a non-zero code: 1

Checklist

Please provide the following information:

  • confluent-kafka-python and librdkafka version (confluent_kafka.version() and confluent_kafka.libversion()):
  • Apache Kafka broker version:
  • Client configuration: {...}
  • Operating system: Alpine
  • Provide client logs (with 'debug': '..' as necessary)
  • Provide broker log excerpts
  • Critical issue
@edenhill
Copy link
Contributor

edenhill commented Oct 6, 2017

&& apk add --no-cache librdkafka

You need to install the librdkafka-dev package too

@ulkas
Copy link

ulkas commented Mar 30, 2021

solution within docker: #184 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@edenhill @ulkas @mpham173