We are currently adding zstd compression support to Spark and we are using ztsd-jni for that. We are facing Spark unit tests failure because the library is compiled with a newer glibc requirement than the amplab machines have. Can you tweak your compilation to support older Linux distros?
See apache/spark#18805 (comment) for more details.