PARQUET-1601: Add zstd support to parquet-cli to-avro

[sekikn]

Make sure you have checked all steps below.

Jira

• My PR addresses the following Parquet Jira issues and references them in the PR title. For example, "PARQUET-1234: My Parquet PR"
  • https://issues.apache.org/jira/browse/PARQUET-1601
  • In case you are adding a dependency, check if the license complies with the ASF 3rd Party License Policy.

Tests

• My PR adds the following unit tests OR does not need testing for this extremely good reason:

  • testToAvroCommandWithGzipCompression
  • testToAvroCommandWithSnappyCompression
  • testToAvroCommandWithZstdCompression
  • testToAvroCommandWithInvalidCompression

In addition, I confirmed an output file generated by to-avro was properly compressed by zstd as follows:

$ java -cp 'target/dependency/*:target/*' org.apache.parquet.cli.Main to-avro sample.parquet -o sample.avro --compression-codec zstd
$ java -jar ~/avro-tools-1.9.0.jar getmeta sample.avro 

(snip)

avro.codec	zstandard

Commits

• My commits all reference Jira issues in their subject lines. In addition, my commits follow the guidelines from "How to write a good git commit message":
  1. Subject is separated from body by a blank line
  2. Subject is limited to 50 characters (not including Jira issue reference)
  3. Subject does not end with a period
  4. Subject uses the imperative mood ("add", not "adding")
  5. Body wraps at 72 characters
  6. Body explains "what" and "why", not "how"

Documentation

• In case of new functionality, my PR adds documentation that describes how to use it.
  • All the public functions and the classes in the PR contain Javadoc that explain what it does

[Fokko]

One minor comment, apart from that: LGTM

[Fokko]

Maybe set this to 1.4.0-1 right away.

[sekikn]

Thanks for the comment @Fokko! Avro 1.9.0 seems to depend on zstd-jni 1.3.8-6, so I reconciled them. Should I update it?

[Fokko]

Good point, maybe leave it as is for now to avoid conflicts

[Fokko]

apache/avro#549

[sekikn]

Rebased on master and resolved conflicts.