Release parquet 1.11.1

[asfimport]

Some issues are discovered during the migration to the parquet-mr release 1.11.0 in Spark. These issues are to be fixed and release in the minor release 1.11.1.

Reporter: Gabor Szadovszky / @gszadovszky
Assignee: Gabor Szadovszky / @gszadovszky

Related issues:

• Make ParquetFileReader.getFilteredRecordCount public (is blocked by)
• Some filters throws ArrayIndexOutOfBoundsException (is blocked by)
• No result for partition key included in Parquet file (is blocked by)
• Changed the data order after DataFrame reuse (is blocked by)
• Invalid filteredRowCount in InternalParquetRecordReader (is blocked by)
• Minimize the parquet-avro fastutil shaded jar (is blocked by)

_{Note: This issue was originally created as PARQUET-1774. Please see the migration documentation for further details.}

[asfimport]

Dongjoon Hyun / @dongjoon-hyun:
@gszadovszky. Could you add is blocked by links to those required issues?

[asfimport]

H. Vetinari:
@gszadovszky @dongjoon-hyun
All blockers of the release of 1.11.1 seem to have been finished (PARQUET-1739 hasn't been closed yet, but all subtasks seem to have been completed) - anything else that stands in the way of a release?

[asfimport]

Gabor Szadovszky / @gszadovszky:
Waiting for Spark to confirm that 1.11.1-SNAPSHOT works properly.

[asfimport]

Matthew McMahon / @maccamlc:
Hi

Is 1.11.1 something that might be released soon?

I just came across quite a big issue when using 1.11.0 (when using Map type) and reported as PARQUET-1879

I have also put together a PR if someone can review, as imo it would be great if its possible to include in the next release.

Regards
Matt

[asfimport]

Gabor Szadovszky / @gszadovszky:
Hi @maccamlc,

Originally 1.11.1 was planned for Spark integration. As this effort seems to be blocked (because of Avro update) it seems fair to postpone the potential Spark related issues to 1.11.2 (or even 1.12) and release 1.11.1 with the current fixes and PARQUET-1879 in addition. But let's fix that issue first. :)

Cheers,
Gabor

[asfimport]

Matthew McMahon / @maccamlc:
Thanks @gszadovszky, sounds good to me :)

[asfimport]

Gabor Szadovszky / @gszadovszky:
Missed to close this one after the release. Now, it is done.