Skip to content

Conversation

mbrobbel
Copy link
Member

Which issue does this PR close?

Rationale for this change

Splitting up #8227.

What changes are included in this PR?

Migrate parquet to Rust 2024

Are these changes tested?

CI

Are there any user-facing changes?

Yes

@mbrobbel mbrobbel added this to the 57.0.0 milestone Sep 30, 2025
@github-actions github-actions bot added the parquet Changes to the parquet crate label Sep 30, 2025
@alamb
Copy link
Contributor

alamb commented Sep 30, 2025

I would like to request we hold off on this crate until we land the in flight work from @etseidl and myself

  • thrift remodel
  • parquet push decoder

I am hoping we'll be ready by the end of this week (though that may be a bit ambitious)

@mbrobbel mbrobbel marked this pull request as draft September 30, 2025 10:26
@mbrobbel mbrobbel marked this pull request as ready for review October 8, 2025 17:32
@mbrobbel mbrobbel merged commit 02fa779 into apache:main Oct 9, 2025
17 checks passed
@mbrobbel
Copy link
Member Author

mbrobbel commented Oct 9, 2025

Thanks @etseidl and @alamb

@mbrobbel mbrobbel deleted the parquet-2024 branch October 9, 2025 09:58
@alamb
Copy link
Contributor

alamb commented Oct 9, 2025

Nice! I was worried this was going to cause me trouble with my push decoder PR, but it was fairly easy to resolve:

@mbrobbel
Copy link
Member Author

Nice! I was worried this was going to cause me trouble with my push decoder PR, but it was fairly easy to resolve:

* [Implement Push Parquet Decoder #7997](https://github.com/apache/arrow-rs/pull/7997)

Oh sorry about that, I missed that PR. I don't know why, but I thought that the pushdown decoder work was merged 😕

@alamb
Copy link
Contributor

alamb commented Oct 10, 2025

Oh sorry about that, I missed that PR. I don't know why, but I thought that the pushdown decoder work was merged 😕

We merged the Push decoder for Metadata (but not yet the actual parquet data decoder). I hope to mark that PR ready for review soon (it is basically ready, I just am trying to make it a more reasonable review)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

parquet Changes to the parquet crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants