Skip to content

Conversation

@m09526
Copy link
Member

@m09526 m09526 commented Sep 19, 2025

Make sure you have checked all steps below.

Issue

Tests

  • My PR adds the following tests based on our test strategy OR does not need testing for this extremely good reason:
    • rust/sleeper_core/src/datafusion/cast_udf.rs
    • rust/sleeper_core/tests/compaction_test.rs - integration test

Documentation

  • In case of new functionality, my PR adds documentation that describes how to use it, or I have linked to a
    separate issue for that below.
  • If I have added new Java code, I have added Javadoc that explains it following our conventions and style.
  • If I have added or removed any dependencies from the project, I have updated the NOTICES file.

@m09526 m09526 added the rust Pull requests that update Rust code label Sep 19, 2025
@m09526 m09526 linked an issue Sep 19, 2025 that may be closed by this pull request
Base automatically changed from 5409-write-java-side-df-query-code to develop October 14, 2025 12:27
@patchwork01 patchwork01 removed the pr-stacked-middle A stacked pull request that must wait until the target PR is merged, and is also a base for stacking label Oct 15, 2025
@m09526 m09526 marked this pull request as draft October 15, 2025 10:23
@m09526 m09526 marked this pull request as ready for review October 23, 2025 10:50
@rtjd6554 rtjd6554 added the needs-reviewer Pull requests that need a reviewer to be assigned label Oct 24, 2025

impl PartialEq for NonNullable {
fn eq(&self, other: &Self) -> bool {
Arc::ptr_eq(&self.inner, &other.inner) && self.func_name == other.func_name
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like equal NonNullables won't always point to the same inner implementation. In the AggregateUDFImpl implementation there's a simplify method that clones the inner function.

What is the implication of this? Why does it need a PartialEq or Eq implementation?

Is it worth adding a comment to explain this if it's needed?


/// A UDF for performing primitive casting, but without producing errors if a narrowing conversion
/// would be outside the target type's range. Casts are performed in the "standard" way, i.e. truncating
/// upper bits on a narrowing conversion.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please can we explain why this is necessary in the comment? We could link to the original issue.

"| 6 | 66 |",
"+------+------+",
];
assert_batches_neq!(expected, &frame.collect().await?);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we assert what actually comes back here? We could explain what's wrong with it in a comment?

@patchwork01 patchwork01 removed the needs-reviewer Pull requests that need a reviewer to be assigned label Oct 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

rust Pull requests that update Rust code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Upgrade DataFusion to 50 Sum aggregation in DataFusion changes the type of integer fields

3 participants