Skip to content

Possible data corruption in "Skipping partial aggregation" change #11850

@andygrove

Description

@andygrove

Describe the bug

When we upgrade DataFusion Comet to use a version of DataFusion that inclues #11627, we see incorrect results for an aggregation in TPC-DS q97.

- q97 *** FAILED *** (11 seconds, 703 milliseconds)
  java.lang.Exception: Expected "53[7833        285408] 200", but got "53[8024  285422] 200" Result did not match

To Reproduce

Start with apache/datafusion-comet#783 and then upgrade DataFusion to include #11627. I do not have a repro for DataFusion yet.

Expected behavior

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions