Skip to content

[BUG] [SPARK-38237][SQL] ClusteredDistribution clustering keys break build with wrong arguments #4879

@amahussein

Description

@amahussein

[SPARK-38237] Allow ClusteredDistribution to require full clustering keys](apache/spark#35574) changes break RAPIDS build with the following error:

[INFO] Compiling 255 Scala sources and 29 Java sources to sql-plugin/target/spark330/classes ...
[ERROR] [Error] sql-plugin/src/main/330+/scala/com/nvidia/spark/rapids/shims/v2/GpuHashPartitioning.scala:30: wrong number of arguments for pattern org.apache.spark.sql.catalyst.plans.physical.ClusteredDistribution(clustering: Seq[org.apache.spark.sql.catalyst.expressions.Expression],requireAllClusterKeys: Boolean,requiredNumPartitions: Option[Int])
[ERROR] [Error] sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuRangePartitioning.scala:68: wrong number of arguments for pattern org.apache.spark.sql.catalyst.plans.physical.ClusteredDistribution(clustering: Seq[org.apache.spark.sql.catalyst.expressions.Expression],requireAllClusterKeys: Boolean,requiredNumPartitions: Option[Int])
[ERROR] two errors found

Metadata

Metadata

Assignees

Labels

P0Must have for releasebugSomething isn't workingbuildRelated to CI / CD or cleanly buildingspark 3.3+

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions