-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-27280][SQL]infer more filter from join or condition #24228
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Is this SQL grammar supported by Hive or standard SQL? |
| } | ||
| } | ||
|
|
||
| /** |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this SQL grammar supported by Hive or standard SQL?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
hive can do this
|
Test build #104008 has finished for PR 24228 at commit
|
|
#24973 I want to do the same thing for partition puring |
|
I also think we need not a band-aid fix, but a general solution for this issue as @cloud-fan suggested in #24973. Have you checked the previous activity for the CNF normalization? https://issues.apache.org/jira/browse/SPARK-6624 |
thanks for Issue link. I will work on this in partition predicate part. |
|
We're closing this PR because it hasn't been updated in a while. If you'd like to revive this PR, please reopen it! |
What changes were proposed in this pull request?
current spark can handle this query to infer fitler from join condition:
but it can not handle following query:
How was this patch tested?
unit test added