-
Notifications
You must be signed in to change notification settings - Fork 486
Frontend peek sequencing -- emit_optimizer_notices also for COPY TO S3
#34290
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Frontend peek sequencing -- emit_optimizer_notices also for COPY TO S3
#34290
Conversation
emit_optimizer_notices also for COPY TOemit_optimizer_notices also for COPY TO S3
aljoscha
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looking good! that is the last two commits of this one.
| global_lir_plan, | ||
| source_ids, | ||
| } => { | ||
| let (df_desc, df_meta) = global_lir_plan.unapply(); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
might have to be _df_meta?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is used in the next commit: passed in to emit_optimizer_notices.
| /// # Panics | ||
| /// | ||
| /// Panics if the dataflow has no sink exports. | ||
| pub fn sink_id(&self) -> GlobalId { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
maybe this also wants to panic when there are more than one sink? but I'm not familiar enough with this code
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think so, yes. I've now made it enforce that we have exactly one sink.
3f278af to
e679ba8
Compare
(This is on top of both #34283 and #34289. Only the last 2 commits are new.)
This does some refactoring and fixes a minor issue in 2 commits:
Command::ExecuteCopyToto take aDataflowDescriptioninstead ofGlobalLirPlan. (Plus some minor code movement.)emit_optimizer_noticesforCOPY TO.Sorry, I didn't add a test for this. Testing of
COPY TOand notices are hard enough by themselves (COPY TOneeds Testdrive, notices need pgtest), testing the two together seems impossibly hard.