Skip to content

Conversation

@yaooqinn
Copy link
Member

@yaooqinn yaooqinn commented Nov 6, 2023

What changes were proposed in this pull request?

Add spark.ui.threadDump.flamegraphEnabled config to switch flame graph on/off

Why are the changes needed?

UI stability

Does this PR introduce any user-facing change?

yes, new spark.ui.threadDump.flamegraphEnabled config

How was this patch tested?

locally tested

bin/spark-shell -c spark.ui.threadDump.flamegraphEnabled=true
image

bin/spark-shell -c spark.ui.threadDump.flamegraphEnabled=false

image

Was this patch authored or co-authored using generative AI tooling?

no

@yaooqinn
Copy link
Member Author

yaooqinn commented Nov 6, 2023

cc @cloud-fan from #42988 (comment)

.createWithDefault(true)

val UI_FLAMEGRAPH_ENABLED = ConfigBuilder("spark.ui.threadDump.flamegraphEnabled")
.doc("Whether to render the Flamegraph for executor thread dumps")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should describe this happens within UI ;-)?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you mean that we should add a short paragraph to describe the flame graph gone because users turned it off? I considered this, but it seems that we don't do such things for other UI elements or switches, i.e., timeline, heapdump.

@dongjoon-hyun
Copy link
Member

Merged to master.

@yaooqinn
Copy link
Member Author

yaooqinn commented Nov 7, 2023

Thank you, as always, @dongjoon-hyun and @HyukjinKwon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants