Skip to content

Conversation

@gengliangwang
Copy link
Member

What changes were proposed in this pull request?

After #28192, the job list page becomes very slow.
For example, after the following operation, the UI loading can take >40 sec.

(1 to 1000).foreach(_ => sc.parallelize(1 to 10).collect) 

This is caused by a performance issue of vis-timeline. The serious issue affects both branch-3.0 and branch-2.4

I tried a different version 4.21.0 from https://cdnjs.com/libraries/vis
The infinite drawing issue seems also fixed if the zoom is disabled as default.

Why are the changes needed?

Fix the serious perf issue in web UI by falling back vis-timeline-graph2d to an ealier version.

Does this PR introduce any user-facing change?

Yes, fix the UI perf regression

How was this patch tested?

Manual test

@gengliangwang
Copy link
Member Author

This PR backports #28806 to branch-3.0

@gengliangwang gengliangwang requested a review from sarutak June 12, 2020 08:45
@SparkQA
Copy link

SparkQA commented Jun 12, 2020

Test build #123909 has finished for PR 28811 at commit 00fc2e9.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@sarutak
Copy link
Member

sarutak commented Jun 12, 2020

retest this please.

@SparkQA
Copy link

SparkQA commented Jun 12, 2020

Test build #123924 has finished for PR 28811 at commit 00fc2e9.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gengliangwang gengliangwang changed the title [3.0][SPARK-31967][UI] UI Perf regression: Loading jobs UI page takes 40 seconds [SPARK-31967][UI][3.0] Downgrade to vis.js 4.21.0 to fix Jobs UI loading time regression Jun 13, 2020
@gengliangwang
Copy link
Member Author

merging to branch-3.0

@gengliangwang gengliangwang changed the title [SPARK-31967][UI][3.0] Downgrade to vis.js 4.21.0 to fix Jobs UI loading time regression [SPARK-31967][UI] Downgrade to vis.js 4.21.0 to fix Jobs UI loading time regression Jun 13, 2020
gengliangwang added a commit that referenced this pull request Jun 13, 2020
…ime regression

### What changes were proposed in this pull request?

After #28192, the job list page becomes very slow.
For example, after the following operation, the UI loading can take >40 sec.
```
(1 to 1000).foreach(_ => sc.parallelize(1 to 10).collect)
```

This is caused by a  [performance issue of `vis-timeline`](visjs/vis-timeline#379). The serious issue affects both branch-3.0 and branch-2.4

I tried a different version 4.21.0 from https://cdnjs.com/libraries/vis
The infinite drawing issue seems also fixed if the zoom is disabled as default.

### Why are the changes needed?

Fix the serious perf issue in web UI by falling back vis-timeline-graph2d to an ealier version.

### Does this PR introduce _any_ user-facing change?

Yes, fix the UI perf regression

### How was this patch tested?

Manual test

Closes #28811 from gengliangwang/downgrade-3.0.

Authored-by: Gengliang Wang <[email protected]>
Signed-off-by: Gengliang Wang <[email protected]>
holdenk pushed a commit to holdenk/spark that referenced this pull request Jun 25, 2020
…ime regression

### What changes were proposed in this pull request?

After apache#28192, the job list page becomes very slow.
For example, after the following operation, the UI loading can take >40 sec.
```
(1 to 1000).foreach(_ => sc.parallelize(1 to 10).collect)
```

This is caused by a  [performance issue of `vis-timeline`](visjs/vis-timeline#379). The serious issue affects both branch-3.0 and branch-2.4

I tried a different version 4.21.0 from https://cdnjs.com/libraries/vis
The infinite drawing issue seems also fixed if the zoom is disabled as default.

### Why are the changes needed?

Fix the serious perf issue in web UI by falling back vis-timeline-graph2d to an ealier version.

### Does this PR introduce _any_ user-facing change?

Yes, fix the UI perf regression

### How was this patch tested?

Manual test

Closes apache#28811 from gengliangwang/downgrade-3.0.

Authored-by: Gengliang Wang <[email protected]>
Signed-off-by: Gengliang Wang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants