Skip to content

Conversation

@pwendell
Copy link
Contributor

This test needs to be fixed. It currently depends on Thread.sleep() having exact-timing
semantics, which is not a valid assumption.

@rxin
Copy link
Contributor

rxin commented Mar 31, 2014

How about just making sure it has a lower bound of 4?

@AmplabJenkins
Copy link

Merged build triggered. Build is starting -or- tests failed to complete.

@AmplabJenkins
Copy link

Merged build started. Build is starting -or- tests failed to complete.

@pwendell
Copy link
Contributor Author

@rxin didn't know whether that was what @tdas would want... we should probably try to upper bound the test some-how because this is a test of rate limiting.

@rxin
Copy link
Contributor

rxin commented Mar 31, 2014

rate limiting was about setting an upper bound in throughput, and thus lower bound in time.

@AmplabJenkins
Copy link

Merged build finished. Build is starting -or- tests failed to complete.

@AmplabJenkins
Copy link

Build is starting -or- tests failed to complete.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13598/

@pwendell
Copy link
Contributor Author

@rxin true, but that's like saying an eventual consistency implementation that never converges is okay. I.e. we want to test that it isn't just a no-op stream that never passes data through.

@pwendell
Copy link
Contributor Author

@rxin I'll just add a conservative upper bound also to make sure it does eventually get through.

@pwendell pwendell changed the title SPARK-1365 [HOTFIX] Disable RateLimitedOutputStream test SPARK-1365 [HOTFIX] Fix RateLimitedOutputStream test Mar 31, 2014
This test needs to be fixed. It currently depends on Thread.sleep() having exact-timing
semantics, which is not a valid assumption.
@AmplabJenkins
Copy link

Merged build triggered. Build is starting -or- tests failed to complete.

@AmplabJenkins
Copy link

Merged build started. Build is starting -or- tests failed to complete.

@AmplabJenkins
Copy link

Merged build finished. All automated tests passed.

@AmplabJenkins
Copy link

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13602/

@asfgit asfgit closed this in 33b3c2a Mar 31, 2014
pdeyhim pushed a commit to pdeyhim/spark-1 that referenced this pull request Jun 25, 2014
This test needs to be fixed. It currently depends on Thread.sleep() having exact-timing
semantics, which is not a valid assumption.

Author: Patrick Wendell <[email protected]>

Closes apache#277 from pwendell/rate-limited-stream and squashes the following commits:

6c0ff81 [Patrick Wendell] SPARK-1365: Fix RateLimitedOutputStream test
Igosuki pushed a commit to Adikteev/spark that referenced this pull request Jul 31, 2018
bzhaoopenstack pushed a commit to bzhaoopenstack/spark that referenced this pull request Sep 11, 2019
arjunshroff pushed a commit to arjunshroff/spark that referenced this pull request Nov 24, 2020
* MapR [SPARK-226] Spark - pySpark Security Vulnerability
turboFei pushed a commit to turboFei/spark that referenced this pull request Nov 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants