data-science-onramp.data-ingestion.ingestion_test: test_setup failed

[flaky-bot]

Note: #8352 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.

---

commit: 07e8b81
buildURL: Build Status, Sponge
status: failed

Test output

Traceback (most recent call last):
  File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/grpc_helpers.py", line 72, in error_remapped_callable
    return callable_(*args, **kwargs)
  File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/grpc/_channel.py", line 946, in __call__
    return _end_unary_response_blocking(state, call, False, None)
  File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.UNAUTHENTICATED
	details = "Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project."
	debug_error_string = "UNKNOWN:Error received from peer ipv4:172.253.117.95:443 {created_time:"2022-11-30T11:29:10.307378194+00:00", grpc_status:16, grpc_message:"Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project."}"
>
The above exception was the direct cause of the following exception:
Traceback (most recent call last):

File "/workspace/data-science-onramp/data-ingestion/ingestion_test.py", line 89, in setup_and_teardown_cluster

operation.result()

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 132, in result

self._blocking_poll(timeout=timeout, **kwargs)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 110, in blocking_poll

retry(self._done_or_raise)(**kwargs)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py", line 288, in retry_wrapped_func

on_error=on_error,

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py", line 190, in retry_target

return target()

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 88, in _done_or_raise

if not self.done(**kwargs):

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/operation.py", line 170, in done

self._refresh_and_update(retry)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/operation.py", line 158, in _refresh_and_update

self._operation = self._refresh(retry=retry)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/operations_v1/operations_client.py", line 143, in get_operation

request, retry=retry, timeout=timeout, metadata=metadata

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/gapic_v1/method.py", line 154, in call

return wrapped_func(*args, **kwargs)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py", line 288, in retry_wrapped_func

on_error=on_error,

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py", line 190, in retry_target

return target()

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/timeout.py", line 210, in func_with_timeout

return func(*args, **kwargs)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/grpc_helpers.py", line 74, in error_remapped_callable

raise exceptions.from_grpc_error(exc) from exc

google.api_core.exceptions.Unauthenticated: 401 Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/grpc_helpers.py", line 72, in error_remapped_callable

return callable_(*args, **kwargs)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/grpc/_channel.py", line 946, in call

return _end_unary_response_blocking(state, call, False, None)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking

raise _InactiveRpcError(state)

grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:

status = StatusCode.UNAUTHENTICATED

details = "Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project."

debug_error_string = "UNKNOWN:Error received from peer ipv4:172.253.117.95:443 {created_time:"2022-11-30T11:29:10.642171378+00:00", grpc_status:16, grpc_message:"Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project."}"


The above exception was the direct cause of the following exception:
Traceback (most recent call last):

File "/workspace/data-science-onramp/data-ingestion/ingestion_test.py", line 100, in setup_and_teardown_cluster

operation.result()

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 132, in result

self._blocking_poll(timeout=timeout, **kwargs)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 110, in blocking_poll

retry(self._done_or_raise)(**kwargs)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py", line 288, in retry_wrapped_func

on_error=on_error,

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py", line 190, in retry_target

return target()

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/future/polling.py", line 88, in _done_or_raise

if not self.done(**kwargs):

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/operation.py", line 170, in done

self._refresh_and_update(retry)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/operation.py", line 158, in _refresh_and_update

self._operation = self._refresh(retry=retry)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/operations_v1/operations_client.py", line 143, in get_operation

request, retry=retry, timeout=timeout, metadata=metadata

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/gapic_v1/method.py", line 154, in call

return wrapped_func(*args, **kwargs)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py", line 288, in retry_wrapped_func

on_error=on_error,

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/retry.py", line 190, in retry_target

return target()

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/timeout.py", line 210, in func_with_timeout

return func(*args, **kwargs)

File "/workspace/data-science-onramp/data-ingestion/.nox/py-3-7/lib/python3.7/site-packages/google/api_core/grpc_helpers.py", line 74, in error_remapped_callable

raise exceptions.from_grpc_error(exc) from exc

google.api_core.exceptions.Unauthenticated: 401 Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project.

[flaky-bot]

Looks like this issue is flaky. 😟

I'm going to leave this open and stop commenting.

A human should fix and close this.

---

When run at the same commit (07e8b81), this test passed in one build (Build Status, Sponge) and failed in another build (Build Status, Sponge).