Fix Spark in CI

[sentrivana]

No description provided.

[codecov]

❌ 47 Tests Failed:

Tests completed	Failed	Passed	Skipped
24160	47	24113	5825

View the top 3 failed test(s) by shortest run time

tests.integrations.asyncio.test_asyncio::test_exception

Stack Traces | 0.001s run time

async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted

tests.test_crons::test_contextmanager_error_async

Stack Traces | 0.001s run time

async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted

tests.test_crons::test_decorator_async

Stack Traces | 0.001s run time

async def functions are not natively supported.
You need to install a suitable plugin for your async framework, for example:
  - anyio
  - pytest-asyncio
  - pytest-tornasync
  - pytest-trio
  - pytest-twisted

To view more test analytics, go to the Test Analytics Dashboard
_{📋 Got 3 mins? Take this short survey to help us improve Test Analytics.}

[sentrivana]

Closing, will do this in #4435