Exploring streaming#133

Merged

Jolanrensen merged 50 commits intospark-3.2from

exploring-streaming

Apr 21, 2022

Commits on Feb 21, 2022

added withSparkStreaming function and example. Let's see if something like this could form the basis of easy streaming support :)
Jolanrensen
committed
makes withSparkStreaming reuse the normal withSpark
Jolanrensen
committed

Commits on Feb 24, 2022

removed sc.stop()
Jolanrensen
committed

Commits on Mar 8, 2022

Commits on Mar 21, 2022

added Option(al) converters, testing fakeClassTag(). Working with streaming pair-functions, decided to go tuple-first instead of arities
Jolanrensen
committed

Commits on Mar 31, 2022

removed commented out code, fixed checkpointPath (needs cleaning up code), new notation for entering KSparkSession scope inside streaming scope
Jolanrensen
committed

Commits on Apr 11, 2022

Commits on Apr 12, 2022

working on testing, not yet finished
Jolanrensen
committed

Commits on Apr 13, 2022

updated to kotlin 1.6.20, refactored withSparkStreaming and fixed tests
Jolanrensen
committed