[SPARK-41232][SQL][PYTHON] Adding array_append function#38865

Closed

infoankitp wants to merge 32 commits intoapache:masterfrom

infoankitp:SPARK-41232

Commits on Dec 24, 2022

[SPARK-41232] Adding array_append function in spark sql, Pyspark
infoankitp
committed
[SPARK-41232] Fixing typo in comment
infoankitp
committed
[SPARK-41232] Removing the errorSubClass, fixing the iteration to not create a temp copy using arrayData.toObjectArray(arrayElementType) rather iterating and copying each value directly
infoankitp
committed
[SPARK-41232] Making behaviour with null checks in sync with snowflakes functions, added test cases.
infoankitp
committed
[SPARK-41232] Fixing Scalastyle error
infoankitp
committed
[SPARK-41232] Adding more examples and fixing the type parsing to pick the type correctly and upgrading the element to find tightest common type, also upgrading sql-expression-schema.md and adding …
infoankitp
committed
[SPARK-41232] Adding quotes to the expected output and fixing the python linting
infoankitp
committed
[SPARK-41232] Fixing unit tests and linting errors
infoankitp
committed
[SPARK-41232] Handling edge cases for null values similar to other high order functions like array_position, array_contains, array_remove
infoankitp
committed
[SPARK-41232] Adding elementType as an instance variable, improving the comment of the function.
infoankitp
committed
[SPARK-41232] Fixing scalastyle
infoankitp
committed
[SPARK-41232] Fixing scalastyle
infoankitp
committed
[SPARK-41232] Adding NullIntolerant trait to the class ArrayAppend
infoankitp
committed
[SPARK-41232] Creating the java code using the codeGenerator
infoankitp
committed
[SPARK-41233] Adding ArrayPrepend Function, reusing the code using trait ArrayAddElement
infoankitp
committed
[SPARK-41233] Fixing python linting and sql function unit test in python
infoankitp
committed
[SPARK-41233] Fixing pyspark function invocation
infoankitp
committed
[SPARK-41233] Removing array_prepend function.
infoankitp
committed
[SPARK-41232] Removing the trait and common code for doGenCode
infoankitp
committed
[SPARK-41232] Including the review changes
infoankitp
committed
[SPARK-41232] Removing unused expression
infoankitp
committed
[SPARK-41232] Removing duplicate temp variable pos

infoankitp
and
beliefer
committed
[SPARK-41232] Using while loop for iterating over the elements, also updating the function definition
infoankitp
committed
[SPARK-41232] Adding function in pyspark connect
infoankitp
committed

Commits on Dec 26, 2022

[SPARK-41232] Pushing change to append null if the element passed is null
infoankitp
committed

Commits on Jan 4, 2023