[SPARK-28287][SQL][PYTHON][TESTS] Convert and port 'udaf.sql' into UDF test base#25113

Closed

vinodkc wants to merge 117 commits intoapache:masterfrom

vinodkc:br_Fix_SPARK-27921

Commits on Jul 11, 2019

Convert applicable udaf.sql tests into UDF integrated test base
vinodkc
committed
[SPARK-28270][SQL][FOLLOW-UP] Explicitly cast into int/long/decimal in udf-aggregates_part1.sql to avoid Python float limitation
HyukjinKwon
committed
[SPARK-28213][SQL] Replace ColumnarBatchScan with equivilant from Columnar

revans2
authored and
tgravescs
committed
[MINOR][SQL] Clean up ObjectProducerExec operators

jaceklaskowski
authored and
srowen
committed
Fixed review comment
vinodkc
committed
[SPARK-26978][SQL][FOLLOWUP] Initialize date-time constants by foldable expressions

MaxGekk
authored and
hvanhovell
committed
[SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations.

gaborgsomogyi
authored and
Marcelo Vanzin
committed
[SPARK-23472][CORE] Add defaultJavaOptions for driver and executor.

gaborgsomogyi
authored and
Marcelo Vanzin
committed
[SPARK-28334][SQL][TEST] Port select.sql

wangyum
authored and
dongjoon-hyun
committed

Commits on Jul 12, 2019

[SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

rdblue
authored and
cloud-fan
committed
[SPARK-28321][SQL] 0-args Java UDF should not be called only once

HyukjinKwon
authored and
cloud-fan
committed
[SPARK-28270][TEST-MAVEN][FOLLOW-UP][SQL][PYTHON][TESTS] Avoid cast input of UDF as double in the failed test in udf-aggregate_part1.sql
HyukjinKwon
committed
[SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

WangGuangxin
authored and
dongjoon-hyun
committed
[SPARK-28034][SQL][TEST] Port with.sql

peter-toth
authored and
dongjoon-hyun
committed
[SPARK-28357][CORE][TEST] Fix Flaky Test - FileAppenderSuite.rollingfile appender - size-based rolling compressed

dongjoon-hyun
authored and
HyukjinKwon
committed
[SPARK-28354][INFRA] Use JIRA user name instead of JIRA user key

dongjoon-hyun
authored and
HyukjinKwon
committed
[SPARK-28228][SQL] Fix substitution order of nested WITH clauses

peter-toth
authored and
dongjoon-hyun
committed
[SPARK-28260][SQL] Add CLOSED state to ExecutionState

wangyum
authored and
gatorsmile
committed
[SPARK-28159][ML][FOLLOWUP] fix typo & (0 until v.size).toList => List.range(0, v.size)

zhengruifeng
authored and
dongjoon-hyun
committed
[SPARK-28361][SQL][TEST] Test equality of generated code with id in class name

gatorsmile
authored and
dongjoon-hyun
committed

Commits on Jul 13, 2019

[SPARK-28355][CORE][PYTHON] Use Spark conf for threshold at which command is compressed by broadcast

jessecai
authored and
gatorsmile
committed
[SPARK-28247][SS] Fix flaky test "query without test harness" on ContinuousSuite

HeartSaVioR
authored and
srowen
committed
[SPARK-28371][SQL] Make Parquet "StartsWith" filter null-safe

Marcelo Vanzin
authored and
dongjoon-hyun
committed
[SPARK-28370][BUILD][TEST] Upgrade Mockito to 2.28.2
dongjoon-hyun
committed

Commits on Jul 14, 2019

[SPARK-28378][PYTHON] Remove usage of cgi.escape

viirya
authored and
HyukjinKwon
committed
[SPARK-28343][SQL][TEST] Enabling cartesian product and ansi mode for PostgreSQL testing

wangyum
authored and
dongjoon-hyun
committed
[SPARK-28199][SS] Move Trigger implementations to Triggers.scala and avoid exposing these to the end users

HeartSaVioR
authored and
srowen
committed

Commits on Jul 15, 2019

[SPARK-28381][PYSPARK] Upgraded version of Pyrolite to 4.30

viirya
authored and
HyukjinKwon
committed
[SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL

Tony Zhang
authored and
dongjoon-hyun
committed
[SPARK-28387][SQL][TEST] Port select_having.sql

wangyum
authored and
dongjoon-hyun
committed
[SPARK-28384][SQL][TEST] Port select_distinct.sql

wangyum
authored and
dongjoon-hyun
committed
[SPARK-28392][SQL][TESTS] Add traits for UDF and PostgreSQL tests to share initialization
HyukjinKwon
committed
[SPARK-28389][SQL] Use Java 8 API in add_months

MaxGekk
authored and
cloud-fan
committed
[SPARK-28311][SQL] Fix STS OpenSession failed return wrong origin PROTOCOL_VERSION

朱夷
authored and
srowen
committed
[SPARK-28150][CORE][FOLLOW-UP] Don't try to log in when impersonating.
Marcelo Vanzin
committed
[SPARK-28306][SQL][FOLLOWUP] Fix NormalizeFloatingNumbers rule idempotence for equi-join with `<=>` predicates

yeshengm
authored and
gatorsmile
committed
[SPARK-28404][SS] Fix negative timeout value in RateStreamContinuousPartitionReader

gaborgsomogyi
authored and
dongjoon-hyun
committed
[SPARK-28152][SQL] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

shivsood
authored and
dongjoon-hyun
committed

Commits on Jul 16, 2019

[SPARK-28408][SQL][TEST] Restrict test values for DateType, TimestampType and CalendarIntervalType

MaxGekk
authored and
dongjoon-hyun
committed
[SPARK-28345][SQL][PYTHON] PythonUDF predicate should be able to pushdown to join

viirya
authored and
HyukjinKwon
committed
[SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

authored and
jerryshao
committed
[SPARK-28395][SQL] Division operator support integral division

wangyum
authored and
cloud-fan
committed
[SPARK-28201][SQL][TEST][FOLLOWUP] Fix Integration test suite according to the new exception message

dongjoon-hyun
authored and
cloud-fan
committed
[SPARK-27485] EnsureRequirements.reorder should handle duplicate expressions gracefully

hvanhovell
authored and
cloud-fan
committed
[SPARK-28356][SQL] Do not reduce the number of partitions for repartition in adaptive execution

carsonwang
authored and
cloud-fan
committed
[SPARK-28129][SQL][TEST] Port float8.sql

wangyum
authored and
HyukjinKwon
committed
[SPARK-27485][FOLLOWUP] Do not reduce the number of partitions for repartition in adaptive execution - fix compilation

gaborgsomogyi
authored and
hvanhovell
committed
[SPARK-27944][ML] Unify the behavior of checking empty output column names

zhengruifeng
authored and
srowen
committed
[SPARK-28343][FOLLOW-UP][SQL][TEST] Enable spark.sql.function.preferIntegralDivision for PostgreSQL testing

wangyum
authored and
dongjoon-hyun
committed
[SPARK-27959][YARN] Change YARN resource configs to use .amount

tgravescs
authored and
Marcelo Vanzin
committed
[SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

nooberfsh
authored and
dongjoon-hyun
committed
[SPARK-27963][CORE] Allow dynamic allocation without a shuffle service.
Marcelo Vanzin
committed

Commits on Jul 17, 2019

Commits on Jul 18, 2019

[SPARK-27609][PYTHON] Convert values of function options to strings

MaxGekk
authored and
HyukjinKwon
committed
[SPARK-28411][PYTHON][SQL] InsertInto with overwrite is not honored

huaxingao
authored and
HyukjinKwon
committed
[SPARK-28270][SQL][FOLLOW-UP] Explicitly cast into int/long/decimal in udf-aggregates_part1.sql to avoid Python float limitation

HyukjinKwon
authored and
vinodkc
committed
[SPARK-28213][SQL] Replace ColumnarBatchScan with equivilant from Columnar

revans2
authored and
vinodkc
committed
[MINOR][SQL] Clean up ObjectProducerExec operators

jaceklaskowski
authored and
vinodkc
committed
[SPARK-26978][SQL][FOLLOWUP] Initialize date-time constants by foldable expressions

MaxGekk
authored and
vinodkc
committed
[SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations.

gaborgsomogyi
authored and
vinodkc
committed
[SPARK-23472][CORE] Add defaultJavaOptions for driver and executor.

gaborgsomogyi
authored and
vinodkc
committed
[SPARK-28334][SQL][TEST] Port select.sql

wangyum
authored and
vinodkc
committed
[SPARK-28139][SQL] Add v2 ALTER TABLE implementation.

rdblue
authored and
vinodkc
committed
[SPARK-28321][SQL] 0-args Java UDF should not be called only once

HyukjinKwon
authored and
vinodkc
committed
[SPARK-28270][TEST-MAVEN][FOLLOW-UP][SQL][PYTHON][TESTS] Avoid cast input of UDF as double in the failed test in udf-aggregate_part1.sql

HyukjinKwon
authored and
vinodkc
committed
[SPARK-28257][SQL] Use ConfigEntry for hardcoded configs in SQL

WangGuangxin
authored and
vinodkc
committed
[SPARK-28034][SQL][TEST] Port with.sql

peter-toth
authored and
vinodkc
committed
[SPARK-28357][CORE][TEST] Fix Flaky Test - FileAppenderSuite.rollingfile appender - size-based rolling compressed

dongjoon-hyun
authored and
vinodkc
committed
[SPARK-28354][INFRA] Use JIRA user name instead of JIRA user key

dongjoon-hyun
authored and
vinodkc
committed
[SPARK-28228][SQL] Fix substitution order of nested WITH clauses

peter-toth
authored and
vinodkc
committed
[SPARK-28260][SQL] Add CLOSED state to ExecutionState

wangyum
authored and
vinodkc
committed
[SPARK-28159][ML][FOLLOWUP] fix typo & (0 until v.size).toList => List.range(0, v.size)

zhengruifeng
authored and
vinodkc
committed
[SPARK-28361][SQL][TEST] Test equality of generated code with id in class name

gatorsmile
authored and
vinodkc
committed
[SPARK-28355][CORE][PYTHON] Use Spark conf for threshold at which command is compressed by broadcast

jessecai
authored and
vinodkc
committed
[SPARK-28247][SS] Fix flaky test "query without test harness" on ContinuousSuite

HeartSaVioR
authored and
vinodkc
committed
[SPARK-28371][SQL] Make Parquet "StartsWith" filter null-safe

Marcelo Vanzin
authored and
vinodkc
committed
[SPARK-28370][BUILD][TEST] Upgrade Mockito to 2.28.2

dongjoon-hyun
authored and
vinodkc
committed
[SPARK-28378][PYTHON] Remove usage of cgi.escape

viirya
authored and
vinodkc
committed
[SPARK-28343][SQL][TEST] Enabling cartesian product and ansi mode for PostgreSQL testing

wangyum
authored and
vinodkc
committed
[SPARK-28199][SS] Move Trigger implementations to Triggers.scala and avoid exposing these to the end users

HeartSaVioR
authored and
vinodkc
committed
[SPARK-28381][PYSPARK] Upgraded version of Pyrolite to 4.30

viirya
authored and
vinodkc
committed
[SPARK-28133][SQL] Add acosh/asinh/atanh functions to SQL

Tony Zhang
authored and
vinodkc
committed
[SPARK-28387][SQL][TEST] Port select_having.sql

wangyum
authored and
vinodkc
committed
[SPARK-28384][SQL][TEST] Port select_distinct.sql

wangyum
authored and
vinodkc
committed
[SPARK-28392][SQL][TESTS] Add traits for UDF and PostgreSQL tests to share initialization

HyukjinKwon
authored and
vinodkc
committed
[SPARK-28389][SQL] Use Java 8 API in add_months

MaxGekk
authored and
vinodkc
committed
[SPARK-28311][SQL] Fix STS OpenSession failed return wrong origin PROTOCOL_VERSION

朱夷
authored and
vinodkc
committed
[SPARK-28150][CORE][FOLLOW-UP] Don't try to log in when impersonating.

Marcelo Vanzin
authored and
vinodkc
committed
[SPARK-28306][SQL][FOLLOWUP] Fix NormalizeFloatingNumbers rule idempotence for equi-join with `<=>` predicates

yeshengm
authored and
vinodkc
committed
[SPARK-28404][SS] Fix negative timeout value in RateStreamContinuousPartitionReader

gaborgsomogyi
authored and
vinodkc
committed
[SPARK-28152][SQL] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

shivsood
authored and
vinodkc
committed
[SPARK-28408][SQL][TEST] Restrict test values for DateType, TimestampType and CalendarIntervalType

MaxGekk
authored and
vinodkc
committed
[SPARK-28345][SQL][PYTHON] PythonUDF predicate should be able to pushdown to join

viirya
authored and
vinodkc
committed
[SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

authored and
vinodkc
committed
[SPARK-28395][SQL] Division operator support integral division

wangyum
authored and
vinodkc
committed
[SPARK-28201][SQL][TEST][FOLLOWUP] Fix Integration test suite according to the new exception message

dongjoon-hyun
authored and
vinodkc
committed
[SPARK-27485] EnsureRequirements.reorder should handle duplicate expressions gracefully

hvanhovell
authored and
vinodkc
committed
[SPARK-28356][SQL] Do not reduce the number of partitions for repartition in adaptive execution

carsonwang
authored and
vinodkc
committed
[SPARK-28129][SQL][TEST] Port float8.sql

wangyum
authored and
vinodkc
committed
[SPARK-27485][FOLLOWUP] Do not reduce the number of partitions for repartition in adaptive execution - fix compilation

gaborgsomogyi
authored and
vinodkc
committed
[SPARK-27944][ML] Unify the behavior of checking empty output column names

zhengruifeng
authored and
vinodkc
committed
[SPARK-28343][FOLLOW-UP][SQL][TEST] Enable spark.sql.function.preferIntegralDivision for PostgreSQL testing

wangyum
authored and
vinodkc
committed
[SPARK-27959][YARN] Change YARN resource configs to use .amount

tgravescs
authored and
vinodkc
committed
[SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

nooberfsh
authored and
vinodkc
committed
[SPARK-27963][CORE] Allow dynamic allocation without a shuffle service.

Marcelo Vanzin
authored and
vinodkc
committed
[SPARK-28418][PYTHON][SQL] Wait for event process in 'test_query_execution_listener_on_collect'

HyukjinKwon
authored and
vinodkc
committed
[SPARK-28359][SQL][PYTHON][TESTS] Make integrated UDF tests robust by making UDFs (virtually) no-op

HyukjinKwon
authored and
vinodkc
committed
[SPARK-28097][SQL] Map ByteType to SMALLINT for PostgresDialect

mojodna
authored and
vinodkc
committed
[SPARK-27609][PYTHON] Convert values of function options to strings

MaxGekk
authored and
vinodkc
committed
[SPARK-28411][PYTHON][SQL] InsertInto with overwrite is not honored

huaxingao
authored and
vinodkc
committed
fix review comments
vinodkc
committed
Convert applicable udaf.sql tests into UDF integrated test base
vinodkc
committed
Fixed review comment
vinodkc
committed
fix review comments
vinodkc
committed
Merge branch 'br_Fix_SPARK-27921' of https://github.com/vinodkc/spark into br_Fix_SPARK-27921
vinodkc
committed