Skip to content

Add UDF support #106

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 18 commits into from
Sep 13, 2021
Merged

Add UDF support #106

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
5f7a0e2
copy code from https://github.com/JetBrains/kotlin-spark-api/pull/67
nonpool Aug 22, 2021
2c161cd
remove hacked RowEncoder.scala
nonpool Aug 23, 2021
8bbea9a
replace all schema(typeOf<R>()) to DataType.fromJson((schema(typeOf<R…
nonpool Aug 23, 2021
a4bbbf9
add return udf data class test
nonpool Aug 23, 2021
59cec6b
change test
nonpool Aug 23, 2021
460350f
add in dataset test for calling the UDF-Wrapper
nonpool Aug 23, 2021
f250694
add the same exception link
nonpool Aug 24, 2021
42b5aa3
refactor unWrapper
nonpool Aug 24, 2021
456a29e
add test for udf return a List
nonpool Aug 25, 2021
6fe2c6b
make the test simpler
nonpool Sep 1, 2021
e77c58d
add License
nonpool Sep 1, 2021
12ea1bd
add UDFRegister for 3.0
nonpool Sep 1, 2021
02169bd
remove useless import
nonpool Sep 1, 2021
e72acee
resolved deprecated method
nonpool Sep 1, 2021
3398210
[experimental] add CatalystTypeConverters.scala for hacked it to impl…
nonpool Sep 5, 2021
fc85d47
[experimental] implement UDF return data class
nonpool Sep 5, 2021
e98f6d1
fix code inspection issue
nonpool Sep 5, 2021
56cd280
Adds suppre unused
asm0dey Sep 5, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion core/3.0/pom_2.12.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,10 @@
<artifactId>scala-library</artifactId>
<version>${scala.version}</version>
</dependency>

<dependency>
<groupId>org.jetbrains.kotlin</groupId>
<artifactId>kotlin-reflect</artifactId>
</dependency>
<!-- Provided dependencies -->
<dependency>
<groupId>org.apache.spark</groupId>
Expand Down
Loading