SPARK-1374: PySpark API for SparkSQL#363

Closed

ahirreddy wants to merge 49 commits intoapache:masterfrom

ahirreddy:pysql

Commits on Apr 15, 2014

compiling
ahirreddy
committed
Java to python
ahirreddy
committed
java to python, and python to java
ahirreddy
committed
Added schema rdd class
ahirreddy
committed
doesn't crash
ahirreddy
committed
working
ahirreddy
committed
more working
ahirreddy
committed
even better
ahirreddy
committed
yippie
ahirreddy
committed
Switched to using Scala SQLContext
ahirreddy
committed
returning dictionaries works
ahirreddy
committed
output dictionaries correctly
ahirreddy
committed
return row objects
ahirreddy
committed
awesome row objects
ahirreddy
committed
SchemaRDD now has all RDD operations
ahirreddy
committed
made jrdd explicitly lazy
ahirreddy
committed
for now only allow dictionaries as input
ahirreddy
committed
added todo explaining cost of creating Row object in python
ahirreddy
committed
adding tests
ahirreddy
committed
added test
ahirreddy
committed
added more tests :)
ahirreddy
committed
added more tests
ahirreddy
committed
Added pyrolite dependency
ahirreddy
committed
Added tests and documentation
ahirreddy
committed
doctest formatting
ahirreddy
committed
cleaning up cruft
ahirreddy
committed
HiveContexts
ahirreddy
committed
Added Long, Double and Boolean as usable types + unit test
ahirreddy
committed
First draft of python sql programming guide.

marmbrus
authored and
ahirreddy
committed
Fix comments.

marmbrus
authored and
ahirreddy
committed
PR Changes + Method Visibility
ahirreddy
committed
Changed com.clearspring.analytics stream version from 2.4.0 to 2.5.1 to match SBT build, and added pyrolite to maven build
ahirreddy
committed
Add note to future non-python developers about python docs.

marmbrus
authored and
ahirreddy
committed
Fix building of Hive API Docs.

marmbrus
authored and
ahirreddy
committed
Build Docs for pyspark SQL Api. Minor fixes.

marmbrus
authored and
ahirreddy
committed
Update API links. Fix Hive example.

marmbrus
authored and
ahirreddy
committed
Display message if hive is not built into spark
ahirreddy
committed
Fixed maven pyrolite dependency
ahirreddy
committed
Added doc test for HiveContext
ahirreddy
committed
Set SPARK_HIVE=true on jenkins
ahirreddy
committed
Trying to get spark to build with hive
ahirreddy
committed
Remove the metastore directory created by the HiveContext tests in SparkSQL
ahirreddy
committed
Doc fixes
ahirreddy
committed
Moved everything into sql.py
ahirreddy
committed
Cache underlying SchemaRDD instead of generating and caching PythonRDD
ahirreddy
committed
Updated documentation because classes moved to sql.py
ahirreddy
committed
Temporary fix MIMA checker. Since we now assemble Spark jar with Hive, we don't want to check the interfaces of all of our hive dependencies
ahirreddy
committed
Style fix
ahirreddy
committed
Updated log4j properties to supress Hive Warns
ahirreddy
committed