0.3.1

0.3.1

• Introducing KNN + DataFrame API (PR)
• Fix wrong ordering when using unique in KNN (PR)
• Introducing Window Query + DataFrame API (PR)
• Rename addSPartitioning -> prePartition (PR)
• Accelerated partitioning (aborted and postponed) (PR)

0.3.0

0.3.0

• Complete change of the interface (#108). This includes:
  • DataFrame API
  • Extension of the Spark SQL module (new methods + implicits on DataFrame)
  • Metadata are propagated (not just 3D coordinates).
  • Seamless interface with Python
• Compiling against Apache Spark 2.3.2: fix incompatibilities (#107)
• Website update: spark-fits version + vulnerability fix (#105)
• Fix wrong angle definition in cartesian to spherical coordinate change! (#102)

0.2.2

0.2.2

• Add the conversion from FITS file (single HDU) to parquet (PR)
• Tools to perform live 3D RDD visualisation (in progress) (PR)
• Several updates to the Travis CI (PR)
• Add example dealing with collapse function in pyspark (PR)
• Deploy pyspark3d with pip (PR)
• Clarify the use of get_spark_session and load_user_conf (for tests only!) (PR)

0.2.1

0.2.1

• pyspark3d contains all the features of spark3D (partitioning, operators)
• Scala reflection support for python using py4j (PR)

0.2.0

0.2.0

• Add support for Python: pyspark3d (PR).
• Update the Travis script to run test suites for both scala and python (PR).
• Switch to docker-based travis to test against ubuntu 16.04 (PR).

0.1.5

0.1.5

• Allow user to cache the rawRDD while loading data to speed-up re-partitioning. (#81)
• Script to benchmark the partitioning (#72)
• Several minor fix (#71, #76, #80)

0.1.4

0.1.4

• Unify the IO: One constructor to rule them all! (PR)
• Octree and Geometry Objects Bug Fixes (PR)

0.1.3

0.1.3

• Add KNN routines (KNN, KNN, KNN)
• Unify API to load data (Point3DRDD, SphereRDD)
• Speed-up cross-match methods by using native Scala methods (Scala)
• Add a new website + spark3D belongs to AstroLab Software (website)
• Update tutorials (tuto.
• Few fixes here and there...

0.1.1

• Add scripts to generate test data #34
• Added Octree Partitioned RDD support #36
• RDD[Sphere] added (SphereRDD) #38
• Code refactoring: Replace Sphere by ShellEnvelope, Shape3D heritage, and move everything under geometryObjects #40
• Add very simple Kryo registration for spark3D classes. Probably need more #31 & #28.
• Few fixes here and there...