SparkSQL+: Next-generation Query Planning over Spark

• DOI: 10.1145/3555041.3589715
• Publication Date: 2023-06-05T16:25:14Z
• Authors: Binyang Dai; Qichen Wang; Ke Yi
• Keywords: SPARK (programming language); Spatial Query; Conjunctive query; RDF query language; Online aggregation; Query plan

We will demonstrate SparkSQL+, a SQL processing engine built on top of Spark. Unlike the vanilla SparkSQL that uses classical query plans, SparkSQL+ adopts some recently developed new including generalized hypertree decompositions(GHD), worst-case optimal join (WCOJ) algorithms, and conjunctive queries with comparisons (CQC). also provides platform for users to explore different plans given through web-based interface, compare their performance same Spark core.