Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-49700

Switch interface and implementations

    XMLWordPrintableJSON

Details

    Description

      Move the interfaces to `org.apache.spark.sql`.

      Move implementation specific classes into the `classic` or `connect` packages.

      Tests in sql/core will still run against classic.

      Attachments

        Issue Links

          blocks

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49437 Create interface implementation tests

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49283 Create a generic builder for SparkSession implementations

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49428 Rename/Reorg Connect Client Packages

          • Major - Major loss of function.
          • Resolved
          is blocked by

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49282 Create shared interface for SparkSession.Builder

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49286 Move the Avro and Protobuf functions.scala files to sql/api

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49369 Create implicit Column conversions to reduce upgrade issues

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49416 Create a shared interface for DataStreamReader

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49417 Create a shared interface for StreamingQueryManager

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49418 Active/default ThreadLocals for shared SparkSession

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49434 Move org.apache.spark.sql.expressions.javalang.typed/scalalang.type to sql/api

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49435 Move ReduceAggregator to sql/api

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49569 Introduce Shim for missing spark/core classes

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-49712 Replace org.apache.spark.sql.encoderFor with AgnosticEncoders.agnosticEncoderFor

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SPARK-50102 Add shims for all classic only classes

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. SPARK-49710 Make sure internal/dev API is properly annotated in SparkSession

          • Major - Major loss of function.
          • Resolved
          is related to

          Umbrella - An overarching type made of sub-tasks SPARK-44111 Prepare Apache Spark 4.0.0

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link GitHub Pull Request #48818

          Web Link GitHub Pull Request #49696

          Activity

            People

              hvanhovell Herman van Hövell
              hvanhovell Herman van Hövell
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: