Skip to content

BoostKit BigData 20220630

Compare
Choose a tag to compare
@tushengxia tushengxia released this 04 Jul 07:22
· 609 commits to main since this release
4c11524

openLooKeng can use omnidata-openlookeng-connector to visit omnidata feature for nearly data process.

Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.

Hive can use omnidata-hive-connector to visit omnidata feature for nearly data process.

Overview
In this version, the library supports filter, aggregation, and limit pushdown for openLooKeng/Spark SQL/Hive SQL.

This library is developed based on openLooKeng 1.6.1 and provides required JAR files.

This library is developed based on Apache Hive 3.1.0 and provides required JAR files.

This library is developed based on Apache Spark SQL v3.0.0 and Apache Spark SQL v3.1.1 and provides required JAR files.

Changes
This release includes the operator pushdown of openLooKeng/Spark and four zip files:

-feature: Supported filter, aggregation, and limit pushdown of openLooKeng/Spark SQL.

update the omniData to version 13.0.

-boostkit-omnidata-openlookeng-1.6.1-1.3.0-aarch64.zip: Released a zip of openLooKeng Connector which contains JAR files of third-party dependency and this library packaged.

-boostkit-omnidata-spark-sql_2.12-3.0.0-1.3.0-aarch64.zip: Released a zip of Spark v3.0.0 Connector which contains JAR files of third-party dependency and this library packaged.

-boostkit-omnidata-spark-sql_2.12-3.1.1-1.3.0-aarch64.zip: Released a zip of Spark v3.1.1 Connector which contains JAR files of third-party dependency and this library packaged.

-boostkit-omnidata-server-1.3.0-aarch64-lib.zip: Released a zip of OmniData Server which contains JAR files of third-party dependency.

-boostkit-omnidata-udf-1.3.0-aarch64.zip: Released a zip of OmniData UDF which contains JAR files of third-party dependency.

-boostkit-omnidata-hive-udf-loader-1.6.1-1.3.0-aarch64.zip: Released a zip of OmniData External Hive UDF which contains JAR files of third-party dependency.

-boostkit-omnidata-hive-exec-3.1.0-1.3.0.zip: Released a zip of Hive Connector which contains JAR files of third-party dependency and this library packaged.