Releases: kunpengcompute/boostkit-bigdata
BoostKit BigData 20221230
openLooKeng can use omnidata-openlookeng-connector to visit omnidata feature for nearly data process.
Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.
Hive can use omnidata-hive-connector to visit omnidata feature for nearly data process.
Overview
In this version, the library supports filter, aggregation, and limit pushdown for openLooKeng/Spark SQL/Hive SQL.
This library is developed based on openLooKeng 1.6.1 and provides required JAR files.
This library is developed based on Apache Hive 3.1.0 and provides required JAR files.
This library is developed based on Apache Spark SQL v3.0.0 and Apache Spark SQL v3.1.1 and provides required JAR files.
Changes
This release includes the operator pushdown of openLooKeng/Spark and four zip files:
-feature: Supported filter, aggregation, and limit pushdown of openLooKeng/Spark SQL.
update the omniData to version 13.0.
-boostkit-omnidata-openlookeng-1.6.1-1.3.0-aarch64.zip: Released a zip of openLooKeng Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.0.0-1.3.0-aarch64.zip: Released a zip of Spark v3.0.0 Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.1.1-1.3.0-aarch64.zip: Released a zip of Spark v3.1.1 Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-server-1.3.0-aarch64-lib.zip: Released a zip of OmniData Server which contains JAR files of third-party dependency.
-boostkit-omnidata-udf-1.3.0-aarch64.zip: Released a zip of OmniData UDF which contains JAR files of third-party dependency.
-boostkit-omnidata-hive-udf-loader-1.6.1-1.3.0-aarch64.zip: Released a zip of OmniData External Hive UDF which contains JAR files of third-party dependency.
-boostkit-omnidata-hive-exec-3.1.0-1.3.0.zip: Released a zip of Hive Connector which contains JAR files of third-party dependency and this library packaged.
BoostKit BigData v1.3.0 for FusionInsight
Hive can use omnidata-hive-connector to visit omnidata feature for nearly data process.
Overview
In this version, the library supports filter, aggregation, and limit pushdown for Hive SQL on MapReduce Service 3.1.3.
This library is developed based on Apache Hive 3.1.0 and provides required JAR files.
Changes
This release includes the operator pushdown of Hive on FusionInsight and a zip file:
-feature: Supported filter, aggregation, and limit pushdown of Hive SQL on FusionInsight.
-boostkit-omnidata-hive-exec-3.1.0-1.3.0.zip: Released a zip of Hive Connector which contains JAR files of third-party dependency and this library packaged.
BoostKit BigData 20220630
openLooKeng can use omnidata-openlookeng-connector to visit omnidata feature for nearly data process.
Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.
Hive can use omnidata-hive-connector to visit omnidata feature for nearly data process.
Overview
In this version, the library supports filter, aggregation, and limit pushdown for openLooKeng/Spark SQL/Hive SQL.
This library is developed based on openLooKeng 1.6.1 and provides required JAR files.
This library is developed based on Apache Hive 3.1.0 and provides required JAR files.
This library is developed based on Apache Spark SQL v3.0.0 and Apache Spark SQL v3.1.1 and provides required JAR files.
Changes
This release includes the operator pushdown of openLooKeng/Spark and four zip files:
-feature: Supported filter, aggregation, and limit pushdown of openLooKeng/Spark SQL.
update the omniData to version 13.0.
-boostkit-omnidata-openlookeng-1.6.1-1.3.0-aarch64.zip: Released a zip of openLooKeng Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.0.0-1.3.0-aarch64.zip: Released a zip of Spark v3.0.0 Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.1.1-1.3.0-aarch64.zip: Released a zip of Spark v3.1.1 Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-server-1.3.0-aarch64-lib.zip: Released a zip of OmniData Server which contains JAR files of third-party dependency.
-boostkit-omnidata-udf-1.3.0-aarch64.zip: Released a zip of OmniData UDF which contains JAR files of third-party dependency.
-boostkit-omnidata-hive-udf-loader-1.6.1-1.3.0-aarch64.zip: Released a zip of OmniData External Hive UDF which contains JAR files of third-party dependency.
-boostkit-omnidata-hive-exec-3.1.0-1.3.0.zip: Released a zip of Hive Connector which contains JAR files of third-party dependency and this library packaged.
BoostKit BigData v1.3.0
openLooKeng can use omnidata-openlookeng-connector to visit omnidata feature for nearly data process.
Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.
Hive can use omnidata-hive-connector to visit omnidata feature for nearly data process.
Overview
In this version, the library supports filter, aggregation, and limit pushdown for openLooKeng/Spark SQL/Hive SQL.
This library is developed based on openLooKeng 1.6.1 and provides required JAR files.
This library is developed based on Apache Hive 3.1.0 and provides required JAR files.
This library is developed based on Apache Spark SQL v3.0.0 and Apache Spark SQL v3.1.1 and provides required JAR files.
Changes
This release includes the operator pushdown of openLooKeng/Spark and four zip files:
-feature: Supported filter, aggregation, and limit pushdown of openLooKeng/Spark SQL.
update the omniData to version 13.0.
-boostkit-omnidata-openlookeng-1.6.1-1.3.0-aarch64.zip: Released a zip of openLooKeng Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.0.0-1.3.0-aarch64.zip: Released a zip of Spark v3.0.0 Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.1.1-1.3.0-aarch64.zip: Released a zip of Spark v3.1.1 Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-server-1.3.0-aarch64-lib.zip: Released a zip of OmniData Server which contains JAR files of third-party dependency.
-boostkit-omnidata-udf-1.3.0-aarch64.zip: Released a zip of OmniData UDF which contains JAR files of third-party dependency.
-boostkit-omnidata-hive-udf-loader-1.6.1-1.3.0-aarch64.zip: Released a zip of OmniData External Hive UDF which contains JAR files of third-party dependency.
-boostkit-omnidata-hive-exec-3.1.0-1.3.0.zip: Released a zip of Hive Connector which contains JAR files of third-party dependency and this library packaged.
BoostKit OmniData Connector v1.2.0
openLooKeng can use omnidata-openlookeng-connector to visit omnidata feature for nearly data process.
Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.
Overview
In this version, the library supports filter, aggregation, and limit pushdown for openLooKeng/Spark SQL.
-
This library is developed based on openLooKeng 1.4.1 and provides required JAR files.
-
This library is developed based on Apache Spark SQL v3.0.0 and provides required JAR files.
Changes
This release includes the operator pushdown of openLooKeng/Spark and four zip files:
-feature: Supported filter, aggregation, and limit pushdown of openLooKeng/Spark SQL.
update the omniData to version 1.2.0.
-boostkit-omnidata-openlookeng-1.4.1-1.2.0-aarch64.zip: Released a zip of openLooKeng Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.0.0-1.2.0-aarch64.zip: Released a zip of Spark Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.1.1-1.2.0-aarch64.zip: Released a zip of Spark(v3.1.1) Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-server-1.2.0-aarch64-lib.zip: Released a zip of OmniData Server which contains JAR files of third-party dependency.
-boostkit-omnidata-udf-1.2.0-aarch64.zip: Released a zip of OmniData UDF which contains JAR files of third-party dependency.
BoostKit OmniData Connector v1.1.0
openLooKeng can use omnidata-openlookeng-connector to visit omnidata feature for nearly data process.
Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.
Overview
In this version, the library supports filter, aggregation, and limit pushdown for openLooKeng/Spark SQL.
-
This library is developed based on openLooKeng 1.4.1 and provides required JAR files.
-
This library is developed based on Apache Spark SQL v3.0.0 and provides required JAR files.
Changes
This release includes the operator pushdown of openLooKeng/Spark and four zip files:
-feature: Supported filter, aggregation, and limit pushdown of openLooKeng/Spark SQL.
-
update the openLooKeng to 1.4.1.
-
support Ceph FS.
-
upgrading the Communication Component to HAF.
-boostkit-omnidata-openlookeng-1.4.1-1.1.0-aarch64.zip: Released a zip of openLooKeng Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.0.0-1.1.0-aarch64.zip: Released a zip of Spark Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-server-1.1.0-aarch64-lib.zip: Released a zip of OmniData Server which contains JAR files of third-party dependency.
-boostkit-omnidata-udf-1.1.0-aarch64.zip: Released a zip of OmniData UDF which contains JAR files of third-party dependency.
BoostKit OmniData Connector v1.0.0-c
Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.
Overview
In this version, the library supports filter, aggregation, and limit pushdown for Spark SQL. This library is developed based on Apache Spark SQL v3.0.0 and provides required JAR files.
Changes
This release includes some issues fixed, function enhancements and a zip:
-fix issues: null pointer with partitionValue and parsing failed with UDF "cast", agg columnOffset and bigint datatype.
-function enhancements: support detailed pushdown infos and some alert logs.
-boostkit-omnidata-spark-sql_2.12-3.0.0-1.0.0.zip: Released a zip of Spark Connector which contains JAR files of third-party dependency and this library packaged.
BoostKit OmniData Connector v1.0.0
openLooKeng can use omnidata-openlookeng-connector to visit omnidata feature for nearly data process.
Spark can use omnidata-spark-connector to visit omnidata feature for nearly data process.
Overview
In this version, the library supports filter, aggregation, and limit pushdown for openLooKeng/Spark SQL.
-
This library is developed based on openLooKeng 1.4.0 and provides required JAR files.
-
This library is developed based on Apache Spark SQL v3.0.0 and provides required JAR files.
Changes
This release includes the operator pushdown of openLooKeng/Spark and four zip files:
-feature: Supported filter, aggregation, and limit pushdown of openLooKeng/Spark SQL.
-openlookeng-omnidata-connector-1.4.0-1.0.0-aarch64.zip: Released a zip of openLooKeng Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-spark-sql_2.12-3.0.0-1.0.0.zip: Released a zip of Spark Connector which contains JAR files of third-party dependency and this library packaged.
-boostkit-omnidata-server-1.0.0-aarch64-lib.zip: Released a zip of OmniData Server which contains JAR files of third-party dependency.
-boostkit-omnidata-udf-1.0.0-aarch64.zip: Released a zip of OmniData UDF which contains JAR files of third-party dependency.