Skip to content

Commit

Permalink
update omnidata/omnidata-spark-connector/README.md.
Browse files Browse the repository at this point in the history
Signed-off-by: 李生 <15840073651@163.com>
  • Loading branch information
tedliUCAS authored and gitee-org committed Nov 16, 2022
1 parent 7149f1f commit 3d07ddf
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion omnidata/omnidata-spark-connector/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
Introduction
============

The omnidata spark connector library running on Kunpeng processors is a Spark SQL plugin that pushes computing-side operators to storage nodes for computing. It is developed based on original APIs of Apache [Spark 3.0.0](https://github.com/apache/spark/tree/v3.0.0). This library applies to the big data storage separation scenario or large-scale fusion scenario where a large number of compute nodes read data from remote nodes. In this scenario, a large amount of raw data is transferred from storage nodes to compute nodes over the network for processing, resulting in a low proportion of valid data and a huge waste of network bandwidth. You can find the latest documentation, including a programming guide, on the project web page. This README file only contains basic setup instructions.
The omnidata spark connector library running on Kunpeng processors is a Spark SQL plugin that pushes computing-side operators to storage nodes for computing. It is developed based on original APIs of Apache [Spark 3.1.1](https://github.com/apache/spark/tree/v3.1.1). This library applies to the big data storage separation scenario or large-scale fusion scenario where a large number of compute nodes read data from remote nodes. In this scenario, a large amount of raw data is transferred from storage nodes to compute nodes over the network for processing, resulting in a low proportion of valid data and a huge waste of network bandwidth. You can find the latest documentation, including a programming guide, on the project web page. This README file only contains basic setup instructions.


Building And Packageing
Expand Down

0 comments on commit 3d07ddf

Please sign in to comment.