Skip to content
@opendatalab

OpenDataLab

OpenDataLab provides access to numerous significant open-source datasets.

English🌎|简体中文🀄

🔥🔥🔥OpenDataLab Provide ecology for high-quality datasets for community. It provides:

🌟Extensive open data resources for AI Model

● High-speed and simple way to access open datasets
● 7700+ Large scale and high-quality open datasets for large model
● 1200+ Open datasets for Computer Vision
● 200+ Open datasets by CVPR
● Categorized datasets for hot topics

✨Open-source data processing toolkits

● Data acquisition toolkits supporting large datasets
● Data acquisition toolkits supporting kinds of tasks
● Open source intelligent Toolbox for Labeling

💫Dataset description language

● Format standardization
● DSDL: Dataset Description Language
● Define a CV dataset by DSDL
● OpenDataLab Standardized 100+ CV Datasets

Check our tutorials videos (in Chinese) to get started.


📣 We have upgraded and launched the function of authors uploading datasets independently. We hereby invite you to participate in using it to better promote your open source datasets, AI research results, etc., so that more people can access, obtain and use your dataset.

This is an introduction to the dataset autonomous upload function 【help doc】,You can create and share your dataset according to our guidelines. 💪

If you have any questions or obstacles, please feel free to contact us OpenDataLab@pjlab.org.cn.

Popular repositories Loading

  1. MinerU MinerU Public

    A one-stop, open-source, high-quality data extraction tool, supports PDF/webpage/e-book extraction.一站式开源高质量数据提取工具,支持PDF/网页/多格式电子书提取。

    Python 7.3k 557

  2. PDF-Extract-Kit PDF-Extract-Kit Public

    A Comprehensive Toolkit for High-Quality PDF Content Extraction

    Python 3.9k 254

  3. WanJuan1.0 WanJuan1.0 Public

    万卷1.0多模态语料

    512 24

  4. labelU labelU Public

    Data annotation toolbox supports image, audio and video data.

    Python 460 38

  5. LabelLLM LabelLLM Public

    The Open-Source Data Annotation Platform

    TypeScript 383 27

  6. magic-doc magic-doc Public

    Python 183 13

Repositories

Showing 10 of 31 repositories
  • MinerU Public

    A one-stop, open-source, high-quality data extraction tool, supports PDF/webpage/e-book extraction.一站式开源高质量数据提取工具,支持PDF/网页/多格式电子书提取。

    opendatalab/MinerU’s past year of commit activity
    Python 7,292 AGPL-3.0 557 76 2 Updated Aug 9, 2024
  • PDF-Extract-Kit Public

    A Comprehensive Toolkit for High-Quality PDF Content Extraction

    opendatalab/PDF-Extract-Kit’s past year of commit activity
    Python 3,941 Apache-2.0 254 34 0 Updated Aug 9, 2024
  • labelU Public

    Data annotation toolbox supports image, audio and video data.

    opendatalab/labelU’s past year of commit activity
    Python 460 38 6 0 Updated Aug 9, 2024
  • opendatalab/skydiffusion’s past year of commit activity
    JavaScript 2 Apache-2.0 0 0 0 Updated Aug 8, 2024
  • LabelLLM Public

    The Open-Source Data Annotation Platform

    opendatalab/LabelLLM’s past year of commit activity
    TypeScript 383 Apache-2.0 27 9 0 Updated Aug 8, 2024
  • opendatalab/CrossViewDiff’s past year of commit activity
    JavaScript 1 0 0 0 Updated Aug 3, 2024
  • Miner-PDF-Benchmark Public

    MPB (Miner-PDF-Benchmark) is an end-to-end PDF document comprehension evaluation suite designed for large-scale model data scenarios.

    opendatalab/Miner-PDF-Benchmark’s past year of commit activity
    Python 6 Apache-2.0 3 5 0 Updated Aug 2, 2024
  • opendatalab-datasets Public

    datasets resource

    opendatalab/opendatalab-datasets’s past year of commit activity
    63 6 2 0 Updated Aug 1, 2024
  • .github Public
    opendatalab/.github’s past year of commit activity
    0 1 0 0 Updated Aug 1, 2024
  • UniMERNet Public

    UniMERNet: A Universal Network for Real-World Mathematical Expression Recognition

    opendatalab/UniMERNet’s past year of commit activity
    Jupyter Notebook 119 Apache-2.0 8 3 0 Updated Jul 30, 2024