Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Uploading datasets from Roboflow seem to have 0 validation images #746

Closed
1 task done
CropWatchDevelopment opened this issue Jun 28, 2024 · 5 comments
Closed
1 task done
Assignees
Labels
fixed Bug is resolved question A HUB question that does not involve a bug

Comments

@CropWatchDevelopment
Copy link

Search before asking

Question

I have uploaded an export of my project from Roboflow. ultralytics can't find any validation images,
Here is my roboflow export:
image
And here is what I see in Ultralytics:
image
image
image

Additional

Not sure if i should add this as a bug, let me know and It can be changed :)

@CropWatchDevelopment CropWatchDevelopment added the question A HUB question that does not involve a bug label Jun 28, 2024
Copy link

👋 Hello @CropWatchDevelopment, thank you for raising an issue about Ultralytics HUB 🚀! Please visit our HUB Docs to learn more:

  • Quickstart. Start training and deploying YOLO models with HUB in seconds.
  • Datasets: Preparing and Uploading. Learn how to prepare and upload your datasets to HUB in YOLO format.
  • Projects: Creating and Managing. Group your models into projects for improved organization.
  • Models: Training and Exporting. Train YOLOv5 and YOLOv8 models on your custom datasets and export them to various formats for deployment.
  • Integrations. Explore different integration options for your trained models, such as TensorFlow, ONNX, OpenVINO, CoreML, and PaddlePaddle.
  • Ultralytics HUB App. Learn about the Ultralytics App for iOS and Android, which allows you to run models directly on your mobile device.
    • iOS. Learn about YOLO CoreML models accelerated on Apple's Neural Engine on iPhones and iPads.
    • Android. Explore TFLite acceleration on mobile devices.
  • Inference API. Understand how to use the Inference API for running your trained models in the cloud to generate predictions.

If this is a 🐛 Bug Report, please provide screenshots and steps to reproduce your problem to help us get started working on a fix.

If this is a ❓ Question, please provide as much information as possible, including dataset, model, environment details etc. so that we might provide the most helpful response.

We try to respond to all issues as promptly as possible. Thank you for your patience!

@pderrenger
Copy link
Member

@CropWatchDevelopment hi there,

Thank you for reaching out and providing detailed screenshots of your issue. It’s very helpful!

To better assist you, could you please provide a minimum reproducible example of your dataset upload process? This will help us diagnose the issue more effectively. You can find guidance on how to create a reproducible example here.

Additionally, please ensure that you are using the latest versions of the Ultralytics packages. Sometimes, issues like these are resolved in newer releases.

If the problem persists after following the above steps, please let us know, and we’ll be happy to investigate further.

@CropWatchDevelopment
Copy link
Author

Thanks for the fast response! I apologise for not adding more detail.
Here are the steps you can take to re-create the same issue that I am seeing.

  1. Navigate to Roboflow.com, Signin and create a new classification project using the "Create New Project" Button, it may be a multi-label or standard classification type. (see image)
    image
  2. Upload images, via the upload section OR use their API
    image
  3. Be sure to have uploaded enough for a split (3 at minimum), visit the "Health Check" section and re-balance your project images making sure you have an image in each of the 3 categories:
    image
  4. Visit the "Generate" section, after generating a new set, Select Download data set, once the folder is on your computer, verifiy there are fiels in each of the folders.
    image
  5. Visit Ultralytics and upload the dataset and view the items in each category:
    image

Let me know if there is anything else I can do to help track down the root of the issue.
one thing I would like to note is that the example directory structure shows the train, validate and test sub dirs in a classify folder. doing this causes the upload dataset to be invalid.
the train and test folder will be populated in ultralytics however:
image
image

@pderrenger
Copy link
Member

Hi @CropWatchDevelopment,

Thank you for providing the detailed steps to reproduce the issue and the additional screenshots. This is very helpful!

Based on your description, it seems like the validation images are not being recognized correctly after uploading the dataset to Ultralytics HUB. Here are a few steps to help troubleshoot and potentially resolve the issue:

  1. Directory Structure: Ensure that the directory structure of your dataset matches the expected format. Typically, the dataset should have separate folders for train, val, and test images. It seems like you mentioned an issue with the classify folder. Make sure the structure is as follows:

    dataset/
    ├── train/
    ├── val/
    └── test/
    
  2. File Verification: Double-check that the val folder contains images and annotations if applicable. Sometimes, files might be missing or incorrectly placed.

  3. Latest Version: Ensure you are using the latest version of the Ultralytics HUB and related packages. Updates often include bug fixes and improvements that might resolve your issue.

  4. Re-upload: Try re-uploading the dataset after verifying the structure and contents. Sometimes, re-uploading can resolve unexpected issues.

If the issue persists, could you please share a minimal reproducible example of your dataset? This will help us diagnose the problem more effectively. You can find guidance on creating a reproducible example here.

Thank you for your patience and cooperation. If you have any further questions or need additional assistance, feel free to ask. We're here to help!

@sergiuwaxmann sergiuwaxmann self-assigned this Jul 1, 2024
@sergiuwaxmann
Copy link
Member

@CropWatchDevelopment It looks like the dataset downloaded from Roboflow doesn't have the correct directory structure as pointed out by @pderrenger. Please make sure your directory structure is correct.
You can read more about this on our docs.

@sergiuwaxmann sergiuwaxmann added the fixed Bug is resolved label Jul 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
fixed Bug is resolved question A HUB question that does not involve a bug
Projects
None yet
Development

No branches or pull requests

3 participants