HUB dataset_stats() error reporting

[glenn-jocher]

🛠️ PR Summary

_{Made with ❤️ by Ultralytics Actions}

🌟 Summary

Enhancing dataset yaml loading robustness in dataloaders.py.

📊 Key Changes

• Wrapped yaml loading inside a try block.
• Added an except block to raise a specific exception on yaml loading failure.

🎯 Purpose & Impact

• Purpose: To provide a more clear and user-friendly error message if there are issues loading the dataset yaml file.
• Impact: Users will encounter a more descriptive error when yaml loading fails, making debugging easier and improving overall user experience. 🛠️

[glenn-jocher]

@kalenmike how's this?

[kalenmike]

@glenn-jocher It will work great to check for YAML parse errors, but can we handle for the other errors as well? Like the paths don't exist for example.

[glenn-jocher]

@kalenmike hmm, most of the finer checks are run by the default YOLOv5 function here:

yolov5/utils/dataloaders.py

Line 1031 in 6a67594

check_dataset(data, autodownload) # download dataset if missing

It looks like only the val path is specifically checked though. We could expand to all parts of the dataset: train, val, test:
i.e. L485

yolov5/utils/general.py

Lines 472 to 487 in 6a67594

	# Resolve paths
	path = Path(extract_dir or data.get('path') or '') # optional 'path' default to '.'
	if not path.is_absolute():
	path = (ROOT / path).resolve()
	for k in 'train', 'val', 'test':
	if data.get(k): # prepend path
	data[k] = str(path / data[k]) if isinstance(data[k], str) else [str(path / x) for x in data[k]]
	# Parse yaml
	train, val, test, s = (data.get(x) for x in ('train', 'val', 'test', 'download'))
	if val:
	val = [Path(x).resolve() for x in (val if isinstance(val, list) else [val])] # val path
	if not all(x.exists() for x in val):
	LOGGER.info(emojis('\nDataset not found ⚠, missing paths %s' % [str(x) for x in val if not x.exists()]))
	if not s or not autodownload:
	raise Exception(emojis('Dataset not found ❌'))

[glenn-jocher]

@kalenmike PR merged to avoid letting it linger. Will update HUB tag to master and we can work on additional error reporting next week.

[awetzel-lionpower]

I am currently getting the generic "Failed: Processing Error". Wondering if the more detailed error reporting has been finished. My data works fine with yolov5.

[glenn-jocher]

@awetzel-lionpower glad your data works with YOLOv5! We've enhanced error reporting with the latest changes. Please update to the latest version and provide the specific error message if the issue persists. Always happy to help!