Print conversation/sample if an error occurrs processing dataset

[teknium1]

⚠️ Please check that this feature request hasn't been suggested before.

• I searched previous Ideas in Discussions didn't find any similar feature requests.
• I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

When processing the dataset to tokenize, and an error occurrs for whatever reason, print to terminal the last example loaded to process, to help diagnose dataset issues.

✔️ Solution

print(example)

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements

• My issue title is concise, descriptive, and in title casing.
• I have searched the existing issues to make sure this feature has not been requested yet.
• I have provided enough information for the maintainers to understand and evaluate this request.

[NanoCode012]

Since we're calling map from datasets library and we use multiple sub-classes of PromptTokenizingStrategy which implement their own tokenize prompt, I'm not sure how we could add a general try catch around everything and still get the exact prompt that caused the issue.

https://github.com/OpenAccess-AI-Collective/axolotl/blob/c1382e79b6eb599f7fd210fd1a621b97bfed0d51/src/axolotl/datasets.py#L41-L45

However, I think this is a useful feature to have!