Getting Started with TruEra

We're glad you're here. It means you're ready to leverage TruEra's AI Quality Platform to analyze and improve your AI/ML modeling projects. In this repository, you'll find sample projects of integrating machine learning models with TruEra to help you get the most out of the TruEra Python SDK.

Why TruEra?

As you build and deploy ML models, TruEra plugs into your ML stack to let you test, debug and monitor your projects to ensure each model is doing what it's supposed to be doing — and, if not, why not? From feature development that helps you refine your data to efficiently training and evaluating your models to validating a final model for production, TruEra has you covered.

Which examples should I use?

To learn how to create and ingest your first project in TruEra, use the SDK Quickstart. If you'd rather explore a particular AI Quality concept such as performance, drift or fairness - start with a "Starter Example". These notebooks, each in two parts, will walk you through testing your ML model for a particular issue and how to improve your model along that axis. Last, if there's a particular framework or environment you'd like to integrate with - check out the Integrations & Extensions section!

Library of Examples to Get Started

Category	Example	Link	Input Type	Output Type	AI Quality Concept	Frameworks
Diagnostics Quick Start	SDK Quickstart		Tabular	Regression	Observability	sklearn
Monitoring Quick Start	SDK Quickstart		Tabular	Classification	Observability	N/A
Monitoring Quick Start	SDK Quickstart		Tabular	Regression	Observability	N/A
Diagnostics Starter Examples	Performance Starter Example (Part 1)		Tabular	Regression	Testing, Performance, Explainability	xgboost
Diagnostics Starter Examples	Performance Starter Example (Part 2)		Tabular	Regression	Debugging, Performance, Explainability	xgboost
Diagnostics Starter Examples	Drift Starter Example (Part 1)		Tabular	Regression	Testing, Drift, Explainability	xgboost
Diagnostics Starter Examples	Drift Starter Example (Part 2)		Tabular	Regression	Debugging, Drift, Explainability	xgboost
Diagnostics Starter Examples	Fairness Starter Example (Part 1)		Tabular	Classification	Testing, Fairness, Explainability	xgboost
Diagnostics Starter Examples	Fairness Starter Example (Part 2)		Tabular	Classification	Debugging, Fairness, Explainability	xgboost
Diagnostics Starter Examples	Ranking Starter Example		Tabular	Ranking	Debugging, Explainability	xgboost, lgbm
Integrations & Extensions	TruSHAP Example		Tabular	Classification	Explainability	SHAP, xgboost, decision trees
Integrations & Extensions	Sagemaker Integration	Coming Soon	...	...	...	...
Integrations & Extensions	BigQueryML Integration	Coming Soon	...	...	...	...