NannyML is a tool for data science teams to monitor their models post-deployment.

Key Features:

Focus on one single metric to measure model performance

Quantify the impact of data drift on model performance

Define a cost-benefit matrix to measure business impact

Detect concept drift impact on model performance

Automate monitoring data collection with the SDK

Use Cases:

Monitoring model performance

Detecting concept drift

Automating monitoring data collection

Benefits:

Crystal clear monitoring of model performance

Understand root cause of performance drops quickly

Effortless observability and concept drift detection

Automated infrastructure for alerting and data collection