NannyML is a tool for data science teams to monitor their models post-deployment.

Key Features:

• Focus on one single metric to measure model performance
• Quantify the impact of data drift on model performance
• Define a cost-benefit matrix to measure business impact
• Detect concept drift impact on model performance
• Automate monitoring data collection with the SDK

Use Cases:

• Monitoring model performance
• Detecting concept drift
• Automating monitoring data collection

Benefits:

• Crystal clear monitoring of model performance
• Understand root cause of performance drops quickly
• Effortless observability and concept drift detection
• Automated infrastructure for alerting and data collection