## Goals * Drift monitoring * Accuracy (and confusion matrix) monitoring * Extensibility (custom functions for monitoring) * Stateless * Able to be used in AWS Lambda, Containers, etc ## Open questions * Choice of language (start with rust) * Do we use Grafana or ELK or just use our own visualization? * If we use our own visualization, what libraries? ## Proposed architecture * Thresholds set via yaml * Simple accuracy (and other confusion matrix) metrics via yaml (timeframe to look back at, etc) * Allow custom functions via CLI (which will generate the required code in the background with only the logic needed to be written) * Custom functions will be pure functions