ml_monitoring
| Crates.io | ml_monitoring |
| lib.rs | ml_monitoring |
| version | 0.1.0 |
| created_at | 2019-03-16 22:19:06.733737+00 |
| updated_at | 2019-03-16 22:19:06.733737+00 |
| description | A library with ml monitoring utilities |
| homepage | https://github.com/phillyfan1138/ml_monitoring |
| repository | https://github.com/phillyfan1138/ml_monitoring |
| max_upload_size | |
| id | 121457 |
| size | 13,692 |
Daniel Stahl (phillyfan1138)
documentation
README
Goals
- Drift monitoring
- Accuracy (and confusion matrix) monitoring
- Extensibility (custom functions for monitoring)
- Stateless
- Able to be used in AWS Lambda, Containers, etc
Open questions
- Choice of language (start with rust)
- Do we use Grafana or ELK or just use our own visualization?
- If we use our own visualization, what libraries?
Proposed architecture
- Thresholds set via yaml
- Simple accuracy (and other confusion matrix) metrics via yaml (timeframe to look back at, etc)
- Allow custom functions via CLI (which will generate the required code in the background with only the logic needed to be written)
- Custom functions will be pure functions