ml_monitoring

Crates.ioml_monitoring
lib.rsml_monitoring
version0.1.0
sourcesrc
created_at2019-03-16 22:19:06.733737
updated_at2019-03-16 22:19:06.733737
descriptionA library with ml monitoring utilities
homepagehttps://github.com/phillyfan1138/ml_monitoring
repositoryhttps://github.com/phillyfan1138/ml_monitoring
max_upload_size
id121457
size13,692
Daniel Stahl (phillyfan1138)

documentation

README

Goals

  • Drift monitoring
  • Accuracy (and confusion matrix) monitoring
  • Extensibility (custom functions for monitoring)
  • Stateless
  • Able to be used in AWS Lambda, Containers, etc

Open questions

  • Choice of language (start with rust)
  • Do we use Grafana or ELK or just use our own visualization?
  • If we use our own visualization, what libraries?

Proposed architecture

  • Thresholds set via yaml
  • Simple accuracy (and other confusion matrix) metrics via yaml (timeframe to look back at, etc)
  • Allow custom functions via CLI (which will generate the required code in the background with only the logic needed to be written)
  • Custom functions will be pure functions
Commit count: 5

cargo fmt