Real-Time Model Quality
RT Model Quality measures desired features
- Accuracy: the smaller the error, the better
- Value: more valuable behavior is more important
- Timeliness: earlier accurate prediction is better than a late accurate prediction
- Normalized relative to optimal and random models
- Easy to compute in a production environment (one pass over the data)