4 Reasons Why Machine Learning Monitoring is Essential for Models in Production
Machine learning (ML) is a field that sounds exciting to work in. Once you discover its capabilities, it gets even...
Prompt engineering sucks. Break free from the endless tweaking with this revolutionary approach - Learn more
Securing AI systems is tricky, ignoring it is risky. Discover the easiest way to secure your AI end to end - Learn more
Let’s say for a given problem we have a big stable model that uses a lot of data to train – let’s mark it as model A. We will also devise another model, a more lightweight model that trained on smaller and more recent data – it can have the same type. We’ll call it model B.
The idea: Find the time windows where model B outperforms model A. As model A is stable and encapsulates more data than model B, we would expect it to outperform it. However, if model B outperforms model A that might suggest that a concept drift has occurred.
If interested, learn and read more about these concepts in our articles concept drift in machine learning 101 and 8 Concept Drift Detection Methods.