Expert-Driven Monitoring of Operational ML Models

Abstract: We propose Expert Monitoring, an approach that leverages domain expertise to enhance the detection and mitigation of concept drift in ML models. Our approach supports practitioners by consolidating domain expertise related to concept drift-inducing events, making this expertise accessible to on-call personnel, and enabling automatic adaptability with expert oversight.