AIMEE: Interactive model maintenance with rule-based surrogates

Abstract

In real-world applications, such as loan approvals or claims management, machine learning (ML) models need to be updated or retrained to adhere to new rules and regulations. But how can a new model be built and new decision boundaries be formed without having new training data available? We present AI Model Explorer and Editor tool (AIMEE) for model exploration and model editing using human understandable rules. It addresses the problem of changing decision boundaries by leveraging user-specified feedback rules that are used to pre-process training data such that a retrained model will reflect user changes. The pre-processing step using synthetic oversampling and relabeling and assumes white box access to the model. AIMEE provides interactive methods to edit rule sets, visualize changes to decision boundaries, and generates interpretable comparisons of model changes so that users see their feedback reflected in the updated model. The demo shows and end-to-end solution that supports the full update lifecycle of an ML model.