Awesome AI Safety

Figuring out how to make your AI safer? How to avoid ethical biases, errors, privacy leaks or robustness issues in your AI models?

This repository contains a curated list of papers & technical articles on AI Quality & Safety that should help 📚

Table of Contents

You can browse papers by Machine Learning task category, and use hashtags like #robustness to explore AI risk types.

1. General ML Testing
2. Tabular Machine Learning
3. Natural Language Processing
4. Computer Vision
5. Recommendation System
6. Time Series

General ML Testing

• Machine learning testing: Survey, landscapes and horizons (Zhang et al., 2020) #General
• Quality Assurance for AI-based Systems: Overview and Challenges (Felderer et al., 2021) #General
• The ML Test Score: A Rubric for ML Production Readiness and Technical Debt Reduction (Breck et al., 2017) #General
• Reliable Machine Learning: Applying SRE Principles to ML in Production [BOOK] (Chen et al., 2022) #Reliability
• Metamorphic testing of decision support systems: A case study (Kuo et al., 2010) #Robustness
• A Survey on Metamorphic Testing (Segura et al., 2016) #Robustness
• Testing and validating machine learning classifiers by metamorphic testing (Xie et al., 2011) #Robustness
• The Disagreement Problem in Explainable Machine Learning: A Practitioner’s Perspective (Krishna et al., 2022) #Explainability
• InterpretML: A Unified Framework for Machine Learning Interpretability (Nori et al., 2019) #Explainability #General
• Fair regression: Quantitative definitions and reduction-based algorithms (Agarwal et al., 2019) #Fairness
• Learning Optimal and Fair Decision Trees for Non-Discriminative Decision-Making (Aghaei et al., 2019) #Fairness
• Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning (Henderson et al., 2020) #Environment

AI Incident Databases

• AI Incident Database (Responsible AI Collaborative)
• AI Vulnerability Database (AVID)

Tabular Machine Learning

• Machine Learning Model Drift Detection Via Weak Data Slices (Ackerman et al., 2021) #DataSlice #Debugging #Drift
• Automated Data Slicing for Model Validation: A Big Data - AI Integration Approach (Chung et al., 2020) #DataSlice
• Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models (Krause et al., 2016) #Explainability

Natural Language Processing

• Beyond Accuracy: Behavioral Testing of NLP Models with CheckList (Ribeiro et al., 2020) #Robustness
• Towards Robust Personalized Dialogue Generation via Order-Insensitive Representation Regularization (Chen et al. 2023)#Robustness
• Pipelines for Social Bias Testing of Large Language Models (Nozza et al., 2022) #Bias #Ethics
• [Why Should I Trust You?": Explaining the P