Chinese Yellow Pages | Classifieds | Knowledge | Tax | IME

General intro

https://github.com/alexandrainst/responsible-ai

https://ai.google/responsibilities/responsible-ai-practices/

https://www.tensorflow.org/responsible_ai

 

Open source implementation

https://github.com/microsoft/responsible-ai-toolbox

https://www.tensorflow.org/responsible_ai/api_docs

https://opendatascience.com/15-open-source-responsible-ai-toolkits-and-projects-to-use-today/

Responsible AI Toolkits for AI Ethics & Privacy

TensorFlow Privacy

TensorFlow Privacy is a Python library that includes implementations of TensorFlow optimizers for training machine learning models with differential privacy.

TensorFlow Federated

TFF has been developed to facilitate open research and experimentation with Federated Learning (FL), an approach to machine learning where a shared global model is trained across many participating clients that keep their training data locally.

Deon

deon is a command-line tool that allows you to easily add an ethics checklist to your data science projects. The goal of deon is to push that conversation forward and provide concrete, actionable reminders to the developers that have influence over how data science gets done. Federated Learning helps preserve privacy, as it’s a new machine learning paradigm to learn a shared model across users or organizations without direct access to the data.

AI Transparency & Bias 

Transparent AI allows people to look under the hood of AI models, so that the model can be properly explained and communicated. Similar to explainable AI, providing transparency into the motives, data, or intent behind the model will take the guesswork out of the model.

Model Card Toolkit

MCT streamlines and automates the generation of Model Cards [1], machine learning documents that provide context and transparency into a model’s development and performance.

TensorFlow Model Remediation

TensorFlow Model Remediation is a library that provides solutions for machine learning practitioners working to create and train models in a way that reduces or eliminates user harm resulting from underlying performance biases.

Fairness

A core principle of ethical AI, fairness includes protecting individuals and groups from discrimination, bias, or mistreatment. Models need to be evaluated for fairness so that there’s no bias towards any groups, factors, or variables.

AI Fairness 360

The AI Fairness 360 toolkit from IBM is an extensible open-source library containing techniques developed by the research community to help detect and mitigate bias in machine learning models throughout the AI application lifecycle.

Fairlearn

Fairlearn is a Python package that empowers developers of artificial intelligence (AI) systems to assess their system’s fairness and mitigate any observed unfairness issues. Fairlearn contains mitigation algorithms as well as metrics for model assessment.

Responsible AI Toolbox

From Microsoft, the Responsible AI Toolbox is a suite of tools that provides a collection of model and data exploration and assessment user interfaces that enable a better understanding of AI systems. It’s an approach to assessing, developing, and deploying AI systems in a safe, trustworthy, and ethical manner, and taking responsible decisions and actions.

AI Explainability

Explainability, aka XAI, is a set of processes and methods that allows human users to better understand and trust the results and output created by machine learning algorithms.

DALEX

The moDel Agnostic Language for Exploration and eXplanation (aka DALEX) package Xrays any model and helps to explore and explain its behavior, while helping to understand how complex models are working.

TensorFlow Data Validation

TensorFlow Data Validation (TFDV) is a library for exploring and validating machine learning data. It is designed to be highly scalable and to work well with TensorFlow and TensorFlow Extended (TFX).

XAI

XAI is a machine learning library that is designed with AI explainability at its core. XAI contains various tools that enable for analysis and evaluation of data and models.

Adversarial Machine Learning & Trusted AI

Adversarial machine learning is a machine learning technique that attempts to exploit models by taking advantage of obtainable model information and using it to create malicious attacks. Responsible AI toolkits can help to protect these attacks from happening and to save the systems should they occur.

Fawkes

Fawkes is an algorithm and software tool that gives individuals the ability to limit how unknown third parties can track them by building facial recognition models out of their publicly available photos. This involves distorting personal images, or cloaking them, so that they can’t be detected by malicious models.

TextAttack

TextAttack is a Python framework for adversarial attacks, adversarial training, and data augmentation in NLP. TextAttack makes experimenting with the robustness of NLP models seamless, fast, and easy. It’s also useful for NLP model training, adversarial training, and data augmentation.

AdverTorch

AdverTorch is a Python toolbox for adversarial robustness research. The primary functionalities are implemented in PyTorch. Specifically, AdverTorch contains modules for generating adversarial perturbations and defending against adversarial examples, also scripts for adversarial training.

 

 

Other docs:

https://www.h2o.ai/insights/responsible-ai/

https://ai.facebook.com/blog/facebooks-five-pillars-of-responsible-ai/

https://www.microsoft.com/en-us/ai/responsible-ai-resources

https://analyticsindiamag.com/8-explainable-ai-frameworks-driving-a-new-paradigm-for-transparency-in-ai

Aporia – ML Observability & Monitoring