Trusted AI Committee

Overview

Below is an overview of the current discussion topics within the Trusted AI Committee. Further updates will follow as the committee work develops.

Focus of the committee is on policies, guidelines, tooling and use cases by industry
Survey and contact current open source Trusted AI related projects to join LF AI efforts
Create a badging or certification process for open source projects that meet the Trusted AI policies/guidelines defined by LF AI
Create a document that describes the basic concepts and definitions in relation to Trusted AI and also aims to standardize the vocabulary/terminology

Mail List

Please self subscribe to the mail list here at https://lists.lfai.foundation/g/trustedai-committee.

Or email trustedai-committee@lists.lfai.foundation for more information.

Participants

Initial Organizations Participating: AT&T, Amdocs, Ericsson, IBM, Orange, TechM, Tencent

Committee Chairs

Name	Region	Organization	Email Address
Animesh Singh	North America	IBM	singhan@us.ibm.com
Souad Ouali	Europe	Orange	souad.ouali@orange.com
Jeff Cao	Asia	Tencent	jeffcao@tencent.com

Committee Participants

Name	Organization	Email Address	LF ID
Ofer Hermoni	Amdocs	oferher@gmail.com
Mazin Gilbert	ATT	mazin@research.att.com
Alka Roy	ATT	AR6705@att.com
Mikael Anneroth	Ericsson	mikael.anneroth@ericsson.com
Alejandro Saucedo	The Institute for Ethical AI and Machine Learning	a@ethical.institute
Jim Spohrer	IBM	spohrer@us.ibm.com	spohrer
Maureen McElaney	IBM	mmcelaney@us.ibm.com
Susan Malaika	IBM	malaika@us.ibm.com	sumalaika (but different email address)
Romeo Kienzler	IBM	romeo.kienzler@ch.ibm.com
Francois Jezequel	Orange	francois.jezequel@orange.com
Nat Subramanian	Tech Mahindra	Natarajan.Subramanian@Techmahindra.com
Han Xiao	Tencent	hanhxiao@tencent.com
Wenjing Chu	Futurewei	chu.wenjing@gmail.com	Wenjing Chu
Yassi Moghaddam	ISSIP	yassi@issip.org

Assets

- All the assets being

Sub Categories

- Fairness: Methods to detect and mitigate bias in datasets and models, including bias against known protected populations

- Robustness: Methods to detect alterations/tampering with datasets and models, including alterations from known adversarial attacks

- Explainability: Methods to enhance understandability/interpretability by persona/roles in process of AI model outcomes/decision recommendations, including ranking and debating results/decision options

- Lineage: Methods to ensure provenance of datasets and AI models, including reproducibility of generated datasets and AI models

Projects

Name	Github	Website
AI Fairness 360	https://github.com/IBM/AIF360	http://aif360.mybluemix.net/
Adversarial Robustness 360	https://github.com/IBM/adversarial-robustness-toolbox	https://art-demo.mybluemix.net/
AI Explainability 360	https://github.com/IBM/AIX360	http://aix360.mybluemix.net

Working Groups

Trusted AI Principles Working Group

Trusted AI Technical Working Group

Meetings

How to Join: Visit the Trusted AI Committee Group Calendar to self subscribe to meetings.

Or email trustedai-committee@lists.lfai.foundation for more information.

Meeting Content (minutes / recording / slides / other):

Date	Agenda/Minutes
14 May 2020	Agenda Swaminathan Chandrasekaran, KPMG Managing Director would be talking about how they are working with practitioners in the field on their AI Governance and Trusted AI needs. Susan Malaika from IBM will be giving an update from the Principles Working Group, and progress there.
30 Apr 2020	Agenda Saishruthi Swaminathan to do a presentation on AI Transparency in Marketplace Francois Jezequel to present on Orange Responsible AI initiative.
16 Apr 2020	Agenda Andrew and Tommy did a deep dive in Kubeflow Serving and Trusted AI Integration Principles Working Group discussion
19 Mar 2020	Proposed Agenda AI for People is focused on the intersection of AI and Society with a lot of commonality with the focus areas of our committee. Marta will be joining to present their organization and what they are working on. Proposal of Use Case to be tested by AT&T using Apache Nifi and AIF360 (romeo)
20 Feb 2020	Proposed Agenda Introduction to baseline data set for AI Bias detection (romeo) Exemplar walk-through: retrospective bias detection with Apache Nifi and AIF360 (romeo) Principles Working Group Status Update (Susan)
23 Jan 2020	Proposed Agenda Discuss AIF360 work around SKLearn community (Samuel Hoffman, IBM Research demo) Discuss "Many organizations have principles documents, and a bit of backlash - for not enough practical examples." Resource Watch updates on production ML with Alejandro Saucedo done with Susan Malaika on the Cognitive Systems Institute call: Notes from the call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20200123.md
12 Dec 2019	Proposed Agenda Meeting notes are now in GitHub here: https://github.com/lfai/trusted-ai/tree/master/committee-meeting-notes Since we don't record and share our committee meetings should our committee channel in Slack be made private for asyncronous conversation outside these calls? Introduction of MLOps in IBM Trusted AI projects Design thinking around integrating Trusted AI projects in Kubeflow Serving Notes from the call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191212.md
14 Nov 2019	Proposed Agenda: Jim to get feedback from LFAI Board meeting Romeo to demo AIF360 -Nifi Integration + feedback from his talk at OSS Lyon Alka to present AT&T Working doc Discuss holiday week meeting potential conflicts (28 Nov - US Holiday, 26 Dec - Day after Christmas) Notes from call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191114.md
17 Oct 2019	Attendees: Ofer, Alka, Francois, Nat, Han, Animesh, Jim, Maureen, Susan, Alejandro Summary Animesh walked through the draft slides (to be presented in Lyon to LFAI governing board about TAIC) Discussion of changes to make Discussion of members, processes, and schedules Detail Jim will put slides in Google Doc and share with all participants Susan is exploring a slack channel for communications Trust and Responsibility, Color, Icons to add Amdocs, Alejandro's Institute Next call Cancelled (31 October) as many committee members will be at OSS EU and TensorFlow World Notes from the call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191017.md
03 Oct 2019	Attendees: Animesh Singh (IBM), Maureen McElaney (IBM), Han Xiao (Tencent), Alejandro Saucedo, Mikael Anneroth (Eriksson), Ofer Hermoni (Amdocs) Animesh will check with Souad Ouali to ensure Orange wants to lead the Principles working group and host regular meetings. Committee members on the call were not included in the email chains that occurred so we need to confirm who is in charge and how communication will occur. The Technical working group has made progress but nothing concrete to report. A possible third working group could form around AI Standards. Notes from the call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191003.md
19 Sep 2019	Attendees: Ibrahim. H, Nat .S, Animesh.S, Alka.R, Jim.S, Francios. J, Jeff. C, Maureen. M, Mikael. A, Ofer. H, Romeo.K Goals defined for the meeting: Working Group Names and Leads have been confirmed: Principles, lead: Souad Ouali (Orange France) with members from Orange, AT&T, Tech Mahindra, Tencent, IBM, Ericsson, Amdocs. Technical, lead: Romeo Kienzler (IBM Switzerland) with members from IBM, AT&T, Tech Mahindra, Tencent, Ericsson, Amdocs, Orange. Working groups will have a weekly meeting to make progress. First read out to LF AI governing board will be Oct 31 in Lyon France. The Principles team will study the existing material from companies, governments, and professional associations (IEEE), and some up with set that can be shared with the technical team for feedback as a first step. We need to identify and compile the existing materials. The Technical team is working on Acuomos+Angel+AIF360 integration demonstration. 3. Possible Discussion about third working group Discussion about LFAI day in Paris More next steps Will begin recording meetings in future calls. Notes from call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20190919.md