Versions Compared

Old Version 46

changes.mady.by.user mo_mack

Saved on

compared with

New Version 47

changes.mady.by.user mo_mack

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Added meeting notes

Table of Contents

Overview

Below is an overview of the current discussion topics within the Trusted AI Committee. Further updates will follow as the committee work develops. 

  • Focus of the committee is on policies, guidelines, tooling and use cases by industry

  • Survey and contact current open source Trusted AI related projects to join LF AI efforts 

  • Create a badging or certification process for open source projects that meet the Trusted AI policies/guidelines defined by LF AI

  • Create a document that describes the basic concepts and definitions in relation to Trusted AI and also aims to standardize the vocabulary/terminology

Mail List

Please self subscribe to the mail list here at https://lists.lfai.foundation/g/trustedai-committee. 

Or email trustedai-committee@lists.lfai.foundation for more information. 

Participants

Initial Organizations Participating: AT&T, Amdocs, Ericsson, IBM, Orange, TechM, Tencent

Committee Chairs

NameRegionOrganizationEmail AddressLF ID
Animesh SinghNorth AmericaIBMsinghan@us.ibm.com
Souad OualiEuropeOrangesouad.ouali@orange.com
Jeff CaoAsiaTencentjeffcao@tencent.com

Committee Participants
NameOrganization Email AddressLF ID
Ofer HermoniAmdocs oferher@gmail.com
Mazin GilbertATT mazin@research.att.com 
Alka RoyATT AR6705@att.com 
Mikael Anneroth Ericssonmikael.anneroth@ericsson.com 
Alejandro SaucedoThe Institute for Ethical AI and Machine Learninga@ethical.institute
Jim SpohrerIBM spohrer@us.ibm.comspohrer
Maureen McElaneyIBM mmcelaney@us.ibm.com
Susan MalaikaIBM malaika@us.ibm.comsumalaika (but different email address)
Romeo KienzlerIBMromeo.kienzler@ch.ibm.com

Francois JezequelOrangefrancois.jezequel@orange.com 
Nat SubramanianTech Mahindra Natarajan.Subramanian@Techmahindra.com
 Han XiaoTencent hanhxiao@tencent.com
Wenjing ChuFutureweichu.wenjing@gmail.comWenjing Chu
Yassi MoghaddamISSIPyassi@issip.org

Assets

- All the assets being 

Sub Categories

- Fairness: Methods to detect and mitigate bias in datasets and models, including bias against known protected populations

- Robustness: Methods to detect alterations/tampering with datasets and models, including alterations from known adversarial attacks

- Explainability: Methods to enhance understandability/interpretability by persona/roles in process of AI model outcomes/decision recommendations, including ranking and debating results/decision options

- Lineage: Methods to ensure provenance of datasets and AI models, including reproducibility of generated datasets and AI models

Projects

NameGithubWebsite
AI Fairness 360https://github.com/IBM/AIF360http://aif360.mybluemix.net/
Adversarial Robustness 360https://github.com/IBM/adversarial-robustness-toolboxhttps://art-demo.mybluemix.net/
AI Explainability 360https://github.com/IBM/AIX360http://aix360.mybluemix.net

Meetings

How to Join: Visit the Trusted AI Committee Group Calendar to self subscribe to meetings.

Or email trustedai-committee@lists.lfai.foundation for more information. 

Meeting Content (minutes / recording / slides / other):

Date

Agenda/Minutes

23rd

Proposed Agenda

  • Discuss AIF360 work around SKLearn community (Samuel Hoffman, IBM Research demo)
  • Discuss "Many organizations have principles documents, and a bit of backlash - for not enough practical examples."

    Resource
  • Watch updates on production ML with Alejandro Saucedo done with Susan Malaika on the Cognitive Systems Institute call:
    Widget Connector
    urlhttps://www.youtube.com/watch?v=nuvRMFM8USE
12th

Notes from the call:
https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20200123.md

Proposed Agenda

  • Meeting notes are now in GitHub here: https://github.com/lfai/trusted-ai/tree/master/committee-meeting-notes
  • Since we don't record and share our committee meetings should our committee channel in Slack be made private for asyncronous conversation outside these calls?
  • Introduction of MLOps  in IBM Trusted AI projects
  • Design thinking around integrating Trusted AI projects in Kubeflow Serving

Notes from the call: 
https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191212.md

Proposed Agenda:

  • Jim to get feedback from LFAI Board meeting
  • Romeo to demo AIF360 -Nifi Integration + feedback from his talk at OSS Lyon
  • Alka to present AT&T Working doc
  • Discuss holiday week meeting potential conflicts (28 Nov - US Holiday, 26 Dec - Day after Christmas)

Notes from call:
https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191114.md

Attendees:
Ofer, Alka, Francois, Nat, Han, Animesh, Jim, Maureen, Susan, Alejandro

Summary

  • Animesh walked through the draft slides (to be presented in Lyon to LFAI governing board about TAIC)
  • Discussion of changes to make
  • Discussion of members, processes, and schedules

Detail

  • Jim will put slides in Google Doc and share with all participants
  • Susan is exploring a slack channel for communications
  • Trust and Responsibility, Color, Icons to add Amdocs, Alejandro's Institute
  • Next call Cancelled (31 October) as many committee members will be at OSS EU and TensorFlow World

Notes from the call:
https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191017.md

Attendees:

Animesh Singh (IBM), Maureen McElaney (IBM), Han Xiao (Tencent), Alejandro Saucedo, Mikael Anneroth (Eriksson), Ofer Hermoni (Amdocs)

Animesh will check with Souad Ouali to ensure Orange wants to lead the Principles working group and host regular meetings. Committee members on the call were not included in the email chains that occurred so we need to confirm who is in charge and how communication will occur.

The Technical working group has made progress but nothing concrete to report.

A possible third working group could form around AI Standards.

Notes from the call:

https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191003.md

 

Attendees:
Ibrahim. H, Nat .S, Animesh.S, Alka.R, Jim.S, Francios. J, Jeff. C, Maureen. M, Mikael. A, Ofer. H, Romeo.K
  • Goals defined for the meeting:
  • Working Group Names and Leads have been confirmed:

    Principles, lead: Souad Ouali (Orange France) with members from Orange, AT&T, Tech Mahindra, Tencent, IBM, Ericsson, Amdocs.

    Technical, lead: Romeo Kienzler (IBM Switzerland) with members from IBM, AT&T, Tech Mahindra, Tencent, Ericsson, Amdocs, Orange.

    Working groups will have a weekly meeting to make progress.  First read out to LF AI governing board will be Oct 31 in Lyon France.

    The Principles team will study the existing material from companies, governments, and professional associations (IEEE), and some up with set that can be shared with the technical team for feedback as a first step.  We need to identify and compile the existing materials.

    The Technical team is working on Acuomos+Angel+AIF360 integration demonstration.


    3. Possible Discussion about third working group

  • Discussion about LFAI day in Paris

  • More next steps
    • Will begin recording meetings in future calls.

Notes from call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20190919.md