Andreas Fehlner

Europe

ONNX

fehlner@arcor.de 

Susan Malaika

America

IBM

malaika@us.ibm.com

Suparna Bhattacharya

Adrian Gonzalez Sanchez

Europe

HEC Montreal / Microsoft / OdiseIA

adrian.gonzalez-sanchez@hec.ca 

Ofer Hermoni

PieEye

oferher@gmail.com

Mazin Gilbert

ATT 

mazin@research.att.com 

Alka Roy

Responsible Innovation Project

alka@responsibleproject.com 

Mikael Anneroth 

Ericsson

mikael.anneroth@ericsson.com 

Alejandro Saucedo

The Institute for Ethical AI and Machine Learning

a@ethical.institute

Jim Spohrer

Retired IBM

, ISSIP.org

spohrer@gmail.com

Jim Spohrer 

Saishruthi Swaminathan

IBM

saishruthi.

tn@ibm.com

Susan Malaika

IBM

malaika@us.ibm.com

sumalaika (but different email address)

Romeo Kienzler

IBM

romeo.kienzler@ch.ibm.com


Francois Jezequel

Orange

francois.jezequel@orange.com 

Nat Subramanian

Tech Mahindra 

Natarajan.Subramanian@Techmahindra.com

Han Xiao

Tencent

hanhxiao@tencent.com

Wenjing Chu

Futurewei

chu.wenjing@gmail.com

Wenjing Chu

Yassi Moghaddam

ISSIP

yassi@issip.org

AI Fairness 360

https://github.com/IBM/AIF360

http://aif360.mybluemix.net/

Adversarial Robustness 360

https://github.com/IBM/adversarial-robustness-toolbox

https://art-demo.mybluemix.net/

AI Explainability 360

https://github.com/IBM/AIX360

http://aix360.mybluemix.net

Zoom Recording Link: https://zoom.us/rec/play/9wmVWdg8wlCuv3E8CVNfKI4uxZA-lHC5RCdwZikVHj4zb3cvvQVw7sE0DQ2vw7XgXT2UgmrFelOa3FEW._gQfopF1nWY820Pf?canPlayFromShare=true&from=share_recording_detail&continueMode=true&componentName=rec-play&originRequestUrl=https%3A%2F%2Fzoom.us%2Frec%2Fshare%2FWCKI--kYX2WJWEm_pa39jWYw8YCxMxxpFc5nHXqzXXaE6Uo_6SUQMLuX1rznqX8s.LBD6697U22Q-rk55

Recording could be also accessed by http://openprofile.dev

Friday August 11, at 10am US Eastern 

 Working Session to prepare for the TAC Trusted AI Committee presentation on Thursday September 7 at 9am US Eastern

MarkTechPost,  Jean-marc Mommessin

Active and Continuous Learning for Trusted AI, Martin Foltin 

AI Explainability, Vijay Arya

Recording (video) Zoom

Recording (video)

Recording (video)

Recording (audio)

Invitees: Beat Buesser; Phaedra Boinodiris ; Alexy Khrabov, David Radley, Adrian Gonzalez Sanchez

Optional: Ofer Hermoni , Nancy Rausch, Alejandro Saucedo, Sri Krishnamurthy, Andreas Fehlner, Suparna Bhattacharya

Attendees: Beat Buesser, Phaedra Boinodiris, Alexy Khrabov, Adrian Gonzalez Sanchez, Ofer Hermoni, Andreas Fehlne

Discussion

• Phaedra - Consider : Large Language Models opportunity and risks - in the context trusted ai - how to mitigate risk -
• Adrian: European Union AI Act https://artificialintelligenceact.eu/
• Suparna -what does it mean foundation models in general, where language models is one example. Another related area is data centric trustworthy AI in this context
• Alexy - Science - More work on understanding at the scientific way (e.g., Validation in Medical Context) - software engineering ad hoc driven by practice

• Fast Forward - what’s next for ChatGPT

• Andreas : File Formats for Models - additional needs for Trustworthy AI - in addition to Lineage
• Idea: Create a PoV - Trustworthy AI for Generative application - Take AI ACT approach
• Gaps in EU AT Act: https://venturebeat.com/ai/coming-ai-regulation-may-not-protect-us-from-dangerous-ai/ useful source

Next steps

• Set up a series of calls through the LF-AI Trusted AI mechanisms to have the following presenters
• Run 3 sessions with presentations
  • Adrian Gonzalez Sanchez
  • Phaedra Boinodiris, IBM
  • Suparna Bhattacharya, suparna.bhattacharya@hpe.com, HPE
• Then create a presentation and/or document

• Create the synthesis -A Point of View on : Trustworthy AI for Generative Applications

• Occasionally the open source project leaders are invited to the call …
• ACTION: Adrian will schedule next meeting

malaika@us.ibm.com has scheduled a call on Monday October 31, 2022 to determine next steps for the committee due to a change in leadership- please connect with Susan if you would like to be added to the call

The group met once a month - on the third Thursday each month at 10am US Eastern. See notes below for prior calls . Activities of the committee included:

• Reviewing all trusted AI related projects at the LF-AI and making suggestions - e.g.,
• AI Fairness 360
• AI Explainability
• Adversarial Robustness Toolbox
• Related projects such as Egeria, Open Lineage etc
• Reviewing the activities of the subgroups - known as working groups - and making suggestions
• MLSecOps WG
• Principles WG (completed)
• Highlighting new projects that should/could be suitable for the LF-AI
• Identifying trends in the industry in Trusted AI that should be of interest to the LF-AI
• Initiating Working Groups within the Trusted AI Committee at the LF-AI to address particular issues

Reporting to:

• The LF-AI Board of Governors on the activities of the Committee and taking guidance from the board - next meeting on Nov 1, 2022
• The LF-AI TAC - making suggestions to the TAC and taking guidance

Questions:

• Should the Trusted AI Committee continue to meet once a month with similar goals?
• Who will:
• Identify the overall program and approach for 2023 - should that be the subject of the next Trusted AI Committee Call?
  • Host the meetings?
  • Identify the speakers?
  • Make sure all is set speakers and community?
  • Should the Trusted AI Committee take an interest in the activities of the PyTorch Consortium?

Invitees and interested parties on the call on October 31, 2022

• HPE Suparna Battacharya
• IBM Beat Buesser David Radley Christian Kadner Ruchi Mahindru Susan Malaika Cheranellore(Vasu) Vasu William Bittles ;
• Beat leads the Adversarial Robustness Toolbox - a graduated project at the LF-AI
• David works on Egeria Project - a graduated project at the LF-AI
• William is involved in open lineage
• Susan co-led Principles WG - a subgroup of Trusted AI Committee - work completed
• Institute for Ethical AI Alejandro Saucedo Alejandro is also at Seldon - Leads MLSec Working Group - a subgroup of Trusted AI Committee
• QuantUniversity Sri Krishnamurthy
• SAS Nancy Rausch Currently chair of LF-AI and Data TAC
• Trumpf Andreas Fehlner

Plotly Demo with SHAP and AIX360 - Xing Han, Plot.ly

• Explain the Tips dataset with SHAP: Article, Demo
• Heart Disease Classification with AIX360: Post, Demo
• Community-made SHAP-to-dashboard API: Post
  
  

Swiss Digital Trust Label - short summary - Romeo Kienzler, IBM

• Announced by Swiss President Doris Leuthard at WEF 2nd Sept. 2019
• Geneva based initiative for sustainable and fair treatment of data
• Among others, those companies are involved already Google, Uber, IBM, Microsoft, Facebook, Roche, Mozilla, Booking.com, UBS, Credit Suisse, Zurich, Siemens IKRK,  EPFL,  ETH, UNO
• Booking.com, Credit Suisse, IBM, Swiss Re, SBB, Kudelski and Canton of Waadt to deliver pilot

• Montreal AI Ethics Institute Presentation

• Status on Trusted AI projects in Open Governance

• Principles Working Group update - Susan Malaika

• Trusted AI Committee activities summarization for Governing board - Animesh Singh

• Swaminathan Chandrasekaran, KPMG Managing Director would be talking about how they are working with practitioners in the field on their AI Governance and Trusted AI needs.

• Susan Malaika from IBM will be giving an update from the Principles Working Group, and progress there.

• Saishruthi Swaminathan to do a presentation on AI Transparency in Marketplace

• Francois Jezequel to present on Orange Responsible AI initiative.

• Andrew and Tommy did a deep dive in Kubeflow Serving and Trusted AI Integration

• Principles Working Group discussion

• AI for People is focused on the intersection of AI and Society with a lot of commonality with the focus areas of our committee. Marta will be joining to present their organization and what they are working on.

• Proposal of Use Case to be tested by AT&T using Apache Nifi and AIF360  (romeo)

20 Feb 2020

• Introduction to baseline data set for AI Bias detection (romeo)

• Exemplar walk-through: retrospective bias detection with Apache Nifi and AIF360 (romeo)

• Principles Working Group Status Update (Susan)

23 Jan 2020

12 Dec 2019

Proposed Agenda

• Meeting notes are now in GitHub here: https://github.com/lfai/trusted-ai/tree/master/committee-meeting-notes

• Since we don't record and share our committee meetings should our committee channel in Slack be made private for asyncronous conversation outside these calls?

• Introduction of MLOps  in IBM Trusted AI projects

• Design thinking around integrating Trusted AI projects in Kubeflow Serving

Notes from the call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191212.md

14 Nov 2019

Proposed Agenda:

• Jim to get feedback from LFAI Board meeting

• Romeo to demo AIF360 -Nifi Integration + feedback from his talk at OSS Lyon

• Alka to present AT&T Working doc

• Discuss holiday week meeting potential conflicts (28 Nov - US Holiday, 26 Dec - Day after Christmas)

Notes from call:

https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191114.md

17 Oct 2019

Attendees:

Ofer, Alka, Francois, Nat, Han, Animesh, Jim, Maureen, Susan, Alejandro

Summary

• Animesh walked through the draft slides (to be presented in Lyon to LFAI governing board about TAIC)

• Discussion of changes to make

• Discussion of members, processes, and schedules

Detail

• Jim will put slides in Google Doc and share with all participants

• Susan is exploring a slack channel for communications

• Trust and Responsibility, Color, Icons to add Amdocs, Alejandro's Institute

• Next call Cancelled (31 October) as many committee members will be at OSS EU and TensorFlow World

Notes from the call:

https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191017.md

03 Oct 2019

Attendees:

Animesh Singh (IBM), Maureen McElaney (IBM), Han Xiao (Tencent), Alejandro Saucedo, Mikael Anneroth (Eriksson), Ofer Hermoni (Amdocs)

Animesh will check with Souad Ouali to ensure Orange wants to lead the Principles working group and host regular meetings. Committee members on the call were not included in the email chains that occurred so we need to confirm who is in charge and how communication will occur.

The Technical working group has made progress but nothing concrete to report.

A possible third working group could form around AI Standards.

Notes from the call:

https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191003.md

19 Sep 2019 

Attendees:

Ibrahim. H, Nat .S, Animesh.S, Alka.R, Jim.S, Francios. J, Jeff. C, Maureen. M, Mikael. A, Ofer. H, Romeo.K

• Goals defined for the meeting:

Working Group Names and Leads have been confirmed:

• Principles, lead: Souad Ouali (Orange France) with members from Orange, AT&T, Tech Mahindra, Tencent, IBM, Ericsson, Amdocs.
• Technical, lead: Romeo Kienzler (IBM Switzerland) with members from IBM, AT&T, Tech Mahindra, Tencent, Ericsson, Amdocs, Orange.
• Working groups will have a weekly meeting to make progress.  First read out to LF AI governing board will be Oct 31 in Lyon France.
• The Principles team will study the existing material from companies, governments, and professional associations (IEEE), and some up with set that can be shared with the technical team for feedback as a first step.  We need to identify and compile the existing materials.
• The Technical team is working on Acuomos+Angel+AIF360 integration demonstration.

Possible Discussion about third working group

Discussion about LFAI day in Paris

More next steps

Will begin recording meetings in future calls.

Notes from call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20190919.md