Versions Compared

Old Version 18

changes.mady.by.user Maureen McElaney

Saved on

compared with

New Version 78

changes.mady.by.user Jim Spohrer

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Overview

Below is an overview of the current discussion topics within the Trusted AI Committee. Further updates will follow as the committee work develops. 

  • Focus of the committee is on policies, guidelines, tooling and use cases by industry

  • Survey and contact current open source Trusted AI related projects to join LF AI efforts 

  • Create a badging or certification process for open source projects that meet the Trusted AI policies/guidelines defined by LF AI

  • Create a document that describes the basic concepts and definitions in relation to Trusted AI and also aims to standardize the vocabulary/terminology

Mailing List

If you are interested in getting involved please email info@lfai.foundation to be added to the mailing list. 

Current Participants

Mail List

Please self subscribe to the mail list here at https://lists.lfai.foundation/g/trustedai-committee. 

Or email trustedai-committee@lists.lfai.foundation for more information. 

Meetings

Zoom info : Trusted AI Committee meeting -  Alternate Thursday's,  10 PM Shenzen China, 4 PM Paris, 10 AM ET, 7 AM PT USA (updated for daylight savings time as needed)
https://zoom.us/j/7659717866

Participants

Initial Organizations Participating: IBM, Orange, AT&T, Amdocs, Ericsson

, IBM, Orange

, TechM, Tencent

Committee Chairs

Name

Region

Organization

Email Address

LF ID

Animesh Singh

 :

North America

(IBM)

  • Souad Ouali : Europe (Orange)

  • Jeff Cao : Asia (Tencent)

    • IBM

    singhan@us.ibm.com


    Souad Ouali

    Europe

    Orange

    souad.ouali@orange.com


    Jeff Cao

    Asia

    Tencent

    jeffcao@tencent.com


    Committee ParticipantsWorking Group:

    Name

    Organization

     Contact Info

     Email Address

    LF ID

    Ofer Hermoni

    Amdocs 

    ofer.hermoni@amdocs

    oferher@gmail.com

     

     Mazin

    Mazin Gilbert

    ATT 

    mazin@research.att.com 

     Alka

    Alka Roy

    ATT 

    Responsible Innovation Project

    AR6705@att

    alka@responsibleproject.com 


    Mikael Anneroth 

    Ericsson

    mikael.anneroth@ericsson.com 


    Alejandro Saucedo

    The Institute for Ethical AI and Machine Learning

    a@ethical.institute


    Jim Spohrer

    IBM

     spohrer@us.ibm.com

    Maureen McElaney

    spohrer

    Saishruthi Swaminathan

    IBM

     

    mmcelaney@us

    saishruthi.

    ibm

    tn@ibm.com


    Susan Malaika

    IBM

     malaika@us.ibm.com

    sumalaika (but different email address)

    Romeo Kienzler

    IBM

    romeo.kienzler@ch.ibm.com



    Francois Jezequel

     Orange

    Orange

    francois.jezequel@orange.com 


    Nat Subramanian

    Tech Mahindra 

    Natarajan.Subramanian@Techmahindra.com


     Han Xiao

     Tencent

    Tencent

     hanhxiao@tencent.com


    Wenjing Chu

    Futurewei

    chu.wenjing@gmail.com

    Wenjing Chu

    Yassi Moghaddam

    ISSIP

    yassi@issip.org


    Assets

    - All the assets being 

    Sub Categories

    - Fairness: Methods to detect and mitigate bias in datasets and models, including bias against known protected populations

    - Robustness: Methods to detect alterations/tampering with datasets and models, including alterations from known adversarial attacks

    - Explainability: Methods to enhance understandability/interpretability by persona/roles in process of AI model outcomes/decision recommendations, including ranking and debating results/decision options

    - Lineage: Methods to ensure provenance of datasets and AI models, including reproducibility of generated datasets and AI models

    Projects:

    Name

    Github

    Website

    AI Fairness 360

    https://github.com/IBM/AIF360

    http://aif360.mybluemix.net/

    Adversarial Robustness 360

    https://github.com/IBM/adversarial-robustness-toolbox

    https://art-demo.mybluemix.net/

    AI Explainability 360

    https://github.com/IBM/AIX360

    http://aix360.mybluemix.net

    If you are interested in getting involved please email info@lfai.foundation for more information. 

    Working Groups

     Trusted AI Principles Working Group

     Trusted AI Technical Working Group

    Meetings

    Zoom info : Trusted AI Committee meeting -  Alternate Thursday's,  10 PM Shenzen China, 4 PM Paris, 10 AM ET, 7 AM PT USA (updated for daylight savings time as needed)
    https://zoom.us/j/7659717866


    How to Join: Visit the Trusted AI Committee Group Calendar to self subscribe to meetings.

    Or email trustedai-committee@lists.lfai.foundation for more information. 

    Meeting Content (minutes / recording / slides / other):

    Date

    Agenda/Minutes

    • Recording
    • Walkthrough of LFAI Trusted AI Website and github location of projects
    • Trusted AI Video Series
    • Trusted AI Course in collaboration with University of Pensylvania

    • Recording
    • Z-Inspection: A holistic and analytic process to assess Ethical AI - Roberto Zicari - University of Frankfurt, Germany
    • Age-At-Home - the exemplar of TrustedAI, David Martin, Hacker in Charge at motion-ai.com

    • Plotly Demo with SHAP and AIX360 - Xing Han, Plot.ly
       
      • Explain the Tips dataset with SHAP: Article, Demo
      • Heart Disease Classification with AIX360: Post, Demo
      • Community-made SHAP-to-dashboard API: Post

    • Swiss Digital Trust Label - short summary - Romeo Kienzler, IBM
      • Announced by Swiss President Doris Leuthard at WEF 2nd Sept. 2019
      • Geneva based initiative for sustainable and fair treatment of data
      • Among others, those companies are involved already Google, Uber, IBM, Microsoft, Facebook, Roche, Mozilla, Booking.com, UBS, Credit Suisse, Zurich, Siemens IKRK,  EPFL,  ETH, UNO
      • Booking.com, Credit Suisse, IBM, Swiss Re, SBB, Kudelski and Canton of Waadt to deliver pilot

    Agenda

    Agenda

    • Montreal AI Ethics Institute Presentation

    • Status on Trusted AI projects in Open Governance

    Agenda

    • Principles Working Group update - Susan Malaika

    • Trusted AI Committee activities summarization for Governing board - Animesh Singh

    Agenda

    • Swaminathan Chandrasekaran, KPMG Managing Director would be talking about how they are working with practitioners in the field on their AI Governance and Trusted AI needs.

    • Susan Malaika from IBM will be giving an update from the Principles Working Group, and progress there.

    Agenda

    • Saishruthi Swaminathan to do a presentation on AI Transparency in Marketplace

    • Francois Jezequel to present on Orange Responsible AI initiative.

    Agenda

    • Andrew and Tommy did a deep dive in Kubeflow Serving and Trusted AI Integration

    • Principles Working Group discussion

    Proposed Agenda

    • AI for People is focused on the intersection of AI and Society with a lot of commonality with the focus areas of our committee. Marta will be joining to present their organization and what they are working on.

    • Proposal of Use Case to be tested by AT&T using Apache Nifi and AIF360  (romeo)

    Proposed Agenda

    • Introduction to baseline data set for AI Bias detection (romeo)

    • Exemplar walk-through: retrospective bias detection with Apache Nifi and AIF360 (romeo)

    • Principles Working Group Status Update (Susan)

    Proposed Agenda

    • Discuss AIF360 work around SKLearn community (Samuel Hoffman, IBM Research demo)
    • Discuss "Many organizations have principles documents, and a bit of backlash - for not enough practical examples."

      Resource
    • Watch updates on production ML with Alejandro Saucedo done with Susan Malaika on the Cognitive Systems Institute call:
      Widget Connector
      urlhttps://www.youtube.com/watch?v=nuvRMFM8USE

    Notes from the call:
    https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20200123.md

    Proposed Agenda

    • Meeting notes are now in GitHub here: https://github.com/lfai/trusted-ai/tree/master/committee-meeting-notes

    • Since we don't record and share our committee meetings should our committee channel in Slack be made private for asyncronous conversation outside these calls?

    • Introduction of MLOps  in IBM Trusted AI projects

    • Design thinking around integrating Trusted AI projects in Kubeflow Serving

    Notes from the call: 
    https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191212.md

    Proposed Agenda:

    • Jim to get feedback from LFAI Board meeting

    • Romeo to demo AIF360 -Nifi Integration + feedback from his talk at OSS Lyon

    • Alka to present AT&T Working doc

    • Discuss holiday week meeting potential conflicts (28 Nov - US Holiday, 26 Dec - Day after Christmas)

    Notes from call:
    https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191114.md

    Attendees:

    Ofer, Alka, Francois, Nat, Han, Animesh, Jim, Maureen, Susan, Alejandro

    Summary

    • Animesh walked through the draft slides (to be presented in Lyon to LFAI governing board about TAIC)

    • Discussion of changes to make

    • Discussion of members, processes, and schedules

    Detail

    • Jim will put slides in Google Doc and share with all participants

    • Susan is exploring a slack channel for communications

    • Trust and Responsibility, Color, Icons to add Amdocs, Alejandro's Institute

    • Next call Cancelled (31 October) as many committee members will be at OSS EU and TensorFlow World

    Notes from the call:

    https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191017.md

    Attendees:

    Animesh Singh (IBM), Maureen McElaney (IBM), Han Xiao (Tencent), Alejandro Saucedo, Mikael Anneroth (Eriksson), Ofer Hermoni (Amdocs)

    Animesh will check with Souad Ouali to ensure Orange wants to lead the Principles working group and host regular meetings. Committee members on the call were not included in the email chains that occurred so we need to confirm who is in charge and how communication will occur.

    The Technical working group has made progress but nothing concrete to report.

    A possible third working group could form around AI Standards.

    Notes from the call:

    https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191003.md

     

    Attendees:
    Ibrahim. H, Nat .S, Animesh.S, Alka.R, Jim.S, Francios. J, Jeff. C, Maureen. M, Mikael. A, Ofer. H, Romeo.K

    • Goals defined for the meeting:
    • Working Group Names and Leads have been confirmed:

      Principles, lead: Souad Ouali (Orange France) with members from Orange, AT&T, Tech Mahindra, Tencent, IBM, Ericsson, Amdocs.

      Technical, lead: Romeo Kienzler (IBM Switzerland) with members from IBM, AT&T, Tech Mahindra, Tencent, Ericsson, Amdocs, Orange.

      Working groups will have a weekly meeting to make progress.  First read out to LF AI governing board will be Oct 31 in Lyon France.

      The Principles team will study the existing material from companies, governments, and professional associations (IEEE), and some up with set that can be shared with the technical team for feedback as a first step.  We need to identify and compile the existing materials.

      The Technical team is working on Acuomos+Angel+AIF360 integration demonstration.


      3. Possible Discussion about third working group

    • Discussion about LFAI day in Paris

    • More next steps
      • Will begin recording meetings in future calls.

    Notes from call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20190919.md