Presentation - Racial and Gender Bias in AI by Gunay Kazimzade. Gunay Kazimzade is working at the Weizenbaum Institute for the Networked Society and she is also a Ph.D. student in Computer Science at the Technical University of Berlin. After Applied Mathematics and Computer Science degrees, she was involved in the education field and managed two social projects focused on women and children Computer Science education. Trained over 3000 women and children in Azerbaijan. Currently working with the Research Group "Criticality of Artificial Intelligence-based systems". Her main research directions are Gender and racial bias in AI, inclusiveness in AI and AI-enhanced education. She is a TEDx speaker participating and presenting in various conferences and summits happening in Europe.

1. 1

2. 2
Weizenbaum Institute for the
Networked Society
Berlin, Germany

3. 3
JOINT PROJECT
The Weizenbaum Institute
investigates the current changes
in all aspects of society occurring
in response to digitalisation.

4. 4
Criticality of AI-based systems

5. 5
5 2 14 20
Doktorand/innen Research Fellows Mitarbeiter in der Beirat mit Vertretern aus
Geschäftsstelle des Wirtschaft, Wissenschaft,
Weizenbaum-Instituts Medien, Zivilgesellschaft
Transportation Medicine Human
Resources
Public Safety Finance
AI: Domains

6. 6

7. 7
BIASED AI vs.
BIASED SOCIETY

8. 8
Data
User
Algorithm/
Machine
Providers/
Developers
Impacted
people
BIAS in AI

9. 9
BIG DATA ≠ GOOD DATA
• How was the data collected?
• By whom was the data collected?
• For which purposes?
• Is the data diverse enough to be
considered for training?
• Which historical or idealogical
mappings does it contain?

10. 10
Bias in AI – Gender Shades project (MIT)

11. 11
BIAS

12. 12
Analogies
Photo credit: Quantifying and Reducing Gender
Stereotypes in Word Embeddings, Kai-Wei Chang, Tolga Bolukbasi, Venkatesh
Saligrama

13. 13
Photo credit: Quantifying and Reducing Gender
Stereotypes in Word Embeddings, Kai-Wei Chang, Tolga Bolukbasi, Venkatesh
Saligrama

14. 14

15. 15
BIASED AI vs.
BIASED SOCIETY

16. 16
BIASED AI vs.
BIASED SOCIETY
Educational Approach:
AI-child interaction

17. 17

18. 18
CONTACT
Weizenbaum Institute for the Networked Society
Hardenbergstr. 32, 10623 Berlin
www.weizenbaum-institut.de
Gunay Kazimzade
Gunay.kazimzade@tu-berlin.de