SlideShare a Scribd company logo
1 of 99
Download to read offline


ACM FAT*
f
f( )=A
f( )=A


f
f( )=A
f 

f( )=A


f
f
f( )=A
f
f 

X Y ̂YX
S = S =
X
Y
S
̂Y
ℙ{ ̂Y ∈ 𝒜|S = s} = ℙ{ ̂Y ∈ 𝒜|S = s′}
𝒜, s, s′
=
̂Y|S = ̂Y|S =
ℙ{ ̂Y ∈ 𝒜|Y = y, S = s} = ℙ{ ̂Y ∈ 𝒜|Y = y, S = s′}
𝒜, y, s, s′
Y ̂Y
Y = 1 ̂p
Y = 1 ̂p
ℙ{Y = 1| ̂p = p, S = s} = p
p, s
p
̂p = p|S =
x, x′
D( f(x), f(x′)) ≤ d(x, x′)
≈ ⟹
f : 𝒳 → Δ(𝒴)
f( )=A
f 

minf Err(f ) + ηUnfair(f )
minf Err(f ) Unfair(f ) ≤ η
Q
Q f
minQ 𝔼f∼Qℙ{f(X) ≠ Y} M𝔼f∼Q[μ(f )] ≤ c
𝔼{f(X)|S = 0} = 𝔼{f(X)}
𝔼{f(X)|S = 1} = 𝔼{f(X)}
minQ 𝔼f∼Qℙ{f(X) ≠ Y} M𝔼f∼Q[μ(f )] ≤ c
maxλ∈ℝK
+,∥λ∥≤B minQ 𝔼f∼Qℙ{f(X) ≠ Y} + λ⊤
(M𝔼f∼Q[μ(f )] − c)
minf ∑
n
i=1 (h(Xi)C1
i + (1 − h(Xi))C0
i )
λ Q
μ
Q
λ


g( )= z
f( )=A
zz
g( )
g( )
z
g( )
g( )
z
g( )
g( )
z
f( )=A
z
g( )
g( )
z
g( )=
f( )=A
d( )=z
z
z








minf Likelihood(f(X), Y) + ηI(f(X), S)
f( )=A
f( )=A
f( )=A


f( )=A


̂Y = 1
maxy,s (VC(ℱ) + ln(1/δ))/(nPy,s)
maxy,s ln(1/δ)/(nPy,s)
maxy,s (VC(ℱ) + ln(1/δ))/(nPy,s)
maxy,s ln(1/δ)/(nPy,s)
(y, s)


minθ 𝔼[ℓ0(X, θ)] 𝔼[ℓi(X, θ)] ≤ 0
ϵ
m
Rn(ℱ)
ϵ + Rn(ℱ) + ln(1/δ)/n
(m ln(1/ϵ) + ln(m/δ))/n
ϵ + Rn(ℱ) + ln(1/δ)/n
(m ln(1/ϵ) + ln(m/δ))/n
ϵ
m
Rn(ℱ)
̂Y = 1 h : 𝒳 → [0,1]
h ℓ0
ℙx,x′{|h(x) − h(x′)| > d(x, x′) + γ} ≤ α
(γ, α)
maxi,j max(0,|h(x) − h(x′)| − d(xi, xj)) ≤ γ
m = O(poly(1/ϵα,1/ϵγ,1/ϵ)) ϵ
(α + ϵα, γ + ϵγ) h




∑
T
t=1
r(t)
x(t)
1 , . . . , x(t)
K i
r(t)
= fi(x(t)
i )
x(t)
i(t)
r(t)
πi(t) > πj(t) fi(x(t)
i ) > fj(x(t)
j )
fi(x(t)
i )
K3
T ln(Tk/δ)
T4/5
K6/5
d3/5
∨ k3
ln(k/δ)
Ω( T) Ω( K3
ln(1/δ))


TKd ln(T)
πi(t) ≠ ℙ{i = arg maxj rj}
D(π(t)
i , π(t)
j ) ≤ ϵ1D(ri, rj) + ϵ2








(KT)2/3
1 − δ D(π(t)
i , π(t)
j ) ≤ 2D(ri, rj) + ϵ2
|πi(t) − πj(t)| ≤ d(x(t)
i , x(t)
j )
x(t)
i
π(t)
r(t)
O(t)



ϵ
r(t)
maxπ∈ΔK
∑
K
i=1
riπi |πi − πj | ≤ dij
K, d T
d T ln(T/δ)
K2
d2
ln(TKd)
K2
d2
ln(kdT/ϵ) + K3
ϵT + d T ln(T/δ)
K2
d2
ln(d/ϵ)
ϵ = 1/K3
T T
∑
∞
t=τ
γt−τ
r(t)
s(t)
a(t)
r(t)
ϵ
1/(1 − γ)
πi(t) > πj(t) fi(s(t)
i ) > fj(s(t)
j )


f
f
• [Hardt+16] Moritz Hardt, Eric Price, and Nathan Srebro.
Equality of Opportunity in Supervised Learning. In: NeurIPS,
pp. 3315-3323, 2016. https://arxiv.org/abs/1610.02413
• [Pleiss+17] Geoff Pleiss, Manish Raghavan, Felix Wu, Jon
Kleinberg, and Kilian Q. Weinberger. On Fairness and
Calibration. In: NeurIPS, pp. 5680-5689, 2017. https://arxiv.org/
abs/1709.02012
• [Dwork+12] Cynthia Dwork, Moritz Hardt, Toniann
Pitassi, Omer Reingold, Rich Zemel. Fairness Through
Awareness. In: the 3rd innovations in theoretical computer
science conference, pp. 214-226, 2012. https://arxiv.org/abs/
1104.3913
• [Agarwal+18] Alekh Agarwal, Alina Beygelzimer, Miroslav
Dudík, John Langford, and Hanna Wallach. A Reductions
Approach to Fair Classification. In: ICML, PMLR 80, pp.
60-69, 2018. https://arxiv.org/abs/1803.02453
• [Agarwal+19] Alekh Agarwal, Miroslav Dudík, and Zhiwei
Steven Wu. Fair Regression: Quantitative Definitions and
Reduction-based Algorithms. In: ICML, PMLR 97, pp. 120-129,
2019. https://arxiv.org/abs/1905.12843
• [Zafar+13] Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi,
and Cynthia Dwork. Learning Fair Representations. In: ICML,
PMLR 28, pp. 325-333, 2013.
• [Zhao+19] Han Zhao, Geoffrey J. Gordon. Inherent Tradeoffs in
Learning Fair Representations. In: NeurIPS, 2019, to appear.
https://arxiv.org/abs/1906.08386
• [Xie+16] Qizhe Xie, Zihang Dai, Yulun Du, Eduard
Hovy, Graham Neubig. Controllable Invariance through
Adversarial Feature Learning. In: NeurIPS, pp. 585-596, 2016.
https://arxiv.org/abs/1705.11122
• [Moyer+18] Daniel Moyer, Shuyang Gao, Rob
Brekelmans, Greg Ver Steeg, and Aram Galstyan. Invariant
Representations without Adversarial Training. In: NeurIPS, pp.
9084-9893, 2018. https://arxiv.org/abs/1805.09458
• [Woodworth+18] Blake Woodworth, Suriya Gunasekar, Mesrob
I. Ohannessian, Nathan Srebro. Learning Non-Discriminatory
Predictors. In: COLT, pp. 1920-1953, 2017. https://arxiv.org/abs/
1702.06081
• [Cotter+19] Andrew Cotter, Maya Gupta, Heinrich
Jiang, Nathan Srebro, Karthik Sridharan, Serena Wang, Blake
Woodworth, Seungil You. Training Well-Generalizing
Classifiers for Fairness Metrics and Other Data-Dependent
Constraints. In: ICML, PMLR 97, pp. 1397-1405, 2019. https://
arxiv.org/abs/1807.00028
• [Rothblum+18] Guy N. Rothblum, Gal Yona. Probably
Approximately Metric-Fair Learning. In: ICML, PMLR 80, pp.
5680-5688, 2018. https://arxiv.org/abs/1803.03242
• [Joseph+16] Matthew Joseph, Michael Kearns, Jamie
Morgenstern, Aaron Roth. Fairness in Learning: Classic and
Contextual Bandits. In: NeurIPS, pp. 325-333, 2016.
• [Liu+17] Yang Liu, Goran Radanovic, Christos
Dimitrakakis, Debmalya Mandal, David C. Parkes. Calibrated
Fairness in Bandits. In: 4th Workshop on Fairness,
Accountability, and Transparency in Machine Learning
(FATML), 2017. https://arxiv.org/abs/1707.01875
• [Gillen+18] Stephen Gillen, Christopher Jung, Michael
Kearns, Aaron Roth. Online Learning with an Unknown
Fairness Metric. In: NeurIPS, pp. 2600-2609, 2018. https://
arxiv.org/abs/1802.06936
• [Jabbari+17] Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie
Morgenstern, Aaron Roth. Fairness in Reinforcement Learning. In:
ICML, PMLR 70, pp. 1617-1626, 2017. https://arxiv.org/abs/1611.03071
• [Liu+18] Lydia T. Liu, Sarah Dean, Esther Rolf, Max
Simchowitz, Moritz Hardt. Delayed Impact of Fair Machine Learning.
In: ICML, PMLR 80, pp. 3150-3158, 2018. https://arxiv.org/abs/
1803.04383
• [Aivodji+19] Ulrich Aïvodji, Hiromi Arai, Olivier Fortineau, Sébastien
Gambs, Satoshi Hara, Alain Tapp. Fairwashing: the risk of
rationalization. In: ICML, 2019. https://arxiv.org/abs/1901.09749
• [Fukuchi+20] Kazuto Fukuchi, Satoshi Hara, Takanori Maehara. Faking
Fairness via Stealthily Biased Sampling. In: AAAI, Special Track on AI
for Social Impact (AISI), 2020, to appear. https://arxiv.org/abs/
1901.08291
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning
ACM FAT* algorithms for fair machine learning

More Related Content

What's hot

モデルではなく、データセットを蒸留する
モデルではなく、データセットを蒸留するモデルではなく、データセットを蒸留する
モデルではなく、データセットを蒸留するTakahiro Kubo
 
Active Learning 入門
Active Learning 入門Active Learning 入門
Active Learning 入門Shuyo Nakatani
 
Active Learning の基礎と最近の研究
Active Learning の基礎と最近の研究Active Learning の基礎と最近の研究
Active Learning の基礎と最近の研究Fumihiko Takahashi
 
不均衡データのクラス分類
不均衡データのクラス分類不均衡データのクラス分類
不均衡データのクラス分類Shintaro Fukushima
 
ナレッジグラフ入門
ナレッジグラフ入門ナレッジグラフ入門
ナレッジグラフ入門KnowledgeGraph
 
Statistical Semantic入門 ~分布仮説からword2vecまで~
Statistical Semantic入門 ~分布仮説からword2vecまで~Statistical Semantic入門 ~分布仮説からword2vecまで~
Statistical Semantic入門 ~分布仮説からword2vecまで~Yuya Unno
 
学習時に使ってはいないデータの混入「リーケージを避ける」
学習時に使ってはいないデータの混入「リーケージを避ける」学習時に使ってはいないデータの混入「リーケージを避ける」
学習時に使ってはいないデータの混入「リーケージを避ける」西岡 賢一郎
 
SHAP値の考え方を理解する(木構造編)
SHAP値の考え方を理解する(木構造編)SHAP値の考え方を理解する(木構造編)
SHAP値の考え方を理解する(木構造編)Kazuyuki Wakasugi
 
AHC-Lab M1勉強会 論文の読み方・書き方
AHC-Lab M1勉強会 論文の読み方・書き方AHC-Lab M1勉強会 論文の読み方・書き方
AHC-Lab M1勉強会 論文の読み方・書き方Shinagawa Seitaro
 
Adversarial Examples 分野の動向 (敵対的サンプル発表資料)
Adversarial Examples 分野の動向(敵対的サンプル発表資料)Adversarial Examples 分野の動向(敵対的サンプル発表資料)
Adversarial Examples 分野の動向 (敵対的サンプル発表資料)cvpaper. challenge
 
【DL輪読会】マルチエージェント強化学習における近年の 協調的方策学習アルゴリズムの発展
【DL輪読会】マルチエージェント強化学習における近年の 協調的方策学習アルゴリズムの発展【DL輪読会】マルチエージェント強化学習における近年の 協調的方策学習アルゴリズムの発展
【DL輪読会】マルチエージェント強化学習における近年の 協調的方策学習アルゴリズムの発展Deep Learning JP
 
強化学習と逆強化学習を組み合わせた模倣学習
強化学習と逆強化学習を組み合わせた模倣学習強化学習と逆強化学習を組み合わせた模倣学習
強化学習と逆強化学習を組み合わせた模倣学習Eiji Uchibe
 
多様な強化学習の概念と課題認識
多様な強化学習の概念と課題認識多様な強化学習の概念と課題認識
多様な強化学習の概念と課題認識佑 甲野
 
機械学習のためのベイズ最適化入門
機械学習のためのベイズ最適化入門機械学習のためのベイズ最適化入門
機械学習のためのベイズ最適化入門hoxo_m
 
SSII2020TS: 機械学習モデルの判断根拠の説明​ 〜 Explainable AI 研究の近年の展開 〜​
SSII2020TS: 機械学習モデルの判断根拠の説明​ 〜 Explainable AI 研究の近年の展開 〜​SSII2020TS: 機械学習モデルの判断根拠の説明​ 〜 Explainable AI 研究の近年の展開 〜​
SSII2020TS: 機械学習モデルの判断根拠の説明​ 〜 Explainable AI 研究の近年の展開 〜​SSII
 
【メタサーベイ】基盤モデル / Foundation Models
【メタサーベイ】基盤モデル / Foundation Models【メタサーベイ】基盤モデル / Foundation Models
【メタサーベイ】基盤モデル / Foundation Modelscvpaper. challenge
 
トピックモデルの基礎と応用
トピックモデルの基礎と応用トピックモデルの基礎と応用
トピックモデルの基礎と応用Tomonari Masada
 
機械学習モデルの判断根拠の説明
機械学習モデルの判断根拠の説明機械学習モデルの判断根拠の説明
機械学習モデルの判断根拠の説明Satoshi Hara
 
潜在ディリクレ配分法
潜在ディリクレ配分法潜在ディリクレ配分法
潜在ディリクレ配分法y-uti
 

What's hot (20)

モデルではなく、データセットを蒸留する
モデルではなく、データセットを蒸留するモデルではなく、データセットを蒸留する
モデルではなく、データセットを蒸留する
 
Active Learning 入門
Active Learning 入門Active Learning 入門
Active Learning 入門
 
Active Learning の基礎と最近の研究
Active Learning の基礎と最近の研究Active Learning の基礎と最近の研究
Active Learning の基礎と最近の研究
 
不均衡データのクラス分類
不均衡データのクラス分類不均衡データのクラス分類
不均衡データのクラス分類
 
ナレッジグラフ入門
ナレッジグラフ入門ナレッジグラフ入門
ナレッジグラフ入門
 
Statistical Semantic入門 ~分布仮説からword2vecまで~
Statistical Semantic入門 ~分布仮説からword2vecまで~Statistical Semantic入門 ~分布仮説からword2vecまで~
Statistical Semantic入門 ~分布仮説からword2vecまで~
 
学習時に使ってはいないデータの混入「リーケージを避ける」
学習時に使ってはいないデータの混入「リーケージを避ける」学習時に使ってはいないデータの混入「リーケージを避ける」
学習時に使ってはいないデータの混入「リーケージを避ける」
 
SHAP値の考え方を理解する(木構造編)
SHAP値の考え方を理解する(木構造編)SHAP値の考え方を理解する(木構造編)
SHAP値の考え方を理解する(木構造編)
 
AHC-Lab M1勉強会 論文の読み方・書き方
AHC-Lab M1勉強会 論文の読み方・書き方AHC-Lab M1勉強会 論文の読み方・書き方
AHC-Lab M1勉強会 論文の読み方・書き方
 
Adversarial Examples 分野の動向 (敵対的サンプル発表資料)
Adversarial Examples 分野の動向(敵対的サンプル発表資料)Adversarial Examples 分野の動向(敵対的サンプル発表資料)
Adversarial Examples 分野の動向 (敵対的サンプル発表資料)
 
【DL輪読会】マルチエージェント強化学習における近年の 協調的方策学習アルゴリズムの発展
【DL輪読会】マルチエージェント強化学習における近年の 協調的方策学習アルゴリズムの発展【DL輪読会】マルチエージェント強化学習における近年の 協調的方策学習アルゴリズムの発展
【DL輪読会】マルチエージェント強化学習における近年の 協調的方策学習アルゴリズムの発展
 
強化学習と逆強化学習を組み合わせた模倣学習
強化学習と逆強化学習を組み合わせた模倣学習強化学習と逆強化学習を組み合わせた模倣学習
強化学習と逆強化学習を組み合わせた模倣学習
 
多様な強化学習の概念と課題認識
多様な強化学習の概念と課題認識多様な強化学習の概念と課題認識
多様な強化学習の概念と課題認識
 
機械学習のためのベイズ最適化入門
機械学習のためのベイズ最適化入門機械学習のためのベイズ最適化入門
機械学習のためのベイズ最適化入門
 
SSII2020TS: 機械学習モデルの判断根拠の説明​ 〜 Explainable AI 研究の近年の展開 〜​
SSII2020TS: 機械学習モデルの判断根拠の説明​ 〜 Explainable AI 研究の近年の展開 〜​SSII2020TS: 機械学習モデルの判断根拠の説明​ 〜 Explainable AI 研究の近年の展開 〜​
SSII2020TS: 機械学習モデルの判断根拠の説明​ 〜 Explainable AI 研究の近年の展開 〜​
 
【メタサーベイ】基盤モデル / Foundation Models
【メタサーベイ】基盤モデル / Foundation Models【メタサーベイ】基盤モデル / Foundation Models
【メタサーベイ】基盤モデル / Foundation Models
 
MICの解説
MICの解説MICの解説
MICの解説
 
トピックモデルの基礎と応用
トピックモデルの基礎と応用トピックモデルの基礎と応用
トピックモデルの基礎と応用
 
機械学習モデルの判断根拠の説明
機械学習モデルの判断根拠の説明機械学習モデルの判断根拠の説明
機械学習モデルの判断根拠の説明
 
潜在ディリクレ配分法
潜在ディリクレ配分法潜在ディリクレ配分法
潜在ディリクレ配分法
 

Similar to ACM FAT* algorithms for fair machine learning

A new Perron-Frobenius theorem for nonnegative tensors
A new Perron-Frobenius theorem for nonnegative tensorsA new Perron-Frobenius theorem for nonnegative tensors
A new Perron-Frobenius theorem for nonnegative tensorsFrancesco Tudisco
 
A derivation of the sampling formulas for An Entity-Topic Model for Entity Li...
A derivation of the sampling formulas for An Entity-Topic Model for Entity Li...A derivation of the sampling formulas for An Entity-Topic Model for Entity Li...
A derivation of the sampling formulas for An Entity-Topic Model for Entity Li...Tomonari Masada
 
Common fixed point theorems for random operators in hilbert space
Common fixed point theorems  for  random operators in hilbert spaceCommon fixed point theorems  for  random operators in hilbert space
Common fixed point theorems for random operators in hilbert spaceAlexander Decker
 
Workshop in honour of Don Poskitt and Gael Martin
Workshop in honour of Don Poskitt and Gael MartinWorkshop in honour of Don Poskitt and Gael Martin
Workshop in honour of Don Poskitt and Gael MartinChristian Robert
 
関西NIPS+読み会発表スライド
関西NIPS+読み会発表スライド関西NIPS+読み会発表スライド
関西NIPS+読み会発表スライドYuchi Matsuoka
 
cps170_bayes_nets.ppt
cps170_bayes_nets.pptcps170_bayes_nets.ppt
cps170_bayes_nets.pptFaizAbaas
 
Ejercicios prueba de algebra de la UTN- widmar aguilar
Ejercicios prueba de algebra de la UTN-  widmar aguilarEjercicios prueba de algebra de la UTN-  widmar aguilar
Ejercicios prueba de algebra de la UTN- widmar aguilarWidmar Aguilar Gonzalez
 
Deep IRL by C language
Deep IRL by C languageDeep IRL by C language
Deep IRL by C languageMasato Nakai
 
統計的学習の基礎 4章 前半
統計的学習の基礎 4章 前半統計的学習の基礎 4章 前半
統計的学習の基礎 4章 前半Ken'ichi Matsui
 
On maximal and variational Fourier restriction
On maximal and variational Fourier restrictionOn maximal and variational Fourier restriction
On maximal and variational Fourier restrictionVjekoslavKovac1
 
Eighth Asian-European Workshop on Information Theory: Fundamental Concepts in...
Eighth Asian-European Workshop on Information Theory: Fundamental Concepts in...Eighth Asian-European Workshop on Information Theory: Fundamental Concepts in...
Eighth Asian-European Workshop on Information Theory: Fundamental Concepts in...Joe Suzuki
 
ゲーム理論BASIC 第23回 -ベイジアンゲームにおける戦略と均衡-
ゲーム理論BASIC 第23回 -ベイジアンゲームにおける戦略と均衡-ゲーム理論BASIC 第23回 -ベイジアンゲームにおける戦略と均衡-
ゲーム理論BASIC 第23回 -ベイジアンゲームにおける戦略と均衡-ssusere0a682
 
2017-07, Research Seminar at Keio University, Metric Perspective of Stochasti...
2017-07, Research Seminar at Keio University, Metric Perspective of Stochasti...2017-07, Research Seminar at Keio University, Metric Perspective of Stochasti...
2017-07, Research Seminar at Keio University, Metric Perspective of Stochasti...asahiushio1
 
ゲーム理論BASIC 演習61 -非対称囚人のジレンマの 無限回繰り返しゲーム-
ゲーム理論BASIC 演習61 -非対称囚人のジレンマの 無限回繰り返しゲーム-ゲーム理論BASIC 演習61 -非対称囚人のジレンマの 無限回繰り返しゲーム-
ゲーム理論BASIC 演習61 -非対称囚人のジレンマの 無限回繰り返しゲーム-ssusere0a682
 
New Insights and Perspectives on the Natural Gradient Method
New Insights and Perspectives on the Natural Gradient MethodNew Insights and Perspectives on the Natural Gradient Method
New Insights and Perspectives on the Natural Gradient MethodYoonho Lee
 
Mathematical formula tables
Mathematical formula tablesMathematical formula tables
Mathematical formula tablesSaravana Selvan
 

Similar to ACM FAT* algorithms for fair machine learning (20)

A new Perron-Frobenius theorem for nonnegative tensors
A new Perron-Frobenius theorem for nonnegative tensorsA new Perron-Frobenius theorem for nonnegative tensors
A new Perron-Frobenius theorem for nonnegative tensors
 
A derivation of the sampling formulas for An Entity-Topic Model for Entity Li...
A derivation of the sampling formulas for An Entity-Topic Model for Entity Li...A derivation of the sampling formulas for An Entity-Topic Model for Entity Li...
A derivation of the sampling formulas for An Entity-Topic Model for Entity Li...
 
Statistical Inference Using Stochastic Gradient Descent
Statistical Inference Using Stochastic Gradient DescentStatistical Inference Using Stochastic Gradient Descent
Statistical Inference Using Stochastic Gradient Descent
 
Statistical Inference Using Stochastic Gradient Descent
Statistical Inference Using Stochastic Gradient DescentStatistical Inference Using Stochastic Gradient Descent
Statistical Inference Using Stochastic Gradient Descent
 
Common fixed point theorems for random operators in hilbert space
Common fixed point theorems  for  random operators in hilbert spaceCommon fixed point theorems  for  random operators in hilbert space
Common fixed point theorems for random operators in hilbert space
 
Workshop in honour of Don Poskitt and Gael Martin
Workshop in honour of Don Poskitt and Gael MartinWorkshop in honour of Don Poskitt and Gael Martin
Workshop in honour of Don Poskitt and Gael Martin
 
関西NIPS+読み会発表スライド
関西NIPS+読み会発表スライド関西NIPS+読み会発表スライド
関西NIPS+読み会発表スライド
 
cps170_bayes_nets.ppt
cps170_bayes_nets.pptcps170_bayes_nets.ppt
cps170_bayes_nets.ppt
 
Ejercicios prueba de algebra de la UTN- widmar aguilar
Ejercicios prueba de algebra de la UTN-  widmar aguilarEjercicios prueba de algebra de la UTN-  widmar aguilar
Ejercicios prueba de algebra de la UTN- widmar aguilar
 
Deep IRL by C language
Deep IRL by C languageDeep IRL by C language
Deep IRL by C language
 
MUMS Undergraduate Workshop - A Biased Introduction to Global Sensitivity Ana...
MUMS Undergraduate Workshop - A Biased Introduction to Global Sensitivity Ana...MUMS Undergraduate Workshop - A Biased Introduction to Global Sensitivity Ana...
MUMS Undergraduate Workshop - A Biased Introduction to Global Sensitivity Ana...
 
統計的学習の基礎 4章 前半
統計的学習の基礎 4章 前半統計的学習の基礎 4章 前半
統計的学習の基礎 4章 前半
 
On maximal and variational Fourier restriction
On maximal and variational Fourier restrictionOn maximal and variational Fourier restriction
On maximal and variational Fourier restriction
 
Eighth Asian-European Workshop on Information Theory: Fundamental Concepts in...
Eighth Asian-European Workshop on Information Theory: Fundamental Concepts in...Eighth Asian-European Workshop on Information Theory: Fundamental Concepts in...
Eighth Asian-European Workshop on Information Theory: Fundamental Concepts in...
 
ゲーム理論BASIC 第23回 -ベイジアンゲームにおける戦略と均衡-
ゲーム理論BASIC 第23回 -ベイジアンゲームにおける戦略と均衡-ゲーム理論BASIC 第23回 -ベイジアンゲームにおける戦略と均衡-
ゲーム理論BASIC 第23回 -ベイジアンゲームにおける戦略と均衡-
 
2017-07, Research Seminar at Keio University, Metric Perspective of Stochasti...
2017-07, Research Seminar at Keio University, Metric Perspective of Stochasti...2017-07, Research Seminar at Keio University, Metric Perspective of Stochasti...
2017-07, Research Seminar at Keio University, Metric Perspective of Stochasti...
 
ゲーム理論BASIC 演習61 -非対称囚人のジレンマの 無限回繰り返しゲーム-
ゲーム理論BASIC 演習61 -非対称囚人のジレンマの 無限回繰り返しゲーム-ゲーム理論BASIC 演習61 -非対称囚人のジレンマの 無限回繰り返しゲーム-
ゲーム理論BASIC 演習61 -非対称囚人のジレンマの 無限回繰り返しゲーム-
 
HMM, MEMM, CRF メモ
HMM, MEMM, CRF メモHMM, MEMM, CRF メモ
HMM, MEMM, CRF メモ
 
New Insights and Perspectives on the Natural Gradient Method
New Insights and Perspectives on the Natural Gradient MethodNew Insights and Perspectives on the Natural Gradient Method
New Insights and Perspectives on the Natural Gradient Method
 
Mathematical formula tables
Mathematical formula tablesMathematical formula tables
Mathematical formula tables
 

Recently uploaded

Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 

Recently uploaded (20)

Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 

ACM FAT* algorithms for fair machine learning

  • 1.
  • 2.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8. f
  • 14. X Y ̂YX S = S = X Y S ̂Y
  • 15.
  • 16. ℙ{ ̂Y ∈ 𝒜|S = s} = ℙ{ ̂Y ∈ 𝒜|S = s′} 𝒜, s, s′ = ̂Y|S = ̂Y|S =
  • 17. ℙ{ ̂Y ∈ 𝒜|Y = y, S = s} = ℙ{ ̂Y ∈ 𝒜|Y = y, S = s′} 𝒜, y, s, s′ Y ̂Y
  • 18. Y = 1 ̂p Y = 1 ̂p ℙ{Y = 1| ̂p = p, S = s} = p p, s p ̂p = p|S =
  • 19. x, x′ D( f(x), f(x′)) ≤ d(x, x′) ≈ ⟹ f : 𝒳 → Δ(𝒴)
  • 20.
  • 22. minf Err(f ) + ηUnfair(f ) minf Err(f ) Unfair(f ) ≤ η
  • 23. Q Q f minQ 𝔼f∼Qℙ{f(X) ≠ Y} M𝔼f∼Q[μ(f )] ≤ c 𝔼{f(X)|S = 0} = 𝔼{f(X)} 𝔼{f(X)|S = 1} = 𝔼{f(X)}
  • 24. minQ 𝔼f∼Qℙ{f(X) ≠ Y} M𝔼f∼Q[μ(f )] ≤ c maxλ∈ℝK +,∥λ∥≤B minQ 𝔼f∼Qℙ{f(X) ≠ Y} + λ⊤ (M𝔼f∼Q[μ(f )] − c)
  • 25. minf ∑ n i=1 (h(Xi)C1 i + (1 − h(Xi))C0 i )
  • 27. Q λ
  • 28.
  • 29. g( )= z f( )=A zz
  • 32. g( ) g( ) z f( )=A z
  • 34. g( )= f( )=A d( )=z z z 
 

  • 35.
  • 37.
  • 42.
  • 44. maxy,s (VC(ℱ) + ln(1/δ))/(nPy,s) maxy,s ln(1/δ)/(nPy,s)
  • 45. maxy,s (VC(ℱ) + ln(1/δ))/(nPy,s) maxy,s ln(1/δ)/(nPy,s) (y, s) 

  • 46. minθ 𝔼[ℓ0(X, θ)] 𝔼[ℓi(X, θ)] ≤ 0
  • 47. ϵ m Rn(ℱ) ϵ + Rn(ℱ) + ln(1/δ)/n (m ln(1/ϵ) + ln(m/δ))/n
  • 48. ϵ + Rn(ℱ) + ln(1/δ)/n (m ln(1/ϵ) + ln(m/δ))/n ϵ m Rn(ℱ)
  • 49.
  • 50. ̂Y = 1 h : 𝒳 → [0,1] h ℓ0 ℙx,x′{|h(x) − h(x′)| > d(x, x′) + γ} ≤ α (γ, α)
  • 51. maxi,j max(0,|h(x) − h(x′)| − d(xi, xj)) ≤ γ m = O(poly(1/ϵα,1/ϵγ,1/ϵ)) ϵ (α + ϵα, γ + ϵγ) h 

  • 52.
  • 53. ∑ T t=1 r(t) x(t) 1 , . . . , x(t) K i r(t) = fi(x(t) i ) x(t) i(t) r(t)
  • 54. πi(t) > πj(t) fi(x(t) i ) > fj(x(t) j ) fi(x(t) i )
  • 55.
  • 56. K3 T ln(Tk/δ) T4/5 K6/5 d3/5 ∨ k3 ln(k/δ) Ω( T) Ω( K3 ln(1/δ)) 
 TKd ln(T)
  • 57. πi(t) ≠ ℙ{i = arg maxj rj} D(π(t) i , π(t) j ) ≤ ϵ1D(ri, rj) + ϵ2
  • 59. 
 
 (KT)2/3 1 − δ D(π(t) i , π(t) j ) ≤ 2D(ri, rj) + ϵ2
  • 60. |πi(t) − πj(t)| ≤ d(x(t) i , x(t) j ) x(t) i π(t) r(t) O(t) 
 
ϵ
  • 62. K, d T d T ln(T/δ) K2 d2 ln(TKd) K2 d2 ln(kdT/ϵ) + K3 ϵT + d T ln(T/δ) K2 d2 ln(d/ϵ) ϵ = 1/K3 T T
  • 64. ϵ 1/(1 − γ) πi(t) > πj(t) fi(s(t) i ) > fj(s(t) j )
  • 65.
  • 66.
  • 67.
  • 68. f
  • 69. f
  • 70.
  • 71. • [Hardt+16] Moritz Hardt, Eric Price, and Nathan Srebro. Equality of Opportunity in Supervised Learning. In: NeurIPS, pp. 3315-3323, 2016. https://arxiv.org/abs/1610.02413 • [Pleiss+17] Geoff Pleiss, Manish Raghavan, Felix Wu, Jon Kleinberg, and Kilian Q. Weinberger. On Fairness and Calibration. In: NeurIPS, pp. 5680-5689, 2017. https://arxiv.org/ abs/1709.02012 • [Dwork+12] Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, Rich Zemel. Fairness Through Awareness. In: the 3rd innovations in theoretical computer science conference, pp. 214-226, 2012. https://arxiv.org/abs/ 1104.3913
  • 72. • [Agarwal+18] Alekh Agarwal, Alina Beygelzimer, Miroslav Dudík, John Langford, and Hanna Wallach. A Reductions Approach to Fair Classification. In: ICML, PMLR 80, pp. 60-69, 2018. https://arxiv.org/abs/1803.02453 • [Agarwal+19] Alekh Agarwal, Miroslav Dudík, and Zhiwei Steven Wu. Fair Regression: Quantitative Definitions and Reduction-based Algorithms. In: ICML, PMLR 97, pp. 120-129, 2019. https://arxiv.org/abs/1905.12843 • [Zafar+13] Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. Learning Fair Representations. In: ICML, PMLR 28, pp. 325-333, 2013.
  • 73. • [Zhao+19] Han Zhao, Geoffrey J. Gordon. Inherent Tradeoffs in Learning Fair Representations. In: NeurIPS, 2019, to appear. https://arxiv.org/abs/1906.08386 • [Xie+16] Qizhe Xie, Zihang Dai, Yulun Du, Eduard Hovy, Graham Neubig. Controllable Invariance through Adversarial Feature Learning. In: NeurIPS, pp. 585-596, 2016. https://arxiv.org/abs/1705.11122 • [Moyer+18] Daniel Moyer, Shuyang Gao, Rob Brekelmans, Greg Ver Steeg, and Aram Galstyan. Invariant Representations without Adversarial Training. In: NeurIPS, pp. 9084-9893, 2018. https://arxiv.org/abs/1805.09458
  • 74. • [Woodworth+18] Blake Woodworth, Suriya Gunasekar, Mesrob I. Ohannessian, Nathan Srebro. Learning Non-Discriminatory Predictors. In: COLT, pp. 1920-1953, 2017. https://arxiv.org/abs/ 1702.06081 • [Cotter+19] Andrew Cotter, Maya Gupta, Heinrich Jiang, Nathan Srebro, Karthik Sridharan, Serena Wang, Blake Woodworth, Seungil You. Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints. In: ICML, PMLR 97, pp. 1397-1405, 2019. https:// arxiv.org/abs/1807.00028 • [Rothblum+18] Guy N. Rothblum, Gal Yona. Probably Approximately Metric-Fair Learning. In: ICML, PMLR 80, pp. 5680-5688, 2018. https://arxiv.org/abs/1803.03242
  • 75. • [Joseph+16] Matthew Joseph, Michael Kearns, Jamie Morgenstern, Aaron Roth. Fairness in Learning: Classic and Contextual Bandits. In: NeurIPS, pp. 325-333, 2016. • [Liu+17] Yang Liu, Goran Radanovic, Christos Dimitrakakis, Debmalya Mandal, David C. Parkes. Calibrated Fairness in Bandits. In: 4th Workshop on Fairness, Accountability, and Transparency in Machine Learning (FATML), 2017. https://arxiv.org/abs/1707.01875 • [Gillen+18] Stephen Gillen, Christopher Jung, Michael Kearns, Aaron Roth. Online Learning with an Unknown Fairness Metric. In: NeurIPS, pp. 2600-2609, 2018. https:// arxiv.org/abs/1802.06936
  • 76. • [Jabbari+17] Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie Morgenstern, Aaron Roth. Fairness in Reinforcement Learning. In: ICML, PMLR 70, pp. 1617-1626, 2017. https://arxiv.org/abs/1611.03071 • [Liu+18] Lydia T. Liu, Sarah Dean, Esther Rolf, Max Simchowitz, Moritz Hardt. Delayed Impact of Fair Machine Learning. In: ICML, PMLR 80, pp. 3150-3158, 2018. https://arxiv.org/abs/ 1803.04383 • [Aivodji+19] Ulrich Aïvodji, Hiromi Arai, Olivier Fortineau, Sébastien Gambs, Satoshi Hara, Alain Tapp. Fairwashing: the risk of rationalization. In: ICML, 2019. https://arxiv.org/abs/1901.09749 • [Fukuchi+20] Kazuto Fukuchi, Satoshi Hara, Takanori Maehara. Faking Fairness via Stealthily Biased Sampling. In: AAAI, Special Track on AI for Social Impact (AISI), 2020, to appear. https://arxiv.org/abs/ 1901.08291