SlideShare uma empresa Scribd logo
1 de 44
Baixar para ler offline
Causality in Complex
Networks
Sebastian Benthall
D-Lab
Why causality?
Causal relations are scientifically interesting
because when exposed, they are:
● a reliable mechanism
● that supports intervention
By understanding causality, we can predict and
control. This is the interest behind causal
knowledge.
Why this talk?
● A “working group” talk - I don’t claim to be an
expert
● I’m working through research problems that
are challenging to me
● I’m presenting this work in progress both to
inform and solicit feedback
● You are welcome to do the same with your
work!
Potential outcomes
The Rubin Causal Model (RCM) or potential
outcomes framework is ascendant.
Potential outcomes
“The causal effect of a treatment on a single
individual or unit of observation is the
comparison (e.g., difference) between the
value of the outcome if the unit is treated
and the value of the outcome if the unit is not
treated.” (Angrist, Imbens, and Rubin, 1996)
Potential outcomes
“The causal effect of a treatment on a single
individual or unit of observation is the
comparison (e.g., difference) between the
value of the outcome if the unit is treated
and the value of the outcome if the unit is not
treated.” (Angrist, Imbens, and Rubin, 1996)
Potential outcomes
Average effect: (10+9+7+12)/4 = 9.5
Controlled Outcome - Yi
(0)
Treated Outcome - Yi
(1)
Causal Effect of
Treatment Yi
(1) - Y(0)
Alice 20 30 10
Bob 15 24 9
Cathy 10 17 7
David 22 34 12
Potential outcomes
You only ever see some of these. This has been called the
Fundamental Problem of Causal Inference
Controlled Outcome - Yi
(0)
Treated Outcome - Yi
(1)
Causal Effect of
Treatment Yi
(1) - Y(0)
Alice 20 30 10
Bob 15 24 9
Cathy 10 17 7
David 22 34 12
Potential outcomes
Stable Unit Treatment Value Assumption
"the [potential outcome] observation on one
unit should be unaffected by the particular
assignment of treatments to the other units"
Potential outcomes
Controlled Outcome - Yi
(0) Treated Outcome - Yi
(1) Causal Effect of Treatment
Yi
(1) - Y(0)
Alice 20 30 10
Bob, if
Alice in
not
treated
15 24 9
Bob, if
Alice is
treated
18 29 11
Cathy 10 17 7
David 22 34 12
Potential outcomes
So for every unit, we have to map out all the
variables that can have an effect on the
potential outcomes.
Spouse treated
Unit treated
Outcome
Potential outcomes
So for every unit, we have to map out all the
variables that can have an effect on the
potential outcomes.
A great tool for this: Pearl’s causal networks.
Causal networks
Pearl, Causality, http://bayes.cs.ucla.edu/BOOK-2K/
Note
There are differences between Pearl and
Rubin’s frameworks but their core concepts are
compatible,
so says Andrew Gelman, 2009:
http://andrewgelman.com/2009/07/07/more_on_pearls/
Causal networks
N.B.
An interesting thing about causal networks is
that the conditional probability distributions can
be arbitrarily complex.
Also, variables need not just be whole numbers
or scalars. They could be a matrix.
Complex networks
Now I’m going to talk about networks that are
not causal networks.
Sometimes in the literature these are called
complex networks.
from http://www.spandidos-publications.com/ijo/43/6/1737
from http:
//noduslabs.
com/radar/type
s-networks-
random-small-
world-scale-
free/
Complex networks
There are lots of different kinds of networks
observed in nature and society.
They can differ substantially in their emergent
properties.
Complex networks
def: emergent property
“An emergent property is a property which a collection or
complex system has, but which the individual members do
not have. A failure to realize that a property is emergent,
or supervenient, leads to the fallacy of division.”
Degree Distribution
from http://www.alexeikurakin.
org/main/lecture4Ext.html
Assortativity
from
http://iopscience.iop.org/1742-
5468/2008/03/P03008/figures
How to make a graph
Different processes for generating graphs have
result in graphs with different properties.
How to make a graph
● Erdős–Rényi (ER) model: G(n,p): Create n
nodes and create edges with probability p
● Barabási–Albert (BA) model:
○ Begin with a fully connected network of m0
nodes
○ Each new node is connected to m (< m0
) node
probability proportional to degree ki
of each node i
How to predict a graph
The distribution of degree of an Erdős–Rényi
graph is binomial.
The distribution of degree of a Barabási–
Albert (BA) graph is scale-free/power-law.
Bayes Theorem
Recall Bayes Theorem:
P(H|D) ∝ P(D|H) P(H)
Bayes Theorem
Recall Bayes Theorem:
P(H|D) ∝ P(D|H) P(H)
If we can show a difference in the
likelihood
of data under different hypotheses, we can
learn something
What process created this graph?
What process created this graph?
Histogram of observed
node degrees d
What process created this graph?
Can in principle compare P(d|ER) and P(d|BA).
What process created this graph?
● We can in principle statistically distinguish
hypotheses about generative processes
based on emergent properties.
● Is this a causal inference?
Ways to model this
Process Graph
Ways to model this
All the logic of graph generation is buried in the
conditional probability function P(B|A).
A
Process
B
Graph
Ways to model this
All the logic of graph generation is buried in the
conditional probability function P(B|A).
“Logical causation” allows no intervention!
A
Process
B
Graph
Ways to model this
The Barabási–Albert (BA) model suggests this
interpretation of graph changing over time.
You can model time series data like this.
B0
B1
B2
B3
B4
Ways to model this
Now we can model a stable transition function
within the graph and external causes.
B0
B1
B2
B3
B4
C
Ways to model this
In other words,
endogenous process + exogenous shocks
B0
B1
B2
B3
B4
C
Tools in the toolbox
If we want to understand the effect of a kind of
exogenous shock,
and we know the endogenous process,
then we can look for natural experiments that
expose the treated outcome.
Tools in the toolbox
To know the endogenous process, then
compute the likelihood of emergent properties.
B0
B1
B2
B3
B4
EEE E E
Problems
● The vastness of the hypothesis space of
graph generation processes
● Related: how do you choose a prior?
Problems
● Computing the likelihood of a graph’s
emergent properties given a particular
generation process is
○ tricky math
○ maybe computationally hard
Dissatisfactions
● We have continued to bury much of the
mechanism of interest in the conditional
probability function.
● Suppose we want to cash this out as a finer-
grained mechanism that supports finer
interventions
● Can we think at multiple levels of abstraction
at once?
Thanks! Contact me at: sb at ischool dot berkeley dot edu

Mais conteúdo relacionado

Mais procurados

Module 6: Ensemble Algorithms
Module 6:  Ensemble AlgorithmsModule 6:  Ensemble Algorithms
Module 6: Ensemble AlgorithmsSara Hooker
 
Regression, Multiple regression in statistics
Regression, Multiple regression in statistics Regression, Multiple regression in statistics
Regression, Multiple regression in statistics Rashna Asif
 
Module 1.2 data preparation
Module 1.2  data preparationModule 1.2  data preparation
Module 1.2 data preparationSara Hooker
 
Alleviating Privacy Attacks Using Causal Models
Alleviating Privacy Attacks Using Causal ModelsAlleviating Privacy Attacks Using Causal Models
Alleviating Privacy Attacks Using Causal ModelsAmit Sharma
 
Module 4: Model Selection and Evaluation
Module 4: Model Selection and EvaluationModule 4: Model Selection and Evaluation
Module 4: Model Selection and EvaluationSara Hooker
 
Module 5: Decision Trees
Module 5: Decision TreesModule 5: Decision Trees
Module 5: Decision TreesSara Hooker
 
Module 2: Machine Learning Deep Dive
Module 2:  Machine Learning Deep DiveModule 2:  Machine Learning Deep Dive
Module 2: Machine Learning Deep DiveSara Hooker
 
Item Analysis: Classical and Beyond
Item Analysis: Classical and BeyondItem Analysis: Classical and Beyond
Item Analysis: Classical and BeyondMhairi Mcalpine
 
Multiple Linear Regression
Multiple Linear RegressionMultiple Linear Regression
Multiple Linear RegressionIndus University
 
Module 7: Unsupervised Learning
Module 7:  Unsupervised LearningModule 7:  Unsupervised Learning
Module 7: Unsupervised LearningSara Hooker
 
To combine forecasts or to combine forecast models?
To combine forecasts or to combine forecast models?To combine forecasts or to combine forecast models?
To combine forecasts or to combine forecast models?Devon K. Barrow
 
Building classification model, tree model, confusion matrix and prediction ac...
Building classification model, tree model, confusion matrix and prediction ac...Building classification model, tree model, confusion matrix and prediction ac...
Building classification model, tree model, confusion matrix and prediction ac...National Cheng Kung University
 
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!Sri Ambati
 
Endogeneity and Entrepreneurship Research
Endogeneity and Entrepreneurship ResearchEndogeneity and Entrepreneurship Research
Endogeneity and Entrepreneurship ResearchBrian Anderson
 
Introduction to Item Response Theory
Introduction to Item Response TheoryIntroduction to Item Response Theory
Introduction to Item Response TheoryOpenThink Labs
 
The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1Carlo Magno
 
Missing Data and data imputation techniques
Missing Data and data imputation techniquesMissing Data and data imputation techniques
Missing Data and data imputation techniquesOmar F. Althuwaynee
 

Mais procurados (20)

Module 6: Ensemble Algorithms
Module 6:  Ensemble AlgorithmsModule 6:  Ensemble Algorithms
Module 6: Ensemble Algorithms
 
Regression, Multiple regression in statistics
Regression, Multiple regression in statistics Regression, Multiple regression in statistics
Regression, Multiple regression in statistics
 
Module 1.2 data preparation
Module 1.2  data preparationModule 1.2  data preparation
Module 1.2 data preparation
 
Alleviating Privacy Attacks Using Causal Models
Alleviating Privacy Attacks Using Causal ModelsAlleviating Privacy Attacks Using Causal Models
Alleviating Privacy Attacks Using Causal Models
 
Module 4: Model Selection and Evaluation
Module 4: Model Selection and EvaluationModule 4: Model Selection and Evaluation
Module 4: Model Selection and Evaluation
 
Module 5: Decision Trees
Module 5: Decision TreesModule 5: Decision Trees
Module 5: Decision Trees
 
Module 2: Machine Learning Deep Dive
Module 2:  Machine Learning Deep DiveModule 2:  Machine Learning Deep Dive
Module 2: Machine Learning Deep Dive
 
Chapter 4R Part II
Chapter 4R Part IIChapter 4R Part II
Chapter 4R Part II
 
Matrix Diagram2001
Matrix Diagram2001Matrix Diagram2001
Matrix Diagram2001
 
Item Analysis: Classical and Beyond
Item Analysis: Classical and BeyondItem Analysis: Classical and Beyond
Item Analysis: Classical and Beyond
 
Multiple Linear Regression
Multiple Linear RegressionMultiple Linear Regression
Multiple Linear Regression
 
Module 7: Unsupervised Learning
Module 7:  Unsupervised LearningModule 7:  Unsupervised Learning
Module 7: Unsupervised Learning
 
To combine forecasts or to combine forecast models?
To combine forecasts or to combine forecast models?To combine forecasts or to combine forecast models?
To combine forecasts or to combine forecast models?
 
Building classification model, tree model, confusion matrix and prediction ac...
Building classification model, tree model, confusion matrix and prediction ac...Building classification model, tree model, confusion matrix and prediction ac...
Building classification model, tree model, confusion matrix and prediction ac...
 
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
Get hands-on with Explainable AI at Machine Learning Interpretability(MLI) Gym!
 
Endogeneity and Entrepreneurship Research
Endogeneity and Entrepreneurship ResearchEndogeneity and Entrepreneurship Research
Endogeneity and Entrepreneurship Research
 
Introduction to Item Response Theory
Introduction to Item Response TheoryIntroduction to Item Response Theory
Introduction to Item Response Theory
 
The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1
 
Missing Data and data imputation techniques
Missing Data and data imputation techniquesMissing Data and data imputation techniques
Missing Data and data imputation techniques
 
Irt assessment
Irt assessmentIrt assessment
Irt assessment
 

Destaque

The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...Catarina Moreira
 
10-Interpretation& Causality by Mehdi Ehtesham
10-Interpretation& Causality  by Mehdi Ehtesham10-Interpretation& Causality  by Mehdi Ehtesham
10-Interpretation& Causality by Mehdi EhteshamResearchGuru
 
Virtual World Data Visualization
Virtual World Data VisualizationVirtual World Data Visualization
Virtual World Data VisualizationMelanie Swan
 
DIYgenomics: An Open Platform for Democratizing the Genome
DIYgenomics: An Open Platform for Democratizing the GenomeDIYgenomics: An Open Platform for Democratizing the Genome
DIYgenomics: An Open Platform for Democratizing the GenomeMelanie Swan
 
Prediction Markets - Singularity University 2013
Prediction Markets - Singularity University 2013Prediction Markets - Singularity University 2013
Prediction Markets - Singularity University 2013Melanie Swan
 
Ibc cell therapy clinical development conference (arlington va september 10 ...
Ibc cell therapy clinical development conference (arlington va  september 10 ...Ibc cell therapy clinical development conference (arlington va  september 10 ...
Ibc cell therapy clinical development conference (arlington va september 10 ...Proteus Venture Partners
 
Introduction to Supervised ML Concepts and Algorithms
Introduction to Supervised ML Concepts and AlgorithmsIntroduction to Supervised ML Concepts and Algorithms
Introduction to Supervised ML Concepts and AlgorithmsNBER
 
Personal Genomes: what can I do with my data?
Personal Genomes: what can I do with my data?Personal Genomes: what can I do with my data?
Personal Genomes: what can I do with my data?Melanie Swan
 
Dublin2016 balancing
Dublin2016 balancingDublin2016 balancing
Dublin2016 balancingHelen Barrett
 
Anterior temporal lobectomy
Anterior temporal lobectomyAnterior temporal lobectomy
Anterior temporal lobectomyApoorv Pandey
 
The Poetic Prosthetic
The Poetic Prosthetic The Poetic Prosthetic
The Poetic Prosthetic Melanie Swan
 
Blockchain Smartnetworks
Blockchain Smartnetworks Blockchain Smartnetworks
Blockchain Smartnetworks Melanie Swan
 
Facial nerve by Dr. Apoorv
Facial nerve by Dr. ApoorvFacial nerve by Dr. Apoorv
Facial nerve by Dr. ApoorvApoorv Pandey
 
Philosophy of Technology
Philosophy of TechnologyPhilosophy of Technology
Philosophy of TechnologyMelanie Swan
 
Managing Agility: From Complex To Simple
Managing Agility: From Complex To SimpleManaging Agility: From Complex To Simple
Managing Agility: From Complex To SimpleJurgen Appelo
 

Destaque (20)

Causal Bayesian Networks
Causal Bayesian NetworksCausal Bayesian Networks
Causal Bayesian Networks
 
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
The Relation Between Acausality and Interference in Quantum-Like Bayesian Net...
 
10-Interpretation& Causality by Mehdi Ehtesham
10-Interpretation& Causality  by Mehdi Ehtesham10-Interpretation& Causality  by Mehdi Ehtesham
10-Interpretation& Causality by Mehdi Ehtesham
 
Complexity Informed Psychotherapy
Complexity Informed PsychotherapyComplexity Informed Psychotherapy
Complexity Informed Psychotherapy
 
Virtual World Data Visualization
Virtual World Data VisualizationVirtual World Data Visualization
Virtual World Data Visualization
 
DIYgenomics: An Open Platform for Democratizing the Genome
DIYgenomics: An Open Platform for Democratizing the GenomeDIYgenomics: An Open Platform for Democratizing the Genome
DIYgenomics: An Open Platform for Democratizing the Genome
 
Prediction Markets - Singularity University 2013
Prediction Markets - Singularity University 2013Prediction Markets - Singularity University 2013
Prediction Markets - Singularity University 2013
 
Ibc cell therapy clinical development conference (arlington va september 10 ...
Ibc cell therapy clinical development conference (arlington va  september 10 ...Ibc cell therapy clinical development conference (arlington va  september 10 ...
Ibc cell therapy clinical development conference (arlington va september 10 ...
 
Virtual worlds
Virtual worlds Virtual worlds
Virtual worlds
 
Introduction to Supervised ML Concepts and Algorithms
Introduction to Supervised ML Concepts and AlgorithmsIntroduction to Supervised ML Concepts and Algorithms
Introduction to Supervised ML Concepts and Algorithms
 
Temporal bone1
Temporal bone1Temporal bone1
Temporal bone1
 
Personal Genomes: what can I do with my data?
Personal Genomes: what can I do with my data?Personal Genomes: what can I do with my data?
Personal Genomes: what can I do with my data?
 
Dublin2016 balancing
Dublin2016 balancingDublin2016 balancing
Dublin2016 balancing
 
Anterior temporal lobectomy
Anterior temporal lobectomyAnterior temporal lobectomy
Anterior temporal lobectomy
 
The Poetic Prosthetic
The Poetic Prosthetic The Poetic Prosthetic
The Poetic Prosthetic
 
Blockchain Smartnetworks
Blockchain Smartnetworks Blockchain Smartnetworks
Blockchain Smartnetworks
 
Facial nerve by Dr. Apoorv
Facial nerve by Dr. ApoorvFacial nerve by Dr. Apoorv
Facial nerve by Dr. Apoorv
 
Philosophy of Technology
Philosophy of TechnologyPhilosophy of Technology
Philosophy of Technology
 
Hippocampus
HippocampusHippocampus
Hippocampus
 
Managing Agility: From Complex To Simple
Managing Agility: From Complex To SimpleManaging Agility: From Complex To Simple
Managing Agility: From Complex To Simple
 

Semelhante a Causality in complex networks

Representing and generating uncertainty effectively presentatıon
Representing and generating uncertainty effectively presentatıonRepresenting and generating uncertainty effectively presentatıon
Representing and generating uncertainty effectively presentatıonAzdeen Najah
 
Neural Nets Deconstructed
Neural Nets DeconstructedNeural Nets Deconstructed
Neural Nets DeconstructedPaul Sterk
 
Joint contrastive learning with infinite possibilities
Joint contrastive learning with infinite possibilitiesJoint contrastive learning with infinite possibilities
Joint contrastive learning with infinite possibilitiestaeseon ryu
 
Recommendation systems in the scope of opinion formation: a model
Recommendation systems in the scope of opinion formation: a modelRecommendation systems in the scope of opinion formation: a model
Recommendation systems in the scope of opinion formation: a modelMarcel Blattner, PhD
 
For this assignment, use the aschooltest.sav dataset.The d
For this assignment, use the aschooltest.sav dataset.The dFor this assignment, use the aschooltest.sav dataset.The d
For this assignment, use the aschooltest.sav dataset.The dMerrileeDelvalle969
 
Deep VI with_beta_likelihood
Deep VI with_beta_likelihoodDeep VI with_beta_likelihood
Deep VI with_beta_likelihoodNatan Katz
 
causality_discussion_slides_final.pdf
causality_discussion_slides_final.pdfcausality_discussion_slides_final.pdf
causality_discussion_slides_final.pdfssuser8cde591
 
Building useful models for imbalanced datasets (without resampling)
Building useful models for imbalanced datasets (without resampling)Building useful models for imbalanced datasets (without resampling)
Building useful models for imbalanced datasets (without resampling)Greg Landrum
 
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...Chandan Sah
 
SPSS statistics - get help using SPSS
SPSS statistics - get help using SPSSSPSS statistics - get help using SPSS
SPSS statistics - get help using SPSScsula its training
 
Mixed Effects Models - Random Intercepts
Mixed Effects Models - Random InterceptsMixed Effects Models - Random Intercepts
Mixed Effects Models - Random InterceptsScott Fraundorf
 
Data Distribution &The Probability Distributions
Data Distribution &The Probability DistributionsData Distribution &The Probability Distributions
Data Distribution &The Probability Distributionsmahaaltememe
 
A Causal Framework for Meta-Analysis, drafty
A Causal Framework for Meta-Analysis, drafty A Causal Framework for Meta-Analysis, drafty
A Causal Framework for Meta-Analysis, drafty Wei Wang
 

Semelhante a Causality in complex networks (20)

Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...
Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...
Causal Inference Opening Workshop - Latent Variable Models, Causal Inference,...
 
Representing and generating uncertainty effectively presentatıon
Representing and generating uncertainty effectively presentatıonRepresenting and generating uncertainty effectively presentatıon
Representing and generating uncertainty effectively presentatıon
 
Neural Nets Deconstructed
Neural Nets DeconstructedNeural Nets Deconstructed
Neural Nets Deconstructed
 
Joint contrastive learning with infinite possibilities
Joint contrastive learning with infinite possibilitiesJoint contrastive learning with infinite possibilities
Joint contrastive learning with infinite possibilities
 
Recommendation systems in the scope of opinion formation: a model
Recommendation systems in the scope of opinion formation: a modelRecommendation systems in the scope of opinion formation: a model
Recommendation systems in the scope of opinion formation: a model
 
Class9_PCA_final.ppt
Class9_PCA_final.pptClass9_PCA_final.ppt
Class9_PCA_final.ppt
 
Lecture 1.pdf
Lecture 1.pdfLecture 1.pdf
Lecture 1.pdf
 
B. Liseo, Metodi inferenziali per dati integrati
B. Liseo, Metodi inferenziali per dati integratiB. Liseo, Metodi inferenziali per dati integrati
B. Liseo, Metodi inferenziali per dati integrati
 
For this assignment, use the aschooltest.sav dataset.The d
For this assignment, use the aschooltest.sav dataset.The dFor this assignment, use the aschooltest.sav dataset.The d
For this assignment, use the aschooltest.sav dataset.The d
 
XAI (IIT-Patna).pdf
XAI (IIT-Patna).pdfXAI (IIT-Patna).pdf
XAI (IIT-Patna).pdf
 
Bivariate Regression
Bivariate RegressionBivariate Regression
Bivariate Regression
 
Deep VI with_beta_likelihood
Deep VI with_beta_likelihoodDeep VI with_beta_likelihood
Deep VI with_beta_likelihood
 
causality_discussion_slides_final.pdf
causality_discussion_slides_final.pdfcausality_discussion_slides_final.pdf
causality_discussion_slides_final.pdf
 
Building useful models for imbalanced datasets (without resampling)
Building useful models for imbalanced datasets (without resampling)Building useful models for imbalanced datasets (without resampling)
Building useful models for imbalanced datasets (without resampling)
 
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
7 QC quality control (7 QC) tools for continuous improvement of manufacturing...
 
SPSS statistics - get help using SPSS
SPSS statistics - get help using SPSSSPSS statistics - get help using SPSS
SPSS statistics - get help using SPSS
 
Mixed Effects Models - Random Intercepts
Mixed Effects Models - Random InterceptsMixed Effects Models - Random Intercepts
Mixed Effects Models - Random Intercepts
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
 
Data Distribution &The Probability Distributions
Data Distribution &The Probability DistributionsData Distribution &The Probability Distributions
Data Distribution &The Probability Distributions
 
A Causal Framework for Meta-Analysis, drafty
A Causal Framework for Meta-Analysis, drafty A Causal Framework for Meta-Analysis, drafty
A Causal Framework for Meta-Analysis, drafty
 

Mais de Sebastian Benthall

Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...Sebastian Benthall
 
Designing digital publics for participatory parity
Designing digital publics for participatory parityDesigning digital publics for participatory parity
Designing digital publics for participatory paritySebastian Benthall
 
Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...Sebastian Benthall
 
GeoNode Motivation, Design, and Challenges
GeoNode Motivation, Design, and ChallengesGeoNode Motivation, Design, and Challenges
GeoNode Motivation, Design, and ChallengesSebastian Benthall
 
On Dretske's The Epistemology of Belief
On Dretske's The Epistemology of BeliefOn Dretske's The Epistemology of Belief
On Dretske's The Epistemology of BeliefSebastian Benthall
 
The Everything at Once Manifesto
The Everything at Once ManifestoThe Everything at Once Manifesto
The Everything at Once ManifestoSebastian Benthall
 
Spatial Data Infrastructure Best Practices with GeoNode
Spatial Data Infrastructure Best Practices with GeoNodeSpatial Data Infrastructure Best Practices with GeoNode
Spatial Data Infrastructure Best Practices with GeoNodeSebastian Benthall
 

Mais de Sebastian Benthall (8)

Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...
 
Designing digital publics for participatory parity
Designing digital publics for participatory parityDesigning digital publics for participatory parity
Designing digital publics for participatory parity
 
Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...
 
GeoNode Motivation, Design, and Challenges
GeoNode Motivation, Design, and ChallengesGeoNode Motivation, Design, and Challenges
GeoNode Motivation, Design, and Challenges
 
On Dretske's The Epistemology of Belief
On Dretske's The Epistemology of BeliefOn Dretske's The Epistemology of Belief
On Dretske's The Epistemology of Belief
 
The Everything at Once Manifesto
The Everything at Once ManifestoThe Everything at Once Manifesto
The Everything at Once Manifesto
 
Geonode
GeonodeGeonode
Geonode
 
Spatial Data Infrastructure Best Practices with GeoNode
Spatial Data Infrastructure Best Practices with GeoNodeSpatial Data Infrastructure Best Practices with GeoNode
Spatial Data Infrastructure Best Practices with GeoNode
 

Último

REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...Universidade Federal de Sergipe - UFS
 
Vision and reflection on Mining Software Repositories research in 2024
Vision and reflection on Mining Software Repositories research in 2024Vision and reflection on Mining Software Repositories research in 2024
Vision and reflection on Mining Software Repositories research in 2024AyushiRastogi48
 
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdf
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdfPests of Blackgram, greengram, cowpea_Dr.UPR.pdf
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdfPirithiRaju
 
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPirithiRaju
 
Dubai Calls Girl Lisa O525547819 Lexi Call Girls In Dubai
Dubai Calls Girl Lisa O525547819 Lexi Call Girls In DubaiDubai Calls Girl Lisa O525547819 Lexi Call Girls In Dubai
Dubai Calls Girl Lisa O525547819 Lexi Call Girls In Dubaikojalkojal131
 
Neurodevelopmental disorders according to the dsm 5 tr
Neurodevelopmental disorders according to the dsm 5 trNeurodevelopmental disorders according to the dsm 5 tr
Neurodevelopmental disorders according to the dsm 5 trssuser06f238
 
Microphone- characteristics,carbon microphone, dynamic microphone.pptx
Microphone- characteristics,carbon microphone, dynamic microphone.pptxMicrophone- characteristics,carbon microphone, dynamic microphone.pptx
Microphone- characteristics,carbon microphone, dynamic microphone.pptxpriyankatabhane
 
Pests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPirithiRaju
 
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxGenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxBerniceCayabyab1
 
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptxRESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptxFarihaAbdulRasheed
 
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)riyaescorts54
 
Pests of castor_Binomics_Identification_Dr.UPR.pdf
Pests of castor_Binomics_Identification_Dr.UPR.pdfPests of castor_Binomics_Identification_Dr.UPR.pdf
Pests of castor_Binomics_Identification_Dr.UPR.pdfPirithiRaju
 
User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)Columbia Weather Systems
 
User Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather StationUser Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather StationColumbia Weather Systems
 
BUMI DAN ANTARIKSA PROJEK IPAS SMK KELAS X.pdf
BUMI DAN ANTARIKSA PROJEK IPAS SMK KELAS X.pdfBUMI DAN ANTARIKSA PROJEK IPAS SMK KELAS X.pdf
BUMI DAN ANTARIKSA PROJEK IPAS SMK KELAS X.pdfWildaNurAmalia2
 
Good agricultural practices 3rd year bpharm. herbal drug technology .pptx
Good agricultural practices 3rd year bpharm. herbal drug technology .pptxGood agricultural practices 3rd year bpharm. herbal drug technology .pptx
Good agricultural practices 3rd year bpharm. herbal drug technology .pptxSimeonChristian
 
Microteaching on terms used in filtration .Pharmaceutical Engineering
Microteaching on terms used in filtration .Pharmaceutical EngineeringMicroteaching on terms used in filtration .Pharmaceutical Engineering
Microteaching on terms used in filtration .Pharmaceutical EngineeringPrajakta Shinde
 
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.PraveenaKalaiselvan1
 
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptxLIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptxmalonesandreagweneth
 
Citronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayCitronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayupadhyaymani499
 

Último (20)

REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
REVISTA DE BIOLOGIA E CIÊNCIAS DA TERRA ISSN 1519-5228 - Artigo_Bioterra_V24_...
 
Vision and reflection on Mining Software Repositories research in 2024
Vision and reflection on Mining Software Repositories research in 2024Vision and reflection on Mining Software Repositories research in 2024
Vision and reflection on Mining Software Repositories research in 2024
 
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdf
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdfPests of Blackgram, greengram, cowpea_Dr.UPR.pdf
Pests of Blackgram, greengram, cowpea_Dr.UPR.pdf
 
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
 
Dubai Calls Girl Lisa O525547819 Lexi Call Girls In Dubai
Dubai Calls Girl Lisa O525547819 Lexi Call Girls In DubaiDubai Calls Girl Lisa O525547819 Lexi Call Girls In Dubai
Dubai Calls Girl Lisa O525547819 Lexi Call Girls In Dubai
 
Neurodevelopmental disorders according to the dsm 5 tr
Neurodevelopmental disorders according to the dsm 5 trNeurodevelopmental disorders according to the dsm 5 tr
Neurodevelopmental disorders according to the dsm 5 tr
 
Microphone- characteristics,carbon microphone, dynamic microphone.pptx
Microphone- characteristics,carbon microphone, dynamic microphone.pptxMicrophone- characteristics,carbon microphone, dynamic microphone.pptx
Microphone- characteristics,carbon microphone, dynamic microphone.pptx
 
Pests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdf
 
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptxGenBio2 - Lesson 1 - Introduction to Genetics.pptx
GenBio2 - Lesson 1 - Introduction to Genetics.pptx
 
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptxRESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
RESPIRATORY ADAPTATIONS TO HYPOXIA IN HUMNAS.pptx
 
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
 
Pests of castor_Binomics_Identification_Dr.UPR.pdf
Pests of castor_Binomics_Identification_Dr.UPR.pdfPests of castor_Binomics_Identification_Dr.UPR.pdf
Pests of castor_Binomics_Identification_Dr.UPR.pdf
 
User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)
 
User Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather StationUser Guide: Magellan MX™ Weather Station
User Guide: Magellan MX™ Weather Station
 
BUMI DAN ANTARIKSA PROJEK IPAS SMK KELAS X.pdf
BUMI DAN ANTARIKSA PROJEK IPAS SMK KELAS X.pdfBUMI DAN ANTARIKSA PROJEK IPAS SMK KELAS X.pdf
BUMI DAN ANTARIKSA PROJEK IPAS SMK KELAS X.pdf
 
Good agricultural practices 3rd year bpharm. herbal drug technology .pptx
Good agricultural practices 3rd year bpharm. herbal drug technology .pptxGood agricultural practices 3rd year bpharm. herbal drug technology .pptx
Good agricultural practices 3rd year bpharm. herbal drug technology .pptx
 
Microteaching on terms used in filtration .Pharmaceutical Engineering
Microteaching on terms used in filtration .Pharmaceutical EngineeringMicroteaching on terms used in filtration .Pharmaceutical Engineering
Microteaching on terms used in filtration .Pharmaceutical Engineering
 
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
BIOETHICS IN RECOMBINANT DNA TECHNOLOGY.
 
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptxLIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
 
Citronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyayCitronella presentation SlideShare mani upadhyay
Citronella presentation SlideShare mani upadhyay
 

Causality in complex networks

  • 2. Why causality? Causal relations are scientifically interesting because when exposed, they are: ● a reliable mechanism ● that supports intervention By understanding causality, we can predict and control. This is the interest behind causal knowledge.
  • 3. Why this talk? ● A “working group” talk - I don’t claim to be an expert ● I’m working through research problems that are challenging to me ● I’m presenting this work in progress both to inform and solicit feedback ● You are welcome to do the same with your work!
  • 4. Potential outcomes The Rubin Causal Model (RCM) or potential outcomes framework is ascendant.
  • 5. Potential outcomes “The causal effect of a treatment on a single individual or unit of observation is the comparison (e.g., difference) between the value of the outcome if the unit is treated and the value of the outcome if the unit is not treated.” (Angrist, Imbens, and Rubin, 1996)
  • 6. Potential outcomes “The causal effect of a treatment on a single individual or unit of observation is the comparison (e.g., difference) between the value of the outcome if the unit is treated and the value of the outcome if the unit is not treated.” (Angrist, Imbens, and Rubin, 1996)
  • 7. Potential outcomes Average effect: (10+9+7+12)/4 = 9.5 Controlled Outcome - Yi (0) Treated Outcome - Yi (1) Causal Effect of Treatment Yi (1) - Y(0) Alice 20 30 10 Bob 15 24 9 Cathy 10 17 7 David 22 34 12
  • 8. Potential outcomes You only ever see some of these. This has been called the Fundamental Problem of Causal Inference Controlled Outcome - Yi (0) Treated Outcome - Yi (1) Causal Effect of Treatment Yi (1) - Y(0) Alice 20 30 10 Bob 15 24 9 Cathy 10 17 7 David 22 34 12
  • 9. Potential outcomes Stable Unit Treatment Value Assumption "the [potential outcome] observation on one unit should be unaffected by the particular assignment of treatments to the other units"
  • 10. Potential outcomes Controlled Outcome - Yi (0) Treated Outcome - Yi (1) Causal Effect of Treatment Yi (1) - Y(0) Alice 20 30 10 Bob, if Alice in not treated 15 24 9 Bob, if Alice is treated 18 29 11 Cathy 10 17 7 David 22 34 12
  • 11. Potential outcomes So for every unit, we have to map out all the variables that can have an effect on the potential outcomes. Spouse treated Unit treated Outcome
  • 12. Potential outcomes So for every unit, we have to map out all the variables that can have an effect on the potential outcomes. A great tool for this: Pearl’s causal networks.
  • 13. Causal networks Pearl, Causality, http://bayes.cs.ucla.edu/BOOK-2K/
  • 14. Note There are differences between Pearl and Rubin’s frameworks but their core concepts are compatible, so says Andrew Gelman, 2009: http://andrewgelman.com/2009/07/07/more_on_pearls/
  • 15. Causal networks N.B. An interesting thing about causal networks is that the conditional probability distributions can be arbitrarily complex. Also, variables need not just be whole numbers or scalars. They could be a matrix.
  • 16. Complex networks Now I’m going to talk about networks that are not causal networks. Sometimes in the literature these are called complex networks.
  • 17.
  • 20. Complex networks There are lots of different kinds of networks observed in nature and society. They can differ substantially in their emergent properties.
  • 21. Complex networks def: emergent property “An emergent property is a property which a collection or complex system has, but which the individual members do not have. A failure to realize that a property is emergent, or supervenient, leads to the fallacy of division.”
  • 24. How to make a graph Different processes for generating graphs have result in graphs with different properties.
  • 25. How to make a graph ● Erdős–Rényi (ER) model: G(n,p): Create n nodes and create edges with probability p ● Barabási–Albert (BA) model: ○ Begin with a fully connected network of m0 nodes ○ Each new node is connected to m (< m0 ) node probability proportional to degree ki of each node i
  • 26. How to predict a graph The distribution of degree of an Erdős–Rényi graph is binomial. The distribution of degree of a Barabási– Albert (BA) graph is scale-free/power-law.
  • 27. Bayes Theorem Recall Bayes Theorem: P(H|D) ∝ P(D|H) P(H)
  • 28. Bayes Theorem Recall Bayes Theorem: P(H|D) ∝ P(D|H) P(H) If we can show a difference in the likelihood of data under different hypotheses, we can learn something
  • 29. What process created this graph?
  • 30. What process created this graph? Histogram of observed node degrees d
  • 31. What process created this graph? Can in principle compare P(d|ER) and P(d|BA).
  • 32. What process created this graph? ● We can in principle statistically distinguish hypotheses about generative processes based on emergent properties. ● Is this a causal inference?
  • 33. Ways to model this Process Graph
  • 34. Ways to model this All the logic of graph generation is buried in the conditional probability function P(B|A). A Process B Graph
  • 35. Ways to model this All the logic of graph generation is buried in the conditional probability function P(B|A). “Logical causation” allows no intervention! A Process B Graph
  • 36. Ways to model this The Barabási–Albert (BA) model suggests this interpretation of graph changing over time. You can model time series data like this. B0 B1 B2 B3 B4
  • 37. Ways to model this Now we can model a stable transition function within the graph and external causes. B0 B1 B2 B3 B4 C
  • 38. Ways to model this In other words, endogenous process + exogenous shocks B0 B1 B2 B3 B4 C
  • 39. Tools in the toolbox If we want to understand the effect of a kind of exogenous shock, and we know the endogenous process, then we can look for natural experiments that expose the treated outcome.
  • 40. Tools in the toolbox To know the endogenous process, then compute the likelihood of emergent properties. B0 B1 B2 B3 B4 EEE E E
  • 41. Problems ● The vastness of the hypothesis space of graph generation processes ● Related: how do you choose a prior?
  • 42. Problems ● Computing the likelihood of a graph’s emergent properties given a particular generation process is ○ tricky math ○ maybe computationally hard
  • 43. Dissatisfactions ● We have continued to bury much of the mechanism of interest in the conditional probability function. ● Suppose we want to cash this out as a finer- grained mechanism that supports finer interventions ● Can we think at multiple levels of abstraction at once?
  • 44. Thanks! Contact me at: sb at ischool dot berkeley dot edu