SlideShare uma empresa Scribd logo
1 de 42
Big Data For A Better World
Sponsors:
Tonight’s schedule
• Panel Presentation
• Keynote
• Networking
Big Data For A Better World
Panel Presentation
• Leon Wilson
• David M. Holmes
• Jason Therrien
Big Data For A Better World
Big Data: The Promise, the
Premise and the Practice
Kambiz (come-bees) Ghazinour
Advanced Information Security and Privacy Research Lab
Kent State University
Nov 16, 2017
Big Data: The Promise, the
Premise and the Practice
Big Data: The Promise, the
Premise and the Practice
Volume
Velocity
Variety
Veracity
Big, Fast, Diverse, Uncertain Data:
The Promise, the Premise and the
Practice
Google, MapReduce 2004
Big, Fast, Diverse, Inaccurate Data:
The Problem of Promising
Protection of Personal Information
in a Protected and Privacy
Preserving Platform in Practice
Phone Metadata
The Stanford Experiment: See Data and Goliath by Bruce Schneider
• phone metadata from 500 volunteers
• One called a hospital, a medical lab, a pharmacy, and
several short calls to a monitoring hotline for a heart
monitor
• One called her sister at length, then calls to an abortion
clinic, further calls two weeks later, and a final call a
month later.
• a heart patient, an abortion …
• This is just metadata not content. It’s very revealing.
Who should be able to see it?
Personal Data and Privacy
No one shall be subjected to arbitrary
interference with his privacy, family, home
or correspondence, nor to attacks upon his
honor and reputation. Everyone has the
right to the protection of the law against
such interference or attacks
• Article12 of the Universal Declaration of Human
Rights
Nothing to hide, nothing to fear?
• Many people need to control their privacy
– victims of rape or other trauma,
– people escaping abusive relationships
– people who may be discriminated against (HIV positive, previous mental illness, spent convictions,
recovering addicts)
– people at risk of “honor” violence from their families for breaking cultural norms
– Adopters, protecting their adopted children from the birth families that abused them
– witness protection, undercover police, some social workers and prison staff ….
• It is unthinking or callous to see other people’s privacy as unimportant.
• Data is forever and your circumstances or society’s attitudes may change
The Value of Big Data
• Facebook and Amazon are valued at $500B,
as of July 2017
• Most of Facebook’s value comes from
personal data
Anonymization
• Statistical analyses are anonymous “70 percent of
American smokers want to quit” does not expose
personal data
• Data about individuals can be anonymous, but it
becomes very difficult when more than a few facts
are included even if these facts are not specific and
some of them are wrong (eg Netflix)
3 ways to anonymize
• Suppress - omit from the released data
• Generalize - for example, replace birth date
with something less specific, like birth year
• Perturb - make changes to the data
Anonymization is difficult
15
Example 1: AOL Search Data August
2006
• To stimulate research into the value of
search data, AOL released the
anonymized search records of 658,000
users over a three month period from
March to May 2006
AOL anonymization
• AOL had tried to anonymize the data they released by removing the
searcher’s IP address and replacing the AOL username with a unique
random identifier linking of the searches by any individual, so that the
data was still useful for research
• It did not take long for two journalists to identify user 4417749, who
had searched for people with the last name Arnold, “homes sold in
shadow lake subdivision Gwinnett county Georgia" and “pine straw in
Lilburn” as Thelma Arnold, a widow living in Lilburn, Georgia
• Her other searches provide a deeply personal view of her life,
difficulties and desires
AOL faced strong criticism
• The violation of privacy was widely
condemned
• AOL described their action as a “screw up”
• They took down the data, but it was too late.
The internet never forgets. Several mirror
sites had already been set up.
http://www.not-secret.com
Example 2:
The Netflix™ Prize
• In October 2006, Netflix launched a $1m prize for an
algorithm that was 10% better than its existing algorithm
Cinematch
• participants were given access to the contest training data
set of more than 100 million ratings from over 480
thousand randomly-chosen, anonymous customers on
nearly 18 thousand movie titles.
• How much information would you need to be able to
identify customers?
Netflix
• Netflix said “to protect customer privacy, all personal
information identifying individual customers has been
removed and all customer ids have been replaced by
randomly-assigned ids. The date of each rating and the
title and year of release for each movie are provided. No
other customer or movie information is provided.”
• Two weeks after the prize was launched, Arvind
Narayanan and Vitaly Shmatikov of the University of
Texas at Austin announced that they could identify a high
proportion of the 480,000 subscribers in the training
data.
Narayanan and Shmatikov’s results
• How much does the attacker need to know about a Netflix subscriber in
order to identify her record in the dataset, and thus completely learn her
movie viewing history? Very little.
• For example, suppose the attacker learns a few random ratings and the
corresponding dates for some subscriber, perhaps from coffee-time chat.
• With 8 movie ratings (of which we allow 2 to be completely wrong) and
dates that may have a 3-day error, 96% of Netflix subscribers whose
records have been released can be uniquely identified in the dataset.
• For 64% of subscribers, knowledge of only 2 ratings and dates is sufficient
for complete deanonymization, and for 89%, 2 ratings and dates are
enough to reduce the set of records to 8 out of almost 500,000, which
can then be inspected for further deanonymisation.
Why are Narayanan and Shmatikov’s
results important?
1. They were results from probability theory, so they apply to all
sparse datasets. (They tested the results later, using the
Internet Movie Database IMDb as a source of data).
2. Psychologists at Cambridge University have shown that a small
number of seemingly innocuous Facebook Likes can be used to
automatically and accurately predict a range of highly sensitive
personal attributes including: sexual orientation, ethnicity,
religious and political views, personality traits, intelligence,
happiness, use of addictive substances, parental separation,
age, and gender).
“Security” Attack Scenario
25
The Attack Scenario
26
The Usefulness Challenge
27
The Attack Scenario - Anonymization
28
Re-identification by linking
Re-identification by linking (example)
Anonymization in Data Systems
31
K-anonymity
K-Anonymity
Output Perturbation
Example of suppression and
generalization
Classification of Attributes
Classification of Attributes
Example
Finding similar instances
• A Fast Approximate Nearest Neighbor Search
Algorithm in the Hamming Space
– Locality sensitive hashing (LSH)
– Error Weighted Hashing (EWH)
– Etc.
39
Big, Fast, Diverse, Inaccurate Data:
The Problem of Promising
Protection of Personal Information
in a Protected and Privacy
Preserving Platform in Practice
Thank you!
• Questions?
Kambiz Ghazinour
kghazino@kent.edu
@DrGhazinour
41
Advanced Information Security and Privacy Lab
Big Data For A Better World
• Networking
Sponsors:

Mais conteúdo relacionado

Semelhante a Using Big Data While Protecting Privacy

Making sense of big data
Making sense of big dataMaking sense of big data
Making sense of big databis_foresight
 
Roundtable: Social Media Users' Privacy Expectations & the Ethics of Using Th...
Roundtable: Social Media Users' Privacy Expectations & the Ethics of Using Th...Roundtable: Social Media Users' Privacy Expectations & the Ethics of Using Th...
Roundtable: Social Media Users' Privacy Expectations & the Ethics of Using Th...Toronto Metropolitan University
 
The Pros and Cons of Big Data in an ePatient World
The Pros and Cons of Big Data in an ePatient WorldThe Pros and Cons of Big Data in an ePatient World
The Pros and Cons of Big Data in an ePatient WorldPYA, P.C.
 
Privacy & Big Data - What do they know about me?
Privacy & Big Data - What do they know about me?Privacy & Big Data - What do they know about me?
Privacy & Big Data - What do they know about me?Facundo Mauricio
 
1. Data Science overview - part1.pptx
1. Data Science overview - part1.pptx1. Data Science overview - part1.pptx
1. Data Science overview - part1.pptxRahulTr22
 
Interesting ways Big Data is used today
Interesting ways Big Data is used todayInteresting ways Big Data is used today
Interesting ways Big Data is used todayDaniel Sârbe
 
Class_5_Data_2018W_pptx.pptx
Class_5_Data_2018W_pptx.pptxClass_5_Data_2018W_pptx.pptx
Class_5_Data_2018W_pptx.pptxccaskumba
 
Confessions (and Lessons) of a "Recovering" Data Broker
Confessions (and Lessons) of a "Recovering" Data BrokerConfessions (and Lessons) of a "Recovering" Data Broker
Confessions (and Lessons) of a "Recovering" Data Brokermetanautix
 
Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age ...
Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age ...Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age ...
Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age ...Jim Adler
 
Data Kindness on the Internet
Data Kindness on the InternetData Kindness on the Internet
Data Kindness on the InternetChristan Grant
 
Introduction to Privacy and Social Networking
Introduction to Privacy and Social NetworkingIntroduction to Privacy and Social Networking
Introduction to Privacy and Social NetworkingJason Hong
 
Data-Driven Enterprise on Any Beat by Manuel Torres - Monroe, La., NewsTrain ...
Data-Driven Enterprise on Any Beat by Manuel Torres - Monroe, La., NewsTrain ...Data-Driven Enterprise on Any Beat by Manuel Torres - Monroe, La., NewsTrain ...
Data-Driven Enterprise on Any Beat by Manuel Torres - Monroe, La., NewsTrain ...News Leaders Association's NewsTrain
 
Sdal air health and social development (jan. 27, 2014) final
Sdal air health and social development (jan. 27, 2014) finalSdal air health and social development (jan. 27, 2014) final
Sdal air health and social development (jan. 27, 2014) finalkimlyman
 
Big Data and the Social Sciences
Big Data and the Social SciencesBig Data and the Social Sciences
Big Data and the Social SciencesAbe Usher
 
Advanced Research Investigations for SIU Investigators
Advanced Research Investigations for SIU InvestigatorsAdvanced Research Investigations for SIU Investigators
Advanced Research Investigations for SIU InvestigatorsSloan Carne
 

Semelhante a Using Big Data While Protecting Privacy (20)

Making sense of big data
Making sense of big dataMaking sense of big data
Making sense of big data
 
Roundtable: Social Media Users' Privacy Expectations & the Ethics of Using Th...
Roundtable: Social Media Users' Privacy Expectations & the Ethics of Using Th...Roundtable: Social Media Users' Privacy Expectations & the Ethics of Using Th...
Roundtable: Social Media Users' Privacy Expectations & the Ethics of Using Th...
 
The Pros and Cons of Big Data in an ePatient World
The Pros and Cons of Big Data in an ePatient WorldThe Pros and Cons of Big Data in an ePatient World
The Pros and Cons of Big Data in an ePatient World
 
Privacy & Big Data - What do they know about me?
Privacy & Big Data - What do they know about me?Privacy & Big Data - What do they know about me?
Privacy & Big Data - What do they know about me?
 
1. Data Science overview - part1.pptx
1. Data Science overview - part1.pptx1. Data Science overview - part1.pptx
1. Data Science overview - part1.pptx
 
Big Data and You
Big Data and YouBig Data and You
Big Data and You
 
Interesting ways Big Data is used today
Interesting ways Big Data is used todayInteresting ways Big Data is used today
Interesting ways Big Data is used today
 
Class_5_Data_2018W_pptx.pptx
Class_5_Data_2018W_pptx.pptxClass_5_Data_2018W_pptx.pptx
Class_5_Data_2018W_pptx.pptx
 
Adler nurani
Adler nurani Adler nurani
Adler nurani
 
Adler nurani
Adler nurani Adler nurani
Adler nurani
 
Big Data World
Big Data WorldBig Data World
Big Data World
 
Confessions (and Lessons) of a "Recovering" Data Broker
Confessions (and Lessons) of a "Recovering" Data BrokerConfessions (and Lessons) of a "Recovering" Data Broker
Confessions (and Lessons) of a "Recovering" Data Broker
 
Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age ...
Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age ...Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age ...
Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age ...
 
Data Kindness on the Internet
Data Kindness on the InternetData Kindness on the Internet
Data Kindness on the Internet
 
Osint part 1_personal_privacy
Osint part 1_personal_privacyOsint part 1_personal_privacy
Osint part 1_personal_privacy
 
Introduction to Privacy and Social Networking
Introduction to Privacy and Social NetworkingIntroduction to Privacy and Social Networking
Introduction to Privacy and Social Networking
 
Data-Driven Enterprise on Any Beat by Manuel Torres - Monroe, La., NewsTrain ...
Data-Driven Enterprise on Any Beat by Manuel Torres - Monroe, La., NewsTrain ...Data-Driven Enterprise on Any Beat by Manuel Torres - Monroe, La., NewsTrain ...
Data-Driven Enterprise on Any Beat by Manuel Torres - Monroe, La., NewsTrain ...
 
Sdal air health and social development (jan. 27, 2014) final
Sdal air health and social development (jan. 27, 2014) finalSdal air health and social development (jan. 27, 2014) final
Sdal air health and social development (jan. 27, 2014) final
 
Big Data and the Social Sciences
Big Data and the Social SciencesBig Data and the Social Sciences
Big Data and the Social Sciences
 
Advanced Research Investigations for SIU Investigators
Advanced Research Investigations for SIU InvestigatorsAdvanced Research Investigations for SIU Investigators
Advanced Research Investigations for SIU Investigators
 

Último

Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesZilliz
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 

Último (20)

Vector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector DatabasesVector Databases 101 - An introduction to the world of Vector Databases
Vector Databases 101 - An introduction to the world of Vector Databases
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 

Using Big Data While Protecting Privacy

  • 1. Big Data For A Better World Sponsors:
  • 2. Tonight’s schedule • Panel Presentation • Keynote • Networking Big Data For A Better World
  • 3. Panel Presentation • Leon Wilson • David M. Holmes • Jason Therrien Big Data For A Better World
  • 4. Big Data: The Promise, the Premise and the Practice Kambiz (come-bees) Ghazinour Advanced Information Security and Privacy Research Lab Kent State University Nov 16, 2017
  • 5. Big Data: The Promise, the Premise and the Practice
  • 6. Big Data: The Promise, the Premise and the Practice Volume Velocity Variety Veracity
  • 7. Big, Fast, Diverse, Uncertain Data: The Promise, the Premise and the Practice Google, MapReduce 2004
  • 8. Big, Fast, Diverse, Inaccurate Data: The Problem of Promising Protection of Personal Information in a Protected and Privacy Preserving Platform in Practice
  • 9. Phone Metadata The Stanford Experiment: See Data and Goliath by Bruce Schneider • phone metadata from 500 volunteers • One called a hospital, a medical lab, a pharmacy, and several short calls to a monitoring hotline for a heart monitor • One called her sister at length, then calls to an abortion clinic, further calls two weeks later, and a final call a month later. • a heart patient, an abortion … • This is just metadata not content. It’s very revealing. Who should be able to see it?
  • 10. Personal Data and Privacy No one shall be subjected to arbitrary interference with his privacy, family, home or correspondence, nor to attacks upon his honor and reputation. Everyone has the right to the protection of the law against such interference or attacks • Article12 of the Universal Declaration of Human Rights
  • 11. Nothing to hide, nothing to fear? • Many people need to control their privacy – victims of rape or other trauma, – people escaping abusive relationships – people who may be discriminated against (HIV positive, previous mental illness, spent convictions, recovering addicts) – people at risk of “honor” violence from their families for breaking cultural norms – Adopters, protecting their adopted children from the birth families that abused them – witness protection, undercover police, some social workers and prison staff …. • It is unthinking or callous to see other people’s privacy as unimportant. • Data is forever and your circumstances or society’s attitudes may change
  • 12. The Value of Big Data • Facebook and Amazon are valued at $500B, as of July 2017 • Most of Facebook’s value comes from personal data
  • 13. Anonymization • Statistical analyses are anonymous “70 percent of American smokers want to quit” does not expose personal data • Data about individuals can be anonymous, but it becomes very difficult when more than a few facts are included even if these facts are not specific and some of them are wrong (eg Netflix)
  • 14. 3 ways to anonymize • Suppress - omit from the released data • Generalize - for example, replace birth date with something less specific, like birth year • Perturb - make changes to the data
  • 16. Example 1: AOL Search Data August 2006 • To stimulate research into the value of search data, AOL released the anonymized search records of 658,000 users over a three month period from March to May 2006
  • 17. AOL anonymization • AOL had tried to anonymize the data they released by removing the searcher’s IP address and replacing the AOL username with a unique random identifier linking of the searches by any individual, so that the data was still useful for research • It did not take long for two journalists to identify user 4417749, who had searched for people with the last name Arnold, “homes sold in shadow lake subdivision Gwinnett county Georgia" and “pine straw in Lilburn” as Thelma Arnold, a widow living in Lilburn, Georgia • Her other searches provide a deeply personal view of her life, difficulties and desires
  • 18. AOL faced strong criticism • The violation of privacy was widely condemned • AOL described their action as a “screw up” • They took down the data, but it was too late. The internet never forgets. Several mirror sites had already been set up.
  • 20.
  • 21. Example 2: The Netflix™ Prize • In October 2006, Netflix launched a $1m prize for an algorithm that was 10% better than its existing algorithm Cinematch • participants were given access to the contest training data set of more than 100 million ratings from over 480 thousand randomly-chosen, anonymous customers on nearly 18 thousand movie titles. • How much information would you need to be able to identify customers?
  • 22. Netflix • Netflix said “to protect customer privacy, all personal information identifying individual customers has been removed and all customer ids have been replaced by randomly-assigned ids. The date of each rating and the title and year of release for each movie are provided. No other customer or movie information is provided.” • Two weeks after the prize was launched, Arvind Narayanan and Vitaly Shmatikov of the University of Texas at Austin announced that they could identify a high proportion of the 480,000 subscribers in the training data.
  • 23. Narayanan and Shmatikov’s results • How much does the attacker need to know about a Netflix subscriber in order to identify her record in the dataset, and thus completely learn her movie viewing history? Very little. • For example, suppose the attacker learns a few random ratings and the corresponding dates for some subscriber, perhaps from coffee-time chat. • With 8 movie ratings (of which we allow 2 to be completely wrong) and dates that may have a 3-day error, 96% of Netflix subscribers whose records have been released can be uniquely identified in the dataset. • For 64% of subscribers, knowledge of only 2 ratings and dates is sufficient for complete deanonymization, and for 89%, 2 ratings and dates are enough to reduce the set of records to 8 out of almost 500,000, which can then be inspected for further deanonymisation.
  • 24. Why are Narayanan and Shmatikov’s results important? 1. They were results from probability theory, so they apply to all sparse datasets. (They tested the results later, using the Internet Movie Database IMDb as a source of data). 2. Psychologists at Cambridge University have shown that a small number of seemingly innocuous Facebook Likes can be used to automatically and accurately predict a range of highly sensitive personal attributes including: sexual orientation, ethnicity, religious and political views, personality traits, intelligence, happiness, use of addictive substances, parental separation, age, and gender).
  • 28. The Attack Scenario - Anonymization 28
  • 31. Anonymization in Data Systems 31
  • 35. Example of suppression and generalization
  • 39. Finding similar instances • A Fast Approximate Nearest Neighbor Search Algorithm in the Hamming Space – Locality sensitive hashing (LSH) – Error Weighted Hashing (EWH) – Etc. 39
  • 40. Big, Fast, Diverse, Inaccurate Data: The Problem of Promising Protection of Personal Information in a Protected and Privacy Preserving Platform in Practice
  • 41. Thank you! • Questions? Kambiz Ghazinour kghazino@kent.edu @DrGhazinour 41 Advanced Information Security and Privacy Lab
  • 42. Big Data For A Better World • Networking Sponsors: