SlideShare a Scribd company logo
1 of 16
Download to read offline
Ecosystem	
  Challenges	
  Around	
  Data	
  Use	
  	
  
Leonid	
  Zhukov	
  
Ancestry.com	
  
2
•  World’s	
  largest	
  online	
  family	
  history	
  
resource	
  
•  Started	
  as	
  a	
  publishing	
  company	
  in	
  
1983,	
  online	
  from	
  1996	
  
•  2.7	
  million	
  worldwide	
  subscribers	
  
	
  
Data	
  at	
  Ancestry	
  
•  Historical	
  records	
  –	
  company	
  acquired	
  content	
  collecFons	
  
•  User	
  created	
  content:	
  
– Ancestor	
  profiles	
  and	
  family	
  trees	
  
– Uploaded	
  photographs	
  and	
  stories	
  
•  User	
  behavior	
  data	
  on	
  Ancestry.com	
  
•  Customer	
  DNA	
  data	
  
•  10	
  PB	
  of	
  structured	
  and	
  unstructured	
  data	
  
3
Historical	
  records	
  
•  Historical	
  Content	
  
– 14	
  billion	
  historical	
  records	
  going	
  back	
  to	
  17th	
  century	
  
– DigiFzed	
  and	
  searchable	
  
4
Historical	
  records	
  
5
•  More	
  than	
  30,000	
  content	
  collecFons	
  
User	
  family	
  trees	
  
6
•  Family	
  trees:	
  
– 60	
  million	
  family	
  trees	
  
– 6	
  billion	
  profiles	
  
Family	
  trees	
  
77
Power	
  law	
  distribuFon	
  
	
  tree	
  sizes	
  
500	
  nodes	
  
700	
  edges	
  
55	
  generaFons	
  	
  
	
  
Fme	
  
User	
  contributed	
  content	
  
– 200	
  million	
  uploaded	
  	
  family	
  photos	
  and	
  stories	
  
8
Person	
  and	
  record	
  search	
  
9
•  Search	
  query	
  
Record	
  linkage	
  
10
•  Record	
  linkage	
  –	
  finding	
  and	
  matching	
  records	
  in	
  mulFple	
  data	
  sets	
  	
  
with	
  non-­‐unique	
  idenFfiers	
  (data	
  matching,	
  	
  enFty	
  disambiguaFon,	
  
duplicate	
  detecFon	
  etc)	
  
•  Goal:	
  bring	
  together	
  informaFon	
  about	
  the	
  same	
  person	
  
•  Some	
  	
  non-­‐unique	
  idenFfiers:	
  
–  Names:	
  first	
  name,	
  last	
  name	
  (John	
  Smith	
  –	
  300,000	
  records)	
  
–  Dates:	
  	
  date	
  of	
  birth,	
  date	
  of	
  death	
  	
  	
  	
  
–  Places:	
  place	
  of	
  birth,	
  residence,	
  place	
  of	
  death	
  	
  
–  Extra:	
  family	
  members,	
  life	
  events	
  
•  Records	
  o_en	
  incomplete	
  and	
  contain	
  mistakes	
  
•  Other	
  industries:	
  banking,	
  insurance,	
  government	
  etc	
  
User	
  behavior	
  data	
  
•  User	
  behavior	
  data:	
  
– 75	
  mln	
  searches	
  daily	
  
– 10	
  mln	
  profiles	
  added	
  daily	
  
– 3.5	
  mln	
  records	
  aaached	
  daily	
  
11
DNA	
  Data	
  
•  Direct	
  to	
  consumer	
  DNA	
  test	
  
•  700,000	
  SNPs	
  per	
  sample	
  
•  400,000	
  DNA	
  samples	
  
•  No	
  medical	
  studies	
  
	
  
	
  
12
Ancestry	
  DNA	
  
	
   	
   	
   	
   	
   	
  	
  
•  GeneFc	
  ethnicity	
  
– Reference	
  panel	
  	
  
– 26	
  ethnic	
  regions,	
  3000	
  samples	
  
	
  
13
Ancestry	
  DNA	
  
14
•  GeneFc	
  inheritance	
  
– IdenFty-­‐by-­‐descent	
  
– Cousin	
  matching	
  	
  
	
  
Matching DNA
DNA	
  data:	
  privacy	
  and	
  research	
  
15
ding how
influence
nd the re-
atments is
communi-
ability of
e distribu-
ences and
ever, like
l informa-
ata are pri-
sensitive.
ed special
imination,
of insur-
r individu-
es (1, 2).
of these data poses
allenges.
differ in about 0.1%
es in their genomes
entific data has led to a search for new tech-
nologies. However, the hurdles may be
greater than had been suspected. For exam-
ple, one approach to protecting privacy is to
dustrial, or governmental r
agrees to our usage policies
of data access) (10). Althou
prevent data abuse, it pro
monitor usage.
Social concern
are intricately con
about benefits o
trustworthiness of
governmental ag
United States, the
Portability and Ac
of 1996 (HIPAA)
ed Privacy Rules o
erally forbid sha
data without p
However, they do
address use or di
for human genetic
bates in Iceland,
and elsewhere (1
range of views on
by genetic information. Th
may be at one end of this sp
izens seem to strongly desir
Whatever the setting, we rec
man Subject Privacy
Zhen Lin,1 Art B. Owen,2 Russ B.Altman1*
Privacy
Independent SNPs
Low
Medium
High
5 75 100 125 1000 2000 3000 4000
Insufficient for future genomic research
Insufficient for privacy protection
Needed to find genetic relationshops
Trade-offs between SNPs and privacy.
Z.	
  Lin,	
  A.	
  Owen,	
  R.	
  Altman,	
  Science,	
  vol	
  305,	
  2004	
  
Challenges	
  
•  Engineering	
  
– Scalability	
  
– Availability	
  
– Security	
  
•  Research	
  
– InformaFon	
  retrieval	
  	
  
– DNA	
  genomic	
  research	
  	
  
•  Privacy	
  
	
  
	
  16

More Related Content

Similar to Ecosystem challenges around data use

ICG-11 - genomic data projects around the world - nov 5 2016
ICG-11 - genomic data projects around the world - nov 5 2016ICG-11 - genomic data projects around the world - nov 5 2016
ICG-11 - genomic data projects around the world - nov 5 2016Fiona Nielsen
 
Genome data management
Genome data managementGenome data management
Genome data managementShareb Ismaeel
 
Data dialogue - Human Genomic Data Discovery
Data dialogue - Human Genomic Data DiscoveryData dialogue - Human Genomic Data Discovery
Data dialogue - Human Genomic Data DiscoveryFiona Nielsen
 
Data Landscapes: The Neuroscience Information Framework
Data Landscapes:  The Neuroscience Information FrameworkData Landscapes:  The Neuroscience Information Framework
Data Landscapes: The Neuroscience Information FrameworkMaryann Martone
 
Partnering on crop wild relative research at three scales: commonalities for ...
Partnering on crop wild relative research at three scales: commonalities for ...Partnering on crop wild relative research at three scales: commonalities for ...
Partnering on crop wild relative research at three scales: commonalities for ...CWRofUS
 
Partnering on CWR research at three scales: commonalities for success
Partnering on CWR research at three scales: commonalities for successPartnering on CWR research at three scales: commonalities for success
Partnering on CWR research at three scales: commonalities for successCWR Project
 
A Deep Survey of the Digital Resource Landscape: Perspectives from the Neuros...
A Deep Survey of the Digital Resource Landscape:Perspectives from the Neuros...A Deep Survey of the Digital Resource Landscape:Perspectives from the Neuros...
A Deep Survey of the Digital Resource Landscape: Perspectives from the Neuros...Maryann Martone
 
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK Cyndy Parr
 
Finding and accessing human genome data with Repositive
Finding and accessing human genome data with RepositiveFinding and accessing human genome data with Repositive
Finding and accessing human genome data with RepositiveManuel Corpas
 
Project Unity: The Way of the Future for Plant Breeding
Project Unity: The Way of the Future for Plant BreedingProject Unity: The Way of the Future for Plant Breeding
Project Unity: The Way of the Future for Plant BreedingPhenome Networks
 
Crowdsourcing the Analysis of Genomes
Crowdsourcing the Analysis of GenomesCrowdsourcing the Analysis of Genomes
Crowdsourcing the Analysis of GenomesBastian Greshake
 
SciDataCon - How to increase accessibility and reuse for clinical and persona...
SciDataCon - How to increase accessibility and reuse for clinical and persona...SciDataCon - How to increase accessibility and reuse for clinical and persona...
SciDataCon - How to increase accessibility and reuse for clinical and persona...Fiona Nielsen
 
How do we know what we don't know?  Exploring the data and knowledge space th...
How do we know what we don't know?  Exploring the data and knowledge space th...How do we know what we don't know?  Exploring the data and knowledge space th...
How do we know what we don't know?  Exploring the data and knowledge space th...Maryann Martone
 
De walt ecn_2012
De walt ecn_2012De walt ecn_2012
De walt ecn_2012ECNOfficer
 
Workshop finding and accessing data - fiona - lunteren april 18 2016
Workshop   finding and accessing data - fiona - lunteren april 18 2016Workshop   finding and accessing data - fiona - lunteren april 18 2016
Workshop finding and accessing data - fiona - lunteren april 18 2016Fiona Nielsen
 

Similar to Ecosystem challenges around data use (20)

ICG-11 - genomic data projects around the world - nov 5 2016
ICG-11 - genomic data projects around the world - nov 5 2016ICG-11 - genomic data projects around the world - nov 5 2016
ICG-11 - genomic data projects around the world - nov 5 2016
 
ICPSR at a Glance
ICPSR at a GlanceICPSR at a Glance
ICPSR at a Glance
 
Genome data management
Genome data managementGenome data management
Genome data management
 
Data dialogue - Human Genomic Data Discovery
Data dialogue - Human Genomic Data DiscoveryData dialogue - Human Genomic Data Discovery
Data dialogue - Human Genomic Data Discovery
 
Data Landscapes - Addiction
Data Landscapes - AddictionData Landscapes - Addiction
Data Landscapes - Addiction
 
Data Landscapes: The Neuroscience Information Framework
Data Landscapes:  The Neuroscience Information FrameworkData Landscapes:  The Neuroscience Information Framework
Data Landscapes: The Neuroscience Information Framework
 
A Deep Survey of the Digital Resource Landscape
A Deep Survey of the Digital Resource LandscapeA Deep Survey of the Digital Resource Landscape
A Deep Survey of the Digital Resource Landscape
 
Partnering on crop wild relative research at three scales: commonalities for ...
Partnering on crop wild relative research at three scales: commonalities for ...Partnering on crop wild relative research at three scales: commonalities for ...
Partnering on crop wild relative research at three scales: commonalities for ...
 
Partnering on CWR research at three scales: commonalities for success
Partnering on CWR research at three scales: commonalities for successPartnering on CWR research at three scales: commonalities for success
Partnering on CWR research at three scales: commonalities for success
 
GFII 2014 Big Data
GFII 2014 Big DataGFII 2014 Big Data
GFII 2014 Big Data
 
A Deep Survey of the Digital Resource Landscape: Perspectives from the Neuros...
A Deep Survey of the Digital Resource Landscape:Perspectives from the Neuros...A Deep Survey of the Digital Resource Landscape:Perspectives from the Neuros...
A Deep Survey of the Digital Resource Landscape: Perspectives from the Neuros...
 
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
iEvoBio Keynote: Frontiers of discovery with Encyclopedia of Life -- TRAITBANK
 
Finding and accessing human genome data with Repositive
Finding and accessing human genome data with RepositiveFinding and accessing human genome data with Repositive
Finding and accessing human genome data with Repositive
 
Project Unity: The Way of the Future for Plant Breeding
Project Unity: The Way of the Future for Plant BreedingProject Unity: The Way of the Future for Plant Breeding
Project Unity: The Way of the Future for Plant Breeding
 
Crowdsourcing the Analysis of Genomes
Crowdsourcing the Analysis of GenomesCrowdsourcing the Analysis of Genomes
Crowdsourcing the Analysis of Genomes
 
SciDataCon - How to increase accessibility and reuse for clinical and persona...
SciDataCon - How to increase accessibility and reuse for clinical and persona...SciDataCon - How to increase accessibility and reuse for clinical and persona...
SciDataCon - How to increase accessibility and reuse for clinical and persona...
 
IRDiRC: progress and expectations
IRDiRC: progress and expectationsIRDiRC: progress and expectations
IRDiRC: progress and expectations
 
How do we know what we don't know?  Exploring the data and knowledge space th...
How do we know what we don't know?  Exploring the data and knowledge space th...How do we know what we don't know?  Exploring the data and knowledge space th...
How do we know what we don't know?  Exploring the data and knowledge space th...
 
De walt ecn_2012
De walt ecn_2012De walt ecn_2012
De walt ecn_2012
 
Workshop finding and accessing data - fiona - lunteren april 18 2016
Workshop   finding and accessing data - fiona - lunteren april 18 2016Workshop   finding and accessing data - fiona - lunteren april 18 2016
Workshop finding and accessing data - fiona - lunteren april 18 2016
 

More from Leonid Zhukov

Social Networks: from Micromotives to Macrobehavior
Social Networks: from Micromotives to MacrobehaviorSocial Networks: from Micromotives to Macrobehavior
Social Networks: from Micromotives to MacrobehaviorLeonid Zhukov
 
Russian Big Data Startups
Russian Big Data StartupsRussian Big Data Startups
Russian Big Data StartupsLeonid Zhukov
 
Революция Больших Данных
Революция Больших ДанныхРеволюция Больших Данных
Революция Больших ДанныхLeonid Zhukov
 
Профессия Data Scientist
 Профессия Data Scientist Профессия Data Scientist
Профессия Data ScientistLeonid Zhukov
 
Большие Данные
Большие ДанныеБольшие Данные
Большие ДанныеLeonid Zhukov
 
Business of Big Data
Business of Big DataBusiness of Big Data
Business of Big DataLeonid Zhukov
 
Information cascades
Information cascadesInformation cascades
Information cascadesLeonid Zhukov
 
Инфорамционные каскады
Инфорамционные каскадыИнфорамционные каскады
Инфорамционные каскадыLeonid Zhukov
 
Social Network Analysis
Social Network AnalysisSocial Network Analysis
Social Network AnalysisLeonid Zhukov
 
Numerical Linear Algebra for Data and Link Analysis.
Numerical Linear Algebra for Data and Link Analysis.Numerical Linear Algebra for Data and Link Analysis.
Numerical Linear Algebra for Data and Link Analysis.Leonid Zhukov
 
Numerical Linear Algebra for Data and Link Analysis
Numerical Linear Algebra for Data and Link AnalysisNumerical Linear Algebra for Data and Link Analysis
Numerical Linear Algebra for Data and Link AnalysisLeonid Zhukov
 
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRIOriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRILeonid Zhukov
 
Vis03 Workshop. DT-MRI Visualization
Vis03 Workshop. DT-MRI VisualizationVis03 Workshop. DT-MRI Visualization
Vis03 Workshop. DT-MRI VisualizationLeonid Zhukov
 

More from Leonid Zhukov (16)

Social Networks: from Micromotives to Macrobehavior
Social Networks: from Micromotives to MacrobehaviorSocial Networks: from Micromotives to Macrobehavior
Social Networks: from Micromotives to Macrobehavior
 
Data Scientists
 Data Scientists Data Scientists
Data Scientists
 
Russian Big Data Startups
Russian Big Data StartupsRussian Big Data Startups
Russian Big Data Startups
 
Революция Больших Данных
Революция Больших ДанныхРеволюция Больших Данных
Революция Больших Данных
 
Профессия Data Scientist
 Профессия Data Scientist Профессия Data Scientist
Профессия Data Scientist
 
Большие Данные
Большие ДанныеБольшие Данные
Большие Данные
 
Business of Big Data
Business of Big DataBusiness of Big Data
Business of Big Data
 
Information cascades
Information cascadesInformation cascades
Information cascades
 
Инфорамционные каскады
Инфорамционные каскадыИнфорамционные каскады
Инфорамционные каскады
 
Social Networks
Social NetworksSocial Networks
Social Networks
 
Social Network Analysis
Social Network AnalysisSocial Network Analysis
Social Network Analysis
 
Numerical Linear Algebra for Data and Link Analysis.
Numerical Linear Algebra for Data and Link Analysis.Numerical Linear Algebra for Data and Link Analysis.
Numerical Linear Algebra for Data and Link Analysis.
 
Numerical Linear Algebra for Data and Link Analysis
Numerical Linear Algebra for Data and Link AnalysisNumerical Linear Algebra for Data and Link Analysis
Numerical Linear Algebra for Data and Link Analysis
 
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRIOriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
Oriented Tensor Reconstruction. Tracing Neural Pathways from DT-MRI
 
Vis03 Workshop. DT-MRI Visualization
Vis03 Workshop. DT-MRI VisualizationVis03 Workshop. DT-MRI Visualization
Vis03 Workshop. DT-MRI Visualization
 
Monitorium DLP
Monitorium DLPMonitorium DLP
Monitorium DLP
 

Recently uploaded

PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...Sérgio Sacani
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsSérgio Sacani
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPirithiRaju
 
Green chemistry and Sustainable development.pptx
Green chemistry  and Sustainable development.pptxGreen chemistry  and Sustainable development.pptx
Green chemistry and Sustainable development.pptxRajatChauhan518211
 
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...anilsa9823
 
Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfrohankumarsinghrore1
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfmuntazimhurra
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfSumit Kumar yadav
 
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡anilsa9823
 
Chromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATINChromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATINsankalpkumarsahoo174
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...Sérgio Sacani
 
Physiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptxPhysiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptxAArockiyaNisha
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTSérgio Sacani
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...ssifa0344
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSarthak Sekhar Mondal
 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000Sapana Sha
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticssakshisoni2385
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPirithiRaju
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PPRINCE C P
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )aarthirajkumar25
 

Recently uploaded (20)

PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
 
Green chemistry and Sustainable development.pptx
Green chemistry  and Sustainable development.pptxGreen chemistry  and Sustainable development.pptx
Green chemistry and Sustainable development.pptx
 
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
 
Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdf
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdf
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdf
 
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡
 
Chromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATINChromatin Structure | EUCHROMATIN | HETEROCHROMATIN
Chromatin Structure | EUCHROMATIN | HETEROCHROMATIN
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
 
Physiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptxPhysiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptx
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
 

Ecosystem challenges around data use

  • 1. Ecosystem  Challenges  Around  Data  Use     Leonid  Zhukov  
  • 2. Ancestry.com   2 •  World’s  largest  online  family  history   resource   •  Started  as  a  publishing  company  in   1983,  online  from  1996   •  2.7  million  worldwide  subscribers    
  • 3. Data  at  Ancestry   •  Historical  records  –  company  acquired  content  collecFons   •  User  created  content:   – Ancestor  profiles  and  family  trees   – Uploaded  photographs  and  stories   •  User  behavior  data  on  Ancestry.com   •  Customer  DNA  data   •  10  PB  of  structured  and  unstructured  data   3
  • 4. Historical  records   •  Historical  Content   – 14  billion  historical  records  going  back  to  17th  century   – DigiFzed  and  searchable   4
  • 5. Historical  records   5 •  More  than  30,000  content  collecFons  
  • 6. User  family  trees   6 •  Family  trees:   – 60  million  family  trees   – 6  billion  profiles  
  • 7. Family  trees   77 Power  law  distribuFon    tree  sizes   500  nodes   700  edges   55  generaFons       Fme  
  • 8. User  contributed  content   – 200  million  uploaded    family  photos  and  stories   8
  • 9. Person  and  record  search   9 •  Search  query  
  • 10. Record  linkage   10 •  Record  linkage  –  finding  and  matching  records  in  mulFple  data  sets     with  non-­‐unique  idenFfiers  (data  matching,    enFty  disambiguaFon,   duplicate  detecFon  etc)   •  Goal:  bring  together  informaFon  about  the  same  person   •  Some    non-­‐unique  idenFfiers:   –  Names:  first  name,  last  name  (John  Smith  –  300,000  records)   –  Dates:    date  of  birth,  date  of  death         –  Places:  place  of  birth,  residence,  place  of  death     –  Extra:  family  members,  life  events   •  Records  o_en  incomplete  and  contain  mistakes   •  Other  industries:  banking,  insurance,  government  etc  
  • 11. User  behavior  data   •  User  behavior  data:   – 75  mln  searches  daily   – 10  mln  profiles  added  daily   – 3.5  mln  records  aaached  daily   11
  • 12. DNA  Data   •  Direct  to  consumer  DNA  test   •  700,000  SNPs  per  sample   •  400,000  DNA  samples   •  No  medical  studies       12
  • 13. Ancestry  DNA                 •  GeneFc  ethnicity   – Reference  panel     – 26  ethnic  regions,  3000  samples     13
  • 14. Ancestry  DNA   14 •  GeneFc  inheritance   – IdenFty-­‐by-­‐descent   – Cousin  matching       Matching DNA
  • 15. DNA  data:  privacy  and  research   15 ding how influence nd the re- atments is communi- ability of e distribu- ences and ever, like l informa- ata are pri- sensitive. ed special imination, of insur- r individu- es (1, 2). of these data poses allenges. differ in about 0.1% es in their genomes entific data has led to a search for new tech- nologies. However, the hurdles may be greater than had been suspected. For exam- ple, one approach to protecting privacy is to dustrial, or governmental r agrees to our usage policies of data access) (10). Althou prevent data abuse, it pro monitor usage. Social concern are intricately con about benefits o trustworthiness of governmental ag United States, the Portability and Ac of 1996 (HIPAA) ed Privacy Rules o erally forbid sha data without p However, they do address use or di for human genetic bates in Iceland, and elsewhere (1 range of views on by genetic information. Th may be at one end of this sp izens seem to strongly desir Whatever the setting, we rec man Subject Privacy Zhen Lin,1 Art B. Owen,2 Russ B.Altman1* Privacy Independent SNPs Low Medium High 5 75 100 125 1000 2000 3000 4000 Insufficient for future genomic research Insufficient for privacy protection Needed to find genetic relationshops Trade-offs between SNPs and privacy. Z.  Lin,  A.  Owen,  R.  Altman,  Science,  vol  305,  2004  
  • 16. Challenges   •  Engineering   – Scalability   – Availability   – Security   •  Research   – InformaFon  retrieval     – DNA  genomic  research     •  Privacy      16