SlideShare uma empresa Scribd logo
1 de 31
Baixar para ler offline
NY:DISRUPT API HACKATHON
Drag and Drop Data Science




Contact Us!                                             http://api.metalayer.com
developers@metalayer.com                                @metaLayer
BIG DATA
    IS
   BIG
PUNY
HUMANS ARE
   PUNY
http://TEDglobe.com
by Kate Starbird, Bill Morris, Chris Danforth and GeoSprocket
Data Sets + APIs + Visualizations




      Made
     Simple.
Data Sets + APIs + Visualizations




      Made
     Simple.
SCHWAG ALERT


   We’ve got hoodies (as many as you can take)

Prize! Apple TV for best in show using our Image API

  Prize! Kindle for best in show using our Text API

                   We’re hiring!
Using the MetaLayer
      Text API
Our Text API offers methods for extracting contextual features
from text documents using various forms of entity extraction.

  •Find place names in documents and turn them into lat/lon
   coordinates for mapping
  •Perform auto-tagging and classification using uncommon
   keywords
  •Utilize our sentiment analysis algorithms
ARCHITECTURE
Built using pyNLTK (python natural language toolkit)

Brown Corpus (Brown University Standard Corpus of Present-Day
American English)

Extended to deal with short form text like Tweets

Corpus can be extended to optimize the API for specific use cases.

60,000 items per minute on a single server

Scales horizontally for ‘bigger data’ streams
FUNCTIONS


Sentiment Analysis

Tagging (Uncommon Keywords)

Location Disambiguation

Bundle (a Buffet of Awesome)
FORMAT
Post: “This is some excellent text that needs to be tagged especially if
we can pick the location Philadelphia, PA out of it.”


Response Example: { "status": "success", "method": "bundle", "service":
"datalayer", "response": { "datalayer": { "text": "this is some excellent text
that needs to be tagged especially if we can pick the location
Philadelphia PA out of it", "locations": [ { "latitude":
39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US",
"longitude": -75.162400000000005 } ], "sentiment":
0.63960214906683133, "tags": [ "excellent", "text", "location",
"Philadelphia", "PA" ] } } }
FORMAT
Post: “This is some excellent text that needs to be tagged especially if
we can pick the location Philadelphia, PA out of it.”


Response Example: { "status": "success", "method": "bundle", "service":
"datalayer", "response": { "datalayer": { "text": "this is some excellent text
that needs to be tagged especially if we can pick the location
Philadelphia PA out of it", "locations": [ { "latitude":
39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US",
"longitude": -75.162400000000005 } ], "sentiment":
0.63960214906683133, "tags": [ "excellent", "text", "location",
"Philadelphia", "PA" ] } } }
Using the MetaLayer
     Image API
Our Image API offers methods for extracting contextual features
from photos and image documents.

  •Find all the objects in a photo along with their relative
   coordinates in the frame
  •Extract color/histogram profiles
  •Parse text from the image to make it actionable
ARCHITECTURE

Built using Teeseract OCR with a proprietary training set.

Extensible and Adaptive

20,000 items per minute on a single server

Scales horizontally

Parses JPG and PNG documents
FUNCTIONS
Color Profile (all colors in an image)

Histogram (the distribution of color in an image)

Optical Character Recognition (OCR)

Object Recognition

Bundle (Awesome Reloaded!)
MetaLayer Dashboard API
  *Coming soon young, Padawan.*
Our Dashboard API offers methods for interacting with
MetaLayer Dashboard products through scripting.

  •Remotely create and configure dashboard environments
  •Push data to RESTful Dashboard hook (ex. real-time streams)
  •Poll/Request data from Dashboard hook (ex. historic data)
  •Analytics from Dashboard activity streams
  •Create data mashups, consume the JSON output
ARCHITECTURE


Dashboard is build with Python and Django

Adds GUI elements to working with APIs

Drag and drop data science. Anyone can use it to mash up data.

Background tasks distributed across horizontal servers.
FUNCTIONS

Control Administration & User Roles

Modify GUI Features

Data Acquisition

Data Consumption

Analytics
API.METALAYER.COM
Drag and Drop Insights




Contact Us!                                         http://api.metalayer.com
developers@metalayer.com                            @metaLayer
MetaLayer Presentation at TechCrunch Disrupt NY 2012

Mais conteúdo relacionado

Mais de Jon Gosier

IOT4I Internet of Things for Impact | Netherlands
IOT4I Internet of Things for Impact | NetherlandsIOT4I Internet of Things for Impact | Netherlands
IOT4I Internet of Things for Impact | NetherlandsJon Gosier
 
Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015
Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015
Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015Jon Gosier
 
Africa's Third Act: Why the Continent Matters Now More than Ever
Africa's Third Act: Why the Continent Matters Now More than EverAfrica's Third Act: Why the Continent Matters Now More than Ever
Africa's Third Act: Why the Continent Matters Now More than EverJon Gosier
 
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Pa...
Predicting Macroeconomic Trends  Through Real-Time Mobile Data Collection [Pa...Predicting Macroeconomic Trends  Through Real-Time Mobile Data Collection [Pa...
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Pa...Jon Gosier
 
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...Jon Gosier
 
21st Century Strategies for Financial Inclusion
21st Century Strategies for Financial Inclusion21st Century Strategies for Financial Inclusion
21st Century Strategies for Financial InclusionJon Gosier
 
About Ebola Deeply - Slides from Foreign Press Center
About Ebola Deeply - Slides from Foreign Press CenterAbout Ebola Deeply - Slides from Foreign Press Center
About Ebola Deeply - Slides from Foreign Press CenterJon Gosier
 
Philly Tech Week 2014 - The Future of Digital Marketing - Data-Mining
Philly Tech Week 2014 - The Future of Digital Marketing - Data-MiningPhilly Tech Week 2014 - The Future of Digital Marketing - Data-Mining
Philly Tech Week 2014 - The Future of Digital Marketing - Data-MiningJon Gosier
 
Using Predictive Analytics for Anticipatory Investigation and Intervention
Using Predictive Analytics for Anticipatory Investigation and InterventionUsing Predictive Analytics for Anticipatory Investigation and Intervention
Using Predictive Analytics for Anticipatory Investigation and InterventionJon Gosier
 
Data Mining Online Audiences with D8A Group
Data Mining Online Audiences with D8A GroupData Mining Online Audiences with D8A Group
Data Mining Online Audiences with D8A GroupJon Gosier
 
Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...
Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...
Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...Jon Gosier
 
The Humanitarian Face of Big Data | ICCM 2013
The Humanitarian Face of Big Data | ICCM 2013The Humanitarian Face of Big Data | ICCM 2013
The Humanitarian Face of Big Data | ICCM 2013Jon Gosier
 
Structuring Your Social Enterprise #FTW
Structuring Your Social Enterprise #FTWStructuring Your Social Enterprise #FTW
Structuring Your Social Enterprise #FTWJon Gosier
 
Platform to Playform: The Gamification of Civic Action
Platform to Playform: The Gamification of Civic ActionPlatform to Playform: The Gamification of Civic Action
Platform to Playform: The Gamification of Civic ActionJon Gosier
 
SiftDeck: Predictive Analytics for Disaster and Risk
SiftDeck: Predictive Analytics for Disaster and RiskSiftDeck: Predictive Analytics for Disaster and Risk
SiftDeck: Predictive Analytics for Disaster and RiskJon Gosier
 
Abayima Crisis Communications igKnight Talk
Abayima Crisis Communications igKnight TalkAbayima Crisis Communications igKnight Talk
Abayima Crisis Communications igKnight TalkJon Gosier
 
The New Business of Africa
The New Business of AfricaThe New Business of Africa
The New Business of AfricaJon Gosier
 
Keynote from 7th Annual Carole I Smith Technology Symposium
Keynote from 7th Annual Carole I Smith Technology SymposiumKeynote from 7th Annual Carole I Smith Technology Symposium
Keynote from 7th Annual Carole I Smith Technology SymposiumJon Gosier
 
Africa's Fifth Estate
Africa's Fifth EstateAfrica's Fifth Estate
Africa's Fifth EstateJon Gosier
 
Apps4Africa Accelerator 2013
Apps4Africa Accelerator 2013Apps4Africa Accelerator 2013
Apps4Africa Accelerator 2013Jon Gosier
 

Mais de Jon Gosier (20)

IOT4I Internet of Things for Impact | Netherlands
IOT4I Internet of Things for Impact | NetherlandsIOT4I Internet of Things for Impact | Netherlands
IOT4I Internet of Things for Impact | Netherlands
 
Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015
Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015
Africa's Third Act: Why the Continent Matters Now More than Ever #BTW2015
 
Africa's Third Act: Why the Continent Matters Now More than Ever
Africa's Third Act: Why the Continent Matters Now More than EverAfrica's Third Act: Why the Continent Matters Now More than Ever
Africa's Third Act: Why the Continent Matters Now More than Ever
 
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Pa...
Predicting Macroeconomic Trends  Through Real-Time Mobile Data Collection [Pa...Predicting Macroeconomic Trends  Through Real-Time Mobile Data Collection [Pa...
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Pa...
 
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...
Predicting Macroeconomic Trends Through Real-Time Mobile Data Collection [Sli...
 
21st Century Strategies for Financial Inclusion
21st Century Strategies for Financial Inclusion21st Century Strategies for Financial Inclusion
21st Century Strategies for Financial Inclusion
 
About Ebola Deeply - Slides from Foreign Press Center
About Ebola Deeply - Slides from Foreign Press CenterAbout Ebola Deeply - Slides from Foreign Press Center
About Ebola Deeply - Slides from Foreign Press Center
 
Philly Tech Week 2014 - The Future of Digital Marketing - Data-Mining
Philly Tech Week 2014 - The Future of Digital Marketing - Data-MiningPhilly Tech Week 2014 - The Future of Digital Marketing - Data-Mining
Philly Tech Week 2014 - The Future of Digital Marketing - Data-Mining
 
Using Predictive Analytics for Anticipatory Investigation and Intervention
Using Predictive Analytics for Anticipatory Investigation and InterventionUsing Predictive Analytics for Anticipatory Investigation and Intervention
Using Predictive Analytics for Anticipatory Investigation and Intervention
 
Data Mining Online Audiences with D8A Group
Data Mining Online Audiences with D8A GroupData Mining Online Audiences with D8A Group
Data Mining Online Audiences with D8A Group
 
Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...
Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...
Data-Driven Crisis Monitoring: Turning Online Activity into Actionable Insigh...
 
The Humanitarian Face of Big Data | ICCM 2013
The Humanitarian Face of Big Data | ICCM 2013The Humanitarian Face of Big Data | ICCM 2013
The Humanitarian Face of Big Data | ICCM 2013
 
Structuring Your Social Enterprise #FTW
Structuring Your Social Enterprise #FTWStructuring Your Social Enterprise #FTW
Structuring Your Social Enterprise #FTW
 
Platform to Playform: The Gamification of Civic Action
Platform to Playform: The Gamification of Civic ActionPlatform to Playform: The Gamification of Civic Action
Platform to Playform: The Gamification of Civic Action
 
SiftDeck: Predictive Analytics for Disaster and Risk
SiftDeck: Predictive Analytics for Disaster and RiskSiftDeck: Predictive Analytics for Disaster and Risk
SiftDeck: Predictive Analytics for Disaster and Risk
 
Abayima Crisis Communications igKnight Talk
Abayima Crisis Communications igKnight TalkAbayima Crisis Communications igKnight Talk
Abayima Crisis Communications igKnight Talk
 
The New Business of Africa
The New Business of AfricaThe New Business of Africa
The New Business of Africa
 
Keynote from 7th Annual Carole I Smith Technology Symposium
Keynote from 7th Annual Carole I Smith Technology SymposiumKeynote from 7th Annual Carole I Smith Technology Symposium
Keynote from 7th Annual Carole I Smith Technology Symposium
 
Africa's Fifth Estate
Africa's Fifth EstateAfrica's Fifth Estate
Africa's Fifth Estate
 
Apps4Africa Accelerator 2013
Apps4Africa Accelerator 2013Apps4Africa Accelerator 2013
Apps4Africa Accelerator 2013
 

Último

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 

Último (20)

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 

MetaLayer Presentation at TechCrunch Disrupt NY 2012

  • 2. Drag and Drop Data Science Contact Us! http://api.metalayer.com developers@metalayer.com @metaLayer
  • 3. BIG DATA IS BIG
  • 5.
  • 6.
  • 8. by Kate Starbird, Bill Morris, Chris Danforth and GeoSprocket
  • 9.
  • 10. Data Sets + APIs + Visualizations Made Simple.
  • 11. Data Sets + APIs + Visualizations Made Simple.
  • 12. SCHWAG ALERT We’ve got hoodies (as many as you can take) Prize! Apple TV for best in show using our Image API Prize! Kindle for best in show using our Text API We’re hiring!
  • 13.
  • 14.
  • 16. Our Text API offers methods for extracting contextual features from text documents using various forms of entity extraction. •Find place names in documents and turn them into lat/lon coordinates for mapping •Perform auto-tagging and classification using uncommon keywords •Utilize our sentiment analysis algorithms
  • 17. ARCHITECTURE Built using pyNLTK (python natural language toolkit) Brown Corpus (Brown University Standard Corpus of Present-Day American English) Extended to deal with short form text like Tweets Corpus can be extended to optimize the API for specific use cases. 60,000 items per minute on a single server Scales horizontally for ‘bigger data’ streams
  • 18. FUNCTIONS Sentiment Analysis Tagging (Uncommon Keywords) Location Disambiguation Bundle (a Buffet of Awesome)
  • 19. FORMAT Post: “This is some excellent text that needs to be tagged especially if we can pick the location Philadelphia, PA out of it.” Response Example: { "status": "success", "method": "bundle", "service": "datalayer", "response": { "datalayer": { "text": "this is some excellent text that needs to be tagged especially if we can pick the location Philadelphia PA out of it", "locations": [ { "latitude": 39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US", "longitude": -75.162400000000005 } ], "sentiment": 0.63960214906683133, "tags": [ "excellent", "text", "location", "Philadelphia", "PA" ] } } }
  • 20. FORMAT Post: “This is some excellent text that needs to be tagged especially if we can pick the location Philadelphia, PA out of it.” Response Example: { "status": "success", "method": "bundle", "service": "datalayer", "response": { "datalayer": { "text": "this is some excellent text that needs to be tagged especially if we can pick the location Philadelphia PA out of it", "locations": [ { "latitude": 39.952300000000001, "confidence": 10.0, "name": "Philadelphia, PA, US", "longitude": -75.162400000000005 } ], "sentiment": 0.63960214906683133, "tags": [ "excellent", "text", "location", "Philadelphia", "PA" ] } } }
  • 21. Using the MetaLayer Image API
  • 22. Our Image API offers methods for extracting contextual features from photos and image documents. •Find all the objects in a photo along with their relative coordinates in the frame •Extract color/histogram profiles •Parse text from the image to make it actionable
  • 23. ARCHITECTURE Built using Teeseract OCR with a proprietary training set. Extensible and Adaptive 20,000 items per minute on a single server Scales horizontally Parses JPG and PNG documents
  • 24. FUNCTIONS Color Profile (all colors in an image) Histogram (the distribution of color in an image) Optical Character Recognition (OCR) Object Recognition Bundle (Awesome Reloaded!)
  • 25. MetaLayer Dashboard API *Coming soon young, Padawan.*
  • 26. Our Dashboard API offers methods for interacting with MetaLayer Dashboard products through scripting. •Remotely create and configure dashboard environments •Push data to RESTful Dashboard hook (ex. real-time streams) •Poll/Request data from Dashboard hook (ex. historic data) •Analytics from Dashboard activity streams •Create data mashups, consume the JSON output
  • 27. ARCHITECTURE Dashboard is build with Python and Django Adds GUI elements to working with APIs Drag and drop data science. Anyone can use it to mash up data. Background tasks distributed across horizontal servers.
  • 28. FUNCTIONS Control Administration & User Roles Modify GUI Features Data Acquisition Data Consumption Analytics
  • 30. Drag and Drop Insights Contact Us! http://api.metalayer.com developers@metalayer.com @metaLayer