SlideShare a Scribd company logo
1 of 31
Download to read offline
All Data Big and Small

May 2011
10.20.2005
http://redmonk.com/public/lucene.pdf




                 2
In the beginning, there was
       the database...

             3
1979   1983   1989



        4
When you have a hammer
       and so on

          5
Source: http://www.flickr.com/photos/pagedooley/2234031789/

             6
December 29, 2004




        7
The Cambrian Non-relational
        Explosion


             8
Source: http://www.pnas.org/content/97/9/4426/F1.expansion.html

               9
10
Why?



 11
Different tools for
   different jobs


         12
Or, rather, different data



            13
A lot of different data



           14
15
Most of the attention goes to
          Big Data



              16
In spite of the fact that
comparatively few have it



            17
Less heralded is unstructured data




                18
19
Between the size and (un)structure,
 it's amazing anything gets found



                 20
21
Source: http://www.flickr.com/photos/28705377@N04/4142872268/
It's hard to ask the right question




                22
To make matters worse,
you may only get one chance



             23
The most important answer
    is the next question


            24
Some questions



      25
26
27
28
29
30
OTHER
QUESTIONS
    31

More Related Content

More from sogrady

What Will You Build, and Why?
What Will You Build, and Why?What Will You Build, and Why?
What Will You Build, and Why?sogrady
 
The Open Source Forecast is Cloudy
The Open Source Forecast is CloudyThe Open Source Forecast is Cloudy
The Open Source Forecast is Cloudysogrady
 
Innovate / Disrupt
Innovate / DisruptInnovate / Disrupt
Innovate / Disruptsogrady
 
Freedom: For Better and For Worse
Freedom: For Better and For WorseFreedom: For Better and For Worse
Freedom: For Better and For Worsesogrady
 
What a Long Strange Trip It's Been
What a Long Strange Trip It's BeenWhat a Long Strange Trip It's Been
What a Long Strange Trip It's Beensogrady
 
The Rise and Fall and Rise of Java (2013)
The Rise and Fall and Rise of Java (2013)The Rise and Fall and Rise of Java (2013)
The Rise and Fall and Rise of Java (2013)sogrady
 
The New Kingmakers
The New KingmakersThe New Kingmakers
The New Kingmakerssogrady
 
What Java Can Learn From JavaScript
What Java Can Learn From JavaScriptWhat Java Can Learn From JavaScript
What Java Can Learn From JavaScriptsogrady
 
Open Cloud & The Future of Cloud Computing
Open Cloud &  The Future of Cloud Computing Open Cloud &  The Future of Cloud Computing
Open Cloud & The Future of Cloud Computing sogrady
 
Begun, the IP Wars Have
Begun, the IP Wars HaveBegun, the IP Wars Have
Begun, the IP Wars Havesogrady
 
RedMonk Analytics: Why, How and What
RedMonk Analytics: Why, How and WhatRedMonk Analytics: Why, How and What
RedMonk Analytics: Why, How and Whatsogrady
 
The Future of the Cloud is Open
The Future of the Cloud is OpenThe Future of the Cloud is Open
The Future of the Cloud is Opensogrady
 
Showcase Your Data w/ RedMonk Analytics
Showcase Your Data w/ RedMonk AnalyticsShowcase Your Data w/ RedMonk Analytics
Showcase Your Data w/ RedMonk Analyticssogrady
 
Survival of the Forges
Survival of the ForgesSurvival of the Forges
Survival of the Forgessogrady
 
Open Source + Big Data = Big Money
Open Source + Big Data = Big Money Open Source + Big Data = Big Money
Open Source + Big Data = Big Money sogrady
 
The State of Novell
The State of NovellThe State of Novell
The State of Novellsogrady
 
The Rise and Fall and Rise of Java
The Rise and Fall and Rise of JavaThe Rise and Fall and Rise of Java
The Rise and Fall and Rise of Javasogrady
 
An Introduction to RedMonk Analytics
An Introduction to RedMonk AnalyticsAn Introduction to RedMonk Analytics
An Introduction to RedMonk Analyticssogrady
 
Make Cash. Using Open Source. And WordPress.
Make Cash. Using Open Source. And WordPress.Make Cash. Using Open Source. And WordPress.
Make Cash. Using Open Source. And WordPress.sogrady
 
UbuntuLive Keynote
UbuntuLive KeynoteUbuntuLive Keynote
UbuntuLive Keynotesogrady
 

More from sogrady (20)

What Will You Build, and Why?
What Will You Build, and Why?What Will You Build, and Why?
What Will You Build, and Why?
 
The Open Source Forecast is Cloudy
The Open Source Forecast is CloudyThe Open Source Forecast is Cloudy
The Open Source Forecast is Cloudy
 
Innovate / Disrupt
Innovate / DisruptInnovate / Disrupt
Innovate / Disrupt
 
Freedom: For Better and For Worse
Freedom: For Better and For WorseFreedom: For Better and For Worse
Freedom: For Better and For Worse
 
What a Long Strange Trip It's Been
What a Long Strange Trip It's BeenWhat a Long Strange Trip It's Been
What a Long Strange Trip It's Been
 
The Rise and Fall and Rise of Java (2013)
The Rise and Fall and Rise of Java (2013)The Rise and Fall and Rise of Java (2013)
The Rise and Fall and Rise of Java (2013)
 
The New Kingmakers
The New KingmakersThe New Kingmakers
The New Kingmakers
 
What Java Can Learn From JavaScript
What Java Can Learn From JavaScriptWhat Java Can Learn From JavaScript
What Java Can Learn From JavaScript
 
Open Cloud & The Future of Cloud Computing
Open Cloud &  The Future of Cloud Computing Open Cloud &  The Future of Cloud Computing
Open Cloud & The Future of Cloud Computing
 
Begun, the IP Wars Have
Begun, the IP Wars HaveBegun, the IP Wars Have
Begun, the IP Wars Have
 
RedMonk Analytics: Why, How and What
RedMonk Analytics: Why, How and WhatRedMonk Analytics: Why, How and What
RedMonk Analytics: Why, How and What
 
The Future of the Cloud is Open
The Future of the Cloud is OpenThe Future of the Cloud is Open
The Future of the Cloud is Open
 
Showcase Your Data w/ RedMonk Analytics
Showcase Your Data w/ RedMonk AnalyticsShowcase Your Data w/ RedMonk Analytics
Showcase Your Data w/ RedMonk Analytics
 
Survival of the Forges
Survival of the ForgesSurvival of the Forges
Survival of the Forges
 
Open Source + Big Data = Big Money
Open Source + Big Data = Big Money Open Source + Big Data = Big Money
Open Source + Big Data = Big Money
 
The State of Novell
The State of NovellThe State of Novell
The State of Novell
 
The Rise and Fall and Rise of Java
The Rise and Fall and Rise of JavaThe Rise and Fall and Rise of Java
The Rise and Fall and Rise of Java
 
An Introduction to RedMonk Analytics
An Introduction to RedMonk AnalyticsAn Introduction to RedMonk Analytics
An Introduction to RedMonk Analytics
 
Make Cash. Using Open Source. And WordPress.
Make Cash. Using Open Source. And WordPress.Make Cash. Using Open Source. And WordPress.
Make Cash. Using Open Source. And WordPress.
 
UbuntuLive Keynote
UbuntuLive KeynoteUbuntuLive Keynote
UbuntuLive Keynote
 

Recently uploaded

Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 

Recently uploaded (20)

Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 

All Data Big and Small