THE TRILLION ROW SPREADSHEET(tm) from Structure:Data 2012

•

1 gostou•626 visualizações

Gigaom

Presentation from Robert Lefkowitz, 1010data #dataconf More at http://event.gigaom.com/structuredata/

Tecnologia Negócios

THE TRILLION-ROW SPREADSHEET™
SPEAKER: Robert Lefkowitz
Director of Web
Development
1010data

Friday, July 27, 2012

The Trillion Row Spreadsheet
r0ml@1010data.com

2
Friday, July 27, 2012

Trillion Row Spreadsheet

5
Friday, July 27, 2012

Trillion Row Spreadsheet
Trillion Row Data Warehouse

6
Friday, July 27, 2012

Data Warehouse
• Operational -> Analytical
- Design/Model
- Data (cleaning)
- Multiple data sources
- Date (timeseries) analytics
- Reporting (business intelligence)

12
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse

14
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse

Data Mart Data Mart Data Mart

15
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse

Data Mart Data Mart Data Mart

Spreadsheet

16
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse

Data Mart Data Mart Data Mart

Spreadsheet

17
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse

Data Mart Data Mart Data Mart

Spreadsheet

18
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse

Spreadsheet

19
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse

Web based
Spreadsheet

20
Friday, July 27, 2012

Spreadsheets lack ... ?
• Content management
• Business process management
• Automated scheduling
• Authentication
• Audit
• Collaboration
• Enterprise level roll-up

21
Friday, July 27, 2012

Spreadsheets lack ... ?
• Scale

22
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse

Web-based
Spreadsheet

23
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse
Spreadsheet

Web-based
Spreadsheet

24
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse
Spreadsheet

If this is fast enough, you can
recalculate the summaries
from the detail on the fly....

Web-based
Spreadsheet

25
Friday, July 27, 2012

Operational Data

Operational Data Operational Data

Data Warehouse

Data Mart Data Mart Data Mart

Web-based
Spreadsheet

26
Friday, July 27, 2012

Spreadsheets lack ... ?
• Professional programming practices
- Requirements analysis
- Formal regression testing
- Model/View separation
- Object-Orientation
- Static typing
- Naming conventions

28
Friday, July 27, 2012

The Trillion Row Spreadsheet
r0ml@1010data.com

30
Friday, July 27, 2012

Mais conteúdo relacionado

Semelhante a THE TRILLION ROW SPREADSHEET(tm) from Structure:Data 2012

ANALYZING LARGE-SCALE USER DATA from Structure:Data 2012Gigaom

Digitale fabriek - I2 - DsquareSirris

Investigative Analytics- What's in a Data Scientists ToolboxData Science London

PhD thesis defense of Ajith RanabahuArtificial Intelligence Institute at UofSC

SPONSORED WORKSHOP by Amplidata from Structure:Data 2012: Gigaom

THE STATE OF GLOBAL INFRASTRUCTURE PERFORMANCE from Structure 2012Gigaom

Data warehouseRishabh Dogra

Jisc RSC Eastern Microsoft Briefing - Ridgian BI Jisc RSC Eastern 19th march ...JISC RSC Eastern

Ms system centar 2012 hp-badurini prezentacijaTomislav Lulic

Evolutionary Development MethodologyDonna Kelly

THE 3V’S OF BIG DATA: VARIETY, VELOCITY, and VOLUMEGigaom

Final Year Project GuidanceVarad Meru

Introduction to Data WarehousingTameem Ahmad

The 5 levels of embedded biMike Boyarski

Campus Party Recife - Sua primeira e próximas aplicações Android: como fazer ...Nelson Glauber Leal

Semelhante a THE TRILLION ROW SPREADSHEET(tm) from Structure:Data 2012 (16)

ANALYZING LARGE-SCALE USER DATA from Structure:Data 2012

Digitale fabriek - I2 - Dsquare

Investigative Analytics- What's in a Data Scientists Toolbox

PhD thesis defense of Ajith Ranabahu

SPONSORED WORKSHOP by Amplidata from Structure:Data 2012:

THE STATE OF GLOBAL INFRASTRUCTURE PERFORMANCE from Structure 2012

Data warehouse

Jisc RSC Eastern Microsoft Briefing - Ridgian BI Jisc RSC Eastern 19th march ...

Ms system centar 2012 hp-badurini prezentacija

Evolutionary Development Methodology

THE 3V’S OF BIG DATA: VARIETY, VELOCITY, and VOLUME

Final Year Project Guidance

Introduction to Data Warehousing

The 5 levels of embedded bi

Campus Party Recife - Sua primeira e próximas aplicações Android: como fazer ...

Mais de Gigaom

Structure 2014 - The strategic value of the cloud - Joe WeinmanGigaom

Structure 2014 - The right and wrong way to scale - RackspaceGigaom

Structure 2014 - The future of cloud computing survey resultsGigaom

Structure 2014 - Launchpad CompetitionGigaom

Structure 2014 - Disrupting the data center - Intel sponsor workshopGigaom

Structure 2014 - Cloud trends - BatteryGigaom

Structure Data 2014: HOW MICRODATA CAN SAY A LOT ABOUT MACROECONOMICS, David ...Gigaom

Structure Data 2014: QLIK SPONSOR WORKSHOP: ANALYTICS THE WAY NATURE INTENDED...Gigaom

Structure Data 2014: FIVE MYTHS ABOUT BIG DATA, Amit BendovGigaom

Structure Data 2014: AMID BILLIONS OF METRICS, YOUR SOFTWARE IS TRYING TO TEL...Gigaom

Structure Data 2014: SISENSE SPONSOR WORKSHOP: ON BEER, CHIPS AND DATA, Gigaom

Structure Data 2014: INVERTING 80/20: BEYOND BESPOKE BIG DATA, Ari GesherGigaom

Structure Data 2014: TRACKING A SOCCER GAME WITH BIG DATA, Chris HaddadGigaom

Structure Data 2014: TECH AGAINST HUMAN TRAFFICKING AND ILLICIT NETWORKS, Jus...Gigaom

Structure Data 2014: DATA DRIVEN DESIGN AT FORMULA ONE SPEED, Geoff McGrathGigaom

Structure Data 2014: IS VIDEO BIG DATA?, Steve RussellGigaom

Structure Data 2014: BIG DATA ANALYTICS RE-INVENTED, Ryan WaiteGigaom

How Data is Remaking E-commerce - from Roadmap 2013Gigaom

25 Favorite Experiences in Tech - from Roadmap 2013Gigaom

How Moore’s Law is Influencing Design - from Roadmap 2013Gigaom

Mais de Gigaom (20)

Structure 2014 - The strategic value of the cloud - Joe Weinman

Structure 2014 - The right and wrong way to scale - Rackspace

Structure 2014 - The future of cloud computing survey results

Structure 2014 - Launchpad Competition

Structure 2014 - Disrupting the data center - Intel sponsor workshop

Structure 2014 - Cloud trends - Battery

Structure Data 2014: HOW MICRODATA CAN SAY A LOT ABOUT MACROECONOMICS, David ...

Structure Data 2014: QLIK SPONSOR WORKSHOP: ANALYTICS THE WAY NATURE INTENDED...

Structure Data 2014: FIVE MYTHS ABOUT BIG DATA, Amit Bendov

Structure Data 2014: AMID BILLIONS OF METRICS, YOUR SOFTWARE IS TRYING TO TEL...

Structure Data 2014: SISENSE SPONSOR WORKSHOP: ON BEER, CHIPS AND DATA,

Structure Data 2014: INVERTING 80/20: BEYOND BESPOKE BIG DATA, Ari Gesher

Structure Data 2014: TRACKING A SOCCER GAME WITH BIG DATA, Chris Haddad

Structure Data 2014: TECH AGAINST HUMAN TRAFFICKING AND ILLICIT NETWORKS, Jus...

Structure Data 2014: DATA DRIVEN DESIGN AT FORMULA ONE SPEED, Geoff McGrath

Structure Data 2014: IS VIDEO BIG DATA?, Steve Russell

Structure Data 2014: BIG DATA ANALYTICS RE-INVENTED, Ryan Waite

How Data is Remaking E-commerce - from Roadmap 2013

25 Favorite Experiences in Tech - from Roadmap 2013

How Moore’s Law is Influencing Design - from Roadmap 2013

Último

How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe

Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro

DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell

DMCC Future of Trade Web3 - Special EditionDubai Multi Commodity Centre

Powerpoint exploring the locations used in television show Time Clashcharlottematthew16

How to write a Business Continuity PlanDatabarracks

"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays

Take control of your SAP testing with UiPath Test SuiteDianaGray10

"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays

Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst

Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge

WordPress Websites for Engineers: Elevate Your Brandgvaughan

Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm

The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech

Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed

Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University

Gen AI in Business - Global Trends Report 2024.pdfAddepto

Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada

DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy

THE TRILLION ROW SPREADSHEET(tm) from Structure:Data 2012

1. THE TRILLION-ROW SPREADSHEET™ SPEAKER: Robert Lefkowitz Director of Web Development 1010data Friday, July 27, 2012

2. The Trillion Row Spreadsheet r0ml@1010data.com 2 Friday, July 27, 2012

3. Friday, July 27, 2012

4. 4 Friday, July 27, 2012

5. Trillion Row Spreadsheet 5 Friday, July 27, 2012

6. Trillion Row Spreadsheet Trillion Row Data Warehouse 6 Friday, July 27, 2012

7. 7 Friday, July 27, 2012

8. 8 Friday, July 27, 2012

9. 9 Friday, July 27, 2012

10. 10 Friday, July 27, 2012

11. 11 Friday, July 27, 2012

12. Data Warehouse • Operational -> Analytical - Design/Model - Data (cleaning) - Multiple data sources - Date (timeseries) analytics - Reporting (business intelligence) 12 Friday, July 27, 2012

13. 13 Friday, July 27, 2012

14. Operational Data Operational Data Operational Data Data Warehouse 14 Friday, July 27, 2012

15. Operational Data Operational Data Operational Data Data Warehouse Data Mart Data Mart Data Mart 15 Friday, July 27, 2012

16. Operational Data Operational Data Operational Data Data Warehouse Data Mart Data Mart Data Mart Spreadsheet 16 Friday, July 27, 2012

17. Operational Data Operational Data Operational Data Data Warehouse Data Mart Data Mart Data Mart Spreadsheet 17 Friday, July 27, 2012

18. Operational Data Operational Data Operational Data Data Warehouse Data Mart Data Mart Data Mart Spreadsheet 18 Friday, July 27, 2012

19. Operational Data Operational Data Operational Data Data Warehouse Spreadsheet 19 Friday, July 27, 2012

20. Operational Data Operational Data Operational Data Data Warehouse Web based Spreadsheet 20 Friday, July 27, 2012

21. Spreadsheets lack ... ? • Content management • Business process management • Automated scheduling • Authentication • Audit • Collaboration • Enterprise level roll-up 21 Friday, July 27, 2012

22. Spreadsheets lack ... ? • Scale 22 Friday, July 27, 2012

23. Operational Data Operational Data Operational Data Data Warehouse Web-based Spreadsheet 23 Friday, July 27, 2012

24. Operational Data Operational Data Operational Data Data Warehouse Spreadsheet Web-based Spreadsheet 24 Friday, July 27, 2012

25. Operational Data Operational Data Operational Data Data Warehouse Spreadsheet If this is fast enough, you can recalculate the summaries from the detail on the fly.... Web-based Spreadsheet 25 Friday, July 27, 2012

26. Operational Data Operational Data Operational Data Data Warehouse Data Mart Data Mart Data Mart Web-based Spreadsheet 26 Friday, July 27, 2012

27. Operational Data Operational Data Operational Data Data Warehouse Spreadsheet If this is fast enough, you can recalculate the summaries from the detail on the fly.... Web-based Spreadsheet 27 Friday, July 27, 2012

28. Spreadsheets lack ... ? • Professional programming practices - Requirements analysis - Formal regression testing - Model/View separation - Object-Orientation - Static typing - Naming conventions 28 Friday, July 27, 2012

29. 29 Friday, July 27, 2012

30. The Trillion Row Spreadsheet r0ml@1010data.com 30 Friday, July 27, 2012

31. Friday, July 27, 2012

THE TRILLION ROW SPREADSHEET(tm) from Structure:Data 2012

Recomendados

Recomendados

Mais conteúdo relacionado

Semelhante a THE TRILLION ROW SPREADSHEET(tm) from Structure:Data 2012

Semelhante a THE TRILLION ROW SPREADSHEET(tm) from Structure:Data 2012 (16)

Mais de Gigaom

Mais de Gigaom (20)

Último

Último (20)

THE TRILLION ROW SPREADSHEET(tm) from Structure:Data 2012