1. The State of Big Data
for Geo
@ajturner
CTO DC Dev Center
@seangorman
Strategist DC Dev Center

2. Trends

3. Of the 318 million mobile handsets
shipped in 2011 79.9% were GPS
enabled
iSuppli 2010

4. Jess3 2011

5. Meeker 2011

6. In the United States 72.2% of users
accessed social media sites and
blogs through their mobile devices –
up 37% from 2010
ComScore 2011

7. What is Big Data?

8. Volume

9. MrGeo

10. MapReduce Geo (MrGeo)
• DIA project initiated by Terry Busch to extend geoprocessing to
very large data sets
• Built by SPADAC -> GeoEye -> Digital Globe
• Uses HDFS and MapReduce to store, process, and index
geospatial imagery and vector data
• Interoperable with:
– ArcGIS Desktop
– COMET
– Google Earth
– WMS clients
– Adobe Flex and Silverlight environments
• Listed on the Hadoop Apache page to be open sourced

11. Brian Levy 2010

12. Velocity

13. Esper

14. GCEP
• Geospatial complex event processing
• Extends the to include the ability to use Geospatial
constructs in the rules for filtering events
• The ability to utilize the OGC Geospatial Functions
within Esper's Event Processing Language (EPL).
–Contains, within, disjoint, intersects, overlaps,
crosses, intersection, touches, buffer, relate, union,
convex hull

15. Variety

17. Neo4j Spatial
• Utilities for importing from ESRI Shapefile as well as
Open Street Map files
• Support for all the common geometry types
• An RTree index for fast searches on geometries
• Support for topology operations during the search
(contains, within, intersects, covers, disjoint, etc.)
• The possibility to enable spatial operations on any graph
of data, regardless of the way the spatial data is stored,
as long as an adapter is provided to map from the graph
to the geometries.
• Ability to split a single layer or dataset into multiple sub-
layers or views with pre-configured filters

18. Peter Neubauer 2011

19. Peter Neubauer 2011

21. ESRI and Big Data

22. Why Big Data?

23. 1. Connecting Big
Data to GIS

25. 2. Scaling
Geoprocessing

27. Case Study:
NYC Marathon

28. Case Study:
Colorado Wildfires

33. 3. Evolving
GeoAnalysis

34. Are we doing it
backwards?

35. May 2nd OBL Tweets
6,454 Tweets with GPS
6,000,000 total Tweets

36. Why run our analysis
with six thousand
instead of six million?

37. Tracking the first
OBL Tweet

38. Extract Analyze
or
Analyze Extract

39. Statistical Mechanics

40. Community
Detection

42. The Future

43. Real Time Pattern
Analysis and Alerting