SlideShare uma empresa Scribd logo
1 de 20
Modeling Count-based Raster Data
       Using R with ArcGIS Desktop

                Jeremy Heffner
           HunchLab Product Manager
             jheffner@azavea.com
We have events that occur in space (i.e. crimes)
?




                  ?
                                    ?




        But why do they occur where they do?
     Do events correlate with geographic features?
Can we predict the rate of events at particular locations?
Let’s create a raster covering formed of square cells
And bring in features of the geography
    that may explain the pattern
For some geographic features we may use a proximity
           measure of spatial influence
For some geographic features we may use a proximity
           measure of spatial influence
For some geographic features we may use a proximity
           measure of spatial influence
For other geographic features we may look at the
     concentration of the features (density)
For each raster cell we have values for these
           explanatory variables
So can’t we use ArcGIS’s built-in
      regression models?
They all assume a normal distribution
      for the response variable




         }
       y = b0 + b1x1 + b2x2 + …
Our cells have 0 or more events and are not a
             normal distribution
Poisson Process
This is a process which counts independent
events happening in a given interval (time,
space).




Poisson Distribution
This process leads to a Poisson distribution of
counts.




                                                                    Source: Wikipedia




Generalized Linear Model                          y = exp(b0 + b1x1 + b2x2 + …)
A GLM can represent this distribution in a
regression model.
Our counts fit a
Poisson distribution
    much better
We can process our geographic data sets in ArcGIS and then
            export the cells to R for modeling




    Raster                                             Calculate
               Export to   Convert to   Build Model
  Processing                                          Predictions
                 ASCII        CSV           (R)
   (ArcGIS)                                            (ArcGIS)
Here is sample output from fitting a Poisson model in R:
We can take the fitted coefficients from R and plug them
into the equation within ArcGIS using the ‘raster calculator’




               y = exp(b0 + b1x1 + b2x2 + …)
Here’s an example of the output
which explains the expectation
of shootings based upon
the location of
drug arrests and
bus stops.
This example is derived from a collaborative project between
      Azavea and the Rutgers Center on Public Security




                   For more information:

                     Jeremy Heffner
                HunchLab Product Manager
                  jheffner@azavea.com

Mais conteúdo relacionado

Mais procurados

A Visualization Application for SIAT
A Visualization Application for SIATA Visualization Application for SIAT
A Visualization Application for SIAT
Bernhard Snizek
 

Mais procurados (19)

A Visualization Application for SIAT
A Visualization Application for SIATA Visualization Application for SIAT
A Visualization Application for SIAT
 
Excel (VBA) Processing DXF Drawings
Excel (VBA) Processing DXF DrawingsExcel (VBA) Processing DXF Drawings
Excel (VBA) Processing DXF Drawings
 
Making Beautiful Maps: Oct 5 2011
Making Beautiful Maps: Oct 5 2011Making Beautiful Maps: Oct 5 2011
Making Beautiful Maps: Oct 5 2011
 
MapTiler Presentation at FOSS4G2019
MapTiler Presentation at FOSS4G2019MapTiler Presentation at FOSS4G2019
MapTiler Presentation at FOSS4G2019
 
How Rough Is Your Runway?
How Rough Is Your Runway? How Rough Is Your Runway?
How Rough Is Your Runway?
 
3D Analyst - Lake, Jatiluhur
3D Analyst - Lake, Jatiluhur3D Analyst - Lake, Jatiluhur
3D Analyst - Lake, Jatiluhur
 
OpenLayers Feature Frenzy
OpenLayers Feature FrenzyOpenLayers Feature Frenzy
OpenLayers Feature Frenzy
 
Creating gridded cartograms: Israel and the Palestine Territories
Creating gridded cartograms: Israel and the Palestine TerritoriesCreating gridded cartograms: Israel and the Palestine Territories
Creating gridded cartograms: Israel and the Palestine Territories
 
Lesson9
Lesson9Lesson9
Lesson9
 
3 D Lidar Epfl Iccsa 08
3 D Lidar Epfl Iccsa 083 D Lidar Epfl Iccsa 08
3 D Lidar Epfl Iccsa 08
 
Colour Correction using Histogram Stretching
Colour Correction using Histogram StretchingColour Correction using Histogram Stretching
Colour Correction using Histogram Stretching
 
Processing Rasters from Satellites, Drones, & More
Processing Rasters from Satellites, Drones, & MoreProcessing Rasters from Satellites, Drones, & More
Processing Rasters from Satellites, Drones, & More
 
3D Analyst - Watershed Lorelindu
3D Analyst - Watershed Lorelindu3D Analyst - Watershed Lorelindu
3D Analyst - Watershed Lorelindu
 
Exploring Raster with FME
Exploring Raster with FMEExploring Raster with FME
Exploring Raster with FME
 
Point Clouds: What's New
Point Clouds: What's NewPoint Clouds: What's New
Point Clouds: What's New
 
Web Map Service Client - EnviroInsite
Web Map Service Client - EnviroInsiteWeb Map Service Client - EnviroInsite
Web Map Service Client - EnviroInsite
 
Detecting Buildings in AHN2 LiDAR data with ArcGIS - Grontmij
Detecting Buildings in AHN2 LiDAR data with ArcGIS - GrontmijDetecting Buildings in AHN2 LiDAR data with ArcGIS - Grontmij
Detecting Buildings in AHN2 LiDAR data with ArcGIS - Grontmij
 
How to Get the Most Out of LiDAR Data
How to Get the Most Out of LiDAR DataHow to Get the Most Out of LiDAR Data
How to Get the Most Out of LiDAR Data
 
2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...
2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...
2018 GIS in the Rockies Vendor Showcase (Th): ERDAS Imagine What's New and Ti...
 

Destaque

R programming language in spatial analysis
R programming language in spatial analysisR programming language in spatial analysis
R programming language in spatial analysis
Abhiram Kanigolla
 

Destaque (7)

Using R for Climate Raster Data Extraction
Using R for Climate Raster Data ExtractionUsing R for Climate Raster Data Extraction
Using R for Climate Raster Data Extraction
 
Maps with leafletR
Maps with leafletRMaps with leafletR
Maps with leafletR
 
Geospatial Data in R
Geospatial Data in RGeospatial Data in R
Geospatial Data in R
 
Spatial Analysis with R - the Good, the Bad, and the Pretty
Spatial Analysis with R - the Good, the Bad, and the PrettySpatial Analysis with R - the Good, the Bad, and the Pretty
Spatial Analysis with R - the Good, the Bad, and the Pretty
 
R programming language in spatial analysis
R programming language in spatial analysisR programming language in spatial analysis
R programming language in spatial analysis
 
Using R to Visualize Spatial Data: R as GIS - Guy Lansley
Using R to Visualize Spatial Data: R as GIS - Guy LansleyUsing R to Visualize Spatial Data: R as GIS - Guy Lansley
Using R to Visualize Spatial Data: R as GIS - Guy Lansley
 
Spatial Data Science with R
Spatial Data Science with RSpatial Data Science with R
Spatial Data Science with R
 

Semelhante a Modeling Count-based Raster Data with ArcGIS and R

Cs221 logic-planning
Cs221 logic-planningCs221 logic-planning
Cs221 logic-planning
darwinrlo
 
Cs221 lecture7-fall11
Cs221 lecture7-fall11Cs221 lecture7-fall11
Cs221 lecture7-fall11
darwinrlo
 
Spme 2013 segmentation
Spme 2013 segmentationSpme 2013 segmentation
Spme 2013 segmentation
Qujiang Lei
 

Semelhante a Modeling Count-based Raster Data with ArcGIS and R (20)

Scale Invariant Feature Tranform
Scale Invariant Feature TranformScale Invariant Feature Tranform
Scale Invariant Feature Tranform
 
On image intensities, eigenfaces and LDA
On image intensities, eigenfaces and LDAOn image intensities, eigenfaces and LDA
On image intensities, eigenfaces and LDA
 
Cs221 logic-planning
Cs221 logic-planningCs221 logic-planning
Cs221 logic-planning
 
Cs221 lecture7-fall11
Cs221 lecture7-fall11Cs221 lecture7-fall11
Cs221 lecture7-fall11
 
05 histogram processing DIP
05 histogram processing DIP05 histogram processing DIP
05 histogram processing DIP
 
Hsieh etal spl
Hsieh etal splHsieh etal spl
Hsieh etal spl
 
Comparison of image segmentation
Comparison of image segmentationComparison of image segmentation
Comparison of image segmentation
 
Spme 2013 segmentation
Spme 2013 segmentationSpme 2013 segmentation
Spme 2013 segmentation
 
[Paper] GIRAFFE: Representing Scenes as Compositional Generative Neural Featu...
[Paper] GIRAFFE: Representing Scenes as Compositional Generative Neural Featu...[Paper] GIRAFFE: Representing Scenes as Compositional Generative Neural Featu...
[Paper] GIRAFFE: Representing Scenes as Compositional Generative Neural Featu...
 
Time-evolving Graph Processing on Commodity Clusters: Spark Summit East talk ...
Time-evolving Graph Processing on Commodity Clusters: Spark Summit East talk ...Time-evolving Graph Processing on Commodity Clusters: Spark Summit East talk ...
Time-evolving Graph Processing on Commodity Clusters: Spark Summit East talk ...
 
論文紹介:Towards Robust Adaptive Object Detection Under Noisy Annotations
論文紹介:Towards Robust Adaptive Object Detection Under Noisy Annotations論文紹介:Towards Robust Adaptive Object Detection Under Noisy Annotations
論文紹介:Towards Robust Adaptive Object Detection Under Noisy Annotations
 
Graph R-CNN for Scene Graph Generation
Graph R-CNN for Scene Graph GenerationGraph R-CNN for Scene Graph Generation
Graph R-CNN for Scene Graph Generation
 
6920161.ppt
6920161.ppt6920161.ppt
6920161.ppt
 
Image feature extraction
Image feature extractionImage feature extraction
Image feature extraction
 
Conference_paper.pdf
Conference_paper.pdfConference_paper.pdf
Conference_paper.pdf
 
Computer graphics notes 2 tutorials duniya
Computer graphics notes 2   tutorials duniyaComputer graphics notes 2   tutorials duniya
Computer graphics notes 2 tutorials duniya
 
Image Restoration UsingNonlocally Centralized Sparse Representation and histo...
Image Restoration UsingNonlocally Centralized Sparse Representation and histo...Image Restoration UsingNonlocally Centralized Sparse Representation and histo...
Image Restoration UsingNonlocally Centralized Sparse Representation and histo...
 
Map Integration PPT_f
Map Integration PPT_fMap Integration PPT_f
Map Integration PPT_f
 
Presentation
PresentationPresentation
Presentation
 
Introduction to Support Vector Machines
Introduction to Support Vector MachinesIntroduction to Support Vector Machines
Introduction to Support Vector Machines
 

Mais de Azavea

HunchLab 2.0 Predictive Missions: Under the Hood
HunchLab 2.0 Predictive Missions: Under the HoodHunchLab 2.0 Predictive Missions: Under the Hood
HunchLab 2.0 Predictive Missions: Under the Hood
Azavea
 

Mais de Azavea (20)

Using New Tools to Analyze and Plan Your Urban Forest
Using New Tools to Analyze and Plan Your Urban Forest Using New Tools to Analyze and Plan Your Urban Forest
Using New Tools to Analyze and Plan Your Urban Forest
 
7 misconceptions about predictive policing webinar
7 misconceptions about predictive policing webinar7 misconceptions about predictive policing webinar
7 misconceptions about predictive policing webinar
 
Tracking Your Green Infrastructure
Tracking Your Green InfrastructureTracking Your Green Infrastructure
Tracking Your Green Infrastructure
 
Growing Your Urban Forest: Using the OpenTreeMap Bulk Uploader
Growing Your Urban Forest: Using the OpenTreeMap Bulk UploaderGrowing Your Urban Forest: Using the OpenTreeMap Bulk Uploader
Growing Your Urban Forest: Using the OpenTreeMap Bulk Uploader
 
Forecasting Space-Time Events - Strata + Hadoop World 2015 San Jose
Forecasting Space-Time Events - Strata + Hadoop World 2015 San JoseForecasting Space-Time Events - Strata + Hadoop World 2015 San Jose
Forecasting Space-Time Events - Strata + Hadoop World 2015 San Jose
 
November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...
November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...
November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...
 
Mobile Citizen Science
Mobile Citizen Science Mobile Citizen Science
Mobile Citizen Science
 
Getting Started with OpenTreeMap Cloud
Getting Started with OpenTreeMap CloudGetting Started with OpenTreeMap Cloud
Getting Started with OpenTreeMap Cloud
 
HunchLab 2.0 Getting Started
HunchLab 2.0 Getting StartedHunchLab 2.0 Getting Started
HunchLab 2.0 Getting Started
 
Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...
Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...
Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...
 
Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...
Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...
Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...
 
HunchLab 2.0 Predictive Missions: Under the Hood
HunchLab 2.0 Predictive Missions: Under the HoodHunchLab 2.0 Predictive Missions: Under the Hood
HunchLab 2.0 Predictive Missions: Under the Hood
 
Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...
Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...
Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...
 
HunchLab 2.0 Preview Webinar - Place
HunchLab 2.0 Preview Webinar - PlaceHunchLab 2.0 Preview Webinar - Place
HunchLab 2.0 Preview Webinar - Place
 
Five Technology Trends Every Nonprofit Needs to Know
Five Technology Trends Every Nonprofit Needs to KnowFive Technology Trends Every Nonprofit Needs to Know
Five Technology Trends Every Nonprofit Needs to Know
 
PhillyHistory.org - Tracking Metrics for a Digital Project
PhillyHistory.org - Tracking Metrics for a Digital ProjectPhillyHistory.org - Tracking Metrics for a Digital Project
PhillyHistory.org - Tracking Metrics for a Digital Project
 
Data Philly Meetup - Big (Geo) Data
Data Philly Meetup - Big (Geo) DataData Philly Meetup - Big (Geo) Data
Data Philly Meetup - Big (Geo) Data
 
Fed Geo Day - Applying GeoTrellis at the US Army Corps
Fed Geo Day - Applying GeoTrellis at the US Army CorpsFed Geo Day - Applying GeoTrellis at the US Army Corps
Fed Geo Day - Applying GeoTrellis at the US Army Corps
 
Fed Geo Day - GeoTrellis Intro
Fed Geo Day - GeoTrellis IntroFed Geo Day - GeoTrellis Intro
Fed Geo Day - GeoTrellis Intro
 
Fed Geo Day 2013 - Azavea Intro
Fed Geo Day 2013 - Azavea Intro Fed Geo Day 2013 - Azavea Intro
Fed Geo Day 2013 - Azavea Intro
 

Último

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Último (20)

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 

Modeling Count-based Raster Data with ArcGIS and R

  • 1. Modeling Count-based Raster Data Using R with ArcGIS Desktop Jeremy Heffner HunchLab Product Manager jheffner@azavea.com
  • 2. We have events that occur in space (i.e. crimes)
  • 3. ? ? ? But why do they occur where they do? Do events correlate with geographic features? Can we predict the rate of events at particular locations?
  • 4. Let’s create a raster covering formed of square cells
  • 5. And bring in features of the geography that may explain the pattern
  • 6. For some geographic features we may use a proximity measure of spatial influence
  • 7. For some geographic features we may use a proximity measure of spatial influence
  • 8. For some geographic features we may use a proximity measure of spatial influence
  • 9. For other geographic features we may look at the concentration of the features (density)
  • 10. For each raster cell we have values for these explanatory variables
  • 11. So can’t we use ArcGIS’s built-in regression models?
  • 12. They all assume a normal distribution for the response variable } y = b0 + b1x1 + b2x2 + …
  • 13. Our cells have 0 or more events and are not a normal distribution
  • 14. Poisson Process This is a process which counts independent events happening in a given interval (time, space). Poisson Distribution This process leads to a Poisson distribution of counts. Source: Wikipedia Generalized Linear Model y = exp(b0 + b1x1 + b2x2 + …) A GLM can represent this distribution in a regression model.
  • 15. Our counts fit a Poisson distribution much better
  • 16. We can process our geographic data sets in ArcGIS and then export the cells to R for modeling Raster Calculate Export to Convert to Build Model Processing Predictions ASCII CSV (R) (ArcGIS) (ArcGIS)
  • 17. Here is sample output from fitting a Poisson model in R:
  • 18. We can take the fitted coefficients from R and plug them into the equation within ArcGIS using the ‘raster calculator’ y = exp(b0 + b1x1 + b2x2 + …)
  • 19. Here’s an example of the output which explains the expectation of shootings based upon the location of drug arrests and bus stops.
  • 20. This example is derived from a collaborative project between Azavea and the Rutgers Center on Public Security For more information: Jeremy Heffner HunchLab Product Manager jheffner@azavea.com