SlideShare a Scribd company logo
1 of 74
GeoNode Motivations, Design, and Challenges


                  Sebastian Benthall
            UC Berkeley School of Information

                       ICTD Seminar

              (Based on a presentation written with

                        Rolando Peñate
                          OpenGeo)
What is...
Spatial Data Infrastructure (SDI)
Spatial Data Infrastructure (SDI)



“[Spatial Data Infrastructure] provides a basis for spatial
data discovery, evaluation, and application for users and
providers within all levels of government, the commercial
sector, the non-profit sector, academia and by citizens in
                          general.”
                                              – SDI Cookbook
The theory of SDI
   developed before
  we learned what was
possible with the Internet
Imagine...




...what an ideal SDI would be like
Imagine...



     ...an SDI that makes
uploading, sharing, and working
           with data
     as easy as blogging
Publishing data




Anthony has some spatial data and wants to
      display it as part of a blog post.
Publishing data




Anthony uploads it to a public SDI, styles it,
provides a background, and then puts a map
             widget on his blog.
Publishing data




Meanwhile, the data, style, and map remain
       available on the public SDI
             for others to use.
Metadata and reputation




 The World Organization tells Cameron, their
consultant, to put data she has gathered on their
                       SDI.
Metadata and reputation




Other users notice mistakes in the metadata.
 They notify Cameron and give it a low rating.
Metadata and reputation




Cameron fixes the mistakes, and the other users
 rate the data more highly. Her reputation on the
                  SDI improves.
Federated search




A regional Health agency and a regional Transit
       agency have separate SDI systems.
Federated search




Tom, a GIS analyst doing research, seeks out
correlations between health and bicycle routes
Federated search




Tom searches for data in a single federated index
      and downloads the data as a batch.
What is GeoNode?




              GeoNode is a spatial data infrastructure
          It focuses on data, then users, then metadata.

Data upload, sharing, cartography, user profiles, dynamic metadata
                      generation, and more.
What is GeoNode?




GeoNode builds on open source geospatial projects like

        GeoExt, OpenLayers, GeoWebCache
        GeoServer, GeoNetwork, and PostGIS

     with application functionality built on Django.
GeoNode Vision

        ⇒

GeoNode Involvement

        ⇒

GeoNode Community
GeoNode Vision

         ⇒

GeoNode Involvement

         ⇒

GeoNode Community


How did this happen?
Can the lessons learned can
    help other ICTD projects?

     A case study GeoNode
sheds light on international disaster
         reduction efforts.
Disaster Risk Modeling 101
                           Risk
• Used for                (busted stuff)

  determining              =
  development
                         Hazard
  investments                (boom)

• Once were a mess         x
• Now standardizing:    Exposure
                             (stuff)


                            x
                       Vulnerability
                         (bust per boom)
GeoNode History


The World Bank had a problem:

Disaster risk modeling requires lots of data

Central American Probabilistic Risk Assessment (CAPRA) initiative
needed participating agencies across various governments to share
data

Top-down approaches didn't work

Needed to work bottom-up
GeoNode History



The World Bank had a problem:

Costly proprietary GIS solutions are a burden to developing nations

The Bank wanted to build local capacity around financially
sustainable software

Smart folks within the Bank turned to open source geospatial
software
GeoNode Vision


OpenGeo had an idea for a solution:

The Bank provided the perfect use case for OpenGeo's vision for open
source architectures of participation in geospatial

Providing freely available web-based tools could be a great way to
collect and share data.

GeoNode was born.
GeoNode Involvement


Traditional SDIs have typically been designed by 'experts' with
abstract needs in mind—hence a focus on metadata.

GeoNode is being designed in response to the needs and
concerns of institutional partners as they implement real-world
projects—hence a focus on data and users.
Metadata Pain



Good metadata for geospatial data is
  important but hard to produce.
 GeoNode has user profiles and features them
prominently
 Those profiles have ISO metadata fields within

them
Metadata Made Easy
Metadata Published



Metadata is published
 with open standard
        CSW
 using GeoNetwork
Open Data Skepticism


Isn't GeoNode an open data platform?



Doesn't open data raise concerns about
   data quality and data security?
Open Data Optimism




Yes, GeoNode is designed to promote open
                  data.
Open Data Optimism


        Features like
      User reputation
 Organizational endorsement
      Flexible security
address data quality concerns
Open Data Optimism


         GeoNode supports

            the continuum

 of openness with a common platform
for institutional GIS and neogeography
GeoNode Involvement


GeoNode seeks to unify data management across
organizations.

Thus many different organizations have reason to get involved.

The opportunity and challenge is effective collaboration.
GeoNode Involvement


As more organizations got involved, development had to
decentralize.

Not just a single team within OpenGeo, but a larger community
How do we continue growth when
vision and development are decentralized?
How do we continue growth when
vision and development are decentralized?
That's what
open source communities
         are for.
But how do we get institutions to get their employees
       to participate in the open community?

   Need to align broader visions, including...
Disaster Reduction




•   Australia-Indonesia Facility for Disaster Reduction
•   Geoscience Australia
•   Global Earthquake Model
•   Global Facility for Disaster Risk Reduction
•   Secretariat of the Pacific

    are mapping infrastructure in developing nations, performing
             disaster modelling, etc. using GeoNode.
Academic




MapStor Foundation and Harvard's WorldMap seek to collect and
 share data across disciplines and institutions using GeoNode.
Spatial Marketplaces




The Australia–New Zealand Spatial Marketplace seeks to increase
    data availability in the South Pacific by creating an online
         marketplace built on GeoNode and open to all.
Community



         The World Bank's vision was the
collaboration of many institutions and governments
    around common goals of data management
Community



             As a result,
  many organizations are involved
in building and extending GeoNode
Community



How can we keep these efforts coherent, not divergent?

Efficient, not redundant?
Community



GeoNode's development requires
  many visions to be aligned.
OpenGeo




• Benefits from contributions back to core software
• Has led effort to coordinate between institutions
   o easier management and development
   o stronger open source communities
Our task has been to
scale up open source development
   practices to large institutions
Roadmapping Summit May 2011




• Explicit transition to open source community model
   o Established a proper Project Steering Committee
   o Passed policies for contributions and code review
• Official decentralization from OpenGeo's core team
• Identified common development goals
How to discover common development goals?
We

            collected

individual organization's roadmaps
We

          standardized

individual organization's roadmaps
Participants shared their visions with each other,
             explored the roadmap,
 and contributed new items that were missing.
We

    identified

a common roadmap
Then we collectively

    prioritized

those roadmap items.
Which do we build first?
Outcomes




• "Rock Solid" 1.1
• People entered the summit to big ideas to impress their
  bosses
• People left having committed resources to docs, bug
  fixes, and other work necessary to keep the project
  running.
Outcomes




• Framework for future improvements
• We have principled roadmap for the software with real
  institutional backing
• We know who to call when we have the resources
Outcomes




• Community solidarity

• “From man’s sweat and God’s love,
  beer came into the world”
  — St. Arnold
Remaining challenges
     for OpenGeo




Achieving open source best practices
  while being a primary contractor.
Remaining challenges




Maintaining consensus among large organizations
      despite natural tensions and turnover.
Remaining challenges




As the process decentralizes, who is responsible
     for the hard work of this coordination?
Remaining (technical) challenges




   Can the GeoNode community develop
     technology that works in regions
           with low connectivity?
Remaining (technical) challenges




                  Is the dream of a
            secure federated data network
               (both spatial and social)
                       realistic?

This ties into questions of federated social networking.
Remaining (research) challenges




     This perspective on GeoNode is from
offices in New York City and Washington, DC

   What does it look like in the countries
        where it is being deployed
Remaining (research) challenges




          Is the open source model
    living up to its development goals?
Thank you.




Any questions?

More Related Content

What's hot

Towards the Open Geospatial Web
Towards the Open Geospatial WebTowards the Open Geospatial Web
Towards the Open Geospatial Webcholmes
 
David Coleman presentation at SDI Summit 2014, Calgary, Canada, 17-19 Sept 2014
David Coleman presentation at SDI Summit 2014, Calgary, Canada, 17-19 Sept 2014David Coleman presentation at SDI Summit 2014, Calgary, Canada, 17-19 Sept 2014
David Coleman presentation at SDI Summit 2014, Calgary, Canada, 17-19 Sept 2014GSDI Association
 
The Disruptive Potential of GIS 2.0
The Disruptive Potential of GIS 2.0The Disruptive Potential of GIS 2.0
The Disruptive Potential of GIS 2.0Joshua Campbell
 
How open is public data agi 2011-13
How open is public data agi 2011-13How open is public data agi 2011-13
How open is public data agi 2011-13lgdigitalcomms
 
Evolution of System Architectures: Where Do We Need to Fail Next?
Evolution of System Architectures: Where Do We Need to Fail Next?Evolution of System Architectures: Where Do We Need to Fail Next?
Evolution of System Architectures: Where Do We Need to Fail Next?Luis Bermudez
 
2012DESFutureSDIs
2012DESFutureSDIs2012DESFutureSDIs
2012DESFutureSDIssirf13
 
Big Data Public-Private Forum_General Presentation
Big Data Public-Private Forum_General PresentationBig Data Public-Private Forum_General Presentation
Big Data Public-Private Forum_General PresentationBIG Project
 

What's hot (9)

Towards the Open Geospatial Web
Towards the Open Geospatial WebTowards the Open Geospatial Web
Towards the Open Geospatial Web
 
David Coleman presentation at SDI Summit 2014, Calgary, Canada, 17-19 Sept 2014
David Coleman presentation at SDI Summit 2014, Calgary, Canada, 17-19 Sept 2014David Coleman presentation at SDI Summit 2014, Calgary, Canada, 17-19 Sept 2014
David Coleman presentation at SDI Summit 2014, Calgary, Canada, 17-19 Sept 2014
 
Characteristics Of VGI Stakeholders
Characteristics Of VGI StakeholdersCharacteristics Of VGI Stakeholders
Characteristics Of VGI Stakeholders
 
The Disruptive Potential of GIS 2.0
The Disruptive Potential of GIS 2.0The Disruptive Potential of GIS 2.0
The Disruptive Potential of GIS 2.0
 
How open is public data agi 2011-13
How open is public data agi 2011-13How open is public data agi 2011-13
How open is public data agi 2011-13
 
Evolution of System Architectures: Where Do We Need to Fail Next?
Evolution of System Architectures: Where Do We Need to Fail Next?Evolution of System Architectures: Where Do We Need to Fail Next?
Evolution of System Architectures: Where Do We Need to Fail Next?
 
2012DESFutureSDIs
2012DESFutureSDIs2012DESFutureSDIs
2012DESFutureSDIs
 
Cadasta presentation
Cadasta presentationCadasta presentation
Cadasta presentation
 
Big Data Public-Private Forum_General Presentation
Big Data Public-Private Forum_General PresentationBig Data Public-Private Forum_General Presentation
Big Data Public-Private Forum_General Presentation
 

Similar to GeoNode Motivation, Design, and Challenges

David Coleman: Challenging Traditional Models, Roles and Responsibilities in ...
David Coleman: Challenging Traditional Models, Roles and Responsibilities in ...David Coleman: Challenging Traditional Models, Roles and Responsibilities in ...
David Coleman: Challenging Traditional Models, Roles and Responsibilities in ...GSDI Association
 
Ron Bloksma: Dutch Spatial Planning SDI
Ron  Bloksma: Dutch Spatial Planning SDIRon  Bloksma: Dutch Spatial Planning SDI
Ron Bloksma: Dutch Spatial Planning SDIAGI Geocommunity
 
Keynote, Oman Geospatial Expo, Dec 2013
Keynote, Oman Geospatial Expo, Dec 2013Keynote, Oman Geospatial Expo, Dec 2013
Keynote, Oman Geospatial Expo, Dec 2013Steven Ramage
 
Towards the Open Geospatial Web (eurogeographics edition)
Towards the Open Geospatial Web (eurogeographics edition)Towards the Open Geospatial Web (eurogeographics edition)
Towards the Open Geospatial Web (eurogeographics edition)cholmes
 
GI2012 trakas standards ogc
GI2012 trakas standards ogcGI2012 trakas standards ogc
GI2012 trakas standards ogcIGN Vorstand
 
2021 GeoConvergence: Ethics presentation
2021 GeoConvergence: Ethics presentation2021 GeoConvergence: Ethics presentation
2021 GeoConvergence: Ethics presentationPLACE
 
20180718 dirk-frigne-foss4 g-europe-final
20180718 dirk-frigne-foss4 g-europe-final20180718 dirk-frigne-foss4 g-europe-final
20180718 dirk-frigne-foss4 g-europe-finalDirk Frigne
 
Big Data in Media
Big Data in MediaBig Data in Media
Big Data in MediaKris Tuttle
 
Fp7consultation
Fp7consultationFp7consultation
Fp7consultationosimod
 
MyNet Social Networking Backupslides Nov 2007
MyNet Social Networking Backupslides Nov 2007MyNet Social Networking Backupslides Nov 2007
MyNet Social Networking Backupslides Nov 2007FinNode
 
Geonode introduction
Geonode introductionGeonode introduction
Geonode introductionTek Kshetri
 
"Plans are worthless, but planning is essential"
"Plans are worthless, but planning is essential""Plans are worthless, but planning is essential"
"Plans are worthless, but planning is essential"Research Data Alliance
 
Keynote: Mark Parsons - Plans are Useless, But Planning is Essential
Keynote: Mark Parsons - Plans are Useless, But Planning is EssentialKeynote: Mark Parsons - Plans are Useless, But Planning is Essential
Keynote: Mark Parsons - Plans are Useless, But Planning is EssentialCASRAI
 
Gis - open source potentials
Gis  - open source potentialsGis  - open source potentials
Gis - open source potentialsTim Willoughby
 
Effective Remote Design Thinking: A Basic Essential For Global Companies To D...
Effective Remote Design Thinking: A Basic Essential For Global Companies To D...Effective Remote Design Thinking: A Basic Essential For Global Companies To D...
Effective Remote Design Thinking: A Basic Essential For Global Companies To D...Dr. Vidya Priya Rao, Founder
 
Social Space for Geospatial Information
Social Space for Geospatial InformationSocial Space for Geospatial Information
Social Space for Geospatial InformationNaturNetPlus
 
Social Space for Geospatial Information
Social Space for Geospatial InformationSocial Space for Geospatial Information
Social Space for Geospatial InformationNaturNetPlus
 

Similar to GeoNode Motivation, Design, and Challenges (20)

David Coleman: Challenging Traditional Models, Roles and Responsibilities in ...
David Coleman: Challenging Traditional Models, Roles and Responsibilities in ...David Coleman: Challenging Traditional Models, Roles and Responsibilities in ...
David Coleman: Challenging Traditional Models, Roles and Responsibilities in ...
 
Ron Bloksma: Dutch Spatial Planning SDI
Ron  Bloksma: Dutch Spatial Planning SDIRon  Bloksma: Dutch Spatial Planning SDI
Ron Bloksma: Dutch Spatial Planning SDI
 
Keynote, Oman Geospatial Expo, Dec 2013
Keynote, Oman Geospatial Expo, Dec 2013Keynote, Oman Geospatial Expo, Dec 2013
Keynote, Oman Geospatial Expo, Dec 2013
 
Towards the Open Geospatial Web (eurogeographics edition)
Towards the Open Geospatial Web (eurogeographics edition)Towards the Open Geospatial Web (eurogeographics edition)
Towards the Open Geospatial Web (eurogeographics edition)
 
GI2012 trakas standards ogc
GI2012 trakas standards ogcGI2012 trakas standards ogc
GI2012 trakas standards ogc
 
2021 GeoConvergence: Ethics presentation
2021 GeoConvergence: Ethics presentation2021 GeoConvergence: Ethics presentation
2021 GeoConvergence: Ethics presentation
 
20180718 dirk-frigne-foss4 g-europe-final
20180718 dirk-frigne-foss4 g-europe-final20180718 dirk-frigne-foss4 g-europe-final
20180718 dirk-frigne-foss4 g-europe-final
 
2009 09 19 Learning Unit Sdi
2009 09 19 Learning Unit Sdi2009 09 19 Learning Unit Sdi
2009 09 19 Learning Unit Sdi
 
Big Data in Media
Big Data in MediaBig Data in Media
Big Data in Media
 
Fp7consultation
Fp7consultationFp7consultation
Fp7consultation
 
MyNet Social Networking Backupslides Nov 2007
MyNet Social Networking Backupslides Nov 2007MyNet Social Networking Backupslides Nov 2007
MyNet Social Networking Backupslides Nov 2007
 
Geonode introduction
Geonode introductionGeonode introduction
Geonode introduction
 
"Plans are worthless, but planning is essential"
"Plans are worthless, but planning is essential""Plans are worthless, but planning is essential"
"Plans are worthless, but planning is essential"
 
Keynote: Mark Parsons - Plans are Useless, But Planning is Essential
Keynote: Mark Parsons - Plans are Useless, But Planning is EssentialKeynote: Mark Parsons - Plans are Useless, But Planning is Essential
Keynote: Mark Parsons - Plans are Useless, But Planning is Essential
 
PlanetData Project Overview
PlanetData Project OverviewPlanetData Project Overview
PlanetData Project Overview
 
Gis - open source potentials
Gis  - open source potentialsGis  - open source potentials
Gis - open source potentials
 
Effective Remote Design Thinking: A Basic Essential For Global Companies To D...
Effective Remote Design Thinking: A Basic Essential For Global Companies To D...Effective Remote Design Thinking: A Basic Essential For Global Companies To D...
Effective Remote Design Thinking: A Basic Essential For Global Companies To D...
 
5 concluding remarks-santucci
5 concluding remarks-santucci5 concluding remarks-santucci
5 concluding remarks-santucci
 
Social Space for Geospatial Information
Social Space for Geospatial InformationSocial Space for Geospatial Information
Social Space for Geospatial Information
 
Social Space for Geospatial Information
Social Space for Geospatial InformationSocial Space for Geospatial Information
Social Space for Geospatial Information
 

More from Sebastian Benthall

Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...Sebastian Benthall
 
Designing digital publics for participatory parity
Designing digital publics for participatory parityDesigning digital publics for participatory parity
Designing digital publics for participatory paritySebastian Benthall
 
Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...Sebastian Benthall
 
On Dretske's The Epistemology of Belief
On Dretske's The Epistemology of BeliefOn Dretske's The Epistemology of Belief
On Dretske's The Epistemology of BeliefSebastian Benthall
 
The Everything at Once Manifesto
The Everything at Once ManifestoThe Everything at Once Manifesto
The Everything at Once ManifestoSebastian Benthall
 

More from Sebastian Benthall (6)

Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...Context, Causality, and Information Flow: Implications for Privacy Engineerin...
Context, Causality, and Information Flow: Implications for Privacy Engineerin...
 
Causality in complex networks
Causality in complex networksCausality in complex networks
Causality in complex networks
 
Designing digital publics for participatory parity
Designing digital publics for participatory parityDesigning digital publics for participatory parity
Designing digital publics for participatory parity
 
Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...Open Collaboration and Peer Production: Technical Infrastructure and Communit...
Open Collaboration and Peer Production: Technical Infrastructure and Communit...
 
On Dretske's The Epistemology of Belief
On Dretske's The Epistemology of BeliefOn Dretske's The Epistemology of Belief
On Dretske's The Epistemology of Belief
 
The Everything at Once Manifesto
The Everything at Once ManifestoThe Everything at Once Manifesto
The Everything at Once Manifesto
 

Recently uploaded

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 

Recently uploaded (20)

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 

GeoNode Motivation, Design, and Challenges

  • 1. GeoNode Motivations, Design, and Challenges Sebastian Benthall UC Berkeley School of Information ICTD Seminar (Based on a presentation written with Rolando Peñate OpenGeo)
  • 4. Spatial Data Infrastructure (SDI) “[Spatial Data Infrastructure] provides a basis for spatial data discovery, evaluation, and application for users and providers within all levels of government, the commercial sector, the non-profit sector, academia and by citizens in general.” – SDI Cookbook
  • 5. The theory of SDI developed before we learned what was possible with the Internet
  • 6. Imagine... ...what an ideal SDI would be like
  • 7. Imagine... ...an SDI that makes uploading, sharing, and working with data as easy as blogging
  • 8. Publishing data Anthony has some spatial data and wants to display it as part of a blog post.
  • 9. Publishing data Anthony uploads it to a public SDI, styles it, provides a background, and then puts a map widget on his blog.
  • 10. Publishing data Meanwhile, the data, style, and map remain available on the public SDI for others to use.
  • 11. Metadata and reputation The World Organization tells Cameron, their consultant, to put data she has gathered on their SDI.
  • 12. Metadata and reputation Other users notice mistakes in the metadata. They notify Cameron and give it a low rating.
  • 13. Metadata and reputation Cameron fixes the mistakes, and the other users rate the data more highly. Her reputation on the SDI improves.
  • 14. Federated search A regional Health agency and a regional Transit agency have separate SDI systems.
  • 15. Federated search Tom, a GIS analyst doing research, seeks out correlations between health and bicycle routes
  • 16. Federated search Tom searches for data in a single federated index and downloads the data as a batch.
  • 17. What is GeoNode? GeoNode is a spatial data infrastructure It focuses on data, then users, then metadata. Data upload, sharing, cartography, user profiles, dynamic metadata generation, and more.
  • 18. What is GeoNode? GeoNode builds on open source geospatial projects like GeoExt, OpenLayers, GeoWebCache GeoServer, GeoNetwork, and PostGIS with application functionality built on Django.
  • 19. GeoNode Vision ⇒ GeoNode Involvement ⇒ GeoNode Community
  • 20. GeoNode Vision ⇒ GeoNode Involvement ⇒ GeoNode Community How did this happen?
  • 21. Can the lessons learned can help other ICTD projects? A case study GeoNode sheds light on international disaster reduction efforts.
  • 22. Disaster Risk Modeling 101 Risk • Used for (busted stuff) determining = development Hazard investments (boom) • Once were a mess x • Now standardizing: Exposure (stuff) x Vulnerability (bust per boom)
  • 23. GeoNode History The World Bank had a problem: Disaster risk modeling requires lots of data Central American Probabilistic Risk Assessment (CAPRA) initiative needed participating agencies across various governments to share data Top-down approaches didn't work Needed to work bottom-up
  • 24. GeoNode History The World Bank had a problem: Costly proprietary GIS solutions are a burden to developing nations The Bank wanted to build local capacity around financially sustainable software Smart folks within the Bank turned to open source geospatial software
  • 25. GeoNode Vision OpenGeo had an idea for a solution: The Bank provided the perfect use case for OpenGeo's vision for open source architectures of participation in geospatial Providing freely available web-based tools could be a great way to collect and share data. GeoNode was born.
  • 26. GeoNode Involvement Traditional SDIs have typically been designed by 'experts' with abstract needs in mind—hence a focus on metadata. GeoNode is being designed in response to the needs and concerns of institutional partners as they implement real-world projects—hence a focus on data and users.
  • 27. Metadata Pain Good metadata for geospatial data is important but hard to produce.
  • 28.  GeoNode has user profiles and features them prominently  Those profiles have ISO metadata fields within them
  • 30. Metadata Published Metadata is published with open standard CSW using GeoNetwork
  • 31. Open Data Skepticism Isn't GeoNode an open data platform? Doesn't open data raise concerns about data quality and data security?
  • 32. Open Data Optimism Yes, GeoNode is designed to promote open data.
  • 33. Open Data Optimism Features like User reputation Organizational endorsement Flexible security address data quality concerns
  • 34. Open Data Optimism GeoNode supports the continuum of openness with a common platform for institutional GIS and neogeography
  • 35. GeoNode Involvement GeoNode seeks to unify data management across organizations. Thus many different organizations have reason to get involved. The opportunity and challenge is effective collaboration.
  • 36. GeoNode Involvement As more organizations got involved, development had to decentralize. Not just a single team within OpenGeo, but a larger community
  • 37. How do we continue growth when vision and development are decentralized?
  • 38. How do we continue growth when vision and development are decentralized?
  • 39. That's what open source communities are for.
  • 40. But how do we get institutions to get their employees to participate in the open community? Need to align broader visions, including...
  • 41. Disaster Reduction • Australia-Indonesia Facility for Disaster Reduction • Geoscience Australia • Global Earthquake Model • Global Facility for Disaster Risk Reduction • Secretariat of the Pacific are mapping infrastructure in developing nations, performing disaster modelling, etc. using GeoNode.
  • 42.
  • 43.
  • 44. Academic MapStor Foundation and Harvard's WorldMap seek to collect and share data across disciplines and institutions using GeoNode.
  • 45.
  • 46. Spatial Marketplaces The Australia–New Zealand Spatial Marketplace seeks to increase data availability in the South Pacific by creating an online marketplace built on GeoNode and open to all.
  • 47. Community The World Bank's vision was the collaboration of many institutions and governments around common goals of data management
  • 48. Community As a result, many organizations are involved in building and extending GeoNode
  • 49. Community How can we keep these efforts coherent, not divergent? Efficient, not redundant?
  • 50. Community GeoNode's development requires many visions to be aligned.
  • 51. OpenGeo • Benefits from contributions back to core software • Has led effort to coordinate between institutions o easier management and development o stronger open source communities
  • 52. Our task has been to scale up open source development practices to large institutions
  • 53. Roadmapping Summit May 2011 • Explicit transition to open source community model o Established a proper Project Steering Committee o Passed policies for contributions and code review • Official decentralization from OpenGeo's core team • Identified common development goals
  • 54. How to discover common development goals?
  • 55.
  • 56. We collected individual organization's roadmaps
  • 57. We standardized individual organization's roadmaps
  • 58. Participants shared their visions with each other, explored the roadmap, and contributed new items that were missing.
  • 59.
  • 60. We identified a common roadmap
  • 61.
  • 62. Then we collectively prioritized those roadmap items.
  • 63. Which do we build first?
  • 64. Outcomes • "Rock Solid" 1.1 • People entered the summit to big ideas to impress their bosses • People left having committed resources to docs, bug fixes, and other work necessary to keep the project running.
  • 65. Outcomes • Framework for future improvements • We have principled roadmap for the software with real institutional backing • We know who to call when we have the resources
  • 66. Outcomes • Community solidarity • “From man’s sweat and God’s love, beer came into the world” — St. Arnold
  • 67. Remaining challenges for OpenGeo Achieving open source best practices while being a primary contractor.
  • 68. Remaining challenges Maintaining consensus among large organizations despite natural tensions and turnover.
  • 69. Remaining challenges As the process decentralizes, who is responsible for the hard work of this coordination?
  • 70. Remaining (technical) challenges Can the GeoNode community develop technology that works in regions with low connectivity?
  • 71. Remaining (technical) challenges Is the dream of a secure federated data network (both spatial and social) realistic? This ties into questions of federated social networking.
  • 72. Remaining (research) challenges This perspective on GeoNode is from offices in New York City and Washington, DC What does it look like in the countries where it is being deployed
  • 73. Remaining (research) challenges Is the open source model living up to its development goals?

Editor's Notes

  1. I’d like to talk a bit about SDI's. Specifically what I think is the last step in building the dream of INSPIRE. If we're to look at this one definition of SDI INSPIRE has already done most every thing needed - it's written in to law, there are standards, everyone's agreed and it's moving forward. But I have a worry:
  2. Traditional SDI : Metadata catalog, sometimes provides access to data, rarely incorporates users. GeoNode : Data first, then users, then metadata is derived where possible. The focus on data means we strive to make it easy to upload data and have it all served up automatically in all available formats.  It's easy to access with a URL to a page with the data and the metadata. It's the actual data so you can see it's rough distribution, and you can easily make a map of it, combining with other data.  It has links to the services, but also direct links to formats people may want from the services.  I always wonder how I am supposed to give someone a link to a layer in a WMS.  Is it the capabilities document?  A top level tile?  Or a catalog response in ISO19115 that gives me the service links?   Then we bring in users.  Every data set is associated with a user, and that user's profile information populates the ISO metadata fields, so you don't have to fill it out every time. From users and data we get to metadata.  We use GeoNetwork as the CS-W engine but we try to populate as much as possible from the user who uploaded the data (via the user profile) and the data itself (by extracting bounding box, etc). Finally we make 'maps' a top level concept that people can share and use, so you can more easily explore data, and from there also derive more metadata (eg, if 5 maps that all use the same layer have a tag 'fire' then perhaps that layer is about fire).  Another thing GeoNode does is always coordinate the right links between the capabilities documents of the CSW and WMS/WFS/WCS, so each refers to the other, and also contains the same abstract, keywords, etc.
  3. In many ways, GeoNode is the product of several very abstract ideas voiced by Stuart Gill of the World Bank and Chris Holmes of OpenGeo.   Top-down == mandating policy. 
  4. The Bank has an interest in promoting IT infrastructure in the regions where it works to promote development   Can pay for proprietary software in an initiative, but that sticks countries with costs after the Bank leaves
  5. was started to encourage bottom-up data sharing while limiting costly proprietary GIS installations to only those agencies that really needed them.
  6. Global Earthquake Model
  7. SOPAC
  8. Harvard WorldMap
  9. Emphasis on public participation—architectures of participation, yay!
  10. Whereas we had approximated open source community-based developed as a team internal to opengeo, we used the opportunity to transition to an official, public community model.  -- though one that is still over-represented by OpenGeo and World Bank developers thus far.
  11. RP: Notes for this?
  12. RP: Notes for this?
  13. Trevor as an example of turnover at AIFDR. He has largely spearheaded the idea of propagating GeoNodes across government agencies  in Indonesia but his term is almost up.