Avec la disponibilité croissante de données très diverses, géospatiales ou non, liés aux efforts et argents investis dans la collection et mise en place de nombreux référentiels ou bases de données tant dans les entreprises que dans les institutions gouvernementales, se fait jour le besoin de plus en plus important et pressant de croiser ces différentes sources de données afin d'appuyer la prise de décision et ceci dans des domaines très variés : banque, assurance, environnement, infrastructures, santé, changements climatiques, ... Les technologies de Business Intelligence (Intelligence d'affaires) permettent le croisement de telles masses de données et leur exploration interactive et rapide afin de dégager des tendances ou mettre en lumière différents phénomènes et ainsi prendre en pleine connaissance de cause des décisions éclairées afin de contrer les effets, corriger ou améliorer la situation observée. La pile logicielle open source disponible et supportée à Spatialytics.org a été développée par l’équipe de recherche GeoSOA mené par le Dr. Thierry Badard de l’Université Laval. La suite Geo-BI est constituée de GeoKettle (un outil ETL spatial), GeoMondrian (un serveur Spatial OLAP ou SOLAP) et SOLAPLayers (un composant cartographique permettant la navigation dans les cubes de données géo-décisionnelles) et permet la pleine prise en compte de la composante spatiale dans l'analyse de ces grandes masses d'information. Il devient ainsi possible d'observer certaines tendances, et ceci à différents niveaux de détails et différentes époques, par le biais de cartes qui viennent s'ajouter aux moyens usuels de représentation des données de synthèse que sont les tableaux croisés et les graphiques dans les outils décisionnels (tableau de bord, outil de reporting, ...). L'estimation de la répartition spatiale de tels ou tels phénomènes ou de son évolution spatiotemporelle est rendue possible et facile. Cette présentation se veut donc une vitrine technologique dans laquelle seront présentés les différents outils géo-décisionnels disponibles à Spatialytics.org , des exemples et démonstrations permettront d'en comprendre le fonctionnement, la portée et pertinence.
Comparing Sidecar-less Service Mesh from Cilium and Istio
GeoKettle, GeoMondrian et Spatialytics : une suite open source de GeoBI
1. Benefits of Open Source
Geospatial Business Intelligence
(Geo-BI)
By Luc Vaillancourt, Spatialytics CEO
for
Dr. Thierry Badard
(Spatialytics CTO and Professor at Laval University)
06/10/2009 Geospatial Business Intelligence 1
2. Plan
1. Spatialytics
– Dr. Thierry Badard
2. Business Intelligence
– BI Offering
3. Open Source
– Open Source BI Players
• Pentaho Offering
4. Spatialytics.org Offering
– GeoKettle
– GeoMondrian
– SOLAPLayers
5. Summary
06/10/2009 Geospatial Business Intelligence 2
3. 1. About Spatialytics
• A new company
• Based in Quebec City
• Inspired by the work of Dr. Thierry Badard
– Inspired by the Pentaho Open Source BI suite..
• Solutions in Geo-BI
• CTO : Dr. Thierry Badard
• CEO : Luc Vaillancourt
– Co-founded KOREM in 1993, founded BALIZ in 2007
06/10/2009 Geospatial Business Intelligence 3
4. 1.1 About Dr. Thierry Badard
• Co-founder & CTO of Spatiaylits Solutons Inc.
• professor in Geomatics at Laval University,
Quebec City, since 2005
– Leads the GeoSOA Research team
• industrial researcher at IGN of France between
1996 and 2004
• well involved in the OSGeo
– Voting member
– Co-fonder of the “francophone” chapter (OSGeo-fr)
– Co-fonder of the “Québec” chapter (OSGeo-qc)
– Member of the FOSS4G organizing committee
06/10/2009 Geospatial Business Intelligence 4
6. 2. Business Intelligence
BI Market Grows 22% In Tough Economy
http://www.informationweek.com/news/business_intelligence/analytics/showArticle.jhtml?articleID=217800991
• 22% growth in 2008 (13% in 2007)
• $8.8 billion in 2008
– BI platforms, analytic applications, performance
management software
• 75% to the top6 :
– SAP/Business Objects, SAS Institute, Oracle, IBM/Cognos,
Microsoft and MicroStrategy
• Users : "increase transparency" to identify costs and
better align strategy with execution
06/10/2009 Geospatial Business Intelligence 6
7. 2.1 BI Offering
• Data Integration (ETL : from OLTP to OLAP)
• Data Warehouse (any RBDMS)
• OLAP Server (OnLine Analytical Processing)
• End-User Applications (via MDX) :
– Analysis - Data Mining
– Dashboards - Reporting
DATA BI TECHNOLOGY ARCHITECTURE
SOURCE
S MDX
ET End‐User Applications
BDM flat L
S files Data
Warehous (OLAP)
sensor e
s
06/10/2009 Geospatial Business Intelligence 7
9. 3. Open Source
Open Source Software Market Accelerated by Economy
and Increased Acceptance From Enterprise Buyers
http://www.businesswire.com/portal/site/home/permalink/?ndmViewId=news_view&newsId=20090729005107&newsLang=en
• An IDC study on Open Source :
– worldwide revenue from OSS will grow at a 22.4%
compound annual growth rate (CAGR) to reach
$8.1 billion by 2013
– OSS has had a much higher level of acceptance
over the past 12 months than previously expected
– the economy accelerated the uptake and use of
OSS in the closing months of 2008
Worldwide Open Source Software 2009–2013 Forecast (IDC #219260)
06/10/2009 Geospatial Business Intelligence 9
10. 3.1 Open Source BI
• Players :
– Pentaho
– SpagoBI
– Talend (ETL)
– JasperSoft
06/10/2009 Geospatial Business Intelligence 10
11. 3.1.1 Pentaho
• Pentaho Corporation is the commercial open
source alternative for Business Intelligence (BI)
• Pentaho's products have been downloaded
more than three million times
• Pentaho is the only commercial open source BI
suite provider who leads and sponsors all of its
core open source BI projects.
06/10/2009 Geospatial Business Intelligence 11
12. 3.1.1 Pentaho
• highly experienced industry leaders with a strong
record of creating successful BI products for top-tier
commercial vendors, including: Business Objects,
Cognos, Hyperion, IBM, Oracle, SAS ...
• « to achieve positive, disruptive change in the BI space
by building a On-Demand Business Intelligence and making !it
Cloud
class-leading BI platform 05/10/2009
available to everyone by shift of business intelligence to an on-
releasing it into Open
LucidEra was founded in 2005 by veterans of the business intelligence industry.
Computing
Our founders recognized early the
Source » demand model.
http://www.pentaho.com/news/releases/20091005_pentaho_announces_strategic_technology_acquisition.php
06/10/2009 Geospatial Business Intelligence 12
14. 3.1.1 Pentaho
• Kettle : ETL / Data Integration
• Mondrian : OLAP Server
• End-User Applications (via MDX) :
– Pentaho Reporting
– CDF (Community Dashboard Framework)
– Weka for Data Mining
DATA
SOURCES MDX
ET End‐User Applications
L
flat Data
BDM
files Warehous (OLAP)
S
e
sensor
s
CDF
06/10/2009 Geospatial Business Intelligence 14
16. 4. Spatialytics.org
Spatialytics leads and sponsors all of its core
Open Source Geo-BI projects,
available at
06/10/2009 Geospatial Business Intelligence 16
17. 4. Spatialytics.org
Spatialytics.org Open Source Geo-BI projects,
are :
Origins of those projects :
- Faculté de foresterie, de géographie et de géomatique
- Département des sciences géomatiques
- GeoSOA Research Team
- Dr. Thierry Badard
06/10/2009 Geospatial Business Intelligence 17
18. 4. Spatialytics.org
• GeoKettle : Data & GeoData Integration
• GeoMondrian : Saptial OLAP Server (SOLAP)
• Enriched MDX with Spatial capabilities
• SOLAPLayer : Map Component for Map-Centric or
“Map-Enabled” (Reporting, Dashboards) applications
DATA
SOURCES MDX
ET End‐User Applications
L
Data
BDM flat
files Warehouse (SOLA
S Thematic
P) Mapping
sensor
s
06/10/2009 Geospatial Business Intelligence 18
19. 4.1 GeoKettle
• GeoKettle is a "spatially-enabled" version of
Pentaho Data Integration (Kettle)
• True and consistent integration of the spatial
component
– All steps provided by Kettle are able to deal with
geospatial data types
– Some geospatial dedicated steps have been added
06/10/2009 Geospatial Business Intelligence 19
21. 4.1 GeoKettle
• Current stable version : 3.2.0-20090609
• Released under LGPL
• http://www.geokettle.org
• Provides support for:
– Handling geometry data types (based on JTS)
– Definition of custom transformation steps by the user
– Topological predicates (Intersects, crosses, etc.)
– Input / Output with some spatial DBMS
– Native support for Oracle, PostGIS and MySQL
– MS SQL Server 2008, Ingres and IBM DB2 can be used but it
requires some tricks
– GIS file Input / Output : Shapefile (GML and KML soon)
06/10/2009 Geospatial Business Intelligence 21
22. 4.1 GeoKettle
• Upcoming features:
– Cartographic preview (work in progress)
– Implementation of data matching and conflation steps in
order to allow geometric data cleansing and comparison of
geospatial datasets
– Read/write support for other DBMS & GIS file formats
• MapInfo (.tab or MIF/MID), KML, GeoJSON, GeoRSS, ESRI
Geodatabase, ArcSDE
• Native support for MS SQL Server 2008 and Ingres
• WFS, Sensor Web (TML, SensorML, SOS, ...)
– Implementation of a “Spatial analysis” step with a GUI
– Raster support : integration in progress of the Sextante
library
06/10/2009 Geospatial Business Intelligence 22
23. 4.2 GeoMondrian
• SOLAP “allows a rapid and easy navigation
within spatial datawarehouses and offers many
levels of information granularity, many themes,
many epochs and many display modes of
information that are synchronized or not: maps,
tables and diagrams” – adapted from Rivest et al.,
2005
06/10/2009 Geospatial Business Intelligence 23
24. 4.2 GeoMondrian
• GeoMondrian is a "spatially-enabled" version of
Pentaho Analysis Services (Mondrian)
• GeoMondrian brings to the Mondrian OLAP
server what PostGIS brings to the PostgreSQL
DBMS
– i.e. a consistent and powerful support for
geospatial data.
• Released under the EPL
• http://www.geo-mondrian.org
06/10/2009 Geospatial Business Intelligence 24
25. 4.2 GeoMondrian
• As far as we know, it is the first implementation of a
true Spatial OLAP (SOLAP) Server
• Provides a consistent integration of spatial objects
into the OLAP data cube structure
– Instead of fetching them from an separate spatial DBMS,
web service or a GIS file
• Implements a native Geometry data type
• Provides first spatial extensions to the MDX
language
– Add spatial analysis capabilities to the analytical queries
• At present, it only supports PostGIS datawarehouses
06/10/2009 Geospatial Business Intelligence 25
26. 4.2.1 Spatially enabled MDX
• bring to Mondrian and MDX what SQL spatial
extensions do for relational DBMS (i.e. Simple
Features for SQL and implementations such as
PostGIS).
• Example query: filter spatial dimension members
based on distance from a feature
– SELECT
{[Measures].[Population]} on columns,
Filter(
{[Unite geographique].[Region economique].members},
ST_Distance([Unitegeographique].CurrentMember.Properties("geom"),
[Unite geographique].[Province].[Ontario].Properties("geom")) < 2.0
) on rows
FROM [Recensements]
WHERE [Temps].[Rencensement 2001 (2001-2003)].[2001]
06/10/2009 Geospatial Business Intelligence 26
27. 4.2.1 Spatially enabled MDX
• Many more possibilities:
– in-line geometry constructors (from WKT)
– member filters based on topological predicates
(intersects, contains, within, …)
– spatial calculated members and measures (e.g.
aggregates of spatial features, buffers)
– calculations based on scalar attributes derived
from
spatial features (area, length, distance, …)
06/10/2009 Geospatial Business Intelligence 27
28. 4.3 SOLAPLayers
• SOLAPLayers is a lightweight cartographic component
which enables navigation in geospatial (Spatial OLAP or
SOLAP) data cubes, such as those handled by
GeoMondrian.
• to be integrated into existing dashboard frameworks in
order to produce interactive geo-analytical dashboards.
• Released under BSD (client part) and EPL (server part).
• http://www.solaplayers.org
06/10/2009 Geospatial Business Intelligence 28
29. 4.3 SOLAPLayers
1645243
06/10/2009 Geospatial Business Intelligence 29
30. 4.3 SOLAPLayers
• Is mainly based on OpenLayers and Dojo
• Allows:
– the connection with a Spatial OLAP server such as
GeoMondrian,
– the navigation in geospatial data cubes,
– and the cartographic representation of some
measures as static or dynamic choropleth maps.
• Many Features in development
– More thematic capabilities
06/10/2009 Geospatial Business Intelligence 30
31. 5. Summary
DATA MDX
SOURCES ET End‐User
L Applications
Data
Warehous (OLAP)
MDX
ET End‐User
e
L Applications
BDM
S Data
Warehous (OLAP) MDX
ET e End‐User
L Applications
flat
Data CDF
Warehouse (SOLA
files
Themati
P) c
Mapping
sensor
s
OLTP
Operational
+ = Geo-BI (full SOLAP)
+ =
06/10/2009 Geospatial Business Intelligence 31
38. QUESTIONS ?
Thank you !
Luc Vaillancourt, Spatialytics CEO lvaillancourt@spatialytics.com @l_vaillancourt
Dr. Thierry Badard
- Spatialytics CTO tbadard@spatialytics.com @tbadard
- Professor at Laval University thierry.badard@scg.ulaval.ca
Coming soon!
WWW
Spatialytics.COM @spatialytics
Spatialytics.ORG
06/10/2009 Geospatial Business Intelligence 38