Walter Simonazzi and Christopher Brown.

1. Geodatabase
Efficiencies
Walter Simonazzi
&
Christopher Brown

2. Agenda
• Geodatabase design and how it can assist you
• Geodatabase Storage and Migration
• Versioning
– When to use?
– How to manage
• Geodatabase Replication
• Performance and Maintenance

3. Department of Spatial Awareness
Dave
• New Spatial Data Administrator
• Existing Organisation
Planning
Operations
Media

4. Department of Spatial Awareness
Dave
• Lots of Corporate Data stored in “silo’s”
• A lot of project data stored on peoples computers
• No specified data standards
• The data has been stored in SDE
– Where no one knows what is there
– Everyone complains about poor performance

5. Department of Spatial Awareness
What should Dave do now?
• Identify the workflows in the organisation
• Create a data governance document
– What do the users need to do to make the data useful to
the organisation
•
•
•
•
Create a Data Model
Import the data into the new data model
Setup an edit workflow
Manage the ongoing performance of the Database

6. What’s in a geodatabase design?
GIS
behavior
Rules
Tools
Elements
Single-user
Multiuser
Geodatabase

7. Geodatabase functionality
Default attribute values
Subtypes
Single-user
Multiuser
Attribute domains
Attachments
Relationship classes
Topology

8. Workflow: From design to prototype
Design the
geodatabase
Obtain
schema
Modify
schema
Add
data
Prototype
geodatabase

9. What should Dave do next?
• Speak to Barry
• Barry is the Corporate DBA
– It is Barry’s job to make sure that the
databases perform
The key to Enterprise GIS is a
collaboration between the business
systems and the spatial architecture

10. Diagrammer & Case Tools (free tools)
• ArcGIS Diagrammer is a
productivity tool for GIS
professionals to create, edit or
analyze geodatabase schema.
• Is a visual editor for Esri’s .xml
Workspace Document
• *Supports complex geodatabase
elements such as topology and
parcel fabrics
http://www.arcgis.com/home/item.html?id=5af1723bab4e413bae63dd89daa87984

11. CDB
If I build it, they will come
ArcGIS Geodatabase and CASE Tools

12. What’s in the Geodatabase?

13. What’s in the Geodatabase?

15. What’s inside the Geodatabase?

16. What’s inside the Geodatabase?
- Pre-configured table
- 370 configuration parameters

17. ArcSDE and the DBTUNE table
Client
Translator
Database Server
Select…
DBTUNE
Repository

18. ArcSDE compressed binary
• Better performance for advance geodatabase elements
• Reduce the storage size in the RDBMS
• Difficult to access with SQL commands and third party applications

19. Spatial field types
• The default format in ArcSDE
• Easy access with SQL operators and spatial functions.

20. Supported Storage types

21. Migrating spatial types
Supported migration paths
SQLServer
•
•
SDE binary to Geometry
SDE binary t Geography
Oracle
•
•
SDE binary to ST_Geometry
SDO_Geometry to ST_Geometry

22. WS
Put it in the bucket
Storage and Migration

23. Like a Version
D77
SDE_STATE_ID
#
DELETED_AT
Unique object ID
 Constant for all
versions of a row
#
#
SDE_DELETES_ROW_ID
A77
SHAPE
NAME
OBJECTID
SDE_STATE_ID
Database state
 Identifies when
row was added
CELL_TOWERS
SHAPE
1
2
3
NAME
Riverside NE
Riverside SE
Riverside W
OBJECTID
1
2
3
SDE_STATE_ID
0
0
0

24. Like a Version - Adding
D77
SDE_STATE_ID
SDE_DELETES_ROW_ID
DELETED_AT
#
#
#
#
A77
SHAPE
4
NAME
OBJECTID
4
SDE_STATE_ID
1
CELL_TOWERS
SHAPE
1
2
3
NAME
Riverside NE
Riverside SE
Riverside W
OBJECTID
1
2
3
SDE_STATE_ID
0
0
0

25. Like a Version - Deleting
D77
#
#
#
SDE_STATE_ID
0
SDE_DELETES_ROW_ID
2
Created at
state
DELETED_AT
2
Deleted at
state
A77
SHAPE
4
NAME
OBJECTID
4
SDE_STATE_ID
1
CELL_TOWERS
SHAPE
1
2
3
NAME
Riverside NE
Riverside SE
Riverside W
OBJECTID
1
2
3
SDE_STATE_ID
0
0
0

26. Like a Version - Updating
D77
#
#
Riverside Mid
SDE_STATE_ID
0
1
SDE_DELETES_ROW_ID
2
4
DELETED_AT
2
3
#
A77
SHAPE
4
4
NAME
OBJECTID
4
Riverside Mid
4
SDE_STATE_ID
1
3
CELL_TOWERS
SHAPE
1
2
3
NAME
Riverside NE
Riverside SE
Riverside W
OBJECTID
1
2
3
SDE_STATE_ID
0
0
0

27. Versioned Editing Performance
• Performance affected by:
0
– Volume of states
– Stale statistics
– Unnecessary versions*
– Proper workflow
State 0
Version
pinning
v2 state tree
• Manage your version
– Reconcile
– Post
– Compress
v1
v4
DEFAULT

28. To Version or not to Version

29. CDB
Who’s afraid of the big bad version?
Version Creation and Management

30. What is Geodatabase Replication?
• Geodatabase replication allows you to create copies of data across two or more
geodatabases and to keep data synchronized.
• Geodatabase replication allows to replicate just the elements you want.

31. Three types of Replication
PARENT
CHILD
Sync both
directions
Two-way
One-way
Sync one
direction
Check-out once
Check-out/ check-in
Check-in once

32. Preparing data for replication
Data requirements
Stored in high-precision spatial format
Registered as fully versioned in 2wR (no move to base)
Non-versioned or fully versioned in 1wR (no move to base)
Must have global ids
The database user must have write permission to the data

33. Create a Replica
• Distributed Geodatabase toolbar
• Create Replica tool
• Arcpy

34. WS
Replica versus Replicant
Using Replication

35. No LAN/WAN between offices?
Replication using Geodata services

36. Real time edits
Use Replication to avoid service interruptions

37. Privileges
• Data set privileges managed from ArcCatalog

38. Performance Bottlenecks
Client
interaction
Network
Server
hardware
DBMS/
ArcSDE
ArcMap
TCP/IP
User
interaction
SQL
Multiuser
geodatabase
Results
presented
SQL
TCP/IP
ArcMap
DBMS
server

39. Attribute indexes
WHERE
value > 10
Use
Index

40. Spatial indexes
Select by
Location
Use Spatial
Index

41. Statistics
Small
table
Full Table
Scan
Large
table
Use Index

42. Scheduling tasks
Windows Scheduler
Python Script
arcpy.RebuildIndexes_management…
arcpy.AnalyzeDatasets_management…

43. Responsibilities
Dave
Barry
Compress
Analyse
Attribute Indexes
Attribute Indexes
Spatial Indexes
Database Statistics

44. ALL
Keep on Running
Performance and Management
Techniques

45. Summary
• Design and maintain your geodatabase to support your business
processes.
• Every minute you spent thinking about the design of your geospatial
database can save you hours of frustration.
See you at the Booth
* The view of the presenters is not always the views of anybody else

46. Training
• Building Geodatabases
• Configuring and Managing the Multiuser Geodatabase
• Implementing Versioned Workflows in a Multiuser Geodatabase
• Distributing Data using Geodatabase replication
Training website
http://esriaustralia.com.au/training

47. Other Resources
• Come chat to us at the Industry Solution booth on the conference
• ArcGIS Resources – Geodatabase Community
http://resources.arcgis.com/en/communities/geodata/
• GIS Wiki
http://wiki.gis.com/wiki/index.php/Main_Page
• Esri Online Training Gateway
http://training.esri.com/gateway/index.cfm

48. Questions?
Thank you