SlideShare uma empresa Scribd logo
1 de 23
Baixar para ler offline
CONNECT. TRANSFORM. AUTOMATE.
No pressure, but the Workbench
needs fixing so the co-worker can
go have her baby...
Bruce Harold
Product Manager, Esri
Where does Esri use FME technology?
Report or Story?
Show of hands please
Your Next 20 19 Minutes Journey
 Ordinary World
 Call to Adventure
 Refusal of the Call
 Meeting with the Mentor
 Crossing the Threshold
 Tests, Allies and Enemies
 Approach the Innermost Cave
 Ordeal
 Reward
 The Road Back
 Resurrection
 Return with the Elixir
 Better World
Ethos, Logos, Pathos
 Project an image of credibility
 Then go prove it
 Win hearts and minds
 Get more work to do….
Patterns in FME Use Cases - Formats
 Spreadsheets
 DBase
 OGC Formats
 CAD
 CSV (the optimists
spreadsheet)
 Custom (weird)
structures
 XML (what are
they thinking?)
 JSON
 RSS
 Directories of Data
 URLs
 The baby is coming
Patterns in FME Use Cases - Functions
 Cross Database
Joins
 Casting Data Types
 Lists & Cardinality
 Vertical Datum
 Coordinate
Rounding
 NULL handling
 SDE Updating
 Feature Granularity
 Binary Attributes
 Change Detection
 Concatenation
 Expressions
 REST/URL handling
The Dreaded Functionality Gap
 Change is guaranteed
 Change always meets resistance
 It is hard to design for change
 Luckily, our software is complete and perfect
 Except for…
Sometimes it’s a judgment call
Field Map Control
Modelbuilder
Baby Story
Baby
needed
TestFilter
Community Maps
Community Maps
 Crowd to Cloud
 Authoritative Data for:
 Streets, Topography, Imagery, Hydrography
 Esri supply the data model
 Contributor sends data regularly
 Contributor data is Change Detected (FME!)
 Adds, Deletes go to SDE Version, gets posted
 Map tile cache refreshed
Community Maps Processing
Contributor ID: {B0BEE756-A683-4700-ACCE-9585A07559C4}
Community Maps Processing
Community TIGER
 Census Bureau project to harvest:
 Streets with Address Ranges
 Address Points (Multiple Dwelling Units)
 Local Government Boundaries
 39,000 Local Governments
 Quality Control Steps – Data Reviewer
 Interesting combination of DR workspace & DI
 Change Detect, De-dupe, Compress, Load to SDE
Community TIGER Workflows
http://geocoding.geo.census.gov/geocoder/
Community TIGER
ETL Tools
3D Work
 Bulk 3D Geometry Creation, Editing
 3D Geometry Comparisons
 Next Generation 3D Geocoding
Aeronautical Charting Example
 FMW is 36Mb
 110 Bookmarks
 1000+Transformers
Professional Services
 Handling Excel, DBase, CSV without stress
 Eliminate need for scripting in Python
Join Excel
Read CSV
Professional Services Cont’d
 Example Multiple DBase Join
7 x Dbase JoinersRead File GDB
On the Slab in the Lab
Thread
Pool
The Perfect Workspace
 Generic Format + Dynamic Schema + Python
Thank You!
 Questions?
 For more information:
 Bruce Harold, bharold@esri.com
 Esri Inc.
 www.esri.com

Mais conteúdo relacionado

Semelhante a No pressure, but the Workspace needs fixing so the coworker can go have her baby...

AI On Your Phone: CoreML and Tensorflow Lite
AI On Your Phone: CoreML and Tensorflow LiteAI On Your Phone: CoreML and Tensorflow Lite
AI On Your Phone: CoreML and Tensorflow LiteRay Deck
 
What's New in ArcGIS 10.1 Data Interoperability Extension
What's New in ArcGIS 10.1 Data Interoperability ExtensionWhat's New in ArcGIS 10.1 Data Interoperability Extension
What's New in ArcGIS 10.1 Data Interoperability ExtensionSafe Software
 
What to do when one size does not fit all?!
What to do when one size does not fit all?!What to do when one size does not fit all?!
What to do when one size does not fit all?!Arjen de Vries
 
CA ERwin Data Modeler End User Presentation
CA ERwin Data Modeler End User PresentationCA ERwin Data Modeler End User Presentation
CA ERwin Data Modeler End User PresentationCA RMDM Latam
 
Spark Based Distributed Deep Learning Framework For Big Data Applications
Spark Based Distributed Deep Learning Framework For Big Data Applications Spark Based Distributed Deep Learning Framework For Big Data Applications
Spark Based Distributed Deep Learning Framework For Big Data Applications Humoyun Ahmedov
 
Data Workflows for Machine Learning - SF Bay Area ML
Data Workflows for Machine Learning - SF Bay Area MLData Workflows for Machine Learning - SF Bay Area ML
Data Workflows for Machine Learning - SF Bay Area MLPaco Nathan
 
Enabling Spatial Decision Support and Analytics on a Campus Scale with FME Te...
Enabling Spatial Decision Support and Analytics on a Campus Scale with FME Te...Enabling Spatial Decision Support and Analytics on a Campus Scale with FME Te...
Enabling Spatial Decision Support and Analytics on a Campus Scale with FME Te...Safe Software
 
Grokking TechTalk #33: Architecture of AI-First Systems - Engineering for Big...
Grokking TechTalk #33: Architecture of AI-First Systems - Engineering for Big...Grokking TechTalk #33: Architecture of AI-First Systems - Engineering for Big...
Grokking TechTalk #33: Architecture of AI-First Systems - Engineering for Big...Grokking VN
 
FME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken BraggFME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken BraggIMGS
 
Data Workflows for Machine Learning - Seattle DAML
Data Workflows for Machine Learning - Seattle DAMLData Workflows for Machine Learning - Seattle DAML
Data Workflows for Machine Learning - Seattle DAMLPaco Nathan
 
FME User Stories from Around the World
FME User Stories from Around the WorldFME User Stories from Around the World
FME User Stories from Around the WorldSafe Software
 
Using FME to support open data initiatives and INSPIRE
Using FME to support open data initiatives and INSPIREUsing FME to support open data initiatives and INSPIRE
Using FME to support open data initiatives and INSPIREIMGS
 
OSCON 2014: Data Workflows for Machine Learning
OSCON 2014: Data Workflows for Machine LearningOSCON 2014: Data Workflows for Machine Learning
OSCON 2014: Data Workflows for Machine LearningPaco Nathan
 
Spatial ETL For Web Services-Based Data Sharing
Spatial ETL For Web Services-Based Data SharingSpatial ETL For Web Services-Based Data Sharing
Spatial ETL For Web Services-Based Data SharingSafe Software
 
Machine Learning with Microsoft Azure
Machine Learning with Microsoft AzureMachine Learning with Microsoft Azure
Machine Learning with Microsoft AzureDmitry Petukhov
 

Semelhante a No pressure, but the Workspace needs fixing so the coworker can go have her baby... (20)

BigData
BigDataBigData
BigData
 
AI On Your Phone: CoreML and Tensorflow Lite
AI On Your Phone: CoreML and Tensorflow LiteAI On Your Phone: CoreML and Tensorflow Lite
AI On Your Phone: CoreML and Tensorflow Lite
 
What's New in ArcGIS 10.1 Data Interoperability Extension
What's New in ArcGIS 10.1 Data Interoperability ExtensionWhat's New in ArcGIS 10.1 Data Interoperability Extension
What's New in ArcGIS 10.1 Data Interoperability Extension
 
What to do when one size does not fit all?!
What to do when one size does not fit all?!What to do when one size does not fit all?!
What to do when one size does not fit all?!
 
CA ERwin Data Modeler End User Presentation
CA ERwin Data Modeler End User PresentationCA ERwin Data Modeler End User Presentation
CA ERwin Data Modeler End User Presentation
 
Spark Based Distributed Deep Learning Framework For Big Data Applications
Spark Based Distributed Deep Learning Framework For Big Data Applications Spark Based Distributed Deep Learning Framework For Big Data Applications
Spark Based Distributed Deep Learning Framework For Big Data Applications
 
Data Workflows for Machine Learning - SF Bay Area ML
Data Workflows for Machine Learning - SF Bay Area MLData Workflows for Machine Learning - SF Bay Area ML
Data Workflows for Machine Learning - SF Bay Area ML
 
Enabling Spatial Decision Support and Analytics on a Campus Scale with FME Te...
Enabling Spatial Decision Support and Analytics on a Campus Scale with FME Te...Enabling Spatial Decision Support and Analytics on a Campus Scale with FME Te...
Enabling Spatial Decision Support and Analytics on a Campus Scale with FME Te...
 
Bigdata
BigdataBigdata
Bigdata
 
LR2. Summary Day 2
LR2. Summary Day 2LR2. Summary Day 2
LR2. Summary Day 2
 
Grokking TechTalk #33: Architecture of AI-First Systems - Engineering for Big...
Grokking TechTalk #33: Architecture of AI-First Systems - Engineering for Big...Grokking TechTalk #33: Architecture of AI-First Systems - Engineering for Big...
Grokking TechTalk #33: Architecture of AI-First Systems - Engineering for Big...
 
FME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken BraggFME World Tour 2015 - Around the World - Ken Bragg
FME World Tour 2015 - Around the World - Ken Bragg
 
Data Workflows for Machine Learning - Seattle DAML
Data Workflows for Machine Learning - Seattle DAMLData Workflows for Machine Learning - Seattle DAML
Data Workflows for Machine Learning - Seattle DAML
 
FME User Stories from Around the World
FME User Stories from Around the WorldFME User Stories from Around the World
FME User Stories from Around the World
 
MTNA DataForge
MTNA DataForgeMTNA DataForge
MTNA DataForge
 
Using FME to support open data initiatives and INSPIRE
Using FME to support open data initiatives and INSPIREUsing FME to support open data initiatives and INSPIRE
Using FME to support open data initiatives and INSPIRE
 
OSCON 2014: Data Workflows for Machine Learning
OSCON 2014: Data Workflows for Machine LearningOSCON 2014: Data Workflows for Machine Learning
OSCON 2014: Data Workflows for Machine Learning
 
Mr bi
Mr biMr bi
Mr bi
 
Spatial ETL For Web Services-Based Data Sharing
Spatial ETL For Web Services-Based Data SharingSpatial ETL For Web Services-Based Data Sharing
Spatial ETL For Web Services-Based Data Sharing
 
Machine Learning with Microsoft Azure
Machine Learning with Microsoft AzureMachine Learning with Microsoft Azure
Machine Learning with Microsoft Azure
 

Mais de Safe Software

Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsSafe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemSafe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISSafe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriSafe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfSafe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologySafe Software
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersSafe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsSafe Software
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategySafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Safe Software
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMESafe Software
 
Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Safe Software
 
Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Safe Software
 
Bringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleBringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleSafe Software
 

Mais de Safe Software (20)

Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FME
 
Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...Identification of landscape features eligible for EU subsidy - Analysis of la...
Identification of landscape features eligible for EU subsidy - Analysis of la...
 
Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework Utilizing FME as an API Test Framework
Utilizing FME as an API Test Framework
 
Bringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) PeopleBringing Open Data Integration to the (SWECO) People
Bringing Open Data Integration to the (SWECO) People
 

Último

How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...BookNet Canada
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Kaya Weers
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Mark Simos
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 

Último (20)

How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)Design pattern talk by Kaya Weers - 2024 (v2)
Design pattern talk by Kaya Weers - 2024 (v2)
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
Tampa BSides - The No BS SOC (slides from April 6, 2024 talk)
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 

No pressure, but the Workspace needs fixing so the coworker can go have her baby...

  • 1. CONNECT. TRANSFORM. AUTOMATE. No pressure, but the Workbench needs fixing so the co-worker can go have her baby... Bruce Harold Product Manager, Esri
  • 2. Where does Esri use FME technology? Report or Story? Show of hands please
  • 3. Your Next 20 19 Minutes Journey  Ordinary World  Call to Adventure  Refusal of the Call  Meeting with the Mentor  Crossing the Threshold  Tests, Allies and Enemies  Approach the Innermost Cave  Ordeal  Reward  The Road Back  Resurrection  Return with the Elixir  Better World
  • 4. Ethos, Logos, Pathos  Project an image of credibility  Then go prove it  Win hearts and minds  Get more work to do….
  • 5. Patterns in FME Use Cases - Formats  Spreadsheets  DBase  OGC Formats  CAD  CSV (the optimists spreadsheet)  Custom (weird) structures  XML (what are they thinking?)  JSON  RSS  Directories of Data  URLs  The baby is coming
  • 6. Patterns in FME Use Cases - Functions  Cross Database Joins  Casting Data Types  Lists & Cardinality  Vertical Datum  Coordinate Rounding  NULL handling  SDE Updating  Feature Granularity  Binary Attributes  Change Detection  Concatenation  Expressions  REST/URL handling
  • 7. The Dreaded Functionality Gap  Change is guaranteed  Change always meets resistance  It is hard to design for change  Luckily, our software is complete and perfect  Except for…
  • 8. Sometimes it’s a judgment call Field Map Control Modelbuilder
  • 11. Community Maps  Crowd to Cloud  Authoritative Data for:  Streets, Topography, Imagery, Hydrography  Esri supply the data model  Contributor sends data regularly  Contributor data is Change Detected (FME!)  Adds, Deletes go to SDE Version, gets posted  Map tile cache refreshed
  • 12. Community Maps Processing Contributor ID: {B0BEE756-A683-4700-ACCE-9585A07559C4}
  • 14. Community TIGER  Census Bureau project to harvest:  Streets with Address Ranges  Address Points (Multiple Dwelling Units)  Local Government Boundaries  39,000 Local Governments  Quality Control Steps – Data Reviewer  Interesting combination of DR workspace & DI  Change Detect, De-dupe, Compress, Load to SDE
  • 17. 3D Work  Bulk 3D Geometry Creation, Editing  3D Geometry Comparisons  Next Generation 3D Geocoding
  • 18. Aeronautical Charting Example  FMW is 36Mb  110 Bookmarks  1000+Transformers
  • 19. Professional Services  Handling Excel, DBase, CSV without stress  Eliminate need for scripting in Python Join Excel Read CSV
  • 20. Professional Services Cont’d  Example Multiple DBase Join 7 x Dbase JoinersRead File GDB
  • 21. On the Slab in the Lab Thread Pool
  • 22. The Perfect Workspace  Generic Format + Dynamic Schema + Python
  • 23. Thank You!  Questions?  For more information:  Bruce Harold, bharold@esri.com  Esri Inc.  www.esri.com

Notas do Editor

  1. FME technology use at Esri:Who wants a report and who wants a story?Bad luck for anyone wanting a report, here is my story…
  2. Hollywood script buyers always look for these aspects of a story, so if you’re looking to retire early by selling a movie script make sure you include them.FME professionals will recognize these plot lines in their everyday work. You get a tap on the shoulder, grudgingly launch into a project, battle the ghouls of Bad Data, find a way to beat them in their hollowed out volcano lair, achieve the satisfaction of success, the banality of documenting your workflow, and emerge with a functioning workspace with which to make the (customer’s) world a better place.
  3. The Greek ideals of persuasion (in our case to use Workbench)
  4. More specifically, FME use cases tend to crop up in patterns. Here are some that are format-driven.An example of a ‘weird’ structure would be 4kB-wide fixed record length data from a vehicle data aggregator.The baby situation is just bad planning…
  5. Here are some that are functionality-driven drivers for using FME technology.By ‘feature granularity’ I mean taking individual features down different tracks based on some test.‘ETL ease of use’ would be one theme I can pick out for why we elect to use FME technology ahead of (say) scripted workflows.
  6. More specifically, FME use cases tend to crop up in patterns that aren’t functionality drivenThe baby situation is just bad planning…
  7. Esri has 900 geoprocessing tools, plus change. You would think we covered it all, and we do, but sometimes at the cost of coding.FME technology is used by Esri when it makes sense, to plug gaps, and in an easily developed and documented environment – Workbench.
  8. Esri’s core GP software does have field mapping and casting capabilities. See the Field Map control here, it crops up in several tools. It is tricky to script.Model Builder is of course the Esri environment analogous to Workbench.
  9. The baby story is true, I got a call late one day from a co-worker who had to complete a job for an expectant mother being induced that evening.By that I mean the baby was coming that evening AND the project had to complete that evening. Who plans these things?The co-worker didn’t know Workbench well, but we made the deadline (and baby arrived).
  10. The first project I’ll outline that depends on FME technology is Community Maps
  11. If you are the curator for these types of useful data WE WANT IT.We will cook it into tiled map services and serve it to the World.
  12. We do eat our own dog food, see here Models, script tools and of course an ETL tool handling the critical change detection function.
  13. In fact it is all scripted after importing the models and tools…which IMHO is a better approach than the executable script approach native to FME.I think SAFE should re-expose fmeobjects as a Python module, but that is a discussion for another day.
  14. Community TIGER is another major project where we use FME technology.TIGER is the US Census Bureau street centreline dataset they make publicly available.The general idea is to streamline aggregating street and address data for Census purposes.
  15. Speaking of Census’ purposes, the URL isn’t really a workflow Esri does, Census build the geocoding service with our outputs. So that’s the end game.AFAIK this is the first announcement at any event of the existence of Census’ geocoder!
  16. Note the ETL tools.
  17. DI is handy for bulk 3D work, here I made some 3D parcel data for geocoding development work, for the real estate market.We will support 3D data in our new US Apartment locator style due out in Q3.
  18. At the extreme end we have this example from the Chamber of Horrors – AIXM file processing.Aeronautical team process these very large XML files for military customers.
  19. We find many businesses communicate in lowest common denominator formats – Excel, Dbase, CSV etc.You can script for these in Python but why go to the trouble?Workbench delivers easy development and documentation for business-friendly formats, in and out.
  20. Nothing fancy here, just handling Dbase as we get it from the customer…
  21. When I get bored I do research.I leveraged something I found in a Python list I’m on and was pleasantly surprised to see the approach worked in a PythonCaller.What is happening here is a pool of worker processes is doing something with geometry in parallel.SAFE will be able to tell you if this should work generally, and if it breaks their license agreement .
  22. I just want to call out Python again here; Esrilites tend to be Python people, personally I use PythonCaller a lot, it gets you out of jail frequently.My joke hypothesis in this slide that with generic formats and dynamic schema, plus PythonCaller, you can do anything.