Mais conteúdo relacionado

Similar a Data to the Masses: Automated Word Document Creation with FME(20)

Mais de Safe Software(20)


Data to the Masses: Automated Word Document Creation with FME

  1. Data to the Masses: Automated Word Document Creation with FME
  2. Meet the Presenters Mary Brown GIS Team Lead Humanitarian Aid, Swiss Agency for Development and Cooperation Kailin Opaleychuk Technical Support Specialist, FME Desktop Safe Software Dale Lutz Co Founder Safe Software
  3. Welcome to Livestorm! A few ways to engage with us during the webinar: Audio issues? Click this for 4 simple troubleshooting steps. *Weʼll also bring up a poll on your screen during the webinar.
  4. How to download slides 1. Hover over the slide deck in the webinar room 2. Click this button
  5. Agenda ● Introduction ● Maryʼs use cases: ○ Typical challenges for GIS at Swiss Humanitarian Aid (HA-GIS) ○ Finding solutions ○ Examples of what came of some perseverance and FME creativity ● Demo: Microsoft Word Writer ● Demo: Powerpoint Documents ● Resources & Q+A
  6. Time for a Poll…
  7. Years of solving data challenges 29+ 16,000+ Organizations trusting us worldwide Global partners delivering FME Services 190+ 128 Countries with FME customers Safe Software Company Profile Users active in FME Community 20,000+
  8. FME® Enterprise Integration Platform FME Desktop Build & Run Data Workflows FME Server Automate Data Workflows FME Mobile Deliver the Power of FME to Mobile The only Enterprise Integration Solution with comprehensive support for Spatial Data Powering your dataflows on premises, in the cloud, and on mobile FME Cloud FME Server in the cloud
  9. Unrivaled Data Support
  10. FME's role in establishing GIS at Swiss Humanitarian Aid
  11. Mary Brown GIS Team Lead, Swiss Humanitarian Aid SHA, Swiss Agency for Development and Cooperation SDC Federal Department of Foreign Affairs FDFA Six years getting GIS established at Swiss Humanitarian Aid. Over 15 years as an FME addict.
  12. FME provided the technical empowerment for GIS to become established at the core of Swiss Humanitarian Aid.
  13. The challenges are manifold South Sudan, © Alex Kühni / SHA
  14. Typical challenges Some of the challenges I face in my job: ● Crisis-driven, rapid response required ● Providing a spatial overview of any given crisis (e.g. earthquake) ● Wide range of data sources/formats, ever changing, event-specific data ● Rapid process development, combination of sources ● Regular updates to source data ● Tiny GIS team, high demands in crises ● Crises often hit on a Friday and Murphy loves GIS! ● FME Cloner transformer fails on GIS staff
  15. Key to solving the problems faced ● First principle: believe in FME! In 15 years of data handling/integration, FME was almost always up to the task ● Modular approach ● Experiment, re-use what works, use parameters, use generic processes ● Ask for help if needed ● Use FME Server to automate, notify and allow others to run processes ● Be proactive, just do things! ● Presenting a prototype or finished product is often more easily understood than words, concepts… ● Communication & perseverance – why the where is important ● Let the data/maps and other FME output do the talking!
  16. Example 1 – Fire Tracking Bolivia
  17. The Problem ● The President is coming to visit tomorrow! ● …. so can you make the prototype internet accessible asap? (i.e. from Portal+SDE to AGOL + Feature Services) Example 1: Fire Tracking Tool The Solution ● Try not to panic, think FME! ● Can FME write features to AGOL? ● Fewer features, automate ● Control features per commit ● Add attributes for symbology ● Configure web app on AGOL ● Summary report in Excel ● Email from FME Server The Result ● AGOL web app used by Bolivian authorities to fight wildfires ● Layer choice and option to print maps with GPS coordinates for the pilots (grid and coords generated with FME). ● GIS provided as Humanitarian Aid for the first time by SHA! ● Idea to production: 2.5 days Background Wildfires in Bolivia 2019 🡪 request to our Humanitarian Hub in Lima for assistance. Request for satellite imagery of affected area. It all started on a Friday evening…
  18. The Problem ● Major wildfires in E. Bolivia Example 1: Fire Tracking Tool - Output The Solution ● Recycle FME processes from previous wildfire events ● Make PDFs, then web map/web app The Result ● AGOL web app & emails/xlsx Background Dynamic situation, huge area affected, not viable to provide satellite imagery. Prototype built in Portal for ArcGIS using NASA Hotspot data for last 7 days.
  19. Example 2 – Covid-19 Digital Situation Report
  20. The Problem ● Covid-19 – thousands of Swiss citizens stranded abroad ● Administrative scramble, political pressure ● Lack of comparable experience of a global crisis – email-centred communications ● The “overview” = a series of illegible Excel sheets produced by copy/paste from emails ● Someone reckoned GIS could help…. Example 2: Covid-19 Digital SitRep The Solution I ● MS SharePoint survey, updated by staff abroad ● A giant technological leap – but only if output was a Word file, to email ● Automate export of content (JSON) ● Read JSON with FME, join to country boundaries, write to geodatabase ● Automate updates The Result I ● A series of simple web maps, added to a StoryMap Series ● IT: process to generate Word files and auto-email to representations when updated. Background With offices in over 170 countries, Covid-19 had a major impact on the Swiss Foreign Ministry.
  21. The Problem II ● Report generation problems ● Decision to advance or drop the idea imminent ● Nerves on edge ● Audience were diplomatic staff – a difficult reception for technological innovation Example 2: Covid-19 Digital SitRep (cont.) Technical Crisis ● Friday 6pm: Report generation very buggy, IT pessimistic ⇨ high risk plug would be pulled ● Friday 6:30pm: decision to try to save the day with FME… ● Saturday: research Word file generation with FME Server, prototype ● Prototype proposed to IT as backup ● New motivation – by Monday we had 2 working reporting systems! ● Plug wasn’t pulled, go–live rescheduled to allow fine-tuning The Solution/Result II ● A series of web maps in a StoryMap Series ● Report generation and emailing by NPrinting/Qlik ● Report generation for IT Support and staff at HQ by FME Server ● Idea to production: 2 weeks Background Problems, doubts setting in, diplomats & technological experiments don't mix well… Map services 20 Web requests >210,400 Digital Sitreps >5,000 FME Workspaces 6 FME Server Automations 3 Process runs 8,376 SharePoint export scripts 2
  22. The Problem ● Stranded Swiss, political pressure ● Dynamic situation, regional differences ● Multiple internal actors needing an overview of the situation ● Emails and giant Excel sheets… Example 2: Covid-19 Digital SitRep - Output The Solution ● MS SharePoint questionnaire ● FME processing ● Web mapping The Result ● A StoryMap Series on Portal ● Automated report/email generation
  23. In summary… ● I learnt a lot! ● A “transformational” project succeeded because of FME ● Without the MS Word Writer it wouldn’t have been possible
  24. GIS is now established at the core of SHA. Without FME this would have been almost impossible. Without my conviction that it would be the answer – neither of these (for us) revolutionary applications would have been considered, never mind successfully implemented under great pressure and with very short deadlines.
  25. Thank You! Any Questions?
  26. Flash Demo
  27. Pre-demo slide The Goal Use FME to create a simple PowerPoint presentation The Obstacles Integrating various media and content types into PowerPoint The Solution Leveraging FMEʼs PowerPointStyler as well as PowerPoint Writer The Result A basic PowerPoint presentation
  28. Input JPEG Folder
  29. Workspace
  30. Output Presentation
  31. Demo
  32. Input Spreadsheet & JPEG Folder +
  33. Workspace
  34. Output Guide
  35. Lesson Slide In the last demo, we reviewed how to combine multiple content types and write to a single destination, Microsoft Word.
  36. Order in FME and Tips & Tricks
  37. Order in FME - Microsoft Word and PowerPoint writing in FME is order-dependent - Feature order must be controlled in the workspace - Generally if there are no blocking transformers, the features will be written in the order they are read
  38. 1. PowerpointStyler: Slide Order Group By - Slide Order Group By: If a value is provided, then the features will be sorted by that value.
  39. 1. Sorting - The simplest method for controlling order - Manually assign an ʻOrderʼ attribute and use a Sorter transformer - Sort: numerically, ascending
  40. 2. Creators - Create at End parameter - This parameter determines whether the feature is created after all reader features have been processed (Yes), or whether the feature is created immediately before the first reader feature is processed (No).
  41. 3. Set Connection Runtime Order - If a transformer output port connects to more than one destination—you can control the order in which these connections execute. - Right-click on one of a transformers connections and select Set Connection Runtime Order.
  42. Tips & Tricks - Feature Caching is not your friend - Bulk mode is your enemy, if youʼre running into bulk mode issues, consider using a Decelerator of ʻ0ʼ
  43. Microsoft Word Writer
  44. Pre-demo slide The Goal Use FME and OpenAI to generate and automate thank you letter creation The Obstacles Creating one thank you letter per person/prompt The Solution Use FMEʼs Word Writer to fanout datasets The Result Batch produced letters
  45. Demo
  46. Input Spreadsheet
  47. Workspace
  48. 20 22 FME User Conference Output Thank-You Letter
  49. Base Files and Formatting - Base files are not template files - The writer will only append features to the end of the existing base document - To avoid awkward formatting, try to use formatting functions available in the native application
  50. Powerpoint Docs
  51. Pre-demo slide The Goal Save time by automating weekly processes like presnetation creation The Obstacles Creating information from data The Solution Use a combination of FME transformers to create graphics and media content The Result Webinar Attendees Summary Presentations
  52. Demo
  53. Input Spreadsheet
  54. Workspace
  55. Output Presentation
  56. Summary Points - Use FME transformer parameters to enhance your workflows - Base files can create help create more aesthetic outputs - Feature order is important!
  57. Next Steps Download FME 2022 & the webinar workspaces Apply the workspaces to your own data to manage changes Free Trial | Upgrade Contact us. We would love to chat with you about anything data
  58. Resources ● Tutorial: Getting Started with the PowerPoint Writer ● How to Create a Microsoft Word Base File to Use With the MSWordStyler Transformer
  59. Claim Your Community Badge Get community badges for watching webinars! Todayʼs Code: LMAFP
  60. Check out our upcoming & on-demand webinars:
  62. Register Now & Apply to Present! The Peak of Data Integration 2023 Europe UC September 5-7, 2023 | Bonn, Germany
  63. Q&A
  64. Thank you! Download FME Free Trial | Upgrade Chat with us Connect with us in the Community Connect with us for more FME Please share your feedback with us through the webinar survey!