Scribe online 01 best practices for sol performance

1. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved.
Best Practices for Scribe Online
Performance

2. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 4
Session Abstract
In this session we will discuss the 3 “Legs” of our Performance
“Stool”…How to optimize your design patterns to leverage Bulk
Processing, how to reduce the excess chatter the integration can create
over the wire and how to best utilize and optimize lookups in your
mapping. When you leave here you should have a greater
understanding of how to optimize your jobs going forward.

3. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 5
Agenda
• Performance Overview
• Scribe Online Technical Benefits for Performance
• Scribe Online Benchmarking data
• Performance Design Tips

4. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 6
Performance Overview
• Types of Performance
◦ How fast can it move the data
◦ How much data can it move

5. Scribe Online Technical Benefits for Performance

6. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 8
Scribe Online – Technical Benefits
• Scribe Online Agents
◦ Run integration as Compiled Code
◦ Leverages Bulk/Batch/Fast Load
◦ Connectors have logic to manage Timeouts/Connection issues
◦ Multi-threaded

7. Scribe Online Benchmarking data

8. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 10
Scribe Online Benchmarking Data
• Stipulations – These were done internally under controlled
environments
• Data we will review
◦ Dynamics CRM
• OnPrem + OnLine
◦ Salesforce.com

9. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 11
Scribe Online Benchmarking Data
• Dynamics CRM

10. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 13
Scribe Online CRM FastLoad
CRM Connector
/ Scribe Online
Core
Dynamics CRM
API DLL
Dynamics
CRM
In-Memory
Array of
Data
Processor
Threads

11. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 14
Scribe Online Benchmarking Data
• Salesforce.com

12. Performance Design Tips

13. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 16
Update Process
Update
Pre-Seek on Match Criteria (Email)
Pre-Seek finds record, returns ID
Update occurs using returned ID

14. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 17
A – Update/Insert B – Update OR Insert
What Design Pattern is Better?

15. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 18
Performance Design Tips
• Don’t take the easy path
◦ Update/Insert vs Lookup/Create/Update

16. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 19
Performance Design Tips
• Bulk/Batch
◦ When to use which one
◦ How they differ from system to system
◦ API hits always count, Bulk can help
• Perf Killers
◦ Lookups
◦ Repetitive processing
◦ Transactional requirements

17. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 20
Performance Design Tips
• Stage data locally
• Leverage Database connections versus API
◦ If using Cloud endpoint, can use RS or IS map to bring key data
locally
• Key Storage
• Plan for errors
◦ If you know you will get N% of errors, build logic to avoid it.
Logging an error takes away from moving data

18. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 21
Performance Design Tips
• 360 Rows Per Second > 19 Rows Per Second

19. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 22
Performance Design Tips
• Take the Create or Update route…with Database lookup

20. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 23
Q+A

21. CONFIDENTIAL | © 2015 Scribe Software Corporation. All rights reserved. 24
THANK YOU