SlideShare uma empresa Scribd logo
1 de 27
Seamless, real-time
data integration
Precisely Connect Overview
Liz Thompson | Sales Engineer
The global leader in data integrity
Trust your data. Build your possibilities.
Our data integrity software and data enrichment products
deliver accuracy and consistency to power confident
business decisions.
Brands you trust, trust us
Data leaders partner with us
of the Fortune 100
90
Customers in more than
100
2,000
employees
customers
12,000
countries
Modern Data Integration + Legacy Data =
Easier Said Than Done!
Integrate data seamlessly from legacy systems into next-gen
cloud and data platforms with one solution.
Batch data transformation Data replication via CDC
High-performance, lightweight batch
data processing for distributed
platforms
Real-time data replication to streaming
platforms, cloud, databases and data
warehouses
Connect
Connect is the best
solution for accessing
and integrating
mainframe and IBM i
data with cloud data
platforms
Quickly and efficiently integrate
ALL enterprise data – including
mainframe and IBM i
Design-once, deploy anywhere
approach to building data
pipelines
Minimal development costs and
time
Unrivaled scalability and
performance
Connect speaks mainframe
Data Translation
• Connect can translate mainframe
on the fly
• No mainframe expertise required
• No need to stage extra copies
Complex Copybooks
• Connect leverages copybooks as-is - no
matter how complex
• Multiple redefines
• Directives, SKIP, EJECT, etc.
• Compiler tags
• ODO’s, even nested
• No padding/exploding the data
• Smaller files = faster execution
Variable Length Records
• Record descriptor words make it
hard to split variable length data
• Connect handles distributing
variable length data with ease.
• Retains the integrity of data
• If you choose, data can remain
unchanged on object storage,
HDFS, etc. while still matching the
original copybook.
Or, get your mainframe data into big data, in a big
data format
Want your data in a cloud-native format? Connect can translate on the fly!
• Big Data lacks robust connectivity to
mainframe.
• With Connect, you can:
• Securely access mainframe data
with FTPS, Connect:Direct.
• Transform data on the fly – no
staging.
• Import hundreds or Db2 tables to
your cluster with a few mouse
clicks.
Access
• Mainframe data needs to be joined with
other data sources for full benefit.
• With Connect, you can:
• Integrate mainframe, relational data,
files, streaming data, …
• Handle all kinds of data formats, old and
new: RDBMS, mainframe variable,
HDFS, DBFS, Hive, Delta Lake, text, Avro,
Kafka, Parquet, S3, …
Integrate
• SLA’s are shorter and data is growing.
• With Connect, you can:
• Access data in parallel.
• Integrate even streaming data with
Spark support.
• Keep Big Data in sync with
mainframe and relational database
changes in real-time with Connect’s
CDC capabilities.
Fast
Connect ETL
Mainframe
IBM i
Relational
databases,
EDW, DBMS
Flat files,
XML, JSON
Sources
Strategic Projects:
Real-time analytics, AI
and machine learning
Targets
Deploy Connect ETL
on a cluster,
Windows, Unix,
Linux, or cloud
Integrate,
Prepare,
Load, Cleanse,
Transform, Deliver
Amazon S3
On-prem
legacy
stores
Cloud
platforms
Big
data
Connect ETL
Precisely Connect
Offload data and processing
• Offload data and processing from mainframe to Cloudera, Databricks,
Snowflake, and more
• Direct, high-performance connectivity to the mainframe
• Ingest from a variety of file formats and data types
• Examples: VSAM, fixed length, variable length, OCCURS, OCCURS DEPENDING ON,
REDEFINES, packed decimals, COMP data types
• Translations from EBCDIC to a variety of encodings
• Examples: ASCII, UTF-8, ICU codepage encodings
• Convert compressed number formats to displayable number formats
• Archive in raw format to target and process without the need for conversion
Connect to any source
• Native drivers to extract data for guaranteed optimal speed and efficiency
• Direct mainframe connectivity
• Support for distributed sources, external sources, flat files, weblogs, etc.
• Join, transform, de-normalize, before landing to the target
• Unique approach to convert the data to native Big Data formats, such as Avro, Parquet,
and ORC
• Quickly create reports showing off the insights from their data
• Connections for Tableau and Qlik
• Read and write to/from Apache Kafka
Design once, deploy anywhere
No re-design, re-compile or re-work – ever.
• Design future-proof workflows for batch and streaming
data
• Cleanse, blend and transform data for context and
meaning
• Move from dev to test to production
• Move from on-premises to Cloud
• Move from one Cloud to another
Drive results through high performance
• Get excellent performance every time
without tuning, load balancing, etc.
Use existing skills to drive new projects
• No parallel programming – Java, MapReduce, Spark …
No worries about:
• Mappers, Reducers
• Big side or small side of joins …
Design
Once
in visual UX
Deploy Anywhere!
On-
premises ,
Cloud
Spark,
MapReduce,
Future
Platforms
Windows,
Unix,
Linux
Batch,
Streaming
Single
Node,
Cluster
Connect comes equipped with
Intelligent Execution
• No administration or management, Connect’s ETL engine
dynamically selects the most efficient algorithms based on the data
structures and systems attributes at run-time
• Highly performant with small-footprint and comprehensive support
for growing modern data warehouses
• Visual design that enables jobs to be created once, and deployed
them anywhere
— Spark, Hadoop, Linux, Unix, Windows
— Public, private, hybrid or multi-cloud
• Simplicity and ease of use - move applications from standalone
server environments and from MapReduce to Spark – as easy as
clicking on a dropdown menu
• Future-proof your organization from underlying complexities of
your technology stack
Connect ETL Advantages
• Connect ETL requires no installation on the mainframe
• No mainframe MIPS used
• Extract from the mainframe, apply translation and transformation in memory and load directly to
RDBMS in one step (no source staging needed), Cloud, Big Data platforms
• No source staging keeps data more secure
• Future proofing
• Design once, deploy anywhere
• Simple, lightweight architecture streamlines development and deployment
• No data repository required
• High performance light weight, self-tuning engine
• No coding, no tuning
Connect ETL Advantages
• We are the experts in mainframe data conversion with excellent support
• Seamlessly read or write mainframe data based on COBOL Copybook
• Apply multiple copybooks to a single mainframe file in one step
• No data loss or data type mismatches -
• Support for complex hierarchical data from Mainframe and IBM i
• Automatically convert from EBCDIC to ASCII including binary values!
• Support for Occurs Depending On (ODO)
• Support high/low values,
• Support for packed decimal
• Support for COMP data
Connect Data Replication (CDC)
Transform your business with Connect CDC
capabilities
• Build streaming data pipelines to power business decision-making with real-time
data
• Get a consistent view of the data across the enterprise and keep your business in
sync
• Keep data lakes fresh with changes made on transactional systems – including
mainframe
• Enable timely reporting and meet tightening SLAs
• Migrate data with zero downtime for database/application upgrades and system
re-platforming
• Resilient data delivery and support data governance and security requirements
Connect – Data Replication Overview
• IBM Db2 for i
• IBM Db2 for z
• IBM Db2 LUW
• IBM Informix
• IMS
Real-time Data Sync
• Without overloading networks.
• Without affecting source database
performance.
• Without coding or tuning.
Real-Time Data Replication +
Transformation
• Apache Kafka
• Oracle
• Sybase
• VSAM
• IMS
• Snowflake
Resilient Delivery – Reliable transfer
of data even if connectivity fails on
either side. No data loss. Auto restart.
High Performance – Captures
changes in source as they happen.
Updates table statistics for faster
queries.
Flexible – RDBMS, Cloud, Cluster
• Replicate data to RDBMSs,
enterprise data warehouses,
cloud systems, and Kafka
• Oracle
• Oracle
RAC
• Sybase
• VSAM
• MS SQL
Server
• IBM Db2 (i, z,
LUW)
• MS Azure SQL
Database
• MS SQL Server
• Teradata
• IBM Informix
Conflict Resolution,
Collision Monitoring,
Tracking and Auditing
Example Sources Example Targets
Connect’s CDC High-level Architecture
Source
Database
PROJECT
METADATA
CHANGE DATA
CAPTURE
Target
Database
PROJECT
METADATA
Connect SaaS
Flexible Replication Options
One Way Two Way
Cascade
Bi-Directional
Distribute
Consolidate
Choose a topology
or combine them
to meet your data
sharing needs
Resilient replication: enable information
accuracy
Ensures ongoing integrity
• Changes collected in queue on source
• Moved to target only after committed
on source
• Ensures write-order-consistency retained
• Queues retained until successfully applied
• No database table locking
Ensures failure integrity
• Automatically detects communications
errors
• Automatically recovers the connection and
processes
• Alerts administrator
• No data is lost
Email Alerting
Accurate tracking and data auditing
Detects and resolves conflicts
• Maintains data integrity
Model verification
• Validates data movement model
Audit Journal Mapping tracks
all updates and changes
• Records
• Before and after values for every column
• Type of transaction
• Type of sending DBMS
• Table name
• User name
• Transaction information
• Records to flat file or to database table
• Can assist with SOX, HIPAA audit
requirements
Replicate exactly what you need
Filters determine what data gets moved
• Select specific column and table
• Select specific rows and table
Transforms data exactly how you need to
• Transforms data into useful information
• 80+ built-in transformation methods
• Field transformations, such as:
• DECIMAL(5,2)
• nulltostring(ZIP_CODE,'00000')
• Table transformation, such as:
• Column merging
• Column splitting
• Creating derived columns
• Custom lookup tables
• Create custom data transformations using
powerful Java scripting interface
Connect CDC Advantages
• Extract from the mainframe, apply translation
and transformation in memory and load directly
to RDBMS in one step (no source staging
needed), Cloud, Big Data platforms
• No staging of source data keeps data more
secure
• Connect CDC uses minimal mainframe MIPS
• No data loss or data type mismatches -
• Support for complex hierarchical data from
Mainframe and IBM i
• Automatically convert from EBCDIC to ASCII
including binary values!
• Support for Occurs Depending On (ODO)
• Support high/low values,
• Support for packed decimal
• Support for COMP data
• Fast real-time capture for IMS,
VSAM, and DB2. Our capture uses
the active logs, where other products
can only look at the IMS archive logs
• Automatic recovery from network
failures for all sources including MF
• Simplicity – no coding, no tuning
• We are the experts in mainframe
data conversion with excellent
support
Precisely data integration top differentiators
1
Resilient & Fault-
Tolerant Replication
2
Scalability &
Performance
3
Design Once,
Deploy Anywhere
4
Native Tech
Partner Integration
Seamless, Real-Time Data Integration with Connect

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Which Change Data Capture Strategy is Right for You?
Which Change Data Capture Strategy is Right for You?Which Change Data Capture Strategy is Right for You?
Which Change Data Capture Strategy is Right for You?
 
Big Data Computing Architecture
Big Data Computing ArchitectureBig Data Computing Architecture
Big Data Computing Architecture
 
Transform Your Mainframe Data for the Cloud with Precisely and Apache Kafka
Transform Your Mainframe Data for the Cloud with Precisely and Apache KafkaTransform Your Mainframe Data for the Cloud with Precisely and Apache Kafka
Transform Your Mainframe Data for the Cloud with Precisely and Apache Kafka
 
Data Lake and the rise of the microservices
Data Lake and the rise of the microservicesData Lake and the rise of the microservices
Data Lake and the rise of the microservices
 
Innovation in the Enterprise Rent-A-Car Data Warehouse
Innovation in the Enterprise Rent-A-Car Data WarehouseInnovation in the Enterprise Rent-A-Car Data Warehouse
Innovation in the Enterprise Rent-A-Car Data Warehouse
 
The Hidden Value of Hadoop Migration
The Hidden Value of Hadoop MigrationThe Hidden Value of Hadoop Migration
The Hidden Value of Hadoop Migration
 
Cortana Analytics Workshop: The "Big Data" of the Cortana Analytics Suite, Pa...
Cortana Analytics Workshop: The "Big Data" of the Cortana Analytics Suite, Pa...Cortana Analytics Workshop: The "Big Data" of the Cortana Analytics Suite, Pa...
Cortana Analytics Workshop: The "Big Data" of the Cortana Analytics Suite, Pa...
 
Cortana Analytics Workshop: The "Big Data" of the Cortana Analytics Suite, Pa...
Cortana Analytics Workshop: The "Big Data" of the Cortana Analytics Suite, Pa...Cortana Analytics Workshop: The "Big Data" of the Cortana Analytics Suite, Pa...
Cortana Analytics Workshop: The "Big Data" of the Cortana Analytics Suite, Pa...
 
Virtual Flink Forward 2020: Netflix Data Mesh: Composable Data Processing - J...
Virtual Flink Forward 2020: Netflix Data Mesh: Composable Data Processing - J...Virtual Flink Forward 2020: Netflix Data Mesh: Composable Data Processing - J...
Virtual Flink Forward 2020: Netflix Data Mesh: Composable Data Processing - J...
 
Future of Data Engineering
Future of Data EngineeringFuture of Data Engineering
Future of Data Engineering
 
How Experian increased insights with Hadoop
How Experian increased insights with HadoopHow Experian increased insights with Hadoop
How Experian increased insights with Hadoop
 
Sidecars and a Microservices Mesh
Sidecars and a Microservices MeshSidecars and a Microservices Mesh
Sidecars and a Microservices Mesh
 
Big Data Education Webcast: Introducing DMX and DMX-h Release 8
Big Data Education Webcast: Introducing DMX and DMX-h Release 8Big Data Education Webcast: Introducing DMX and DMX-h Release 8
Big Data Education Webcast: Introducing DMX and DMX-h Release 8
 
Modern Data Warehousing with the Microsoft Analytics Platform System
Modern Data Warehousing with the Microsoft Analytics Platform SystemModern Data Warehousing with the Microsoft Analytics Platform System
Modern Data Warehousing with the Microsoft Analytics Platform System
 
Preventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive IndustryPreventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive Industry
 
Accelerating Data Warehouse Modernization
Accelerating Data Warehouse ModernizationAccelerating Data Warehouse Modernization
Accelerating Data Warehouse Modernization
 
IlOUG Tech Days 2016 - Big Data for Oracle Developers - Towards Spark, Real-T...
IlOUG Tech Days 2016 - Big Data for Oracle Developers - Towards Spark, Real-T...IlOUG Tech Days 2016 - Big Data for Oracle Developers - Towards Spark, Real-T...
IlOUG Tech Days 2016 - Big Data for Oracle Developers - Towards Spark, Real-T...
 
A7 storytelling with_oracle_analytics_cloud
A7 storytelling with_oracle_analytics_cloudA7 storytelling with_oracle_analytics_cloud
A7 storytelling with_oracle_analytics_cloud
 
Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...
Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...
Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...
 
Case Study: Elasticsearch Ingest Using StreamSets at Cisco Intercloud
Case Study: Elasticsearch Ingest Using StreamSets at Cisco IntercloudCase Study: Elasticsearch Ingest Using StreamSets at Cisco Intercloud
Case Study: Elasticsearch Ingest Using StreamSets at Cisco Intercloud
 

Semelhante a Seamless, Real-Time Data Integration with Connect

Bridging to a hybrid cloud data services architecture
Bridging to a hybrid cloud data services architectureBridging to a hybrid cloud data services architecture
Bridging to a hybrid cloud data services architecture
IBM Analytics
 

Semelhante a Seamless, Real-Time Data Integration with Connect (20)

Streaming IBM i to Kafka for Next-Gen Use Cases
Streaming IBM i to Kafka for Next-Gen Use CasesStreaming IBM i to Kafka for Next-Gen Use Cases
Streaming IBM i to Kafka for Next-Gen Use Cases
 
Customer Education Webcast: New Features in Data Integration and Streaming CDC
Customer Education Webcast: New Features in Data Integration and Streaming CDCCustomer Education Webcast: New Features in Data Integration and Streaming CDC
Customer Education Webcast: New Features in Data Integration and Streaming CDC
 
Bridging to a hybrid cloud data services architecture
Bridging to a hybrid cloud data services architectureBridging to a hybrid cloud data services architecture
Bridging to a hybrid cloud data services architecture
 
Big Data Q2 Customer Education Webcast: New DMX Change Data Capture for Hadoo...
Big Data Q2 Customer Education Webcast: New DMX Change Data Capture for Hadoo...Big Data Q2 Customer Education Webcast: New DMX Change Data Capture for Hadoo...
Big Data Q2 Customer Education Webcast: New DMX Change Data Capture for Hadoo...
 
Migrer vos bases Oracle vers du SQL, le tout dans Azure !
Migrer vos bases Oracle vers du SQL, le tout dans Azure !Migrer vos bases Oracle vers du SQL, le tout dans Azure !
Migrer vos bases Oracle vers du SQL, le tout dans Azure !
 
Otimizações de Projetos de Big Data, Dw e AI no Microsoft Azure
Otimizações de Projetos de Big Data, Dw e AI no Microsoft AzureOtimizações de Projetos de Big Data, Dw e AI no Microsoft Azure
Otimizações de Projetos de Big Data, Dw e AI no Microsoft Azure
 
Webinar - Delivering Enhanced Message Processing at Scale With an Always-on D...
Webinar - Delivering Enhanced Message Processing at Scale With an Always-on D...Webinar - Delivering Enhanced Message Processing at Scale With an Always-on D...
Webinar - Delivering Enhanced Message Processing at Scale With an Always-on D...
 
Mainframe Modernization with Precisely and Microsoft Azure
Mainframe Modernization with Precisely and Microsoft AzureMainframe Modernization with Precisely and Microsoft Azure
Mainframe Modernization with Precisely and Microsoft Azure
 
Using Mainframe Data in the Cloud: Design Once, Deploy Anywhere in a Hybrid W...
Using Mainframe Data in the Cloud: Design Once, Deploy Anywhere in a Hybrid W...Using Mainframe Data in the Cloud: Design Once, Deploy Anywhere in a Hybrid W...
Using Mainframe Data in the Cloud: Design Once, Deploy Anywhere in a Hybrid W...
 
Fueling AI & Machine Learning: Legacy Data as a Competitive Advantage
Fueling AI & Machine Learning: Legacy Data as a Competitive AdvantageFueling AI & Machine Learning: Legacy Data as a Competitive Advantage
Fueling AI & Machine Learning: Legacy Data as a Competitive Advantage
 
Slides: Accelerating Queries on Cloud Data Lakes
Slides: Accelerating Queries on Cloud Data LakesSlides: Accelerating Queries on Cloud Data Lakes
Slides: Accelerating Queries on Cloud Data Lakes
 
AWS-DMS-2023.pptx
AWS-DMS-2023.pptxAWS-DMS-2023.pptx
AWS-DMS-2023.pptx
 
Big Data Customer Education Webcast: The Latest Advancements in Syncsort DMX ...
Big Data Customer Education Webcast: The Latest Advancements in Syncsort DMX ...Big Data Customer Education Webcast: The Latest Advancements in Syncsort DMX ...
Big Data Customer Education Webcast: The Latest Advancements in Syncsort DMX ...
 
IBM Aspera for high-speed data migration to your AWS Cloud - DEM02-S - New Yo...
IBM Aspera for high-speed data migration to your AWS Cloud - DEM02-S - New Yo...IBM Aspera for high-speed data migration to your AWS Cloud - DEM02-S - New Yo...
IBM Aspera for high-speed data migration to your AWS Cloud - DEM02-S - New Yo...
 
Migrating to Amazon RDS with Database Migration Service
Migrating to Amazon RDS with Database Migration ServiceMigrating to Amazon RDS with Database Migration Service
Migrating to Amazon RDS with Database Migration Service
 
An overview of modern scalable web development
An overview of modern scalable web developmentAn overview of modern scalable web development
An overview of modern scalable web development
 
Data Con LA 2018 - Populating your Enterprise Data Hub for Next Gen Analytics...
Data Con LA 2018 - Populating your Enterprise Data Hub for Next Gen Analytics...Data Con LA 2018 - Populating your Enterprise Data Hub for Next Gen Analytics...
Data Con LA 2018 - Populating your Enterprise Data Hub for Next Gen Analytics...
 
Keeping Data in Sync with Syncsort
Keeping Data in Sync with SyncsortKeeping Data in Sync with Syncsort
Keeping Data in Sync with Syncsort
 
IBM - Introduction to Cloudant
IBM - Introduction to CloudantIBM - Introduction to Cloudant
IBM - Introduction to Cloudant
 
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part20812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
0812 2014 01_toronto-smac meetup_i_os_cloudant_worklight_part2
 

Mais de Precisely

How to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdfHow to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdf
Precisely
 
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter MassendatenZukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
Precisely
 
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Precisely
 
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3fTestjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Precisely
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
Precisely
 
Moving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and PreciselyMoving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and Precisely
Precisely
 
Automate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center ExcellenceAutomate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center Excellence
Precisely
 

Mais de Precisely (20)

How to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdfHow to Build Data Governance Programs That Last - A Business-First Approach.pdf
How to Build Data Governance Programs That Last - A Business-First Approach.pdf
 
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter MassendatenZukuntssichere SAP Prozesse dank automatisierter Massendaten
Zukuntssichere SAP Prozesse dank automatisierter Massendaten
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
Crucial Considerations for AI-ready Data.pdf
Crucial Considerations for AI-ready Data.pdfCrucial Considerations for AI-ready Data.pdf
Crucial Considerations for AI-ready Data.pdf
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Justifying Capacity Managment Webinar 4/10
Justifying Capacity Managment Webinar 4/10Justifying Capacity Managment Webinar 4/10
Justifying Capacity Managment Webinar 4/10
 
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
Automate Studio Training: Materials Maintenance Tips for Efficiency and Ease ...
 
Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...
Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...
Leveraging Mainframe Data in Near Real Time to Unleash Innovation With Cloud:...
 
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3fTestjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
Testjrjnejrvnorno4rno3nrfnfjnrfnournfou3nfou3f
 
Data Innovation Summit: Data Integrity Trends
Data Innovation Summit: Data Integrity TrendsData Innovation Summit: Data Integrity Trends
Data Innovation Summit: Data Integrity Trends
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
Optimisez la fonction financière en automatisant vos processus SAP
Optimisez la fonction financière en automatisant vos processus SAPOptimisez la fonction financière en automatisant vos processus SAP
Optimisez la fonction financière en automatisant vos processus SAP
 
SAPS/4HANA Migration - Transformation-Management + nachhaltige Investitionen
SAPS/4HANA Migration - Transformation-Management + nachhaltige InvestitionenSAPS/4HANA Migration - Transformation-Management + nachhaltige Investitionen
SAPS/4HANA Migration - Transformation-Management + nachhaltige Investitionen
 
Automatisierte SAP Prozesse mit Hilfe von APIs
Automatisierte SAP Prozesse mit Hilfe von APIsAutomatisierte SAP Prozesse mit Hilfe von APIs
Automatisierte SAP Prozesse mit Hilfe von APIs
 
Moving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and PreciselyMoving IBM i Applications to the Cloud with AWS and Precisely
Moving IBM i Applications to the Cloud with AWS and Precisely
 
Effective Security Monitoring for IBM i: What You Need to Know
Effective Security Monitoring for IBM i: What You Need to KnowEffective Security Monitoring for IBM i: What You Need to Know
Effective Security Monitoring for IBM i: What You Need to Know
 
Automate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center ExcellenceAutomate Your Master Data Processes for Shared Service Center Excellence
Automate Your Master Data Processes for Shared Service Center Excellence
 
5 Keys to Improved IT Operation Management
5 Keys to Improved IT Operation Management5 Keys to Improved IT Operation Management
5 Keys to Improved IT Operation Management
 
Unlock Efficiency With Your Address Data Today For a Smarter Tomorrow
Unlock Efficiency With Your Address Data Today For a Smarter TomorrowUnlock Efficiency With Your Address Data Today For a Smarter Tomorrow
Unlock Efficiency With Your Address Data Today For a Smarter Tomorrow
 
Navigating Cloud Trends in 2024 Webinar Deck
Navigating Cloud Trends in 2024 Webinar DeckNavigating Cloud Trends in 2024 Webinar Deck
Navigating Cloud Trends in 2024 Webinar Deck
 

Último

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Último (20)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 

Seamless, Real-Time Data Integration with Connect

  • 1. Seamless, real-time data integration Precisely Connect Overview Liz Thompson | Sales Engineer
  • 2. The global leader in data integrity Trust your data. Build your possibilities. Our data integrity software and data enrichment products deliver accuracy and consistency to power confident business decisions. Brands you trust, trust us Data leaders partner with us of the Fortune 100 90 Customers in more than 100 2,000 employees customers 12,000 countries
  • 3. Modern Data Integration + Legacy Data = Easier Said Than Done!
  • 4. Integrate data seamlessly from legacy systems into next-gen cloud and data platforms with one solution. Batch data transformation Data replication via CDC High-performance, lightweight batch data processing for distributed platforms Real-time data replication to streaming platforms, cloud, databases and data warehouses Connect
  • 5. Connect is the best solution for accessing and integrating mainframe and IBM i data with cloud data platforms Quickly and efficiently integrate ALL enterprise data – including mainframe and IBM i Design-once, deploy anywhere approach to building data pipelines Minimal development costs and time Unrivaled scalability and performance
  • 6. Connect speaks mainframe Data Translation • Connect can translate mainframe on the fly • No mainframe expertise required • No need to stage extra copies Complex Copybooks • Connect leverages copybooks as-is - no matter how complex • Multiple redefines • Directives, SKIP, EJECT, etc. • Compiler tags • ODO’s, even nested • No padding/exploding the data • Smaller files = faster execution Variable Length Records • Record descriptor words make it hard to split variable length data • Connect handles distributing variable length data with ease. • Retains the integrity of data • If you choose, data can remain unchanged on object storage, HDFS, etc. while still matching the original copybook.
  • 7. Or, get your mainframe data into big data, in a big data format Want your data in a cloud-native format? Connect can translate on the fly! • Big Data lacks robust connectivity to mainframe. • With Connect, you can: • Securely access mainframe data with FTPS, Connect:Direct. • Transform data on the fly – no staging. • Import hundreds or Db2 tables to your cluster with a few mouse clicks. Access • Mainframe data needs to be joined with other data sources for full benefit. • With Connect, you can: • Integrate mainframe, relational data, files, streaming data, … • Handle all kinds of data formats, old and new: RDBMS, mainframe variable, HDFS, DBFS, Hive, Delta Lake, text, Avro, Kafka, Parquet, S3, … Integrate • SLA’s are shorter and data is growing. • With Connect, you can: • Access data in parallel. • Integrate even streaming data with Spark support. • Keep Big Data in sync with mainframe and relational database changes in real-time with Connect’s CDC capabilities. Fast
  • 9. Mainframe IBM i Relational databases, EDW, DBMS Flat files, XML, JSON Sources Strategic Projects: Real-time analytics, AI and machine learning Targets Deploy Connect ETL on a cluster, Windows, Unix, Linux, or cloud Integrate, Prepare, Load, Cleanse, Transform, Deliver Amazon S3 On-prem legacy stores Cloud platforms Big data Connect ETL Precisely Connect
  • 10. Offload data and processing • Offload data and processing from mainframe to Cloudera, Databricks, Snowflake, and more • Direct, high-performance connectivity to the mainframe • Ingest from a variety of file formats and data types • Examples: VSAM, fixed length, variable length, OCCURS, OCCURS DEPENDING ON, REDEFINES, packed decimals, COMP data types • Translations from EBCDIC to a variety of encodings • Examples: ASCII, UTF-8, ICU codepage encodings • Convert compressed number formats to displayable number formats • Archive in raw format to target and process without the need for conversion
  • 11. Connect to any source • Native drivers to extract data for guaranteed optimal speed and efficiency • Direct mainframe connectivity • Support for distributed sources, external sources, flat files, weblogs, etc. • Join, transform, de-normalize, before landing to the target • Unique approach to convert the data to native Big Data formats, such as Avro, Parquet, and ORC • Quickly create reports showing off the insights from their data • Connections for Tableau and Qlik • Read and write to/from Apache Kafka
  • 12. Design once, deploy anywhere No re-design, re-compile or re-work – ever. • Design future-proof workflows for batch and streaming data • Cleanse, blend and transform data for context and meaning • Move from dev to test to production • Move from on-premises to Cloud • Move from one Cloud to another Drive results through high performance • Get excellent performance every time without tuning, load balancing, etc. Use existing skills to drive new projects • No parallel programming – Java, MapReduce, Spark … No worries about: • Mappers, Reducers • Big side or small side of joins … Design Once in visual UX Deploy Anywhere! On- premises , Cloud Spark, MapReduce, Future Platforms Windows, Unix, Linux Batch, Streaming Single Node, Cluster
  • 13. Connect comes equipped with Intelligent Execution • No administration or management, Connect’s ETL engine dynamically selects the most efficient algorithms based on the data structures and systems attributes at run-time • Highly performant with small-footprint and comprehensive support for growing modern data warehouses • Visual design that enables jobs to be created once, and deployed them anywhere — Spark, Hadoop, Linux, Unix, Windows — Public, private, hybrid or multi-cloud • Simplicity and ease of use - move applications from standalone server environments and from MapReduce to Spark – as easy as clicking on a dropdown menu • Future-proof your organization from underlying complexities of your technology stack
  • 14. Connect ETL Advantages • Connect ETL requires no installation on the mainframe • No mainframe MIPS used • Extract from the mainframe, apply translation and transformation in memory and load directly to RDBMS in one step (no source staging needed), Cloud, Big Data platforms • No source staging keeps data more secure • Future proofing • Design once, deploy anywhere • Simple, lightweight architecture streamlines development and deployment • No data repository required • High performance light weight, self-tuning engine • No coding, no tuning
  • 15. Connect ETL Advantages • We are the experts in mainframe data conversion with excellent support • Seamlessly read or write mainframe data based on COBOL Copybook • Apply multiple copybooks to a single mainframe file in one step • No data loss or data type mismatches - • Support for complex hierarchical data from Mainframe and IBM i • Automatically convert from EBCDIC to ASCII including binary values! • Support for Occurs Depending On (ODO) • Support high/low values, • Support for packed decimal • Support for COMP data
  • 17. Transform your business with Connect CDC capabilities • Build streaming data pipelines to power business decision-making with real-time data • Get a consistent view of the data across the enterprise and keep your business in sync • Keep data lakes fresh with changes made on transactional systems – including mainframe • Enable timely reporting and meet tightening SLAs • Migrate data with zero downtime for database/application upgrades and system re-platforming • Resilient data delivery and support data governance and security requirements
  • 18. Connect – Data Replication Overview • IBM Db2 for i • IBM Db2 for z • IBM Db2 LUW • IBM Informix • IMS Real-time Data Sync • Without overloading networks. • Without affecting source database performance. • Without coding or tuning. Real-Time Data Replication + Transformation • Apache Kafka • Oracle • Sybase • VSAM • IMS • Snowflake Resilient Delivery – Reliable transfer of data even if connectivity fails on either side. No data loss. Auto restart. High Performance – Captures changes in source as they happen. Updates table statistics for faster queries. Flexible – RDBMS, Cloud, Cluster • Replicate data to RDBMSs, enterprise data warehouses, cloud systems, and Kafka • Oracle • Oracle RAC • Sybase • VSAM • MS SQL Server • IBM Db2 (i, z, LUW) • MS Azure SQL Database • MS SQL Server • Teradata • IBM Informix Conflict Resolution, Collision Monitoring, Tracking and Auditing Example Sources Example Targets
  • 19. Connect’s CDC High-level Architecture Source Database PROJECT METADATA CHANGE DATA CAPTURE Target Database PROJECT METADATA Connect SaaS
  • 20. Flexible Replication Options One Way Two Way Cascade Bi-Directional Distribute Consolidate Choose a topology or combine them to meet your data sharing needs
  • 21. Resilient replication: enable information accuracy Ensures ongoing integrity • Changes collected in queue on source • Moved to target only after committed on source • Ensures write-order-consistency retained • Queues retained until successfully applied • No database table locking Ensures failure integrity • Automatically detects communications errors • Automatically recovers the connection and processes • Alerts administrator • No data is lost Email Alerting
  • 22. Accurate tracking and data auditing Detects and resolves conflicts • Maintains data integrity Model verification • Validates data movement model Audit Journal Mapping tracks all updates and changes • Records • Before and after values for every column • Type of transaction • Type of sending DBMS • Table name • User name • Transaction information • Records to flat file or to database table • Can assist with SOX, HIPAA audit requirements
  • 23. Replicate exactly what you need Filters determine what data gets moved • Select specific column and table • Select specific rows and table
  • 24. Transforms data exactly how you need to • Transforms data into useful information • 80+ built-in transformation methods • Field transformations, such as: • DECIMAL(5,2) • nulltostring(ZIP_CODE,'00000') • Table transformation, such as: • Column merging • Column splitting • Creating derived columns • Custom lookup tables • Create custom data transformations using powerful Java scripting interface
  • 25. Connect CDC Advantages • Extract from the mainframe, apply translation and transformation in memory and load directly to RDBMS in one step (no source staging needed), Cloud, Big Data platforms • No staging of source data keeps data more secure • Connect CDC uses minimal mainframe MIPS • No data loss or data type mismatches - • Support for complex hierarchical data from Mainframe and IBM i • Automatically convert from EBCDIC to ASCII including binary values! • Support for Occurs Depending On (ODO) • Support high/low values, • Support for packed decimal • Support for COMP data • Fast real-time capture for IMS, VSAM, and DB2. Our capture uses the active logs, where other products can only look at the IMS archive logs • Automatic recovery from network failures for all sources including MF • Simplicity – no coding, no tuning • We are the experts in mainframe data conversion with excellent support
  • 26. Precisely data integration top differentiators 1 Resilient & Fault- Tolerant Replication 2 Scalability & Performance 3 Design Once, Deploy Anywhere 4 Native Tech Partner Integration