SlideShare a Scribd company logo
1 of 15
Domino and AWS: Collaborative Analytics and
Model Governance at Financial Services Firms
Introduction
Financial Services Industry
• Highly regulated
• Broad range of firm sizes, from small hedge funds to global
money center banks
• Large amount of analytical work related to transactions (e.g.
mergers and acquisitions, securitizations, equity IPOs)
• Subscribers to multiple data vendors
• Historically have been massive consumers of technology
Technical Challenges
• Large amounts of legacy analytics
• Subject matter experts technically proficient, but not software
engineers
• Collaborative analytics between front office desks, risk
departments and back office can get complex
• Desktop environment and version management creates
challenges for reproducibility and collaboration
• Multiple version control file storage and database systems
• Spreadsheets and shared drives that never stop growing
Financial Service Industry Analytics
Common Tasks
• Building predictive risk models
• Validating the predictive models (often by a different group)
• Derivative pricing
• Constructing and back testing algorithmic trading strategies
• Credit risk stress testing
• Transaction analytics
• Reconciliation / tie-out
• Data driven research
Financial Service Industry Analytics
Typical quantitative developer profile
• Masters/pHd in math, physics or statistics
• Deep subject matter expertise in a rather narrow specialty
• Often build and support their own analytical stack. An
example:
• High powered local machine
• Sas, R, Matlab, SPSS
• C++
• SQL
• Excel, csv
• Maintain large libraries themselves
• Some (not all) can be a bit reluctant to adopt new technologies
into their stack
DBRS Overview
DBRS is an internationally recognized credit rating agency that has been providing issuers,
regulators, investors and intermediaries with objective, transparent, insightful risk analysis and
opinion since 1976.
DBRS rates entities in:
Argentina
Australia
Austria
Barbados
Belgium
Brazil
Canada
Cayman Islands
Chile
China
Colombia
Cyprus
Denmark
Finland
France
Germany
Greece
India
Ireland
Italy
Japan
Luxembourg
Malta
Mexico
Netherlands
New Zealand
Norway
Peru
Portugal
Spain
Sweden
Switzerland
Turkey
UK
USA
Uruguay
DBRS employs approximately 440 professionals around the world, with offices in New
York, Chicago, Toronto, London and Mexico City.
Public Finance
(includes Sovereigns) – 39%
Corporates – 6%
Financial Institutions &
Insurance – 26%
Structured Finance – 29%
Coverage by
Industry
DBRS Overview
DBRS & Domino
Securitization Analysis Example – Residential Mortgage Backed Security
Investment
Decision
Predictive
Analytics
Train/test regression
model on large historical
mortgage data set
Transaction
Analytics
For a given default &
interest rate scenario,
forecast the interest and
principal paid to the bonds Qualitative
Analysis
Legal documentation
review (true sale, events
of default)
Traditional data
science (R, Python)
Fixed income
analysis (Excel,
VBA, Python)
Human group decision
making (Word,
PowerPoint, Email)
DBRS & Domino
Traditional Approach Modern Approach
Data exploration / wrangling
• Excel
Scripting
• VBA
Technical computing
• Stata, Matlab, R
Storage
• Shared drive, SQL Server
Model engines
• C#, VBA
Front end
• Excel add-ins
Presentation
• Powerpoint
Data exploration / wrangling
• Jupyter notebooks
Scripting
• Python
Technical computing
• Python (numpy, pandas, sci-kit), R
Storage
• S3, Athena, Domino projects
Model engines
• Python
Front end
• Excel add-ins, R Shiny
Presentation
• Plotly, Jupyter notebooks, Powerpoint*
*Still can’t escape it
DBRS & Domino
Model Governance Example
Development
• Parameter estimation performed in Jupyter notebooks, which
are easily shared with the model review team
• Excel add-in which allows developers dump transaction data to
json files, Domino via REST API, or S3 bucket
• Developer codes locally with their IDE, using json files to debug
• Code changes reviewed and approved via GitHub
• Domino project automatically synced to the repo
• Developer can easily setup the correct environment for their
project inside of Domino
Advantages
• Analysts interact with Excel/R Shiny front end as they normally
would, the code is all executed server side on Domino
• Analyst workflow is auditable in the form of a Domino run,
which is a record of the code version, inputs, outputs and
environment
• Scalable via AWS, large batch jobs are easily scheduled
• Developers can control their code base by hosting it server side
without any knowledge of web technology, Docker containers,
etc.
• Development can still be very rapid & flexible
AWS Global Infrastructure
16 Regions – 42 Availability Zones – 76 Edge Locations Region & Number of Availability Zones
AWS GovCloud (2) EU
Ireland (3)
US West Frankfurt (2)
Oregon (3) London (2)
Northern California (3)
Asia Pacific
US East Singapore (2)
N. Virginia (5), Ohio (3) Sydney (3), Tokyo (3),
Seoul (2), Mumbai (2)
Canada
Central (2) China
Beijing (2)
South America
São Paulo (3)
Announced Regions
Paris, Ningxia, Stockholm
Over 2 million active customers across 190 countries
2,300+ Government Agencies
7,000+ Educational Institutions
1,000+ Financial Services Organizations
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Right Now in Asset Management...
…a top 5 asset manager is consolidating data centers, with a plan to
move 400 workloads (5,000 servers) in 2 years to AWS.
...that same industry-leading firm is shuttering its internal private cloud.
...2 of the top 10 asset managers in the world are moving “all in” to AWS.
...and migrating its order routing system off of mainframe to AWS.
...leading providers of solutions to the industry are migrating those
applications to AWS.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
FS enterprises are using AWS to transform
BANKING & PAYMENTS INSURANCECAPITAL MARKETS
Capital One
“For our market surveillance systems, we are looking at about 40% [savings with AWS], but the real
benefits are the business benefits: We can do things that we physically weren’t able to do before,
and that is priceless.
”
RIGHT NOW: FINRA is using Amazon S3 and EMR to Power Market Surveillance
FINRA is the largest independent
regulator for all securities firms
doing business in the US. FINRA
oversees about 4,250 brokerage
firms, about 162,155 branch offices
and approximately 629,525
registered securities
representatives.
- Steve Randich, CIO, FINRA
What FINRA needed:
• Infrastructure for its market surveillance platform
• Analysis and storage of approximately 35 billion market events every day
• Interactively query multi-petabyte data sets
Why they chose AWS:
• Fulfillment of FINRA’s security requirements
• Ability to create a flexible platform using dynamic clusters (Hadoop, Hive, and
HBase), Amazon EMR, and Amazon S3
Benefits realized:
• Increased agility, speed, and cost savings
• Estimated savings of $20m annually by using AWS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Nasdaq has been a user of Amazon Redshift since it was released and we are extremely happy with
it. Currently, our system is moving an average of 5.5 billion rows into Amazon Redshift every day.”
”
RIGHT NOW: Nasdaq is Using Amazon Redshift to Power Data Analytics
Nasdaq is the 2nd largest exchange
group in the world by market
capitalization. Nasdaq operates one
of the world’s largest networks of
exchanges, which spans 26 markets,
1 clearing house, and 5 central
securities depositories. Its markets
trade multiple asset classes
including equities, options, futures,
fixed-income, commodities,
derivatives and structured products.
- Nate Sammons, Principal Architect, Nasdaq
What Nasdaq needed:
• Replacement of on-premise legacy warehouses
• Reduction of cost and increase in data capacity
Why they chose AWS and Amazon Redshift:
• Fulfillment of security and regulatory requirements
• Cost efficiencies without sacrificing functionalities
Benefits realized:
• System that moves an average of 5.5 billion rows into Amazon Redshift every day
(with 14 billion on a peak day in Oct of 2014)
• Ability to increase accessibility of historic data to a growing number of internal
groups
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS in Capital Markets
Broadridge has launched a technology
platform on AWS named Inlet to make it
easier for companies to provide millions
of consumers access to their most
important documents from hundreds of
providers in just a few clicks. Broadridge
uses Inlet to deliver investment industry
content for its financial institution
customers.
Global Investor Communications
Robinhood is a U.S. based financial
services company founded in 2013 that
runs its entire broker-dealer on
AWS. The Robinhood app allows
individuals to invest in publicly
traded companies and exchange-traded
funds listed on U.S. exchanges without
paying a commission.
$0 Commission Trading
Trading Technologies, a leading global
provider of a derivatives trading platform
to the financial services industry, has built
their next-generation trading platform
using a hybrid architecture, with its
backbone built on AWS spanning all
publicly available AWS regions which are
connected to co-located infrastructure at
global exchanges.
Global Trading Solutions
This global exchange group has migrated
its entire historical data footprint to
AWS, as well as an industry-leading
messaging application, and a web-based
trading platform.
Global Exchange Group
In order to achieve greater resource
scalability, St. James’s Place has migrated
85% of its applications to AWS and
expects a full migration by the end of
2016.
UK Wealth Management
TickerTags uses AWS to maintain a
curated taxonomy of over 300,000
tagged products, brands, competitors,
topics, affiliated people, places,
regulatory threats, etc. Tags serve to
bridge and filter immense volumes of
unstructured data for market insight.
Social Sentiment
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Conclusions
Domino & AWS
• There is a large population of analysts who are “part time” data scientists, and are not using the optimal technology
stack. Collaborative analytical solutions enable them to get up to speed rapidly and help reduce silos
• Domino provides easy access to AWS, git, docker containers, and REST API’s for non-software engineers
• There is strong momentum for AWS, not only for large firms but small ones as well
• While the modular nature of the Python/R ecosystems provide many benefits, one must be cautious of environment,
especially package management
• Subject matter experts should focus on business logic & model design, let somebody else do the plumbing!

More Related Content

What's hot

Predictive analytics and big data tutorial
Predictive analytics and big data tutorial Predictive analytics and big data tutorial
Predictive analytics and big data tutorial Benjamin Taylor
 
H2O World - Machine Learning for non-data scientists
H2O World - Machine Learning for non-data scientistsH2O World - Machine Learning for non-data scientists
H2O World - Machine Learning for non-data scientistsSri Ambati
 
Data science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi PeriasamyData science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi PeriasamyPeter Kua
 
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017Caserta
 
H2O World - Intro to Data Science with Erin Ledell
H2O World - Intro to Data Science with Erin LedellH2O World - Intro to Data Science with Erin Ledell
H2O World - Intro to Data Science with Erin LedellSri Ambati
 
Creating an Enterprise AI Strategy
Creating an Enterprise AI StrategyCreating an Enterprise AI Strategy
Creating an Enterprise AI StrategyAtScale
 
Moving Data Science from an Event to A Program: Considerations in Creating Su...
Moving Data Science from an Event to A Program: Considerations in Creating Su...Moving Data Science from an Event to A Program: Considerations in Creating Su...
Moving Data Science from an Event to A Program: Considerations in Creating Su...Domino Data Lab
 
Evaluating Big Data Predictive Analytics Platforms
Evaluating Big Data Predictive Analytics PlatformsEvaluating Big Data Predictive Analytics Platforms
Evaluating Big Data Predictive Analytics PlatformsTeradata Aster
 
Data Scientist vs Data Analyst vs Data Engineer - Role & Responsibility, Skil...
Data Scientist vs Data Analyst vs Data Engineer - Role & Responsibility, Skil...Data Scientist vs Data Analyst vs Data Engineer - Role & Responsibility, Skil...
Data Scientist vs Data Analyst vs Data Engineer - Role & Responsibility, Skil...Simplilearn
 
New professional careers in data
New professional careers in dataNew professional careers in data
New professional careers in dataDavid Rostcheck
 
Back to Square One: Building a Data Science Team from Scratch
Back to Square One: Building a Data Science Team from ScratchBack to Square One: Building a Data Science Team from Scratch
Back to Square One: Building a Data Science Team from ScratchKlaas Bosteels
 
Architecting Data For The Modern Enterprise - Data Summit 2017, Closing Keynote
Architecting Data For The Modern Enterprise - Data Summit 2017, Closing KeynoteArchitecting Data For The Modern Enterprise - Data Summit 2017, Closing Keynote
Architecting Data For The Modern Enterprise - Data Summit 2017, Closing KeynoteCaserta
 
Building a Data Platform Strata SF 2019
Building a Data Platform Strata SF 2019Building a Data Platform Strata SF 2019
Building a Data Platform Strata SF 2019mark madsen
 
How to Build Data Science Teams
How to Build Data Science TeamsHow to Build Data Science Teams
How to Build Data Science TeamsGanes Kesari
 
Data science Applications in the Enterprise
Data science Applications in the EnterpriseData science Applications in the Enterprise
Data science Applications in the EnterpriseSrinath Perera
 
Building Data Science Teams
Building Data Science TeamsBuilding Data Science Teams
Building Data Science TeamsEMC
 

What's hot (20)

Predictive analytics and big data tutorial
Predictive analytics and big data tutorial Predictive analytics and big data tutorial
Predictive analytics and big data tutorial
 
H2O World - Machine Learning for non-data scientists
H2O World - Machine Learning for non-data scientistsH2O World - Machine Learning for non-data scientists
H2O World - Machine Learning for non-data scientists
 
Data science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi PeriasamyData science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi Periasamy
 
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
Creating a DevOps Practice for Analytics -- Strata Data, September 28, 2017
 
Big data analysis
Big data analysisBig data analysis
Big data analysis
 
H2O World - Intro to Data Science with Erin Ledell
H2O World - Intro to Data Science with Erin LedellH2O World - Intro to Data Science with Erin Ledell
H2O World - Intro to Data Science with Erin Ledell
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Creating an Enterprise AI Strategy
Creating an Enterprise AI StrategyCreating an Enterprise AI Strategy
Creating an Enterprise AI Strategy
 
Moving Data Science from an Event to A Program: Considerations in Creating Su...
Moving Data Science from an Event to A Program: Considerations in Creating Su...Moving Data Science from an Event to A Program: Considerations in Creating Su...
Moving Data Science from an Event to A Program: Considerations in Creating Su...
 
Evaluating Big Data Predictive Analytics Platforms
Evaluating Big Data Predictive Analytics PlatformsEvaluating Big Data Predictive Analytics Platforms
Evaluating Big Data Predictive Analytics Platforms
 
Data Scientist vs Data Analyst vs Data Engineer - Role & Responsibility, Skil...
Data Scientist vs Data Analyst vs Data Engineer - Role & Responsibility, Skil...Data Scientist vs Data Analyst vs Data Engineer - Role & Responsibility, Skil...
Data Scientist vs Data Analyst vs Data Engineer - Role & Responsibility, Skil...
 
New professional careers in data
New professional careers in dataNew professional careers in data
New professional careers in data
 
Back to Square One: Building a Data Science Team from Scratch
Back to Square One: Building a Data Science Team from ScratchBack to Square One: Building a Data Science Team from Scratch
Back to Square One: Building a Data Science Team from Scratch
 
Architecting Data For The Modern Enterprise - Data Summit 2017, Closing Keynote
Architecting Data For The Modern Enterprise - Data Summit 2017, Closing KeynoteArchitecting Data For The Modern Enterprise - Data Summit 2017, Closing Keynote
Architecting Data For The Modern Enterprise - Data Summit 2017, Closing Keynote
 
Building a Data Platform Strata SF 2019
Building a Data Platform Strata SF 2019Building a Data Platform Strata SF 2019
Building a Data Platform Strata SF 2019
 
How to Build Data Science Teams
How to Build Data Science TeamsHow to Build Data Science Teams
How to Build Data Science Teams
 
Data science Applications in the Enterprise
Data science Applications in the EnterpriseData science Applications in the Enterprise
Data science Applications in the Enterprise
 
BigData Analysis
BigData AnalysisBigData Analysis
BigData Analysis
 
Building Data Science Teams
Building Data Science TeamsBuilding Data Science Teams
Building Data Science Teams
 
Data science Big Data
Data science Big DataData science Big Data
Data science Big Data
 

Similar to Domino and AWS: collaborative analytics and model governance at financial services firms

Big Data on AWS - Toronto FSI Symposium - October 2016
Big Data on AWS - Toronto FSI Symposium - October 2016Big Data on AWS - Toronto FSI Symposium - October 2016
Big Data on AWS - Toronto FSI Symposium - October 2016Amazon Web Services
 
Financial Services Analytics on AWS
Financial Services Analytics on AWSFinancial Services Analytics on AWS
Financial Services Analytics on AWSAmazon Web Services
 
IARE_BDBA_ PPT_0.pptx
IARE_BDBA_ PPT_0.pptxIARE_BDBA_ PPT_0.pptx
IARE_BDBA_ PPT_0.pptxAIMLSEMINARS
 
AWS 활용을 통한 금융권 혁신 사례 소개 :: Felix Candelario :: AWS Fi...
AWS 활용을 통한 금융권 혁신 사례 소개 :: Felix Candelario :: AWS Fi...AWS 활용을 통한 금융권 혁신 사례 소개 :: Felix Candelario :: AWS Fi...
AWS 활용을 통한 금융권 혁신 사례 소개 :: Felix Candelario :: AWS Fi...Amazon Web Services Korea
 
Big Data & Analytics - Innovating at the Speed of Light
Big Data & Analytics - Innovating at the Speed of LightBig Data & Analytics - Innovating at the Speed of Light
Big Data & Analytics - Innovating at the Speed of LightAmazon Web Services LATAM
 
Track 1 Session 6_建立安全高效的資料分析平台加速金融創新_HC+EMQ Cliff(已檢核,上下無黑邊).pptx
Track 1 Session 6_建立安全高效的資料分析平台加速金融創新_HC+EMQ Cliff(已檢核,上下無黑邊).pptxTrack 1 Session 6_建立安全高效的資料分析平台加速金融創新_HC+EMQ Cliff(已檢核,上下無黑邊).pptx
Track 1 Session 6_建立安全高效的資料分析平台加速金融創新_HC+EMQ Cliff(已檢核,上下無黑邊).pptxAmazon Web Services
 
AWS Financial Services Cloud Symposium | Hong Kong - Keynote
AWS Financial Services Cloud Symposium | Hong Kong - KeynoteAWS Financial Services Cloud Symposium | Hong Kong - Keynote
AWS Financial Services Cloud Symposium | Hong Kong - KeynoteAmazon Web Services
 
IBM Relay 2015: Open for Data
IBM Relay 2015: Open for Data IBM Relay 2015: Open for Data
IBM Relay 2015: Open for Data IBM
 
Data Treatment MongoDB
Data Treatment MongoDBData Treatment MongoDB
Data Treatment MongoDBNorberto Leite
 
Hooduku - Big data analytics - case study
Hooduku - Big data analytics - case studyHooduku - Big data analytics - case study
Hooduku - Big data analytics - case studySudhi Seshachala
 
Latest corp big data and acme
Latest corp   big data and acmeLatest corp   big data and acme
Latest corp big data and acmehooduku
 
금융권 big data 쉽게 도입 하기 :: Stire Craig :: AWS Finance Seminar
금융권 big data 쉽게 도입 하기 :: Stire Craig :: AWS Finance Seminar금융권 big data 쉽게 도입 하기 :: Stire Craig :: AWS Finance Seminar
금융권 big data 쉽게 도입 하기 :: Stire Craig :: AWS Finance SeminarAmazon Web Services Korea
 
AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)
AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)
AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)Amazon Web Services
 
AWS Webcast - Informatica - Big Data Solutions Showcase
AWS Webcast - Informatica - Big Data Solutions ShowcaseAWS Webcast - Informatica - Big Data Solutions Showcase
AWS Webcast - Informatica - Big Data Solutions ShowcaseAmazon Web Services
 
10/ EnterpriseDB @ OPEN'16
10/ EnterpriseDB @ OPEN'16 10/ EnterpriseDB @ OPEN'16
10/ EnterpriseDB @ OPEN'16 Kangaroot
 
How Financial Institutions Are Leveraging Data Virtualization to Overcome the...
How Financial Institutions Are Leveraging Data Virtualization to Overcome the...How Financial Institutions Are Leveraging Data Virtualization to Overcome the...
How Financial Institutions Are Leveraging Data Virtualization to Overcome the...Denodo
 
AWS vs Azure - A high level comparison between the giants in cloud computing
AWS vs Azure - A high level comparison between the giants in cloud computingAWS vs Azure - A high level comparison between the giants in cloud computing
AWS vs Azure - A high level comparison between the giants in cloud computingEuro IT Group
 
Analyzing Billions of Data Rows with Alteryx, Amazon Redshift, and Tableau
Analyzing Billions of Data Rows with Alteryx, Amazon Redshift, and TableauAnalyzing Billions of Data Rows with Alteryx, Amazon Redshift, and Tableau
Analyzing Billions of Data Rows with Alteryx, Amazon Redshift, and TableauDATAVERSITY
 

Similar to Domino and AWS: collaborative analytics and model governance at financial services firms (20)

Big Data on AWS - Toronto FSI Symposium - October 2016
Big Data on AWS - Toronto FSI Symposium - October 2016Big Data on AWS - Toronto FSI Symposium - October 2016
Big Data on AWS - Toronto FSI Symposium - October 2016
 
Financial Services Analytics on AWS
Financial Services Analytics on AWSFinancial Services Analytics on AWS
Financial Services Analytics on AWS
 
IARE_BDBA_ PPT_0.pptx
IARE_BDBA_ PPT_0.pptxIARE_BDBA_ PPT_0.pptx
IARE_BDBA_ PPT_0.pptx
 
AWS 101
AWS 101AWS 101
AWS 101
 
AWS 활용을 통한 금융권 혁신 사례 소개 :: Felix Candelario :: AWS Fi...
AWS 활용을 통한 금융권 혁신 사례 소개 :: Felix Candelario :: AWS Fi...AWS 활용을 통한 금융권 혁신 사례 소개 :: Felix Candelario :: AWS Fi...
AWS 활용을 통한 금융권 혁신 사례 소개 :: Felix Candelario :: AWS Fi...
 
Big Data & Analytics - Innovating at the Speed of Light
Big Data & Analytics - Innovating at the Speed of LightBig Data & Analytics - Innovating at the Speed of Light
Big Data & Analytics - Innovating at the Speed of Light
 
Track 1 Session 6_建立安全高效的資料分析平台加速金融創新_HC+EMQ Cliff(已檢核,上下無黑邊).pptx
Track 1 Session 6_建立安全高效的資料分析平台加速金融創新_HC+EMQ Cliff(已檢核,上下無黑邊).pptxTrack 1 Session 6_建立安全高效的資料分析平台加速金融創新_HC+EMQ Cliff(已檢核,上下無黑邊).pptx
Track 1 Session 6_建立安全高效的資料分析平台加速金融創新_HC+EMQ Cliff(已檢核,上下無黑邊).pptx
 
AWS Financial Services Cloud Symposium | Hong Kong - Keynote
AWS Financial Services Cloud Symposium | Hong Kong - KeynoteAWS Financial Services Cloud Symposium | Hong Kong - Keynote
AWS Financial Services Cloud Symposium | Hong Kong - Keynote
 
IBM Relay 2015: Open for Data
IBM Relay 2015: Open for Data IBM Relay 2015: Open for Data
IBM Relay 2015: Open for Data
 
Data Treatment MongoDB
Data Treatment MongoDBData Treatment MongoDB
Data Treatment MongoDB
 
Hooduku - Big data analytics - case study
Hooduku - Big data analytics - case studyHooduku - Big data analytics - case study
Hooduku - Big data analytics - case study
 
Latest corp big data and acme
Latest corp   big data and acmeLatest corp   big data and acme
Latest corp big data and acme
 
금융권 big data 쉽게 도입 하기 :: Stire Craig :: AWS Finance Seminar
금융권 big data 쉽게 도입 하기 :: Stire Craig :: AWS Finance Seminar금융권 big data 쉽게 도입 하기 :: Stire Craig :: AWS Finance Seminar
금융권 big data 쉽게 도입 하기 :: Stire Craig :: AWS Finance Seminar
 
AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)
AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)
AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)
 
AWS Webcast - Informatica - Big Data Solutions Showcase
AWS Webcast - Informatica - Big Data Solutions ShowcaseAWS Webcast - Informatica - Big Data Solutions Showcase
AWS Webcast - Informatica - Big Data Solutions Showcase
 
10/ EnterpriseDB @ OPEN'16
10/ EnterpriseDB @ OPEN'16 10/ EnterpriseDB @ OPEN'16
10/ EnterpriseDB @ OPEN'16
 
How Financial Institutions Are Leveraging Data Virtualization to Overcome the...
How Financial Institutions Are Leveraging Data Virtualization to Overcome the...How Financial Institutions Are Leveraging Data Virtualization to Overcome the...
How Financial Institutions Are Leveraging Data Virtualization to Overcome the...
 
AWS vs Azure - A high level comparison between the giants in cloud computing
AWS vs Azure - A high level comparison between the giants in cloud computingAWS vs Azure - A high level comparison between the giants in cloud computing
AWS vs Azure - A high level comparison between the giants in cloud computing
 
Analyzing Billions of Data Rows with Alteryx, Amazon Redshift, and Tableau
Analyzing Billions of Data Rows with Alteryx, Amazon Redshift, and TableauAnalyzing Billions of Data Rows with Alteryx, Amazon Redshift, and Tableau
Analyzing Billions of Data Rows with Alteryx, Amazon Redshift, and Tableau
 
The Benefits of Cloud Computing
The Benefits of Cloud ComputingThe Benefits of Cloud Computing
The Benefits of Cloud Computing
 

More from Domino Data Lab

What's in your workflow? Bringing data science workflows to business analysis...
What's in your workflow? Bringing data science workflows to business analysis...What's in your workflow? Bringing data science workflows to business analysis...
What's in your workflow? Bringing data science workflows to business analysis...Domino Data Lab
 
The Proliferation of New Database Technologies and Implications for Data Scie...
The Proliferation of New Database Technologies and Implications for Data Scie...The Proliferation of New Database Technologies and Implications for Data Scie...
The Proliferation of New Database Technologies and Implications for Data Scie...Domino Data Lab
 
Racial Bias in Policing: an analysis of Illinois traffic stops data
Racial Bias in Policing: an analysis of Illinois traffic stops dataRacial Bias in Policing: an analysis of Illinois traffic stops data
Racial Bias in Policing: an analysis of Illinois traffic stops dataDomino Data Lab
 
Data Quality Analytics: Understanding what is in your data, before using it
Data Quality Analytics: Understanding what is in your data, before using itData Quality Analytics: Understanding what is in your data, before using it
Data Quality Analytics: Understanding what is in your data, before using itDomino Data Lab
 
Supporting innovation in insurance with randomized experimentation
Supporting innovation in insurance with randomized experimentationSupporting innovation in insurance with randomized experimentation
Supporting innovation in insurance with randomized experimentationDomino Data Lab
 
Summertime Analytics: Predicting E. coli and West Nile Virus
Summertime Analytics: Predicting E. coli and West Nile VirusSummertime Analytics: Predicting E. coli and West Nile Virus
Summertime Analytics: Predicting E. coli and West Nile VirusDomino Data Lab
 
Reproducible Dashboards and other great things to do with Jupyter
Reproducible Dashboards and other great things to do with JupyterReproducible Dashboards and other great things to do with Jupyter
Reproducible Dashboards and other great things to do with JupyterDomino Data Lab
 
GeoViz: A Canvas for Data Science
GeoViz: A Canvas for Data ScienceGeoViz: A Canvas for Data Science
GeoViz: A Canvas for Data ScienceDomino Data Lab
 
Managing Data Science | Lessons from the Field
Managing Data Science | Lessons from the Field Managing Data Science | Lessons from the Field
Managing Data Science | Lessons from the Field Domino Data Lab
 
Doing your first Kaggle (Python for Big Data sets)
Doing your first Kaggle (Python for Big Data sets)Doing your first Kaggle (Python for Big Data sets)
Doing your first Kaggle (Python for Big Data sets)Domino Data Lab
 
Leveraged Analytics at Scale
Leveraged Analytics at ScaleLeveraged Analytics at Scale
Leveraged Analytics at ScaleDomino Data Lab
 
Software Engineering for Data Scientists
Software Engineering for Data ScientistsSoftware Engineering for Data Scientists
Software Engineering for Data ScientistsDomino Data Lab
 
Building Data Analytics pipelines in the cloud using serverless technology
Building Data Analytics pipelines in the cloud using serverless technologyBuilding Data Analytics pipelines in the cloud using serverless technology
Building Data Analytics pipelines in the cloud using serverless technologyDomino Data Lab
 
Leveraging Open Source Automated Data Science Tools
Leveraging Open Source Automated Data Science ToolsLeveraging Open Source Automated Data Science Tools
Leveraging Open Source Automated Data Science ToolsDomino Data Lab
 
The Role and Importance of Curiosity in Data Science
The Role and Importance of Curiosity in Data ScienceThe Role and Importance of Curiosity in Data Science
The Role and Importance of Curiosity in Data ScienceDomino Data Lab
 
Fuzzy Matching to the Rescue
Fuzzy Matching to the RescueFuzzy Matching to the Rescue
Fuzzy Matching to the RescueDomino Data Lab
 
How to Effectively Combine Numerical Features and Categorical Features
How to Effectively Combine Numerical Features and Categorical FeaturesHow to Effectively Combine Numerical Features and Categorical Features
How to Effectively Combine Numerical Features and Categorical FeaturesDomino Data Lab
 
Building Up Local Models of Customers
Building Up Local Models of CustomersBuilding Up Local Models of Customers
Building Up Local Models of CustomersDomino Data Lab
 
Making Investing A Science
Making Investing A ScienceMaking Investing A Science
Making Investing A ScienceDomino Data Lab
 

More from Domino Data Lab (20)

What's in your workflow? Bringing data science workflows to business analysis...
What's in your workflow? Bringing data science workflows to business analysis...What's in your workflow? Bringing data science workflows to business analysis...
What's in your workflow? Bringing data science workflows to business analysis...
 
The Proliferation of New Database Technologies and Implications for Data Scie...
The Proliferation of New Database Technologies and Implications for Data Scie...The Proliferation of New Database Technologies and Implications for Data Scie...
The Proliferation of New Database Technologies and Implications for Data Scie...
 
Racial Bias in Policing: an analysis of Illinois traffic stops data
Racial Bias in Policing: an analysis of Illinois traffic stops dataRacial Bias in Policing: an analysis of Illinois traffic stops data
Racial Bias in Policing: an analysis of Illinois traffic stops data
 
Data Quality Analytics: Understanding what is in your data, before using it
Data Quality Analytics: Understanding what is in your data, before using itData Quality Analytics: Understanding what is in your data, before using it
Data Quality Analytics: Understanding what is in your data, before using it
 
Supporting innovation in insurance with randomized experimentation
Supporting innovation in insurance with randomized experimentationSupporting innovation in insurance with randomized experimentation
Supporting innovation in insurance with randomized experimentation
 
Summertime Analytics: Predicting E. coli and West Nile Virus
Summertime Analytics: Predicting E. coli and West Nile VirusSummertime Analytics: Predicting E. coli and West Nile Virus
Summertime Analytics: Predicting E. coli and West Nile Virus
 
Reproducible Dashboards and other great things to do with Jupyter
Reproducible Dashboards and other great things to do with JupyterReproducible Dashboards and other great things to do with Jupyter
Reproducible Dashboards and other great things to do with Jupyter
 
GeoViz: A Canvas for Data Science
GeoViz: A Canvas for Data ScienceGeoViz: A Canvas for Data Science
GeoViz: A Canvas for Data Science
 
Managing Data Science | Lessons from the Field
Managing Data Science | Lessons from the Field Managing Data Science | Lessons from the Field
Managing Data Science | Lessons from the Field
 
Doing your first Kaggle (Python for Big Data sets)
Doing your first Kaggle (Python for Big Data sets)Doing your first Kaggle (Python for Big Data sets)
Doing your first Kaggle (Python for Big Data sets)
 
Leveraged Analytics at Scale
Leveraged Analytics at ScaleLeveraged Analytics at Scale
Leveraged Analytics at Scale
 
Software Engineering for Data Scientists
Software Engineering for Data ScientistsSoftware Engineering for Data Scientists
Software Engineering for Data Scientists
 
Making Big Data Smart
Making Big Data SmartMaking Big Data Smart
Making Big Data Smart
 
Building Data Analytics pipelines in the cloud using serverless technology
Building Data Analytics pipelines in the cloud using serverless technologyBuilding Data Analytics pipelines in the cloud using serverless technology
Building Data Analytics pipelines in the cloud using serverless technology
 
Leveraging Open Source Automated Data Science Tools
Leveraging Open Source Automated Data Science ToolsLeveraging Open Source Automated Data Science Tools
Leveraging Open Source Automated Data Science Tools
 
The Role and Importance of Curiosity in Data Science
The Role and Importance of Curiosity in Data ScienceThe Role and Importance of Curiosity in Data Science
The Role and Importance of Curiosity in Data Science
 
Fuzzy Matching to the Rescue
Fuzzy Matching to the RescueFuzzy Matching to the Rescue
Fuzzy Matching to the Rescue
 
How to Effectively Combine Numerical Features and Categorical Features
How to Effectively Combine Numerical Features and Categorical FeaturesHow to Effectively Combine Numerical Features and Categorical Features
How to Effectively Combine Numerical Features and Categorical Features
 
Building Up Local Models of Customers
Building Up Local Models of CustomersBuilding Up Local Models of Customers
Building Up Local Models of Customers
 
Making Investing A Science
Making Investing A ScienceMaking Investing A Science
Making Investing A Science
 

Recently uploaded

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 

Recently uploaded (20)

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 

Domino and AWS: collaborative analytics and model governance at financial services firms

  • 1. Domino and AWS: Collaborative Analytics and Model Governance at Financial Services Firms
  • 2. Introduction Financial Services Industry • Highly regulated • Broad range of firm sizes, from small hedge funds to global money center banks • Large amount of analytical work related to transactions (e.g. mergers and acquisitions, securitizations, equity IPOs) • Subscribers to multiple data vendors • Historically have been massive consumers of technology Technical Challenges • Large amounts of legacy analytics • Subject matter experts technically proficient, but not software engineers • Collaborative analytics between front office desks, risk departments and back office can get complex • Desktop environment and version management creates challenges for reproducibility and collaboration • Multiple version control file storage and database systems • Spreadsheets and shared drives that never stop growing
  • 3. Financial Service Industry Analytics Common Tasks • Building predictive risk models • Validating the predictive models (often by a different group) • Derivative pricing • Constructing and back testing algorithmic trading strategies • Credit risk stress testing • Transaction analytics • Reconciliation / tie-out • Data driven research
  • 4. Financial Service Industry Analytics Typical quantitative developer profile • Masters/pHd in math, physics or statistics • Deep subject matter expertise in a rather narrow specialty • Often build and support their own analytical stack. An example: • High powered local machine • Sas, R, Matlab, SPSS • C++ • SQL • Excel, csv • Maintain large libraries themselves • Some (not all) can be a bit reluctant to adopt new technologies into their stack
  • 5. DBRS Overview DBRS is an internationally recognized credit rating agency that has been providing issuers, regulators, investors and intermediaries with objective, transparent, insightful risk analysis and opinion since 1976. DBRS rates entities in: Argentina Australia Austria Barbados Belgium Brazil Canada Cayman Islands Chile China Colombia Cyprus Denmark Finland France Germany Greece India Ireland Italy Japan Luxembourg Malta Mexico Netherlands New Zealand Norway Peru Portugal Spain Sweden Switzerland Turkey UK USA Uruguay DBRS employs approximately 440 professionals around the world, with offices in New York, Chicago, Toronto, London and Mexico City. Public Finance (includes Sovereigns) – 39% Corporates – 6% Financial Institutions & Insurance – 26% Structured Finance – 29% Coverage by Industry DBRS Overview
  • 6. DBRS & Domino Securitization Analysis Example – Residential Mortgage Backed Security Investment Decision Predictive Analytics Train/test regression model on large historical mortgage data set Transaction Analytics For a given default & interest rate scenario, forecast the interest and principal paid to the bonds Qualitative Analysis Legal documentation review (true sale, events of default) Traditional data science (R, Python) Fixed income analysis (Excel, VBA, Python) Human group decision making (Word, PowerPoint, Email)
  • 7. DBRS & Domino Traditional Approach Modern Approach Data exploration / wrangling • Excel Scripting • VBA Technical computing • Stata, Matlab, R Storage • Shared drive, SQL Server Model engines • C#, VBA Front end • Excel add-ins Presentation • Powerpoint Data exploration / wrangling • Jupyter notebooks Scripting • Python Technical computing • Python (numpy, pandas, sci-kit), R Storage • S3, Athena, Domino projects Model engines • Python Front end • Excel add-ins, R Shiny Presentation • Plotly, Jupyter notebooks, Powerpoint* *Still can’t escape it
  • 8. DBRS & Domino Model Governance Example Development • Parameter estimation performed in Jupyter notebooks, which are easily shared with the model review team • Excel add-in which allows developers dump transaction data to json files, Domino via REST API, or S3 bucket • Developer codes locally with their IDE, using json files to debug • Code changes reviewed and approved via GitHub • Domino project automatically synced to the repo • Developer can easily setup the correct environment for their project inside of Domino Advantages • Analysts interact with Excel/R Shiny front end as they normally would, the code is all executed server side on Domino • Analyst workflow is auditable in the form of a Domino run, which is a record of the code version, inputs, outputs and environment • Scalable via AWS, large batch jobs are easily scheduled • Developers can control their code base by hosting it server side without any knowledge of web technology, Docker containers, etc. • Development can still be very rapid & flexible
  • 9. AWS Global Infrastructure 16 Regions – 42 Availability Zones – 76 Edge Locations Region & Number of Availability Zones AWS GovCloud (2) EU Ireland (3) US West Frankfurt (2) Oregon (3) London (2) Northern California (3) Asia Pacific US East Singapore (2) N. Virginia (5), Ohio (3) Sydney (3), Tokyo (3), Seoul (2), Mumbai (2) Canada Central (2) China Beijing (2) South America São Paulo (3) Announced Regions Paris, Ningxia, Stockholm Over 2 million active customers across 190 countries 2,300+ Government Agencies 7,000+ Educational Institutions 1,000+ Financial Services Organizations © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 10. Right Now in Asset Management... …a top 5 asset manager is consolidating data centers, with a plan to move 400 workloads (5,000 servers) in 2 years to AWS. ...that same industry-leading firm is shuttering its internal private cloud. ...2 of the top 10 asset managers in the world are moving “all in” to AWS. ...and migrating its order routing system off of mainframe to AWS. ...leading providers of solutions to the industry are migrating those applications to AWS. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 11. FS enterprises are using AWS to transform BANKING & PAYMENTS INSURANCECAPITAL MARKETS Capital One
  • 12. “For our market surveillance systems, we are looking at about 40% [savings with AWS], but the real benefits are the business benefits: We can do things that we physically weren’t able to do before, and that is priceless. ” RIGHT NOW: FINRA is using Amazon S3 and EMR to Power Market Surveillance FINRA is the largest independent regulator for all securities firms doing business in the US. FINRA oversees about 4,250 brokerage firms, about 162,155 branch offices and approximately 629,525 registered securities representatives. - Steve Randich, CIO, FINRA What FINRA needed: • Infrastructure for its market surveillance platform • Analysis and storage of approximately 35 billion market events every day • Interactively query multi-petabyte data sets Why they chose AWS: • Fulfillment of FINRA’s security requirements • Ability to create a flexible platform using dynamic clusters (Hadoop, Hive, and HBase), Amazon EMR, and Amazon S3 Benefits realized: • Increased agility, speed, and cost savings • Estimated savings of $20m annually by using AWS © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 13. “Nasdaq has been a user of Amazon Redshift since it was released and we are extremely happy with it. Currently, our system is moving an average of 5.5 billion rows into Amazon Redshift every day.” ” RIGHT NOW: Nasdaq is Using Amazon Redshift to Power Data Analytics Nasdaq is the 2nd largest exchange group in the world by market capitalization. Nasdaq operates one of the world’s largest networks of exchanges, which spans 26 markets, 1 clearing house, and 5 central securities depositories. Its markets trade multiple asset classes including equities, options, futures, fixed-income, commodities, derivatives and structured products. - Nate Sammons, Principal Architect, Nasdaq What Nasdaq needed: • Replacement of on-premise legacy warehouses • Reduction of cost and increase in data capacity Why they chose AWS and Amazon Redshift: • Fulfillment of security and regulatory requirements • Cost efficiencies without sacrificing functionalities Benefits realized: • System that moves an average of 5.5 billion rows into Amazon Redshift every day (with 14 billion on a peak day in Oct of 2014) • Ability to increase accessibility of historic data to a growing number of internal groups © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 14. AWS in Capital Markets Broadridge has launched a technology platform on AWS named Inlet to make it easier for companies to provide millions of consumers access to their most important documents from hundreds of providers in just a few clicks. Broadridge uses Inlet to deliver investment industry content for its financial institution customers. Global Investor Communications Robinhood is a U.S. based financial services company founded in 2013 that runs its entire broker-dealer on AWS. The Robinhood app allows individuals to invest in publicly traded companies and exchange-traded funds listed on U.S. exchanges without paying a commission. $0 Commission Trading Trading Technologies, a leading global provider of a derivatives trading platform to the financial services industry, has built their next-generation trading platform using a hybrid architecture, with its backbone built on AWS spanning all publicly available AWS regions which are connected to co-located infrastructure at global exchanges. Global Trading Solutions This global exchange group has migrated its entire historical data footprint to AWS, as well as an industry-leading messaging application, and a web-based trading platform. Global Exchange Group In order to achieve greater resource scalability, St. James’s Place has migrated 85% of its applications to AWS and expects a full migration by the end of 2016. UK Wealth Management TickerTags uses AWS to maintain a curated taxonomy of over 300,000 tagged products, brands, competitors, topics, affiliated people, places, regulatory threats, etc. Tags serve to bridge and filter immense volumes of unstructured data for market insight. Social Sentiment © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 15. Conclusions Domino & AWS • There is a large population of analysts who are “part time” data scientists, and are not using the optimal technology stack. Collaborative analytical solutions enable them to get up to speed rapidly and help reduce silos • Domino provides easy access to AWS, git, docker containers, and REST API’s for non-software engineers • There is strong momentum for AWS, not only for large firms but small ones as well • While the modular nature of the Python/R ecosystems provide many benefits, one must be cautious of environment, especially package management • Subject matter experts should focus on business logic & model design, let somebody else do the plumbing!

Editor's Notes

  1. AWS serves hundreds of thousands of customers in more than 190 countries. Amazon CloudFront and Amazon Route 53 services are offered at AWS Edge Locations
  2. AWS serves hundreds of thousands of customers in more than 190 countries. Amazon CloudFront and Amazon Route 53 services are offered at AWS Edge Locations
  3. AWS serves hundreds of thousands of customers in more than 190 countries. Amazon CloudFront and Amazon Route 53 services are offered at AWS Edge Locations
  4. AWS serves hundreds of thousands of customers in more than 190 countries. Amazon CloudFront and Amazon Route 53 services are offered at AWS Edge Locations
  5. AWS serves hundreds of thousands of customers in more than 190 countries. Amazon CloudFront and Amazon Route 53 services are offered at AWS Edge Locations
  6. AWS serves hundreds of thousands of customers in more than 190 countries. Amazon CloudFront and Amazon Route 53 services are offered at AWS Edge Locations
  7. AWS serves hundreds of thousands of customers in more than 190 countries. Amazon CloudFront and Amazon Route 53 services are offered at AWS Edge Locations
  8. TALKING POINTS: WE SPEND A LOT OF TIME TALKING TO OUR FSI CUSTOMERS AROUND THE WORLD. OUR CUSTOMERS TELL US: REGULATORY COMPLIANCE CONTINUES TO BE A SIGNIFICANT EXPENSE DRIVER, AS REGULATORY OVERSIGHT CONTINUES TO EXPAND COMPETITION – FROM NEW FINTECH ENTRANTS AND TRADITIONAL PLAYERS – IS AT AN ALL TIME HIGH; FINANCIAL CONSUMERS HAVE MORE CHOICE NOW THAN AT ANY OTHER TIME IN HISTORY SECURITY IS JOB ZERO FOR FSI FIRMS FIRMS ARE SITTING ON PETABYTES OF DATA – EITHER FOR COMPLIANCE PURPOSES OR BECAUSE THEY THINK THAT IF THEY CAN MINE THAT DATA, THEY’LL BE ABLE TO IDENTIFY ACTIONABLE INFORMATION CLOUD IS THE NEW NORMAL RESOURCES ARE SCARCE. AS MORE AND MORE ENTERPRISES MAKE THE MOVE TO THE CLOUD, FINDING THE RIGHT PEOPLE TO HELP YOU DRIVE THIS CHANGE IS IMPORTANT, ESPECIALLY IN LIGHT OF SHRINKING BUDGETS AND DECLINING REVENUES
  9. AWS serves hundreds of thousands of customers in more than 190 countries. Amazon CloudFront and Amazon Route 53 services are offered at AWS Edge Locations