SlideShare uma empresa Scribd logo
1 de 25
Baixar para ler offline
SUSE for Hadoop & Big Data 
Stephen Mogg 
SUSE UK 
October 2014
2 
About SUSE 
• Established 1992 
• Original Provider of Enterprise Linux 
About Me 
• SUSE Employee 4 years 
• Systems Engineer
3 
If you want to know more about SUSE 
• New Certifications 
• New Resources 
• New Lab
SUSE for Hadoop
5 
Big Data Reference Architecture 
Operating System OS / Cloud Platform 
Source: Hortonworks Modern Data Architecture - http://hortonworks.com/partner/suse/
6 
SUSE Big Data Reference Architecture 
Source: Hortonworks Modern Data Architecture - http://hortonworks.com/partner/suse/
7 
SUSE Big Data Partners 
Hadoop Data Systems 
Applications Services
8 
Certified for Leading Hadoop Platforms 
Additional level of testing 
and quality assurance to 
make sure SUSE Linux 
Enterprise Server 
integrates with partner 
software, saving our 
customers time while 
providing them with an 
assurance of 
interoperability. 
We hereby declare that 
SUSE Linux Enterprise Server 
is officially certified for: 
Cloudera CDH 5 
Hortonworks HDP2
Market Leadership
10 
SUSE in High Performance 
“Teradata's extensive 
financial, technical, 
and management 
resources can 
create a unique, 
high-performance 
Hadoop appliance 
that few other 
vendors can match.” 
– Forrester Feb 2014 
High Performance Computing 
‒ Half of the world's largest super computer 
clusters run SUSE Linux Enterprise Server 
Mainframe Computing 
‒ Over 80% of all Linux running on mainframe 
computers is SUSE Linux 
SAP Hana 
‒ SUSE Linux Enterprise Server is the 
recommended OS for the market leading 
analytics appliance, SAP HANA. 
Teradata 
‒ SUSE Linux Enterprise Server is the OS 
foundation for Hadoop in the Aster Big Analytics 
Appliance 
IBM Watson 
‒ Power artificial intelligence computer runs SUSE 
Linux and Hadoop
11 
What Makes an Optimal Foundation 
for Hadoop? 
SLAs and 
Business Continuity 
Resource Utilization 
and Efficiency 
Security and 
Compliance 
Affordable, No 
Vendor Lock-in
12 
Power, Scalability 
Reliability, Availability,Serviceability: 
Swap-over NFS 
Built-in open source multi-path IO 
CPU/Memory hot-plugging 
Horizontal/Vertical Scalability: 
Large capacity and faster system 
interconnect (OFED, Infiniband) 
A rock-solid, certified 
foundation for deploying 
Hadoop clusters. 
Huge Data, Massive Compute: 
4096 logical CPU 
64 TiB RAM 
Supports latest Intel CPUs: 
Ivy Bridge v2 
Haswell 
SUSE Linux Enterprise Server
13 
Flexibility, Agility 
Massively Scalable Private 
Cloud Implementations 
Deploy pre-configured 
Hadoop clusters on 
KVM, Xen, Hyper-V, ESXi 
Spin up fully configured and 
optimized Hadoop Cluster in 
minutes for dev/test 
Scale-out Hadoop cluster 
Infrastructure easily 
API for Cloud-aware 
Applications 
SUSE Cloud 
Hadoop in the Cloud: 
OpenStack based 
enterprise ready IaaS Cloud 
Platform.
14 
Improve Resource Utilization and Efficiency 
Batch Command Speeds Up 
Cluster Implementation 
Centralized Server 
Infrastructure Management 
Software and Patch 
Management for Linux and 
Hadoop 
Batch-deploy config files to 
entire Hadoop cluster 
Asset Management 
and Reporting 
Application and 
Infrastructure Monitoring 
SUSE Manager 
A perfect complement 
to the monitoring and 
management capabilities 
provided in the Hadoop 
cluster management 
software.
15 
Security and Certifications 
90% of companies cite data access and data protection as either extremely or very important 
security capabilities. - IDG Big Data Survey 2014 
Security Features SUSE Linux Enterprise Server 
System Hardening YaST2 Security Center 
Application Confinement AppArmor 
System Confinement SE Linux (stack support) 
Intrusion Detection (file system) AIDE 
Fine-grained Access Rights File system POSIX capabilities 
Encryption Capabilities Three ways: Full disk, Volume, Filesystem 
(eCryptFS) 
Certifications Carrier Grade Linux (CGL) 4.0 IPv6 (refresh) 
Measure and Monitor System Integrity During 
Trusted Platform Modules (TPM)—Trusted 
Reboot 
Computing 
System Requirements for Cryptographic Modules FIPS 140-2 Validation for OpenSSL 
Common Criteria for IT Security Evaluation Common Criteria Certification for SP2 
(x86 64 with KVM; IBM System z)
16 
Summary: Key Features and Benefits 
Key Features Benefits 
Reliability, 
Availability, 
Serviceability, 
Scalability 
Swap over NFS Cut cost with less expensive diskless servers 
Kernel 3.0 Enhanced RAS capabilities 
Intel Ivy-Bridge 2 and Haswell Support Harness the latest CPU technologies and provides 
excellent 4096 Logical CPU, 64TiB RAM Support vertical scalability 
InfiniBand, iSCSI Target (LIO) and OFED Faster connectivity with networking and storage equipment 
Dual Hypervisor Support: Xen and KVM 
Cross-platform Maximum choice both as a host and as a guest 
Virtualization 
Optimized for vSphere, Hyper-V, Open 
Source Hypervisors 
Linux Containers Light weight OS level virtualization 
UEFI Secure Boot Less malicious attach risk in boot 
Security and 
Compliance 
FIPS 140-2 Validation and Common 
Criteria Certification Security standard compliance 
AppArmor Protects from external/internal threats and zero-day 
attacks 
Integrated System 
Management 
Snapper and BTRFS Snapshot and rollback for easy management 
YaST, AutoYaST and Zypp Integrated single system management and fast update 
tools 
Interop with 
Other Platforms 
SAMBA 3.6 Compatible with Windows 
IPv6 Compliance Networking with IPv6 equipment
SUSE Big Data Resources
18 
Hadoop on SLES 
Best Practices White Paper: 
• Deployment scenarios 
• Proposed Architecture using SLES 
• Infrastructure considerations 
• Basic optimization of the Linux OS 
• Installation and configuration of Hadoop 
on SLES
19 
SUSE Manager and Hadoop 
Step-by-step guide for using SUSE 
Manager to deploy Cloudera on SLES: 
• Automate OS provisioning 
• Deploy new servers with identical 
characteristics 
• Auto-deployment of RPM-based applications 
• Centralize management of configuration files 
• Connect to SUSE Customer Center for 
updates 
• Create / manage multiple organizations from a 
single remote console. 
• Create customized repositories 
• Maintain the security of enterprise systems 
• Leverage the SUSE Manager API to create 
custom scripts to manage tasks or integrate 
third-party applications and management 
tools
20 
Hadoop / HP Reference Architecture 
HP Reference Architechture: 
• Written by SUSE, HP & Hortonworks, 
• Proposed Architecture using SLES 
• HP Recommends SLES
21 
SUSE Big Data Lab 
Big Data Cluster in USA for: 
• Benchmarking 
• Software certification 
• Integration / test 
• Reference architectures
Learn About: 
Register: 
22 
SUSE Linux Expert Days 
• SUSE and Big Data 
• Towards Zero Uptime with SUSE Tecnology 
• SUSE Linux Enterprise Server 
https://www.suse.com/events/slef-2014/#Liste
23 
Learn More 
Visit our web site 
www.suse.com/solutions/platform.html#big_data 
Read our whitepapers 
Deploying Hadoop on SLES 
Deploy and Manage Hadoop with SUSE Manager 
HP Reference Architecture. 
Contact us 
bigdata@suse.com
24
Unpublished Work of SUSE LLC. All Rights Reserved. 
This work is an unpublished work and contains confidential, proprietary and trade secret information of SUSE LLC. 
Access to this work is restricted to SUSE employees who have a need to know to perform tasks within the scope of 
their assignments. No part of this work may be practiced, performed, copied, distributed, revised, modified, translated, 
abridged, condensed, expanded, collected, or adapted without the prior written consent of SUSE. 
Any use or exploitation of this work without authorization could subject the perpetrator to criminal and civil liability. 
General Disclaimer 
This document is not to be construed as a promise by any participating company to develop, deliver, or market a 
product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making 
purchasing decisions. SUSE makes no representations or warranties with respect to the contents of this document, 
and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The 
development, release, and timing of features or functionality described for SUSE products remains at the sole 
discretion of SUSE. Further, SUSE reserves the right to revise this document and to make changes to its content, at 
any time, without obligation to notify any person or entity of such revisions or changes. All SUSE marks referenced in 
this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All 
third-party trademarks are the property of their respective owners.

Mais conteúdo relacionado

Mais procurados

How Apache Hadoop is Revolutionizing Business Intelligence and Data Analytics...
How Apache Hadoop is Revolutionizing Business Intelligence and Data Analytics...How Apache Hadoop is Revolutionizing Business Intelligence and Data Analytics...
How Apache Hadoop is Revolutionizing Business Intelligence and Data Analytics...
Amr Awadallah
 

Mais procurados (20)

Oracle’s Advanced Analytics & Machine Learning 12.2c New Features & Road Map;...
Oracle’s Advanced Analytics & Machine Learning 12.2c New Features & Road Map;...Oracle’s Advanced Analytics & Machine Learning 12.2c New Features & Road Map;...
Oracle’s Advanced Analytics & Machine Learning 12.2c New Features & Road Map;...
 
MOUG17 Keynote: Oracle OpenWorld Major Announcements
MOUG17 Keynote: Oracle OpenWorld Major AnnouncementsMOUG17 Keynote: Oracle OpenWorld Major Announcements
MOUG17 Keynote: Oracle OpenWorld Major Announcements
 
Hadoop in the Cloud - The what, why and how from the experts
Hadoop in the Cloud - The what, why and how from the expertsHadoop in the Cloud - The what, why and how from the experts
Hadoop in the Cloud - The what, why and how from the experts
 
SQL Server on Linux - march 2017
SQL Server on Linux - march 2017SQL Server on Linux - march 2017
SQL Server on Linux - march 2017
 
Modern Data Warehousing with the Microsoft Analytics Platform System
Modern Data Warehousing with the Microsoft Analytics Platform SystemModern Data Warehousing with the Microsoft Analytics Platform System
Modern Data Warehousing with the Microsoft Analytics Platform System
 
Db2 analytics accelerator on ibm integrated analytics system technical over...
Db2 analytics accelerator on ibm integrated analytics system   technical over...Db2 analytics accelerator on ibm integrated analytics system   technical over...
Db2 analytics accelerator on ibm integrated analytics system technical over...
 
HA/DR options with SQL Server in Azure and hybrid
HA/DR options with SQL Server in Azure and hybridHA/DR options with SQL Server in Azure and hybrid
HA/DR options with SQL Server in Azure and hybrid
 
Meetup Oracle Database MAD: 2.1 Data Management Trends: SQL, NoSQL y Big Data
Meetup Oracle Database MAD: 2.1 Data Management Trends: SQL, NoSQL y Big Data Meetup Oracle Database MAD: 2.1 Data Management Trends: SQL, NoSQL y Big Data
Meetup Oracle Database MAD: 2.1 Data Management Trends: SQL, NoSQL y Big Data
 
Dipping Your Toes: Azure Data Lake for DBAs
Dipping Your Toes: Azure Data Lake for DBAsDipping Your Toes: Azure Data Lake for DBAs
Dipping Your Toes: Azure Data Lake for DBAs
 
How Apache Hadoop is Revolutionizing Business Intelligence and Data Analytics...
How Apache Hadoop is Revolutionizing Business Intelligence and Data Analytics...How Apache Hadoop is Revolutionizing Business Intelligence and Data Analytics...
How Apache Hadoop is Revolutionizing Business Intelligence and Data Analytics...
 
Nordic infrastructure Conference 2017 - SQL Server on Linux Overview
Nordic infrastructure Conference 2017 - SQL Server on Linux OverviewNordic infrastructure Conference 2017 - SQL Server on Linux Overview
Nordic infrastructure Conference 2017 - SQL Server on Linux Overview
 
Big Data in the Cloud - The What, Why and How from the Experts
Big Data in the Cloud - The What, Why and How from the ExpertsBig Data in the Cloud - The What, Why and How from the Experts
Big Data in the Cloud - The What, Why and How from the Experts
 
Dynamic DDL: Adding structure to streaming IoT data on the fly
Dynamic DDL: Adding structure to streaming IoT data on the flyDynamic DDL: Adding structure to streaming IoT data on the fly
Dynamic DDL: Adding structure to streaming IoT data on the fly
 
Implement SQL Server on an Azure VM
Implement SQL Server on an Azure VMImplement SQL Server on an Azure VM
Implement SQL Server on an Azure VM
 
Temporal Tables, Transparent Archiving in DB2 for z/OS and IDAA
Temporal Tables, Transparent Archiving in DB2 for z/OS and IDAATemporal Tables, Transparent Archiving in DB2 for z/OS and IDAA
Temporal Tables, Transparent Archiving in DB2 for z/OS and IDAA
 
Built-In Security for the Cloud
Built-In Security for the CloudBuilt-In Security for the Cloud
Built-In Security for the Cloud
 
Introducing Azure SQL Database
Introducing Azure SQL DatabaseIntroducing Azure SQL Database
Introducing Azure SQL Database
 
Accelerating Big Data Insights
Accelerating Big Data InsightsAccelerating Big Data Insights
Accelerating Big Data Insights
 
Intel and Cloudera: Accelerating Enterprise Big Data Success
Intel and Cloudera: Accelerating Enterprise Big Data SuccessIntel and Cloudera: Accelerating Enterprise Big Data Success
Intel and Cloudera: Accelerating Enterprise Big Data Success
 
Treat your enterprise data lake indigestion: Enterprise ready security and go...
Treat your enterprise data lake indigestion: Enterprise ready security and go...Treat your enterprise data lake indigestion: Enterprise ready security and go...
Treat your enterprise data lake indigestion: Enterprise ready security and go...
 

Destaque

The European Conference on Software Architecture (ECSA) 14 - IBM BigData Refe...
The European Conference on Software Architecture (ECSA) 14 - IBM BigData Refe...The European Conference on Software Architecture (ECSA) 14 - IBM BigData Refe...
The European Conference on Software Architecture (ECSA) 14 - IBM BigData Refe...
Romeo Kienzler
 

Destaque (10)

Case study: Hadoop as ELT for Leading US Retailer - Happiest Minds
Case study: Hadoop as ELT for Leading US Retailer - Happiest MindsCase study: Hadoop as ELT for Leading US Retailer - Happiest Minds
Case study: Hadoop as ELT for Leading US Retailer - Happiest Minds
 
The European Conference on Software Architecture (ECSA) 14 - IBM BigData Refe...
The European Conference on Software Architecture (ECSA) 14 - IBM BigData Refe...The European Conference on Software Architecture (ECSA) 14 - IBM BigData Refe...
The European Conference on Software Architecture (ECSA) 14 - IBM BigData Refe...
 
Realizing the Promise of Big Data with Hadoop - Cloudera Summer Webinar Serie...
Realizing the Promise of Big Data with Hadoop - Cloudera Summer Webinar Serie...Realizing the Promise of Big Data with Hadoop - Cloudera Summer Webinar Serie...
Realizing the Promise of Big Data with Hadoop - Cloudera Summer Webinar Serie...
 
Scaling up with hadoop and banyan at ITRIX-2015, College of Engineering, Guindy
Scaling up with hadoop and banyan at ITRIX-2015, College of Engineering, GuindyScaling up with hadoop and banyan at ITRIX-2015, College of Engineering, Guindy
Scaling up with hadoop and banyan at ITRIX-2015, College of Engineering, Guindy
 
Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...
Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...
Big Data Analytics: Reference Architectures and Case Studies by Serhiy Haziye...
 
Big Data: Introducing BigInsights, IBM's Hadoop- and Spark-based analytical p...
Big Data: Introducing BigInsights, IBM's Hadoop- and Spark-based analytical p...Big Data: Introducing BigInsights, IBM's Hadoop- and Spark-based analytical p...
Big Data: Introducing BigInsights, IBM's Hadoop- and Spark-based analytical p...
 
Big data concepts
Big data conceptsBig data concepts
Big data concepts
 
Big Data Architectural Patterns
Big Data Architectural PatternsBig Data Architectural Patterns
Big Data Architectural Patterns
 
Big Data & Analytics Architecture
Big Data & Analytics ArchitectureBig Data & Analytics Architecture
Big Data & Analytics Architecture
 
Big Data Architecture
Big Data ArchitectureBig Data Architecture
Big Data Architecture
 

Semelhante a SUSE, Hadoop and Big Data Update. Stephen Mogg, SUSE UK

Running SAP on SUSE Cloud 2.0
Running SAP on SUSE Cloud 2.0Running SAP on SUSE Cloud 2.0
Running SAP on SUSE Cloud 2.0
Dirk Oppenkowski
 

Semelhante a SUSE, Hadoop and Big Data Update. Stephen Mogg, SUSE UK (20)

High Performance Computing with SUSE — We adapt. You succeed!
High Performance Computing with SUSE — We adapt. You succeed!High Performance Computing with SUSE — We adapt. You succeed!
High Performance Computing with SUSE — We adapt. You succeed!
 
SUSE: Infraestructura definida por software para BigData
SUSE: Infraestructura definida por software para BigDataSUSE: Infraestructura definida por software para BigData
SUSE: Infraestructura definida por software para BigData
 
SUSE y Big Data
SUSE y Big DataSUSE y Big Data
SUSE y Big Data
 
Productos de SUSE basados en CaaSP
Productos de SUSE basados en CaaSPProductos de SUSE basados en CaaSP
Productos de SUSE basados en CaaSP
 
SUSE Linux Enterprise and SAP NetWeaver 7.30 HA Cluster
SUSE Linux Enterprise and SAP NetWeaver 7.30 HA Cluster SUSE Linux Enterprise and SAP NetWeaver 7.30 HA Cluster
SUSE Linux Enterprise and SAP NetWeaver 7.30 HA Cluster
 
TechEd 2019 SUSE theater session
TechEd  2019   SUSE theater sessionTechEd  2019   SUSE theater session
TechEd 2019 SUSE theater session
 
Presentation SUSE workshop Brussel September 24th 2014
Presentation SUSE workshop Brussel September 24th 2014Presentation SUSE workshop Brussel September 24th 2014
Presentation SUSE workshop Brussel September 24th 2014
 
SUSE: Software Defined Storage
SUSE: Software Defined StorageSUSE: Software Defined Storage
SUSE: Software Defined Storage
 
Bridging IaaS With PaaS To Deliver The Service-Oriented Data Center
Bridging IaaS With PaaS To Deliver The Service-Oriented Data CenterBridging IaaS With PaaS To Deliver The Service-Oriented Data Center
Bridging IaaS With PaaS To Deliver The Service-Oriented Data Center
 
Using Ceph in a Private Cloud - Ceph Day Frankfurt
Using Ceph in a Private Cloud - Ceph Day Frankfurt Using Ceph in a Private Cloud - Ceph Day Frankfurt
Using Ceph in a Private Cloud - Ceph Day Frankfurt
 
SUSE Open Stack Cloud.
SUSE Open Stack Cloud.SUSE Open Stack Cloud.
SUSE Open Stack Cloud.
 
SUSE Expert Days, Brussels and Luxembourg - SUSE + Microsoft Partnership gets...
SUSE Expert Days, Brussels and Luxembourg - SUSE + Microsoft Partnership gets...SUSE Expert Days, Brussels and Luxembourg - SUSE + Microsoft Partnership gets...
SUSE Expert Days, Brussels and Luxembourg - SUSE + Microsoft Partnership gets...
 
SUSE Enterprise Storage - a Gentle Introduction
SUSE Enterprise Storage - a Gentle IntroductionSUSE Enterprise Storage - a Gentle Introduction
SUSE Enterprise Storage - a Gentle Introduction
 
VMworld 2013: Beyond Mission Critical: Virtualizing Big-Data, Hadoop, HPC, Cl...
VMworld 2013: Beyond Mission Critical: Virtualizing Big-Data, Hadoop, HPC, Cl...VMworld 2013: Beyond Mission Critical: Virtualizing Big-Data, Hadoop, HPC, Cl...
VMworld 2013: Beyond Mission Critical: Virtualizing Big-Data, Hadoop, HPC, Cl...
 
Running SAP on SUSE Cloud 2.0
Running SAP on SUSE Cloud 2.0Running SAP on SUSE Cloud 2.0
Running SAP on SUSE Cloud 2.0
 
SUSE Manager for Retail 3.1
SUSE Manager for Retail 3.1SUSE Manager for Retail 3.1
SUSE Manager for Retail 3.1
 
SAP UNIX to Linux
SAP UNIX to LinuxSAP UNIX to Linux
SAP UNIX to Linux
 
SUSE OpenStack Cloud
SUSE OpenStack CloudSUSE OpenStack Cloud
SUSE OpenStack Cloud
 
Uyuni, the movie
Uyuni, the movieUyuni, the movie
Uyuni, the movie
 
Amit Anand - devops
Amit Anand - devopsAmit Anand - devops
Amit Anand - devops
 

Mais de huguk

Mais de huguk (20)

Data Wrangling on Hadoop - Olivier De Garrigues, Trifacta
Data Wrangling on Hadoop - Olivier De Garrigues, TrifactaData Wrangling on Hadoop - Olivier De Garrigues, Trifacta
Data Wrangling on Hadoop - Olivier De Garrigues, Trifacta
 
ether.camp - Hackathon & ether.camp intro
ether.camp - Hackathon & ether.camp introether.camp - Hackathon & ether.camp intro
ether.camp - Hackathon & ether.camp intro
 
Google Cloud Dataproc - Easier, faster, more cost-effective Spark and Hadoop
Google Cloud Dataproc - Easier, faster, more cost-effective Spark and HadoopGoogle Cloud Dataproc - Easier, faster, more cost-effective Spark and Hadoop
Google Cloud Dataproc - Easier, faster, more cost-effective Spark and Hadoop
 
Using Big Data techniques to query and store OpenStreetMap data. Stephen Knox...
Using Big Data techniques to query and store OpenStreetMap data. Stephen Knox...Using Big Data techniques to query and store OpenStreetMap data. Stephen Knox...
Using Big Data techniques to query and store OpenStreetMap data. Stephen Knox...
 
Extracting maximum value from data while protecting consumer privacy. Jason ...
Extracting maximum value from data while protecting consumer privacy.  Jason ...Extracting maximum value from data while protecting consumer privacy.  Jason ...
Extracting maximum value from data while protecting consumer privacy. Jason ...
 
Intelligence Augmented vs Artificial Intelligence. Alex Flamant, IBM Watson
Intelligence Augmented vs Artificial Intelligence. Alex Flamant, IBM WatsonIntelligence Augmented vs Artificial Intelligence. Alex Flamant, IBM Watson
Intelligence Augmented vs Artificial Intelligence. Alex Flamant, IBM Watson
 
Streaming Dataflow with Apache Flink
Streaming Dataflow with Apache Flink Streaming Dataflow with Apache Flink
Streaming Dataflow with Apache Flink
 
Lambda architecture on Spark, Kafka for real-time large scale ML
Lambda architecture on Spark, Kafka for real-time large scale MLLambda architecture on Spark, Kafka for real-time large scale ML
Lambda architecture on Spark, Kafka for real-time large scale ML
 
Today’s reality Hadoop with Spark- How to select the best Data Science approa...
Today’s reality Hadoop with Spark- How to select the best Data Science approa...Today’s reality Hadoop with Spark- How to select the best Data Science approa...
Today’s reality Hadoop with Spark- How to select the best Data Science approa...
 
Jonathon Southam: Venture Capital, Funding & Pitching
Jonathon Southam: Venture Capital, Funding & PitchingJonathon Southam: Venture Capital, Funding & Pitching
Jonathon Southam: Venture Capital, Funding & Pitching
 
Signal Media: Real-Time Media & News Monitoring
Signal Media: Real-Time Media & News MonitoringSignal Media: Real-Time Media & News Monitoring
Signal Media: Real-Time Media & News Monitoring
 
Dean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your StartupDean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your Startup
 
Peter Karney: Intro to the Digital catapult
Peter Karney: Intro to the Digital catapultPeter Karney: Intro to the Digital catapult
Peter Karney: Intro to the Digital catapult
 
Cytora: Real-Time Political Risk Analysis
Cytora:  Real-Time Political Risk AnalysisCytora:  Real-Time Political Risk Analysis
Cytora: Real-Time Political Risk Analysis
 
Cubitic: Predictive Analytics
Cubitic: Predictive AnalyticsCubitic: Predictive Analytics
Cubitic: Predictive Analytics
 
Bird.i: Earth Observation Data Made Social
Bird.i: Earth Observation Data Made SocialBird.i: Earth Observation Data Made Social
Bird.i: Earth Observation Data Made Social
 
Aiseedo: Real Time Machine Intelligence
Aiseedo: Real Time Machine IntelligenceAiseedo: Real Time Machine Intelligence
Aiseedo: Real Time Machine Intelligence
 
Secrets of Spark's success - Deenar Toraskar, Think Reactive
Secrets of Spark's success - Deenar Toraskar, Think Reactive Secrets of Spark's success - Deenar Toraskar, Think Reactive
Secrets of Spark's success - Deenar Toraskar, Think Reactive
 
TV Marketing and big data: cat and dog or thick as thieves? Krzysztof Osiewal...
TV Marketing and big data: cat and dog or thick as thieves? Krzysztof Osiewal...TV Marketing and big data: cat and dog or thick as thieves? Krzysztof Osiewal...
TV Marketing and big data: cat and dog or thick as thieves? Krzysztof Osiewal...
 
Hadoop - Looking to the Future By Arun Murthy
Hadoop - Looking to the Future By Arun MurthyHadoop - Looking to the Future By Arun Murthy
Hadoop - Looking to the Future By Arun Murthy
 

Último

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Último (20)

Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 

SUSE, Hadoop and Big Data Update. Stephen Mogg, SUSE UK

  • 1. SUSE for Hadoop & Big Data Stephen Mogg SUSE UK October 2014
  • 2. 2 About SUSE • Established 1992 • Original Provider of Enterprise Linux About Me • SUSE Employee 4 years • Systems Engineer
  • 3. 3 If you want to know more about SUSE • New Certifications • New Resources • New Lab
  • 5. 5 Big Data Reference Architecture Operating System OS / Cloud Platform Source: Hortonworks Modern Data Architecture - http://hortonworks.com/partner/suse/
  • 6. 6 SUSE Big Data Reference Architecture Source: Hortonworks Modern Data Architecture - http://hortonworks.com/partner/suse/
  • 7. 7 SUSE Big Data Partners Hadoop Data Systems Applications Services
  • 8. 8 Certified for Leading Hadoop Platforms Additional level of testing and quality assurance to make sure SUSE Linux Enterprise Server integrates with partner software, saving our customers time while providing them with an assurance of interoperability. We hereby declare that SUSE Linux Enterprise Server is officially certified for: Cloudera CDH 5 Hortonworks HDP2
  • 10. 10 SUSE in High Performance “Teradata's extensive financial, technical, and management resources can create a unique, high-performance Hadoop appliance that few other vendors can match.” – Forrester Feb 2014 High Performance Computing ‒ Half of the world's largest super computer clusters run SUSE Linux Enterprise Server Mainframe Computing ‒ Over 80% of all Linux running on mainframe computers is SUSE Linux SAP Hana ‒ SUSE Linux Enterprise Server is the recommended OS for the market leading analytics appliance, SAP HANA. Teradata ‒ SUSE Linux Enterprise Server is the OS foundation for Hadoop in the Aster Big Analytics Appliance IBM Watson ‒ Power artificial intelligence computer runs SUSE Linux and Hadoop
  • 11. 11 What Makes an Optimal Foundation for Hadoop? SLAs and Business Continuity Resource Utilization and Efficiency Security and Compliance Affordable, No Vendor Lock-in
  • 12. 12 Power, Scalability Reliability, Availability,Serviceability: Swap-over NFS Built-in open source multi-path IO CPU/Memory hot-plugging Horizontal/Vertical Scalability: Large capacity and faster system interconnect (OFED, Infiniband) A rock-solid, certified foundation for deploying Hadoop clusters. Huge Data, Massive Compute: 4096 logical CPU 64 TiB RAM Supports latest Intel CPUs: Ivy Bridge v2 Haswell SUSE Linux Enterprise Server
  • 13. 13 Flexibility, Agility Massively Scalable Private Cloud Implementations Deploy pre-configured Hadoop clusters on KVM, Xen, Hyper-V, ESXi Spin up fully configured and optimized Hadoop Cluster in minutes for dev/test Scale-out Hadoop cluster Infrastructure easily API for Cloud-aware Applications SUSE Cloud Hadoop in the Cloud: OpenStack based enterprise ready IaaS Cloud Platform.
  • 14. 14 Improve Resource Utilization and Efficiency Batch Command Speeds Up Cluster Implementation Centralized Server Infrastructure Management Software and Patch Management for Linux and Hadoop Batch-deploy config files to entire Hadoop cluster Asset Management and Reporting Application and Infrastructure Monitoring SUSE Manager A perfect complement to the monitoring and management capabilities provided in the Hadoop cluster management software.
  • 15. 15 Security and Certifications 90% of companies cite data access and data protection as either extremely or very important security capabilities. - IDG Big Data Survey 2014 Security Features SUSE Linux Enterprise Server System Hardening YaST2 Security Center Application Confinement AppArmor System Confinement SE Linux (stack support) Intrusion Detection (file system) AIDE Fine-grained Access Rights File system POSIX capabilities Encryption Capabilities Three ways: Full disk, Volume, Filesystem (eCryptFS) Certifications Carrier Grade Linux (CGL) 4.0 IPv6 (refresh) Measure and Monitor System Integrity During Trusted Platform Modules (TPM)—Trusted Reboot Computing System Requirements for Cryptographic Modules FIPS 140-2 Validation for OpenSSL Common Criteria for IT Security Evaluation Common Criteria Certification for SP2 (x86 64 with KVM; IBM System z)
  • 16. 16 Summary: Key Features and Benefits Key Features Benefits Reliability, Availability, Serviceability, Scalability Swap over NFS Cut cost with less expensive diskless servers Kernel 3.0 Enhanced RAS capabilities Intel Ivy-Bridge 2 and Haswell Support Harness the latest CPU technologies and provides excellent 4096 Logical CPU, 64TiB RAM Support vertical scalability InfiniBand, iSCSI Target (LIO) and OFED Faster connectivity with networking and storage equipment Dual Hypervisor Support: Xen and KVM Cross-platform Maximum choice both as a host and as a guest Virtualization Optimized for vSphere, Hyper-V, Open Source Hypervisors Linux Containers Light weight OS level virtualization UEFI Secure Boot Less malicious attach risk in boot Security and Compliance FIPS 140-2 Validation and Common Criteria Certification Security standard compliance AppArmor Protects from external/internal threats and zero-day attacks Integrated System Management Snapper and BTRFS Snapshot and rollback for easy management YaST, AutoYaST and Zypp Integrated single system management and fast update tools Interop with Other Platforms SAMBA 3.6 Compatible with Windows IPv6 Compliance Networking with IPv6 equipment
  • 17. SUSE Big Data Resources
  • 18. 18 Hadoop on SLES Best Practices White Paper: • Deployment scenarios • Proposed Architecture using SLES • Infrastructure considerations • Basic optimization of the Linux OS • Installation and configuration of Hadoop on SLES
  • 19. 19 SUSE Manager and Hadoop Step-by-step guide for using SUSE Manager to deploy Cloudera on SLES: • Automate OS provisioning • Deploy new servers with identical characteristics • Auto-deployment of RPM-based applications • Centralize management of configuration files • Connect to SUSE Customer Center for updates • Create / manage multiple organizations from a single remote console. • Create customized repositories • Maintain the security of enterprise systems • Leverage the SUSE Manager API to create custom scripts to manage tasks or integrate third-party applications and management tools
  • 20. 20 Hadoop / HP Reference Architecture HP Reference Architechture: • Written by SUSE, HP & Hortonworks, • Proposed Architecture using SLES • HP Recommends SLES
  • 21. 21 SUSE Big Data Lab Big Data Cluster in USA for: • Benchmarking • Software certification • Integration / test • Reference architectures
  • 22. Learn About: Register: 22 SUSE Linux Expert Days • SUSE and Big Data • Towards Zero Uptime with SUSE Tecnology • SUSE Linux Enterprise Server https://www.suse.com/events/slef-2014/#Liste
  • 23. 23 Learn More Visit our web site www.suse.com/solutions/platform.html#big_data Read our whitepapers Deploying Hadoop on SLES Deploy and Manage Hadoop with SUSE Manager HP Reference Architecture. Contact us bigdata@suse.com
  • 24. 24
  • 25. Unpublished Work of SUSE LLC. All Rights Reserved. This work is an unpublished work and contains confidential, proprietary and trade secret information of SUSE LLC. Access to this work is restricted to SUSE employees who have a need to know to perform tasks within the scope of their assignments. No part of this work may be practiced, performed, copied, distributed, revised, modified, translated, abridged, condensed, expanded, collected, or adapted without the prior written consent of SUSE. Any use or exploitation of this work without authorization could subject the perpetrator to criminal and civil liability. General Disclaimer This document is not to be construed as a promise by any participating company to develop, deliver, or market a product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. SUSE makes no representations or warranties with respect to the contents of this document, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The development, release, and timing of features or functionality described for SUSE products remains at the sole discretion of SUSE. Further, SUSE reserves the right to revise this document and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. All SUSE marks referenced in this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All third-party trademarks are the property of their respective owners.