More Related Content
Similar to Deep Learning On Apache Spark (20)
Deep Learning On Apache Spark
- 9. 9 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Deep Learning on Apache Spark
Apache Spark上で動作するDeep Learningフレームワークの代表的な選択肢
à CaffeOnSpark
– CaffeのSpark拡張
– Yahoo! Inc.によって主に開発が進められているオープン
ソースプロジェクト。
– 既存のSparkのコード資産やワークフロー資産を強調。
citaHon: hJp://yahoohadoop.tumblr.com/post/139916563586/caffeonspark-open-sourced-for-distributed-deep
- 17. 17 © Hortonworks Inc. 2011 – 2016. All Rights Reserved
Deep Learning on Apache Spark on Hortonworks Data Platform
Hortonworks Data Platform 2.5
GOVERNANCE OPERATION
S
BATCH, INTERACTIVE & REAL-TIME DATA ACCESS
YARN: Data OperaIng System
(Cluster Resource Management)
Map
Reduce
Apache Falcon
Apache Sqoop
Apache Flume
Apache Ka^a
Apache
Hive
Apache
Pig
Apache
HBase
Apache
Accumulo
Apache
Solr
Apache
Spark
Apache
Storm
1 • • • • • • • • • • •
• • • • • • • • • • • •
HDFS
(Hadoop Distributed File System)
Apache
Ambari
Apache
ZooKeeper
Apache Oozie
Deployment Choice
Linux Windows On-
premises
Cloud
Apache Atlas
Cloudbreak
SECURITY
Apache
Ranger
Apache Knox
Apache Atlas
HDFS
EncrypHon
ISV
Engines
→ 周辺部の⼿間はプラットフォームに任せ
DLアプリケーションの開発にリソースを集中できる!