O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.

Introduction of k8s-cluster-simulator

Yahoo! JAPAN MEETUP #32 / Kubernetes Meetup Tokyo #19にてk8s-cluster-simulatorを紹介しました。

  • Seja o primeiro a comentar

Introduction of k8s-cluster-simulator

  1. 1. Introduction of k8s-cluster-simulator: A simulator for evaluating Kubernetes schedulers Daisuke Taniwaki, Engineer Preferred Networks, Inc. 2019/5/31 Yahoo! JAPAN MEETUP #32
  2. 2. Self Introduction 谷脇 大輔 (Daisuke Taniwaki) 職歴 2008~2012 Trend Micro - Developed a web crawler which looked for undiscovered threats 2012~2014 Kakaku.com - Launched Tabelog US web service 2014~2017 Kaizen Platform - Developed Kaizen Optimization Platform 2017~Present Preferred Networks - Developing tools and systems for GPU clusters 技術領域 dtaniwaki dtaniwaki 2
  3. 3. The GPU Cluster of Preferred Networks Preferred Networks builds MN-2, a state-of-the-art supercomputer powered with NVIDIA GPUs: https://www.preferred-networks.jp/en/news/pr20190318
  4. 4. Our Custom Pod Scheduler - Concerns for Our Scheduler - Resource usage efficiency - Job priorities - User fairness Icons by Noto Emoji Smileys Icons by Google http://www.iconarchive.com/show/noto-emoji-smileys-icons-by-google.html - We should not change the scheduling algorithm so often. - Testing new scheduling algorithm in the production environment is risky.
  5. 5. k8s-cluster-simulator https://github.com/pfnet-research/k8s-cluster-simulator Shingo Omura Daisuke TaniwakiHidehito Yabuuchi
  6. 6. Architecture
  7. 7. High-level Class Diagram Design user behaviors flexibly. Test your scheduler w/ minor modifications.
  8. 8. Blog post: https://preferredresearch.jp/2019/04/11/k8s-cluster-simulator-release/
  9. 9. Develop a great scheduler for ML jobs! Hopefully with us!