O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.

StackStormを1年間データ基盤で使ってみてぶつかったトラブルとその解決策の共有

474 visualizações

Publicada em

StackStorm Meetup JP #7 https://stackstorm-jp.connpass.com/event/125944/ 発表資料

Publicada em: Tecnologia
  • Seja o primeiro a comentar

StackStormを1年間データ基盤で使ってみてぶつかったトラブルとその解決策の共有

  1. 1. StackStorm 1 / @laclefyoshi / ysaeki@r.recruit.co.jp
  2. 2. : / @laclefyoshi • 2011/04 • 2015/09 • • (FutureOfData; 2016) • Queryable State for Kafka Streams (Apache Kafka Meetup Japan #2; 2016) • Apache Spark ( Geek Night #11; 2016) • (BigData-JAWS #6; 2017) • Apache Kafka 0.11 Exactly Once Semantics (Apache Kafka Meetup Japan #3; 2017) • Apache Kafka 
 (Apache Kafka Meetup Japan #4; 2018) • StackStorm (Tech Night @ Shiodome #8; 2018) • Neptune (BigData-JAWS #13; 2018) 2
  3. 3. StackStorm 1
  4. 4. 1 https://www.slideshare.net/laclefyoshi/stackstorm-99437154 4
  5. 5. 5
  6. 6. logging.conf consoleHandler →journald st2xxx → journald → rsyslogd 6
  7. 7. Timeout 1/2 • 1 • grpc : https://github.com/grpc/grpc/issues/17986 • St2 gsutil • gsutil v1.9.0 St2 ↓ St2 Status = Timeout 7
  8. 8. Timeout 2/2 • 2 • • AM3 logrotate logrotate ↓ St2 Status = Timeout 8
  9. 9. Running ↓ St2 Status = Running • • logrotate etc. st2actionrunner RabbitMQ PostgreSQL for Mistral 
 9
  10. 10. CronTimer • st2ruleengine 
 CronTimer 10
  11. 11. • st2 get … ASCII Python2 : st2 execution get … -d DEBUG st2 execution get … -j JSON CLI st2 execution get … UnicodeEncodeError: 'ascii' codec can't encode characters 11
  12. 12. Web UI • Web UI • React Run Web UI CLI Web UI ↓ 12
  13. 13. 1/2 • 1 stdbuf -o0 
 1 core.remote 
 2 ↓ 2 1 
 KB 10KB 13
  14. 14. 2/2 • pseudo tty SSH • st2common/st2common/runners/paramiko_ssh.py sudo paramiko.channel.Channel.get_pty 370 get_pty 1 core.remote 
 2 ↓ 2 1 
 KB 10KB 14
  15. 15. • St2 React OS • 
 OSS • v2.9 • v3 Python3 • Orquesta Mistral 16

×