How do we solve typical problems on Corezoid project - Denys Lavorov

•Transferir como PPTX, PDF•

1 gostou•503 visualizações

The document discusses how to support large codebases and reduce performance bottlenecks in Corezoid, an open-source distributed system. It suggests breaking large Lua source files into smaller modules and using caching to avoid redundant Redis queries. Recommended books and resources on distributed systems and Erlang programming are also provided.

Tecnologia

How do we solve typical
problems on Corezoid?

36человек
Middleware Inc.
Штаб-квартира Офис разработки
Est. 2014

What is Corezoid?
FUNCTIONS that are
applied to the counters
of time
FUNCTIONS that are
applied to the counters
of objects
FUNCTIONS that are
applied to the custom
counters
COUNTERS of objects
COUNTERS of time
CUSTOM COUNTERS
fn(Сn) Сn
API COREZOID
…{COREZOID}{API}
<code
>
FUNCTION that is
applied to the object
QUEUE that enables
you to store endless
amount
of objects
{Сi}
Ct
ft(Сt
)
{fi(Сi)}
© Patent protected.
Corezoid
is a set of nodes

How to exclude RabbitMQ Performance Bottleneck?

How to support 9,000 LOC?
ip-192-168-1-52:lua_src denis$ ls -la
total 56
drwxr-xr-x 9 denis staff 306 Jun 16 13:44 .
drwxr-xr-x 6 denis staff 204 Jun 20 02:22 ..
-rw-r--r-- 1 denis staff 287 Jun 16 13:44 bind_ref_id_to_task_id.lua
-rw-r--r-- 1 denis staff 407 Jun 16 13:44
bind_task_id_to_locked_task.lua
-rw-r--r-- 1 denis staff 1474 Jun 16 13:44 lock_task_create.lua
-rw-r--r-- 1 denis staff 2285 Jun 16 13:44 lock_task_modify.lua
……..
After

Too Many Function Clauses
Performance x2
Before After

Books
http://christophermeiklejohn.com/
https://lasp-lang.readme.io/docs/overview
https://github.com/lasp-lang/partisan
https://marianoguerra.github.io/little-riak-core-book/
https://github.com/basho/riak_core
https://www.youtube.com/user/ErlangSolutions/playlists?sort=dd&view=1&shelf_id=3
http://ricon.io/archive/
http://alvaro-videla.com/ (talks section google for them in infoq and youtube
https://www.youtube.com/results?search_query=%22alvaro%20videla%22)
https://dotnet.github.io/orleans/ (erlang implementation https://github.com/SpaceTime-IoT/erleans)

Mais conteúdo relacionado

Semelhante a How do we solve typical problems on Corezoid project - Denys Lavorov

Presented by: Aydrian Howard Developer Advocate, MongoDB MongoDB Stitch is a serverless platform designed to help you easily and securely build an application on top of MongoDB Atlas. It lets developers focus on building applications rather than on managing data manipulation code, service integration, or backend infrastructure. MongoDB Stitch also makes it simple to respond to backend changes immediately, allowing you to simplify client side code and build complex flows more easily. This talk will cover ways that MongoDB Stitch helps you respond to changes in your database and take your applications to the next level.

MongoDB.local Austin 2018: Ch-Ch-Ch-Ch-Changes: Taking Your MongoDB Stitch A...

MongoDB

iPhone Workshop Mobile Monday Ahmedabad

momoahmedabad

UBC’s Cloud Innovation Centre (CIC) invites students to our AWS RoboMaker webinar and live lab on Thursday, July 22 from 1:00 to 3:30 pm PST. In this session, special guest Alex Coqueiro, will introduce you to AWS Robomaker, a service that makes it easy to develop, test, and deploy intelligent robotics applications at scale. We walk through the features of integrating key components into robotics, deploying a single solution, and discuss the uniquely designed models that allow for optimized robots use cases to get you to production fast. We will cover use cases, implementation, simulation, and deployment. Demos will be implemented using Python.

Building Your Robot using AWS Robomaker

Alex Barbosa Coqueiro

Hai mai pensato che le tue lambda functions possano fallire senza che tu te ne accorga? Se la risposta é "SI" probabilmente é perché ti sei giá "bruciato" giocando con il cloud, dove errori e fallimenti sono sempre dietro l'angolo. Purtroppo non possiamo prevenire tutti i fallimenti, pero' possiamo essere notificati quando qualcosa va storto cosí da poter reagire tempestivamente. Ma come fare a configurare il nostro ambiente AWS per raggiungere un buon livello di "Observability"? Se hai giá provato ad utilizzare CloudWatch saprai giá quanto possa essere complesso. In questo talk, esploreremo il tema dell'observability per applicazioni Serverless su AWS. Discuteremo problemi e best practices. Infine vi proporró un tool che permette di automatizzare la configurazione di CloudWatch per l'80% delle esigenze in pochi minuti!

Semplificare l'observability per progetti Serverless

Luciano Mammino

DotNet Introduction

Wei Sun

Coding Naked – Practical steps to moving towards & embracing TDD. We'll overview the normal roadblocks that people typically run in to, and practical ways to overcome those road blocks on your way to embracing Test Driven Development - make coding without tests as uncomfortable as coding naked! Code: https://github.com/calebjenkins/Acme.CodingNaked Presenting at events: https://developingux.com/tag/coding-naked/

Coding Naked 2023

Caleb Jenkins

Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData

InfluxData

StrongLoop Overview

Shubhra Kar

Today, organizations are using robotics to address a host of business challenges, from the self-driving car to autonomous walkers to assist older adults, exploring various environments from deep oceans to other planets like Mars. In the past, the integration of these robots took a significant amount of time and effort, and it required specialized expertise in this field. Still, this scenario has dramatically changed thanks to adopting a real-time production system with Linux and the Robot Operating System (ROS). ROS is an open-source software framework for robot development, including middleware, drivers, libraries, tools, and commonly used algorithms for robotics. In this session, we walk the audience through the steps from design to deployment robots using ROS2 Foxy (new version of ROS) from zero to hero using live demo using Python 3 (rclpy) with DDS (Data Distribution Service) simulating real-world environments with Gazebo (open-source 3D robotics simulator). In a nutshell, I will cover designing, developing, testing, and deploying intelligent robotics applications at scale, including integration with critical components, and discuss models that allow for optimized large fleet management.

Building Robotics Application at Scale using OpenSource from Zero to Hero

Alex Barbosa Coqueiro

MongoDB World 2018: Ch-Ch-Ch-Ch-Changes: Taking Your Stitch Application to th...

MongoDB

Watch this Tech Talk: https://do.co/video_dworth Dave Worth, Engineering Manager at Strava, lays out a strategy for choosing the right tech stack depending on your business and team need. Watch as he guides you through tool sets that navigate around business constraints and regulatory concerns. About the Presenter Dave Worth’s professional life consists of being a web and backend engineer who developed specialization in observability through building reliable distributed systems at Strava, and previously DigitalOcean. In his spare time, Dave loves cycling, jiu jitsu, and searching for another great math book to only read the first 50 pages of. New to DigitalOcean? Get US $100 in credit when you sign up: https://do.co/deploytoday To learn more about DigitalOcean: https://www.digitalocean.com/ Follow us on Twitter: https://twitter.com/digitalocean Like us on Facebook: https://www.facebook.com/DigitalOcean Follow us on Instagram: https://www.instagram.com/thedigitalocean/ We're hiring: http://do.co/careers

Building an Observability Platform in 389 Difficult Steps

DigitalOcean

Ravindra sdp

Kingg Ravi

Future of Cloud Starts with Serverless

Antoni Orfin

This session covers our experience with using the Spark and Shark frameworks for running real-time queries on top of Cassandra data.We will start by surveying the current Cassandra analytics landscape, including Hadoop and HIVE, and touch on the use of custom input formats to extract data from Cassandra. We will then dive into Spark and Shark, two memory-based cluster computing frameworks, and how they enable often dramatic improvements in query speed and productivity, over the standard solutions today.

C* Summit 2013: Real-time Analytics using Cassandra, Spark and Shark by Evan ...

DataStax Academy

Building a Stock Prediction system with Machine Learning using Geode, SpringX...

William Markito Oliveira

Rsockets ofa12

trustitrusti

Serving up content on the Internet is something our web sites do daily. But are we doing this in the fastest way possible? How are users in faraway countries experiencing our apps? Why do we have three webservers serving the same content over and over again? In this session, we’ll explore the Azure Content Delivery Network or CDN, a service which makes it easy to serve up blobs, videos and other content from servers close to our users. We’ll explore simple file serving as well as some more advanced, dynamic edge caching scenarios.

Get more than a cache back! The Microsoft Azure Redis Cache (NDC Oslo)

Maarten Balliauw

Sterowniki .NET i C++ dla Apache Cassandra

Cognitum

The MongoDB Spark Connector integrates MongoDB and Apache Spark, providing users with the ability to process data in MongoDB with the massive parallelism of Spark. The connector gives users access to Spark's streaming capabilities, machine learning libraries, and interactive processing through the Spark shell, Dataframes and Datasets. We'll take a tour of the connector with a focus on practical use of the connector, and run a demo using both Spark and MongoDB for data processing.

MongoDB and Spark

Norberto Leite

MongoDB.local Dallas 2019: MongoDB and Spark

MongoDB

Semelhante a How do we solve typical problems on Corezoid project - Denys Lavorov (20)

MongoDB.local Austin 2018: Ch-Ch-Ch-Ch-Changes: Taking Your MongoDB Stitch A...

iPhone Workshop Mobile Monday Ahmedabad

Building Your Robot using AWS Robomaker

Semplificare l'observability per progetti Serverless

DotNet Introduction

Coding Naked 2023

Creating and Using the Flux SQL Datasource | Katy Farmer | InfluxData

StrongLoop Overview

Building Robotics Application at Scale using OpenSource from Zero to Hero

MongoDB World 2018: Ch-Ch-Ch-Ch-Changes: Taking Your Stitch Application to th...

Building an Observability Platform in 389 Difficult Steps

Ravindra sdp

Future of Cloud Starts with Serverless

C* Summit 2013: Real-time Analytics using Cassandra, Spark and Shark by Evan ...

Building a Stock Prediction system with Machine Learning using Geode, SpringX...

Rsockets ofa12

Get more than a cache back! The Microsoft Azure Redis Cache (NDC Oslo)

Sterowniki .NET i C++ dla Apache Cassandra

MongoDB and Spark

MongoDB.local Dallas 2019: MongoDB and Spark

Mais de Elixir Club

Kubernetes + Docker + Elixir - Alexei Sholik, Andrew Dryga Slides of Alexei Sholik, Andrew Dryga, at Lightning Talk session at Elixir Club Ukraine, Kyiv, 28.09.2019 Next conference - http://www.elixirkyiv.club/ Follow us on social networks @ElixirClubUA and #ElixirClubUA Announce and materials from conf - https://www.fb.me/ElixirClubUA News - https://twitter.com/ElixirClubUA Photo and free atmosphere - https://www.instagram.com/ElixirClubUA *Organizer’s channel - https://t.me/incredevly

Kubernetes + Docker + Elixir - Alexei Sholik, Andrew Dryga | Elixir Club Ukraine

Elixir Club

Slides of Eduardo Aguilera, Elixir developer at The Coingaming Group, at Elixir Club Ukraine, Kyiv, 28.09.2019 Next conference - http://www.elixirkyiv.club/ Description of presentation Only a handful of systems can work on their own, and most of the time this external parties are out of your control, this is why how your application communicates with them is crucial for everything to work smoothly. Ecto is an incredibly powerful data validation tool, and in this talk I will show you how we use it to make our integrations consistent, catching any error before the request goes out of your realm. Follow us on social networks @ElixirClubUA and #ElixirClubUA Announce and materials from conf - https://www.fb.me/ElixirClubUA News - https://twitter.com/ElixirClubUA Photo and free atmosphere - https://www.instagram.com/ElixirClubUA *Organizer’s channel - https://t.me/incredevly

Integrating 3rd parties with Ecto - Eduardo Aguilera | Elixir Club Ukraine

Elixir Club

Slides of Oleksandr Khokhlov, Founder at Nots.io, at Elixir Club Ukraine, Kyiv, 28.09.2019 Next conference - http://www.elixirkyiv.club/ Description of presentation Elixir and Erlang platform are all about asynchronous communications. Why don’t we use this feature while rendering templates? In this talk, Oleksandr unveils how we in Nots.io split HTML documents into smaller pieces and render them in parallel. Follow us on social networks @ElixirClubUA and #ElixirClubUA Announce and materials from conf - https://www.fb.me/ElixirClubUA News - https://twitter.com/ElixirClubUA Photo and free atmosphere - https://www.instagram.com/ElixirClubUA *Organizer’s chanel - https://t.me/incredevly

— An async template - Oleksandr Khokhlov | Elixir Club Ukraine

Elixir Club

Slides of Andrea Leopardi, member of the @elixir-lang core team, at Elixir Club Ukraine, Kyiv, 28.09.2019 Next conference - http://www.elixirkyiv.club/ Description of presentation If you are writing a stateless web application backed up by a database, there is a good chance Elixir is a great fit. However, this is not where it shines. In this talk, we will discuss how to architect Elixir applications in order to leverage the features of the language and of its runtime. We will look at this both from a lower level, talking about the architecture of processes inside an Elixir application, as well as from a higher perspective of writing Elixir services and architecting systems to play to Elixir's strengths. We will see practical use cases and discuss design patterns. Follow us on social networks @ElixirClubUA and #ElixirClubUA Announce and materials from conf - https://www.fb.me/ElixirClubUA News - https://twitter.com/ElixirClubUA Photo and free atmosphere - https://www.instagram.com/ElixirClubUA *Organizer’s channel - https://t.me/incredevly

BEAM architecture handbook - Andrea Leopardi | Elixir Club Ukraine

Elixir Club

Slides of Ulisses Almeida, Elixir Developer at The Coingaming Group, at Elixir Club Ukraine, Kyiv, 28.09.2019 Next conference - http://www.elixirkyiv.club/ Description of presentation GenServers plays a central role in Elixir OTP applications. However, when you overuse it, it can become an anti-pattern and introduce bottlenecks in your system. In this talk you'll learn: * What's a GenServer * When GenServer can harm * GenServer FOMO (fear of missing out) * How Elixir ecosystem get you covered After this talk, you'll understand how putting a GenServer in the wrong place can slowdown in your entire system. You'll understand how the Elixir frameworks and libraries enable you to have reliable concurrency applications. You'll feel no shame of being an Elixir developer and never had to write yourself a GenServer. Follow us on social networks @ElixirClubUA and #ElixirClubUA Announce and materials from conf - https://www.fb.me/ElixirClubUA News - https://twitter.com/ElixirClubUA Photo and free atmosphere - https://www.instagram.com/ElixirClubUA *Organizer’s channel - https://t.me/incredevly

You ain't gonna need write a GenServer - Ulisses Almeida | Elixir Club Ukraine

Elixir Club

Доповідь Олександра Хохлова, Founder Nots.io, на Elixir Club 13, Dnipro, 13.04.2019 Наступна конференція - http://www.elixirkyiv.club/ Elixir and Erlang platform are all about asynchronous communications. Why don’t we use this feature while rendering templates? In this talk, Alexander unveils how we in Nots.io split HTML documents into smaller pieces and render them in parallel. Cлідкуйте за нами у соцмережах @ElixirClubUA та #ElixirClubUA Анонси та матеріали конференцій - https://www.fb.me/ElixirClubUA Новини - https://twitter.com/ElixirClubUA Фото та невимушена атмосфера - https://www.instagram.com/ElixirClubUA *Канал організаторів мітапа - https://t.me/incredevly

— Knock, knock — An async templates — Who’s there? - Alexander Khokhlov | ...

Elixir Club

Доповідь Максима Пугача, Team Lead/Software Engineer at LITSLINK, на Elixir Evening Club 3, Kyiv, 13.12.2018 Наступна конференція - http://www.elixirkyiv.club/ A boss of mine once told me "Just see, my poorly written Vert.x app outperforms my poorly written Elixir app". Now it is time to take up the gauntlet. Cлідкуйте за нами у соцмережах @ElixirClubUA та #ElixirClubUA Анонси та матеріали конференцій - https://www.fb.me/ElixirClubUA Новини - https://twitter.com/ElixirClubUA Фото та невимушена атмосфера - https://www.instagram.com/ElixirClubUA *Канал організаторів мітапа - https://t.me/incredevly

Performance measurement methodology — Maksym Pugach | Elixir Evening Club 3

Elixir Club

Доповідь Валерія Василькова, Founder at Digitbay, на Elixir Evening Club 3, Kyiv, 13.12.2018 Наступна конференція - http://www.elixirkyiv.club/ We will talk about Erlang distribution under the hood. Use cases, production usage and maintenance. Cлідкуйте за нами у соцмережах @ElixirClubUA та #ElixirClubUA Анонси та матеріали конференцій - https://www.fb.me/ElixirClubUA Новини - https://twitter.com/ElixirClubUA Фото та невимушена атмосфера - https://www.instagram.com/ElixirClubUA *Канал організаторів мітапа - https://t.me/incredevly

Erlang cluster. How is it? Production experience. — Valerii Vasylkov | Elixi...

Elixir Club

Promo Phx4RailsDevs - Volodya Sveredyuk

Elixir Club

Web of today — Alexander Khokhlov

Elixir Club

ElixirConf Eu 2018, what was it like? – Eugene Pirogov

Elixir Club

Implementing GraphQL API in Elixir – Victor Deryagin

Elixir Club

WebPerformance: Why and How? – Stefan Wintermeyer

Elixir Club

GenServer in Action – Yurii Bodarev

Elixir Club

Russian Doll Paradox: Elixir Web without Phoenix - Alex Rozumii

Elixir Club

Practical Fault Tolerance in Elixir - Alexei Sholik

Elixir Club

Phoenix and beyond: Things we do with Elixir - Alexander Khokhlov

Elixir Club

Monads are just monoids in the category of endofunctors - Ike Kurghinyan

Elixir Club

Craft effective API with GraphQL and Absinthe - Ihor Katkov

Elixir Club

Elixir in a service of government - Alex Troush

Elixir Club

Mais de Elixir Club (20)