Devoxx 2016 Using Jenkins, Gerrit and Spark for Continuous Delivery Analytics

•Transferir como PPTX, PDF•

2 gostaram•1,256 visualizações

Our journey and experience in dealing with the collection/analysis of Continuous Delivery log events using Gerrit Code Review, Jenkins with Apache Flume, ElasticSearch, Kibana and Spark

Tecnologia

@gitenterprise#DevoxxPL
Platinum Sponsors:
Speed-up your Continuous Delivery
with BigData
Luca Milanesio
GerritForge

@gitenterprise#DevoxxPL
• Founded in the UK
• HQ in London, Offices in
the UK and Italy
• Committed to
OpenSource
About GerritForge

@gitenterprise#DevoxxPL
• Co-founder and
Director of GerritForge
• over 20 years in Agile
Development and ALM
• Contributor to many
OpenSource projects
• Mind and hands of
@gitenterprise and
@gerritreview
About Luca Milanesio

@gitenterprise#DevoxxPL
NOT a lecture on Continuous Delivery
NOT a lecture on Code Review
NOT a lecture on BigData
What NOT to expect?

@gitenterprise#DevoxxPL
SHOW
a scenario of Continuous Delivery

@gitenterprise#DevoxxPL
LEARN
together about the problems

@gitenterprise#DevoxxPL
EXPERIMENT
my approach leveraging BigData

@gitenterprise#DevoxxPL
DISCUSS
and evolve the approach together

@gitenterprise#DevoxxPL
Continuous Delivery Pipeline
Push Build
Unit Tests
Push Build
Unit Tests
Automated
Tests
Push Build
Unit Tests
Automated
Tests
Beta Users
Tests
User's feedback Publish to all Users
Failed
Failed

@gitenterprise#DevoxxPL
Code Review & CD Validation
A1
refs/for/master
master
C2 C2*
A1 C2 (local)
master
C2*
push
Verified: -1
(build failed)
push
Verified: +1
(build OK)
Reviewed: +2
CI Build: OK
C2*
CI Build: OK
amend

@gitenterprise#DevoxxPL
Git/Gerrit
(Code Review)
Jenkins
(Continuous
Integration & Delivery)
Docker
(Release and Service
Packaging)
Mesos &
Marathon
(Delivery and Resource
Manangement)
Components

@gitenterprise#DevoxxPL
DEMO
See the pipeline in action

@gitenterprise#DevoxxPL
We use micro-services
• 100+ Components
• 200+ Repositories
• 300+ People and 100,000+ of review comments
• Cross-components [implicit] dependencies
• Lots of build chains
• 10,000+ of builds
Now feel the pain :-(

@gitenterprise#DevoxxPL
"It was working until 5
mins ago … then
someone changed
something"
 Rings any
bell?
Problem #1 : Ripple effect

@gitenterprise#DevoxxPL
In order to deliver Feature ABC
I NEED
Ver. N of Service-A with
Ver. M of Service-B and
Ver. K of Service C
Problem #2 : Dependencies

@gitenterprise#DevoxxPL
"Where can I find an environment
to
run ALL my Micro-Services
integration tests?"
Problem #3 : Resources

@gitenterprise#DevoxxPL
Release small changes is GOOD
Release often every change is GOOD
BUT
How long it takes the "Big Picture" and End-to-End?
Where is my bottleneck?
Problem #4 : Cycle time

@gitenterprise#DevoxxPL
Micro-Services are
distributed
Builds are distributed
Deployments are
distributed
 Tackling THIS
have you ever felt
like drowning in
your logs?
Problem #5 : Lots of logs

@gitenterprise#DevoxxPL
Problems #1 + #2 + #3 + #4 + #5 =
lead to your daily
Micro-Services mental meltdown
Problem #6 : all together

@gitenterprise#DevoxxPL
• Collect all review events
• Collect all logs
• Channel them to a
central store
• Crunch and Crunch
continuously
• Never delete
• Process, inspect and
learn
BigData to the rescue

@gitenterprise#DevoxxPL
DEMO
Continuous Delivery Analytics

@gitenterprise#DevoxxPL
•Problem #1 – Ripple effect?
•Problem #2 – Dependencies?
•Problem #3 – Resources?
•Problem #4 – Cycle Time?
•Problem #5 – Logs aggregation?
•Problem #6 – Avoid mental meltdown?
Did we solve the problems?

@gitenterprise#DevoxxPL
• Collect more data (System, JVM, Review
scores)
• Real-time statistics
• Events correlation
• Feedback loop to Code-Review
• Production data harvest
• More?
Future directions

@gitenterprise#DevoxxPL
• My blog
www.gitenterprise.me
• Gerrit Code Review
www.gerritcodereview.co
m
• Jenkins
www.jenkins.io
• RabbitMQ
rabbitmq.com
• Apache Flume
flume.apache.org
• Hadoop HDFS
hadoop.apache.org
• Apache Spark
spark.apache.org
• Kibana
github.com/elastic/kibana
Resources

Mais conteúdo relacionado

Mais procurados

Flex and .NET Integration

icaraion

Occ iware docker-connector-demo-june-2015

Fawaz Fernand PARAISO

Dev01 - Don't Reinvent the Wheel

Christian Güdemann

Build your own PaaS using Kubernetes and Deis — GDG DevFest NL

Jeroen Visser

It's all about feedback - code review as a great tool in the agile toolbox

Stefan Lay

Presented at Open Source 101 2022 Presented by Milana Cap, XWP Abstract: Your code can be all rainbows and unicorns, cutting and shining, but if there’s no documentation, does it even exist? Documentation can make or break your open source project. Don’t believe me? Let me tell you a story or three about writing and managing documentation for the largest open source CMS community. The WordPress documentation.

Docs or it didn’t happen

All Things Open

Ti weekopenshift

Axway Appcelerator

Github, Travis-CI and Perl

Dave Cross

Git Branching for Agile Teams

Atlassian

Slides from OpenSource101.com Talk (https://opensource101.com/sessions/wtf-is-gitops-why-should-you-care/) If you’re interested in learning more about Cloud Native Computing or are already in the Kubernetes community you may have heard the term GitOps. It’s become a bit of a buzzword, but it’s so much more! The benefits of GitOps are real – they bring you security, reliability, velocity and more! And the project that started it all was Flux – a CNCF Incubating project developed and later donated by Weaveworks (the GitOps company who coined the term). Pinky will share from personal experience why GitOps has been an essential part of achieving a best-in-class delivery and platform team. Pinky will give a brief overview of definitions, CNCF-based principles, and Flux’s capabilities: multi-tenancy, multi-cluster, (multi-everything!), for apps and infra, and more. Pinky will cover a little of Flux’s microservices architecture and how the various components deliver this robust, secure, and trusted open source solution. Through the components of the Flux project, users today are enjoying compatibility with Helm, Jenkins, Terraform, Prometheus, and more as well as with cloud providers such as AWS, Azure, Google Cloud, and more. Join us for this informative session and get all of your GitOps questions answered by an end user in the community! Speaker: Priyanka (aka “Pinky”) is a Developer Experience Engineer at Weaveworks. She has worked on a multitude of topics including front end development, UI automation for testing and API development. Previously she was a software developer at State Farm where she was on the delivery engineering team working on GitOps enablement. She was instrumental in the multi-tenancy migration to utilize Flux for an internal Kubernetes offering. Outside of work, Priyanka enjoys hanging out with her husband and two rescue dogs as well as traveling around the globe.

WTF is GitOps and Why You Should Care?

Weaveworks

OpenTuesday: Agile Testautomatisierung und Continuous Integration

Digicomp Academy AG

Github copilot

ssuser30b5d4

Moving to Git opens up a whole new level of agility for software teams. Freed from the clunky code freezes and monolithic mega-merges that plague centralized version control, developers can isolate work in progress and build in narrow vertical slices with ease. Branching is so painless with Git that many teams are making new branches for each user story or bug fix they implement. This model is quickly becoming the new gold standard for agile teams – and for good reason!

Git Branching for Agile Teams

Sven Peters

Intro to git and git hub

JasleenSondhi

After the grant success of the C-level event "I/O: Intelligent Outsourcing", Bridge Global is conducting a free webinar under BEAM (Bridge Events And Meets) on September 6th, 2017. We designed this webinar as a must-attend event for those who are looking for a kick-start moment to lead their organization into the DevOps environment. It attracted several attendees from all parts of the world. They all sat back and learned valuable insights on DevOps culture and practices. People are tired of hearing the countless amount of suggestions and opinions while contemplating to start their DevOps journey. This webinar helped its attendees in getting rid of all kinds of apprehensions related to the topic. Topics Covered DevOps vs. Traditional Approach. Addressing the Delivery Challenges. Why Continuous Integration and Continuous Delivery is so relevant? DevOps vs Release Management. Best Practices.

Practical DevOps & Continuous Delivery – A Webinar to learn in depth on DevO...

Hugo Messer

Git is not just a version control system. Git can change the way you interact with your team members. Lot’s of teams don’t think about reflecting their development workflow in Git and just use it out-of-the-box. Git, however, can be much more powerful, giving your team a boost in productivity, protecting your delivery pipeline and helping you to work better together. In this session we will start with a central workflow that is used by a lot of Subversion teams. You will learn how to practically integrate ALM solutions like continuous deployment, code reviews, change tracking and much more into your individual workflow. You will find out how to protect your master branch from accidental commits, broken builds and unreviewed code. This presentation will help you discover the best way to work together as a team – whether you’re yet to migrate to Git or even an experienced Git user.

Git with t for teams

Sven Peters

GitLab Frontend and VueJS at GitLab

Fatih Acet

Automating Code Reviews for Salesforce Apps

Lorenzo Frattini

EGit and Gerrit Code Review - Eclipse DemoCamp Bonn - 2010-11-16

msohn

Nuance Communications is making the move from SVN to Git! Why? To take advantage of its strong branching and merging capabilities... and to keep their developers happy. With wild variations between each product's release model, they have multiple releases of one or more components in play at a given time. So they had to get creative with a branching model. This talk will discuss choosing the right Git branching model for each of your release streams, and managing multiple releases using Bitbucket (including Stash), JIRA, Bamboo, and Maven.

Creative Branching Models for Multiple Release Streams

Atlassian

Mais procurados (20)

Flex and .NET Integration

Occ iware docker-connector-demo-june-2015

Dev01 - Don't Reinvent the Wheel

Build your own PaaS using Kubernetes and Deis — GDG DevFest NL

It's all about feedback - code review as a great tool in the agile toolbox

Docs or it didn’t happen

Ti weekopenshift

Github, Travis-CI and Perl

Git Branching for Agile Teams

WTF is GitOps and Why You Should Care?

OpenTuesday: Agile Testautomatisierung und Continuous Integration

Github copilot

Git Branching for Agile Teams

Intro to git and git hub

Practical DevOps & Continuous Delivery – A Webinar to learn in depth on DevO...

Git with t for teams

GitLab Frontend and VueJS at GitLab

Automating Code Reviews for Salesforce Apps

EGit and Gerrit Code Review - Eclipse DemoCamp Bonn - 2010-11-16

Creative Branching Models for Multiple Release Streams

Destaque

Gerrit Code Review Analytics

Luca Milanesio

Gerrit Code Review: how to script a plugin with Scala and Groovy

Luca Milanesio

SmartPhones have revolutionised the way we think and write software: software development on Mobile has and need to be agile ... but how can you make one step further and have actually your SmartPhone to drive your development ? Can Mobile App development and Continuous Delivery be pushed to the edges? See how you can follow every step of your development with your SmartPhone end-to-end: Continuous Integration Continuous Delivery Install Test execution Issue tracking

Mobile Application Lifecycle with Jekins, Trello and CollabNet TeamForge

Luca Milanesio

Git workshop 33degree 2011 krakow

Luca Milanesio

GerritHub.io - present, past, future

Luca Milanesio

GitBlit plugin for Gerrit Code Review

Luca Milanesio

Jenkins

Roger Xia

Synchronizing parallel delivery flows in jenkins using groovy, build flow and...

Andrey Devyatkin

Hadoop Summit 2013 : Continuous Integration on top of hadoop

Wisely chen

Cloud Computing And Salesforce

Abhishek Chikane

Groovy Maven Builds

Evgeny Goldin

Ant, Maven and Jenkins

Kenu, GwangNam Heo

Gerrit is Getting Native with RPM, Deb and Docker

Luca Milanesio

Basics of cloud computing & salesforce.com

Deepu S Nath

Jenkins User Conference - Continuous Delivery on Mobile

Luca Milanesio

Continuous Integration for Spark Apps by Sean McIntyre

Spark Summit

Gerrit Code Review with GitHub plugin

Luca Milanesio

Gerrit Code Review

Luca Milanesio

State of the Jenkins Automation

Julien Pivotto

Destaque (19)

Gerrit Code Review Analytics

Gerrit Code Review: how to script a plugin with Scala and Groovy

Mobile Application Lifecycle with Jekins, Trello and CollabNet TeamForge

Git workshop 33degree 2011 krakow

GerritHub.io - present, past, future

GitBlit plugin for Gerrit Code Review

Jenkins

Synchronizing parallel delivery flows in jenkins using groovy, build flow and...

Hadoop Summit 2013 : Continuous Integration on top of hadoop

Cloud Computing And Salesforce

Groovy Maven Builds

Ant, Maven and Jenkins

Gerrit is Getting Native with RPM, Deb and Docker

Basics of cloud computing & salesforce.com

Jenkins User Conference - Continuous Delivery on Mobile

Continuous Integration for Spark Apps by Sean McIntyre

Gerrit Code Review with GitHub plugin

Gerrit Code Review

State of the Jenkins Automation

Semelhante a Devoxx 2016 Using Jenkins, Gerrit and Spark for Continuous Delivery Analytics

BrainQuest-DevOps

Eric Phan

DevOpsGuys FutureDecoded 2016 - is DevOps the Answer

DevOpsGroup

Microservices has been buzzword in the last years in software engineering. It helps to solve issues we had with monolith applications, however it also brings new challenges. Eclipse MicroProfile provides a time to market set of specifications and tools addressing these many challenges. Jean-Louis will be looking on how to use these spec implementations in practice throughout this presentation and show step-by-step examples on how to add monitoring with MP Health and with MP Metrics, security with MP JWT, custom configuration with MP Config, and also teach how to easily provide documentation with MP OpenAPI and much more. Lightweight will be achieved by deploying and running Docker on raspberry PIs.

Dublin JUG Lightweight Microservices with Microprofile and Raspberry PIs

Jean-Louis MONTEIRO

Moving to a DevOps mode - easy, hard or just plain terrifying? - Daniel Bryan...

JAXLondon2014

DevOps - is it for you? Heard about the wonderful ways it could benefit your organisation, but put off by the scary stories? Can you really make the transition to DevOps, and is it worth it? Listen and learn from two DevOps practitioners about their hands-on experiences in making the change. Covering a range of real life examples, this talk will explain the real business benefits to be had from using DevOps techniques, as well as the technical and personal aspects involved. Whether it’s a small team within a startup or one of hundreds within a large organisation, this talk has practical advice on how to approach the challenge, what critical changes need to be considered, and what tools and processes are best suited for the situation. The adoption of DevOps is a game changing event for the industry. Learn why and learn how you can benefit from it too. This talk was presented with Steve Poole (@spoole167) at JAX London, October 2014

JAX London 2014 "Moving to DevOps Mode: easy, hard or just plain terrifying?"

Daniel Bryant

DevOpsGuys - Getting Started with DevOps - Github/Azure Webinar

DevOpsGroup

AgileLIVE Webinar: Build a DevOps Culture & Infrastructure for Success Part 1

VersionOne

What is devops

Aaron Blythe

Many Java-based organizations adopt cloud native development practices with the goal of shipping features faster. The technologies and architectures may change when we move to the cloud, but the fact remains that we all still add the occasional bug to our code. The challenge here is that many of your existing local debugging tools and practices can't be used when everything is running in a container or deployed onto Kubernetes running in the cloud. This is where the open source Telepresence tool can help. Join me to learn about: - The challenges with scaling Kubernetes-based Java development i.e. you can only run so many microservices locally before minikube melts your laptop - An exploration of how Telepresence can "intercept" or reroute traffic from a specified service in a remote K8s cluster to your local dev machine - The benefits of getting a "hot reload" fast feedback loop between applications being developed locally and apps running in the remote environment - A tour of Telepresence, from the sidecar proxy deployed into the remote K8s cluster to the CLI - An overview of using "preview URLs" and header-based routing for the sharing, collaboration, and isolation of changes you are making on your local copy of an intercepted service

LJC 4/21"Easy Debugging of Java Microservices Running on Kubernetes with Tele...

Daniel Bryant

Achieving continuous testing is a daunting task for many test teams still struggling with combining agile, test automation, and increased speed. We know that change is rarely easy. Fixing or getting rid of some practices is tough. However, one-step-at-a-time change can take you far and fast. To jumpstart your team, Michael Hackett shares learnings from four LogiGear clients in various stages of continuous integration, continuous testing, and continuous delivery. Failures in one organization ranged from naively thinking that automating every manual script was a good thing to misusing agile principles; this team needed an overhaul. Michael began with better test design, got rid of old style automation, and defined four sets of automated suites for different purposes, environments, and execution times. Very quickly the test team was contributing faster and providing more useful feedback to the whole development team. Join Michael and get moving to higher levels of continuous testing.

Continuous Testing in DevOps

TechWell

"Stop Caring about Kubernetes" is a humorous talk about how Kubernetes is an important technology for managing containerized applications, but it should be abstracted to the level of an operating system, making it transparent and easy for application teams to deploy their applications without needing deep knowledge of Kubernetes. The talk will discuss the benefits of using Kubernetes in this way, such as improved efficiency and scalability, and will also introduce tools and best practices for achieving this level of abstraction. The goal of the talk is to empower application teams to focus on what they do best, developing and deploying their applications while leaving the management of the underlying infrastructure to Kubernetes.

Stop Caring About Kubernetes

David Lewis

Slides from Jesper Ottosen's 2017 Fall OnlineTestConf session – Shifting is more than shift left. Change is happening to the testing activities. Shift-left automates and codifies the testing activities. Shift-right does it for production. This session was about a couple of other trends, changes, and shifts that are happening to testers and test managers. – Shift-Coach, where It’s more about coaching teams. – Shift-SME, where it’s more about business savvy. – Shift-Deliver, where it’s more about the road to production www.onlinetestconf.com

Shifting is more than shifting left

PractiTest

Microservices

PT.JUG

Nitobi/PhoneGap at Bootup 2011

Brian LeRoux

Like a lot of online businesses today, PrepSportswear’s success is 100% dependent on the availability, scalability and performance of their digital online services. If the website is down, the business stops. They knew they had to transform their business from that of a retailer with a website to a high caliber IT company that sells products online. In these webinar slides, Richard Dominguez, PrepSportswear’s Developer in Operations, shares their journey. They transformed from a team operating a monolithic app using waterfall development methodology on an old, hard to maintain code base, to a modern IT organization applying new practices from Agile development, DevOps and a Service-Oriented Architectural approach. The Impact? PrepSportswear’s Most Successful Online Holiday Shopping Season in Company History! Join us to: Learn how to identify if you are running a monolithic application that is dragging you down. Get tips on hiring the right people to inject a DevOps cultural mindset into your organization. Understand how to break the monolith into smaller pieces that support key lines of business. Discover where to automate monitoring into your pipeline and platform. Identify metrics for individual stakeholders (dev vs. test vs. business). Go forward, celebrate, learn from, and repeat success! Richard will be joined by Andreas Grabner, Performance Advocate at Dynatrace who will support why monitoring, application and end user metrics have to be a key part of your own transformation! Richard Dominguez has 9+ years’ experience as both a System Analyst and Software Developer in Test. He has worked on many high profile projects in Microsoft such as Hyper-V, Windows 7 Client Performance, and Windows Phone Services. Richard now works at PrepSportswear as the company’s DevOps engineer. His responsibilities include site reliability, external synthetic testing, release management and overall site performance. Andreas Grabner has 15+ years’ experience as an architect and developer in the Java and .NET space. In his current role, Andi works as an advocate for high performing applications in both the development and operations areas. He is a regular expert and contributor to large performance communities, a frequent speaker at technology conferences and regularly publishes articles blogs on blog.dynatrace.com

6 ways DevOps helped PrepSportswear move from monolith to microservices

Dynatrace

Microservices - Scaling Development and Service

Paulo Gaspar

When you adopt microservices, containers, and cloud native development, the technologies and architectures may change, but the need for fast feedback doesn’t. Kubernetes enables us to deploy and run applications at scale, but whether you’re coding or testing applications, you want to be able to get work done quickly without spinning up all of your microservices locally and driving your laptop fans into high speed! Join me for a tour of coding, testing, and shipping microservices using remote-to-local “remocal” tools and techniques. You will: Understand the challenges with scaling container-based application development – i.e. you can only run so many microservices locally before minikube melts your laptop. Learn when to use various types of development practices and tooling based on your use case and requirements for production realism, speed, and practicality. Explore how to utilize containerized dependencies and Docker for testing, including for both apps and services you own and those you don’t. Learn how Telepresence can enable “remocal” development, expanding your local machine and Docker Desktop out into a remote Kubernetes cluster.

Building Microservice Systems Without Cooking Your Laptop: Going “Remocal” wi...

Ambassador Labs

Join me for a tour of coding, testing, and shipping microservices using remote-to-local “remocal” tools and techniques. You will: - Understand the challenges with scaling container-based application development – i.e. you can only run so many microservices locally before minikube melts your laptop. - Learn when to use various types of development practices and tooling based on your use case and requirements for production realism, speed, and practicality. - Explore how to utilize containerized dependencies and Docker for testing, including for both apps and services you own and those you don’t. - Learn how Telepresence can enable “remocal” development, expanding your local machine and Docker Desktop out into a remote Kubernetes cluster.

Building Microservice Systems Without Cooking Your Laptop: Going “Remocal” wi...

Daniel Bryant

MJC 2021: "Debugging Java Microservices Running on Kubernetes with Telepresence"

Daniel Bryant

Slides used for https://www.devopsdays.org/events/2017-toronto/program/andreas-grabner/ In 2011 we delivered 2 major releases of our on premise enterprise software. Market, technology and customer requirements forced us to change that in order to remain competitive. Now – in 2017 - we are deploying and providing feature releases every 2 weeks for both our on premise and SaaS-based offering. We deploy 170 SaaS production changes per day and have a DevOps pipeline that allows us to deploy a code change within 1h if necessary. To increase quality, we built and provide a DevOps pipeline that currently executes 31000 Unit & Integration Tests per Hour as well as 60h UI Tests per Build. Our application teams are responsible end-to-end for their features and use production monitoring to validate their deployments which allows them to find 93% of bugs in production before it impacts our end users. In this session I explain how this transformation worked from both “Top Down” as well as “Bottom Up” in our organization. A key component was the 4 people strong DevOps Team who developed and “sell” their DevOps Pipeline to the globally distributed application teams. I will give insights into how our pipeline enables application teams to design, code, test and run a new feature for our user base. I will also talk about the “dark moments” as change is never without friction. Both internally as well as with our customers who also had to get used to more rapid changes.

DevOps Days Toronto: From 6 Months Waterfall to 1 hour Code Deploys

Andreas Grabner

Semelhante a Devoxx 2016 Using Jenkins, Gerrit and Spark for Continuous Delivery Analytics (20)

BrainQuest-DevOps

DevOpsGuys FutureDecoded 2016 - is DevOps the Answer

Dublin JUG Lightweight Microservices with Microprofile and Raspberry PIs

Moving to a DevOps mode - easy, hard or just plain terrifying? - Daniel Bryan...

JAX London 2014 "Moving to DevOps Mode: easy, hard or just plain terrifying?"

DevOpsGuys - Getting Started with DevOps - Github/Azure Webinar

AgileLIVE Webinar: Build a DevOps Culture & Infrastructure for Success Part 1

What is devops

LJC 4/21"Easy Debugging of Java Microservices Running on Kubernetes with Tele...

Continuous Testing in DevOps

Stop Caring About Kubernetes

Shifting is more than shifting left

Microservices

Nitobi/PhoneGap at Bootup 2011

6 ways DevOps helped PrepSportswear move from monolith to microservices

Microservices - Scaling Development and Service

Building Microservice Systems Without Cooking Your Laptop: Going “Remocal” wi...

MJC 2021: "Debugging Java Microservices Running on Kubernetes with Telepresence"

DevOps Days Toronto: From 6 Months Waterfall to 1 hour Code Deploys

Mais de Luca Milanesio

What's new in Gerrit Code Review v3.1 and beyond

Luca Milanesio

Gerrit Analytics applied to Android source code

Luca Milanesio

Cloud-native Gerrit Code Review

Luca Milanesio

Gerrit Code Review migrations step-by-step

Luca Milanesio

Gerrit Code Review v3.2 and v3.3

Luca Milanesio

ChronicleMap non-blocking cache for Gerrit v3.3

Luca Milanesio

Last year we presented the vision and road-map of Gerrit multi-master setup at GerritHub.io. This year GerritForge and the Gerrit community have released the first version of the multi-site plugin, based on the legacy of the successful high-availability plugin started years ago by Ericsson. The multi-site plugin is a 100% OpenSource solution and does not require any proprietary software installed or hardware/software level filesystem replication: it is fully based on the replication, healthcheck and multi-site plugins. Multi-site is a journey and the Community is making big steps towards it.

Gerrit Code Review multi-site

Luca Milanesio

Gerrit 3.0 it out! If you‘ve tried 2.16, you may have already seen the new database backend (NoteDb) and UI (PolyGerrit). With 2.16 and 3.0, these features are better than ever. In Gerrit 3.0, we’ve deleted thousands and thousands of lines from Gerrit's codebase. Join me for a tour of new features you can use today, and a discussion about even more things to look forward to once we've freed ourselves from the burden of some of our legacy code.

What's new in Gerrit Code Review 3.0

Luca Milanesio

Gerrit User Summit 2019 Keynote

Luca Milanesio

Gerrit multi-master / multi-site at GerritHub

Luca Milanesio

GerritHub a true Gerrit migration story to v2.15

Luca Milanesio

Gerrit User Summit 2018 - Keynote

Luca Milanesio

Introducing the brand new plugin that brings Gerrit Code Review into the Jenkins Pipeline world: simpler, faster and yet more powerful than ever. Gerrit becomes a first-class citizen into the Jenkins ecosystem by enabling a complete pipeline to fetch changes for review, building and submitting the relevant feedback as automated review comment to Gerrit. The new plugin comes from the CI validation workflow experience of the Gerrit Code Review project. The key aspects are stateless, configuration-less - apart from the standard SCM configuration settings. That means that multiple jobs and multiple branches of the same job, can have their own Gerrit integration defined and working out-of-the-box.

Jenkins plugin for Gerrit Code Review pipelines

Luca Milanesio

Gerrit User Summit 2017 Keynote

Luca Milanesio

How to keep Jenkins logs forever without performance issues

Luca Milanesio

Jenkins Pipeline on your Local Box to Reduce Cycle Time

Luca Milanesio

There is hidden value in the data produced by your Continous Delivery Pipeline that could help you achieve more efficient processing. The main objective of this workshop is to show you how to extract that value and benefit from it. We will introduce you to how to configure and improve your Continuous Delivery Pipeline using data. After an overview of a Continuous Delivery Pipeline setup using Gerrit Code Review, Jenkins, and Docker, we will go through the steps on how to extract and analyze data across all the pipeline stages of the delivery chain.

Jenkins world 2017 - Data-Driven CI Pipeline with Gerrit Code Review

Luca Milanesio

Stable master workflow with Gerrit Code Review

Luca Milanesio

Mais de Luca Milanesio (18)

What's new in Gerrit Code Review v3.1 and beyond

Gerrit Analytics applied to Android source code

Cloud-native Gerrit Code Review

Gerrit Code Review migrations step-by-step

Gerrit Code Review v3.2 and v3.3

ChronicleMap non-blocking cache for Gerrit v3.3

Gerrit Code Review multi-site

What's new in Gerrit Code Review 3.0

Gerrit User Summit 2019 Keynote

Gerrit multi-master / multi-site at GerritHub

GerritHub a true Gerrit migration story to v2.15

Gerrit User Summit 2018 - Keynote

Jenkins plugin for Gerrit Code Review pipelines

Gerrit User Summit 2017 Keynote

How to keep Jenkins logs forever without performance issues

Jenkins Pipeline on your Local Box to Reduce Cycle Time

Jenkins world 2017 - Data-Driven CI Pipeline with Gerrit Code Review

Stable master workflow with Gerrit Code Review

Último

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

ICT role in 21st century education and its challenges

rafiqahmad00786416

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Tracing the root cause of a performance issue requires a lot of patience, experience, and focus. It’s so hard that we sometimes attempt to guess by trying out tentative fixes, but that usually results in frustration, messy code, and a considerable waste of time and money. This talk explains how to correctly zoom in on a performance bottleneck using three levels of profiling: distributed tracing, metrics, and method profiling. After we learn to read the JVM profiler output as a flame graph, we explore a series of bottlenecks typical for backend systems, like connection/thread pool starvation, invisible aspects, blocking code, hot CPU methods, lock contention, and Virtual Thread pinning, and we learn to trace them even if they occur in library code you are not familiar with. Attend this talk and prepare for the performance issues that will eventually hit any successful system. About authorWith two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Victor Rentea

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

[BuildWithAI] Introduction to Gemini.pdf

Sandro Moreira

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

MINDCTI Revenue Release Quarter One 2024

MIND CTI

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

Devoxx 2016 Using Jenkins, Gerrit and Spark for Continuous Delivery Analytics

1. @gitenterprise#DevoxxPL Platinum Sponsors: Speed-up your Continuous Delivery with BigData Luca Milanesio GerritForge

2. @gitenterprise#DevoxxPL • Founded in the UK • HQ in London, Offices in the UK and Italy • Committed to OpenSource About GerritForge

3. @gitenterprise#DevoxxPL • Co-founder and Director of GerritForge • over 20 years in Agile Development and ALM • Contributor to many OpenSource projects • Mind and hands of @gitenterprise and @gerritreview About Luca Milanesio

4. @gitenterprise#DevoxxPL NOT a lecture on Continuous Delivery NOT a lecture on Code Review NOT a lecture on BigData What NOT to expect?

5. @gitenterprise#DevoxxPL SO WHAT? #!@$!

6. @gitenterprise#DevoxxPL SHOW a scenario of Continuous Delivery

7. @gitenterprise#DevoxxPL LEARN together about the problems

8. @gitenterprise#DevoxxPL EXPERIMENT my approach leveraging BigData

9. @gitenterprise#DevoxxPL DISCUSS and evolve the approach together

10. @gitenterprise#DevoxxPL Continuous Delivery Pipeline Push Build Unit Tests Push Build Unit Tests Automated Tests Push Build Unit Tests Automated Tests Beta Users Tests User's feedback Publish to all Users Failed Failed

11. @gitenterprise#DevoxxPL Code Review & CD Validation A1 refs/for/master master C2 C2* A1 C2 (local) master C2* push Verified: -1 (build failed) push Verified: +1 (build OK) Reviewed: +2 CI Build: OK C2* CI Build: OK amend

12. @gitenterprise#DevoxxPL Git/Gerrit (Code Review) Jenkins (Continuous Integration & Delivery) Docker (Release and Service Packaging) Mesos & Marathon (Delivery and Resource Manangement) Components

13. @gitenterprise#DevoxxPL DEMO See the pipeline in action

14. @gitenterprise#DevoxxPL We use micro-services • 100+ Components • 200+ Repositories • 300+ People and 100,000+ of review comments • Cross-components [implicit] dependencies • Lots of build chains • 10,000+ of builds Now feel the pain :-(

15. @gitenterprise#DevoxxPL "It was working until 5 mins ago … then someone changed something"  Rings any bell? Problem #1 : Ripple effect

16. @gitenterprise#DevoxxPL In order to deliver Feature ABC I NEED Ver. N of Service-A with Ver. M of Service-B and Ver. K of Service C Problem #2 : Dependencies

17. @gitenterprise#DevoxxPL "Where can I find an environment to run ALL my Micro-Services integration tests?" Problem #3 : Resources

18. @gitenterprise#DevoxxPL Release small changes is GOOD Release often every change is GOOD BUT How long it takes the "Big Picture" and End-to-End? Where is my bottleneck? Problem #4 : Cycle time

19. @gitenterprise#DevoxxPL Micro-Services are distributed Builds are distributed Deployments are distributed  Tackling THIS have you ever felt like drowning in your logs? Problem #5 : Lots of logs

20. @gitenterprise#DevoxxPL Problems #1 + #2 + #3 + #4 + #5 = lead to your daily Micro-Services mental meltdown Problem #6 : all together

21. @gitenterprise#DevoxxPL • Collect all review events • Collect all logs • Channel them to a central store • Crunch and Crunch continuously • Never delete • Process, inspect and learn BigData to the rescue

22. @gitenterprise#DevoxxPL DEMO Continuous Delivery Analytics

23. @gitenterprise#DevoxxPL •Problem #1 – Ripple effect? •Problem #2 – Dependencies? •Problem #3 – Resources? •Problem #4 – Cycle Time? •Problem #5 – Logs aggregation? •Problem #6 – Avoid mental meltdown? Did we solve the problems?

24. @gitenterprise#DevoxxPL • Collect more data (System, JVM, Review scores) • Real-time statistics • Events correlation • Feedback loop to Code-Review • Production data harvest • More? Future directions

25. @gitenterprise#DevoxxPL • My blog www.gitenterprise.me • Gerrit Code Review www.gerritcodereview.co m • Jenkins www.jenkins.io • RabbitMQ rabbitmq.com • Apache Flume flume.apache.org • Hadoop HDFS hadoop.apache.org • Apache Spark spark.apache.org • Kibana github.com/elastic/kibana Resources

Devoxx 2016 Using Jenkins, Gerrit and Spark for Continuous Delivery Analytics

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (19)

Semelhante a Devoxx 2016 Using Jenkins, Gerrit and Spark for Continuous Delivery Analytics

Semelhante a Devoxx 2016 Using Jenkins, Gerrit and Spark for Continuous Delivery Analytics (20)

Mais de Luca Milanesio

Mais de Luca Milanesio (18)

Último

Último (20)

Devoxx 2016 Using Jenkins, Gerrit and Spark for Continuous Delivery Analytics