Empowering Agile Development with Containers
•Transferir como PPTX, PDF•
1 gostou•146 visualizações
Slide Deck from the Microservices, Containers and DevOps Summit in Denver
Recomendados
Recomendados
Mais conteúdo relacionado
Mais procurados
Mais procurados (20)
Semelhante a Empowering Agile Development with Containers
Semelhante a Empowering Agile Development with Containers (20)
Mais de Kellyn Pot'Vin-Gorman
Mais de Kellyn Pot'Vin-Gorman (20)
Último
Último (20)
Empowering Agile Development with Containers
- 1. © 2017 Delphix. All Rights Reserved. Private and Confidential.© 2017 Delphix. All Rights Reserved. Private and Confidential. Kellyn Pot’Vin-Gorman | Technical Intelligence Manager | September, 2017 Empowering Agile Development with Containers
- 2. © 2017 Delphix. All Rights Reserved. Private and Confidential. 2 Kellyn Pot’Vin-Gorman Technical Intelligence Manager, Delphix • Multi-platform DBA, (Oracle, MSSQL, MySQL, Sybase, Postgres…..) • Oracle ACE Director, (Alumni) • Oak Table Network • APEX Women in Technology Award, CTA 2014 • STEM education with Raspberry Pi and Python • President, Rocky Mtn Oracle User Group • Liaison, Denver SQL Server User Group • Author, blogger, (http://dbakevlar.com)
- 3. © 2017 Delphix. All Rights Reserved. Private and Confidential.© 2017 Delphix. All Rights Reserved. Private and Confidential. Agile and Containers is Everywhere
- 4. © 2017 Delphix. All Rights Reserved. Private and Confidential. -Per Evans Research sinceTracking in 2009
- 5. © 2017 Delphix. All Rights Reserved. Private and Confidential. Why? DevOps is Here. • 20%+ increase to the development cycle withAgile and DevOps. • Almost 25% increase in collaboration between departments. • Almost 50% increase in revenue with DevOps. • 53% businesses will require more resources to satisfy needs. http://www.devx.com/enterprise/devops-drives-revenue-for-it-shops-ca-study.html
- 6. © 2017 Delphix. All Rights Reserved. Private and Confidential. https://www2.deloitte.com/us/en/pages/public-sector/articles/federal-cloud-migration-survey.html
- 7. © 2017 Delphix. All Rights Reserved. Private and Confidential.© 2017 Delphix. All Rights Reserved. Private and Confidential. The promise of the cloud is huge, but the journey isn’t easy. Cloud value cannot be achieved through technology alone—it’s about governance, security, people, and processes. This report validates that support for cloud in federal agencies is growing, but perceptions of its impact vary significantly. Agencies need to rethink their core development principles and strategy for going cloud native. – Doug Bourgeois, managing director, Deloitte Consulting LLP
- 8. © 2017 Delphix. All Rights Reserved. Private and Confidential. Data Causes Friction • If those managing the data sources aren’t included and working well with those needing that data to produce features and products, friction is the result. • DBAs are consistently working with archaic utilities that guarantee outcome, rarely speed of results.
- 9. © 2017 Delphix. All Rights Reserved. Private and Confidential.
- 10. © 2017 Delphix. All Rights Reserved. Private and Confidential. Secondary Data Gravity? Data Gravity is the ability for data to attract applications, services, etc. As with the laws of physical gravity, data, due to its mass, will attract all else that has less mass.
- 11. © 2017 Delphix. All Rights Reserved. Private and Confidential. “All else is seldom equal.”
- 12. © 2017 Delphix. All Rights Reserved. Private and Confidential. When you consider… An estimate of a 10% increase in data accessibility will result in more than $65 million in additional net income, you can see why data gravity is a big deal.
- 13. © 2017 Delphix. All Rights Reserved. Private and Confidential. How much data are we talking about? • More data has been created in just the last two years than the previous history of humanity • 1.7MB of new information created every second per human on the planet. • Introduction of big data often has same development pain points.
- 14. © 2017 Delphix. All Rights Reserved. Private and Confidential.
- 15. © 2017 Delphix. All Rights Reserved. Private and Confidential. As Data Increases… • Resources are busier • Development cycle shortens • Demands increase • Resources are less available • Previous way of performing refreshes, provisioning and supporting are no longer sustainable.
- 16. © 2017 Delphix. All Rights Reserved. Private and Confidential.
- 17. © 2017 Delphix. All Rights Reserved. Private and Confidential.© 2017 Delphix. All Rights Reserved. Private and Confidential. Virtualize
- 18. © 2017 Delphix. All Rights Reserved. Private and Confidential. Not Your Father’s Virtualization • NotVirtualized Servers, (VMs) • Not to be confused withVirtualizing a network • Not Federating Data • Not an ETL or subset of data
- 19. © 2017 Delphix. All Rights Reserved. Private and Confidential. Older Cloning Methods
- 20. © 2017 Delphix. All Rights Reserved. Private and Confidential. Who Has Time for THAT? • Copies requires adequate storage. • Requires more resources- demands on people and technology • Agile moves fast and data, (traditionally) moves slow. • More inline with archaic data movement tools.
- 21. © 2017 Delphix. All Rights Reserved. Private and Confidential. Virtualize Compress and Dedup
- 22. © 2017 Delphix. All Rights Reserved. Private and Confidential. Create as Many Copies as Needed • No more waiting for a physical clone • Uses the same native backup files that DBAs depend on, but in a new way • Free up the DBA to work on others tasks • Development, testing, QA, Reporting, Offload of Batch and ETL processing • Test backups and simplify patching and upgrading.
- 23. © 2017 Delphix. All Rights Reserved. Private and Confidential. Virtualized Database, (VDB)
- 24. © 2017 Delphix. All Rights Reserved. Private and Confidential. Now to Escape the Data Gravity • Provision in minutes, not days or weeks • Refreshes almost instantaneously • Self-service portal for developers and testers to refresh and develop they way they do in an agile environment. • Tools with an interface made for Agile and Development data at its focus.
- 25. © 2017 Delphix. All Rights Reserved. Private and Confidential.© 2017 Delphix. All Rights Reserved. Private and Confidential. Containerize
- 26. © 2017 Delphix. All Rights Reserved. Private and Confidential. Containers Come in Many Forms Containers != Docker Only Containerizing = Packaging
- 27. © 2017 Delphix. All Rights Reserved. Private and Confidential. Group Environments into Data Pods
- 28. © 2017 Delphix. All Rights Reserved. Private and Confidential. Why Create Data Pods • Development is done by project or feature vs. tier or product. • With the introduction to the cloud, the business requires those that can do more at a global scale. • Ease of management and maintenance • Provide more value to the business
- 29. © 2017 Delphix. All Rights Reserved. Private and Confidential. How We Currently Move/Migrate Cloud Storage Database server Everything moved individually! Database/Application server
- 30. © 2017 Delphix. All Rights Reserved. Private and Confidential. Data Virtualization, OnPrem & Data Pods Source DB server SQL Server 2008-2016 1 TB Delphix Virtualization Engine 2 TB storage Target DB server SQL Server 1008-2016 No database storage SCCI/SSL Backups via SMB Bin files, flat files, data sources Virtualized and now containerized as a Data Pod
- 31. © 2017 Delphix. All Rights Reserved. Private and Confidential. Data virtualization: from on-premises into the Cloud Source DB server SQL Server 2008-2016 2TB storage Delphix Data Platform 2 TB storage Target DB server SQL Server 2008-2016 No database storage
- 32. © 2017 Delphix. All Rights Reserved. Private and Confidential.© 2017 Delphix. All Rights Reserved. Private and Confidential. Solution- High Level
- 33. © 2017 Delphix. All Rights Reserved. Private and Confidential. The Power of Data Pods Personal Secure Portable DynamicLightweight
- 34. © 2017 Delphix. All Rights Reserved. Private and Confidential. Data Pods for Cloud Migrations O N P R E M D B A D E V Q A C L O U D
- 35. © 2017 Delphix. All Rights Reserved. Private and Confidential. Data Pods for Cloud Migration O N P R E M D E V Q A C L O U D D B A
- 36. © 2017 Delphix. All Rights Reserved. Private and Confidential. Data Pods for Cloud Migration O N P R E M D E V Q A C L O U D D B A
- 37. © 2017 Delphix. All Rights Reserved. Private and Confidential. Delphix Platform for Cloud Adoption O N P R E M D E V Q A C L O U D D B A
- 38. © 2017 Delphix. All Rights Reserved. Private and Confidential. Delphix Platform for Cloud Adoption O N P R E M D E V Q A C L O U D D B A
- 39. © 2017 Delphix. All Rights Reserved. Private and Confidential. Delphix Platform for Cloud Adoption O N P R E M Q A C L O U D D B A D E V
- 40. © 2017 Delphix. All Rights Reserved. Private and Confidential. The Data Pod Change • Development evolves from data gravity to DevOps focused with DataOps. • Enable the business by removing data gravity and the friction it causes by • Virtualizing environments • Creating Data Pods to simplify and empower environment management.
- 41. © 2017 Delphix. All Rights Reserved. Private and Confidential.© 2017 Delphix. All Rights Reserved. Private and Confidential. Thank you
Notas do Editor
- But we’re only discussing part of the solution- it’s often geared towards apps, but applications are often extremely light and easy to move. What about when data is involved? Containers help, but are they the answer? Are traditional containers the answer? This session is going to go into a distinct solution around that discussion.
- 83% of development is currently performed in the cloud, so we can’t discuss development today without including the cloud. Delays are not an option- including those in hardware and IT allocation. This pushes a need for the cloud that previously we hadn’t experienced. The ability for developers to allocate an environment and start working within minutes is essential to agile
- I speak to many DBAs about DevOps as the third option for the future of their career. It’s not just about operations or development, but a hybrid of both and the power of automation. Our natural skill sets will benefit this. Now data is at the center of the hold on DBAs, but it can be mitigated and eliminated. Really? You’re all saying this, I know.
- Migrating what results from that development process from dev, to test, to production is another story.
- Data is center of this. I’m a DBA, I know this. Data sources are central to most development projects and as applications and code is migrated to the cloud, so must the data source. For a typical Fortune 1000 company, just a 10% increase in data accessibility will result in more than $65 million additional net income. Leveraging data coupld increase revenue by as much as 60%
- Data Gravity has two definitions and both revolve around data sources. For the first, there are larger data sources every day. Databases are at the center of this friction and the natural life of a database is growth. By 2020, a third of all data will be on the cloud and 58% of data will be comprised in big data. In the last two years, we’ve created more data has been created in the past two years than in the entire previous history of the human race. Data isn’t going to slow down, either. By the year 2020, about 1.7 megabytes of new information will be created every second for every human being on the planet. By 2020, we’ll grow from today’s 4.4 zettabyets to an approximate, but staggering 44 zettabytes, or 44 trillion gigabytes. And by 2020, a third of that data will pass through the cloud.
- For the second, Data gravity is the ability of bodies of data to attract applications, services and other data. ... IT expert Dave McRory coined the term data gravity as an analogy to the way that, in accordance with the physical laws of gravity, objects with more mass attract those with less.
- Data gravity suffers from the Von Newmann Bottleneck. It’s a basic limitation on how fast computers can be. Pretty simple, but states that the speed of where data resides and where it’s worked with, (i.e. processed) is the limiting factor in computing speed. This is why we have numerous local cache to address memory issues while processing data. Microsoft researcher Jim Gray has spend most of his career looking at the economics of data, which I think is pretty cool! This is why DBAs spend so much time on the cost based optimizer, as moving or getting data has cost. After all is said and done, this is the fundamental principle of data gravity and why DBAs get the big bucks.
- And yet we state that we won’t need DBAs? That data isn’t the center of challenge?
- Per Forbes, by the year 2020, about 1.7 megabytes of new information will be created every second for every human being on the planet. more data has been created in the past two years than in the entire previous history of the human race. That data has to be stored somewhere and there’s a large chance it’s going to be in a relational data store.
- So after all that, you may still ask, why is all this data talk still important to a discussion on Agile and containers? Currently we perform 40,000 search queries every second (on Google alone), which makes it 3.5 searches per day and 1.2 trillion searches per year. If we start to multiply this by all the web searches, business searches, applications, etc. You realize how important data is to the solution to moving faster with a lighter, more packaged solution.
- This has become an oxy-moron. It becomes a cog in the wheel of development and we aren’t able to contain something that’s become to large to contain.
- We can’t eliminate the majority of data We can optimize the code and the applications, but data is still data- i.e. large. It will continue to grow This solution I’m about to show you has many uses, but the although you’ll see huge benefits, my demo will show you the added benefit when things DON’T go as planned.
- We’ll start with three areas that solve the problem of data gravity and data friction in agile development, We Virtualize.
- RMAN duplicates, cold backup to restores, datapump and other archaic data transfer processes are time consuming.
- By virtualizing, we remove the “weight” of the data. We know that 80% of the data won’t change between copies, so why do we need individual copies of it. Our source is then deduped and compressed to conserve more space.
- Each Virtual Database, (VDB) will no longer require space, (only background and foreground memory for SGA/PGA, etc.) and local redo logs. This is a considerable savings, but… If we take this a step further by embracing write changes only on blocks changed from the source, then we’ll experience 10-20 copies of a database in about the same space that one database requires.
- The business is able to provision new environments or refresh existing ones in a matter of minutes. Developers and testers who’ve worked with bookmarks and branching of their code changes can now do the same with database changes, rewinding and refreshing as they need without impacting the DBAs day. This allows the DBA to do more with their time. Having tools that includes the database in the Agile development cycle makes a pivotal change in how the DBA is capable of being part of DevOps.
- The next step is moving to data pods. Containers are a buzz area of technology right now. If we’re talking Docker or Kubernetes, we know this is the way of the future. Instead of having locked, unique environments, the ability to package them as one, in a lighter and more flexible unit makes incredible sense. As a DBA, I rarely, if ever, just released code to the database. It was commonly to the database, the application and linked products. The ability to package and manage as a Data Pod is an impressive enhancement to the Developer, tester and DBA.
- The next step is the ability to migrate to the cloud or from one cloud to another. Right now, 60% of customers are using 2-5 clouds on average. The ability to move a Data Pod from one cloud to another is incredibly powerful. Companies are spending increased time now just migrating to the cloud, but to other clouds and if it would be as simple as migrating a Data pod with a few changes to the new storage location, (i.e. cloud) that could save companies millions of dollars.
- Once final tests are done- you are testing. Perform final migration, final sync to prod and downtime to switch from on-prem to cloud.
- With virtualization, we virtualize it all- the database, data sources, application and flat files. We containerize it into a Data Pod
- By doing so, it’s easier to life and shift to the cloud. It’s lighter and we can move 20 + environments in the same space as one.
- So we evolve from being a DBA to embracing more DevOps skills, including more scripting, scheduling and automation, then include DataOps to create a flexible, agile solution. There are two areas that the DBA can build out on their path to DevOps that are database centric and crucial to the solution- Virtualize Data pods to package environments. By doing all these things, impressive changes can be made by the DBA to any team and they can become valued as a key member of the agile development cycle.