We had wonderful 2 hours workshop about oVirt. I showed basic usages, the architecture and some advanced parts (scheduling, qos, quotas declaration and more) that user can use by playing with ovirt live usb stick (https://www.ovirt.org/download/ovirt-live).
Thanks for all participates ! It was pleasure to be part of Fossasia.
Fell free to contact me any time - Yaniv Bronhaim - ybronhei@redhat.com
Testing tools and AI - ideas what to try with some tool examples
Fossasia 16 - oVirt overview
1. FOSSASIA, March 2016
The oVirt Way
General Product
Overview
Senior Software Engineer,
Maintainer @ RHEV
Red Hat IL
March 2016, FOSSASIA, Singapore
Yaniv Bronhaim
2. FOSSASIA, March 2016
The oVirt
● Open source
● What is oVirt
● Utilizing Virt and KVM features
● Architecture
● Road-map
● Ovirt 4.0 and beyond
3. FOSSASIA, March 2016
Open Source:
● It's not just for Linux
● It may or may not have support
● You don't have to be an expert to use it
● You have full access to the source code
● You're probably already using it
4. FOSSASIA, March 2016
Provide an open source alternative
to vCenter/vSphere/Xen
Large scale, centralized
management for server and
desktop virtualization
Based on leading performance,
scalability and security
infrastructure technologies
Focus on ease of use/deployment
What is oVirt?
7. 8FOSSASIA, March 2016
Kenrel-based Virtual Machine
● Included in Linux kernel since 2006
● Runs Linux, Windows and other
operating system guests
● Advanced features
– Live migration
– Memory page sharing
– Thin provisioning
– PCI Pass-through
● KVM architecture provides high
“feature-velocity” – leverages the
power of Linux
10. Live snapshot
Task Management
Async Operations
Live Migration
Overcommit
CPU, Memory, I/O
Hotplug
External Providers
Hosted
Engine + HA engine
Live Storage Migration
SSO
NUMA
SPICE
Memory
Ballooning
PCI pass through
QuotaImport Storage
Domain
VIRT V2VProgress Live
Processes
Iscsi , NFS
Management
Network Interfaces
Management
Cinder
User Roles
Fence Kdump support PPC Support
Foreman Hosts
Provisioning
Host Upgrade
Manager
Expose Errata
Information
SRIOV Support
11. 12FOSSASIA, March 2016
The oVirt's Entities
Data Centers
GuestVM
Storage
Linux Hypervisors
GuestVM
Virtual ClustersNetwork
12. 13FOSSASIA, March 2016
● What makes up a Hypervisor?
– OS FedoraRed Hat Enterprise LinuxCentOsUbuntu
– VDSM
● Hardware Management
● Memory Manager
● Storage Manipulations
● Resource Management
● Scheduling
● Access Control
● Power Management
● Memory Manager
● Device Model (emulation)
● Virtual Machine Monitor
Linux as a Hypervisor?
13. FOSSASIA, March 2016
oVirt Node
● Standalone hypervisor
– Small footprint < 100MB
● Customized 'spin' of Fedora +
KVM
● 'Just enough' Fedora to run virtual
machines
● Runs on all RHEL hardware
with Intel VT/AMD-V CPUs
– Easy to install, configure and upgrade
● PXE boot, USB boot, CD or Hard
drive
● Node 4.0 new generation
14. 15FOSSASIA, March 2016
● What makes up a cluster?
– Group – Migration domain
– Share Specification
– Share Storage Array
– Network Cluster
● Provides Migration Abilities
Cluster Of Hypervisors
15. 16FOSSASIA, March 2016
● What is a VM
– User level process
– Controls part of the hypervisor hardware
– Attached to storage disk
– Exposes VDI access control
Guest Virtual Machine
18. 19FOSSASIA, March 2016
Live Migration
• Dynamically move virtual machines
between hosts
● No service interruption
● Applications continue to run
• Migrate even I/O intensive workloads
such as databases
• Perform hardware maintenance
without application downtime
• Dynamically balance workloads
between host systems
19. 20FOSSASIA, March 2016
• Build a highly available enterprise
infrastructure
• Continually monitor host systems and
virtual machines
• Automatically restart virtual machines in
case of host failure
● Restart virtual machine on another
node in the cluster
• Use live migration to “fail-back” a VM to
it's original host when the server is
restored
High Availability
20. 21FOSSASIA, March 2016
System Scheduler
• Dynamically balance
workloads in the data center.
• Automatically live migrate
virtual machines based on
resources
• Define custom policies for
distribution of virtual machines
Maintain consistent resource usage across the
enterprise data center
21. 22FOSSASIA, March 2016
Power Saver
Define policies to optimize workload on a fewer number of servers during “off-
peak” hours
Turn off servers – Saving money
23. FOSSASIA, March 2016
libvirt
VDSM
Host | Node
libvirt
VDSM
Host | Node
Linux/Windows
client
Linux/Windows
client
Shared Storage
FC/iSCSI/NFS
Shared Storage
FC/iSCSI/NFS
Linux VMLinux VM Win VMWin VM
oVirt
Engine
Java
oVirt
Engine
Java
SDK/CLI
Python
SDK/CLI
Python
R
E
S
T
R
E
S
T
ADAD
IPAIPA
Local StorageLocal Storage
Guest agentGuest agent Guest agentGuest agent
Admin Portal
GWT
Admin Portal
GWT
User Portal
GWT
User Portal
GWT
PostgresPostgres
oVirt High Level Architecture
SPICE
25. FOSSASIA, March 2016
virto-serial
Guest AgentGuest Agent
QEMU/KVMQEMU/KVM
Host
Config &
Monitor
Host
Config &
Monitor
Storage
Config &
Monitor
Storage
Config &
Monitor
Network
Config &
Monitor
Network
Config &
Monitor
VM
Config &
Monitor
VM
Config &
Monitor
Auto
Register
Auto
Register
KSMKSM
Zoom In To The Hypervisor's Components
libvirtlibvirt
hookshooks
VDSM
26. FOSSASIA, March 2016
Zoom In To The VM Components
SSOSSO
Virtio-
net
Virtio-
net
Virtio-
block
Virtio-
block
Spice
driver
Spice
driver
USBUSB guest
Agent
guest
Agent
balloonballoon
29. FOSSASIA, March 2016
Simplicity
● Installation
– yum install -y ovirt-engine; engine-setup
● http://www.ovirt.org/Build_and_Install_Engine_RPM
● http://www.ovirt.org/OVirt_Engine_Development_Environment
● oVirt-Host-Deploy process
● oVirt Node
● Varied user interaction mechanisms
– Python CLI, Python/Java SDK
● Configuration - One place, single utility
30. FOSSASIA, March 2016
Stability
● Involvement of big companies
– RHEV is based on oVirt
– IBM, Netapp, Cisco etc.
● Release schedule
– Feature freeze
– Stabilization periods
– Test days
● Continues Integration
– Jenkins jobs – Available upstream
● Active users community
43. FOSSASIA, March 2016
Virtual Desktop Infrastructure
Centralized management,
security and policy enforcement
Virtual desktops with user
experience of a physical PC
Multiple monitors
HD quality video
Bi-directional audio/video for
VoIP or video-conferencing
Smartcard support
USB support
Industry leading density of virtual
desktops/server
61. FOSSASIA, March 2016
Notification Service
● oVirt allows registration to certain audit events
● The notification service
sends emails per audit
message to relevant
users
● Also monitors engine
itself
62. FOSSASIA, March 2016
Hooks
● “Hook” mechanism for customization
– Allows administrator to define scripts to modify VM operation
● eg. Add extra options such as CPU pinning, watchdog device,
direct LUN access, etc
– Allows oVirt to be extended for new KVM features before full
integration is done
– An easy way to test a new kvm/libvirt/linux feature
63. FOSSASIA, March 2016
Hooks
● Hook scripts are called at specific VM lifecycle events
● VDSM (management agent) Start
● Before VM start
● After VM start
● Before VM migration in/out
● After VM migration in/out
● Before and After VM Pause
● Before and After VM Continue
● Before and After VM Hibernate
● Before and After VM resume from hibernate
● On VM stop
● On VDSM Stop
● Hooks can modify a virtual machines XML definition before VM start
● Hooks can run system commands – eg. Apply firewall rule to VM
65. FOSSASIA, March 2016
UI-Plugin: oVirt Monitoring sub-tab
More info at: https://labs.ovido.at/monitoring/wiki/ovirt-monitoring-ui-plugin
66. FOSSASIA, March 2016
Also in oVirt but not here
● Gluster Support
● Hot plug
– Cpu, memory, nics
● Shared disks
● PPC support
● Integration with:
– Foreman, Glance,
Neutron, Cinder ..
● Live snapshot with
ram
● Numa
● Live storage
Migration
● Upgrade Manager
● Events
● Network Broker
67. FOSSASIA, March 2016
Getting oVirt
● Obtain from oVirt website -
– http://www.ovirt.org/Download
● Fedora And oVirt repositories
(resources.ovirt.org)
● Live USB - http://wiki.ovirt.org/wiki/OVirt_Live
● Build from source
68. FOSSASIA, March 2016
How To Contribute
● Website and Repository:
– http://gerrit.ovirt.org/
– http://www.ovirt.org
– http://www.ovirt.org/wiki
Join the community
- Find bugs, File Them, Correct Them.
- Translate, Write Documentation.
- Design Interfaces, Develop new features
- Share your experiences.
Everyone can make a difference.
● Mailing lists:
● http://lists.ovirt.org/mailman/listinfo
● IRC:
● #ovirt on OFTC
WE WILL INDRODUCE THE PRODUCT
-
ITS ADVANDAGES FEATURES USAGES
-
FROM MY EXPERIENCE
-
WHO USES VIRTUALIZATION MANGMENT PRODUCTS? FAMILIAR WITH ALTERNATIVES
WE WILL INDRODUCE THE PRODUCT
-
ITS ADVANDAGES FEATURES USAGES
-
FROM MY EXPERIENCE
-
WHO USES VIRTUALIZATION MANGMENT PRODUCTS? FAMILIAR WITH ALTERNATIVES
HOW DO WE MANAGE PYSICAL SERVERS LIKE CYCLE?
-
Bare metal in real life
-
The open source solution – Foreman
-
Empower your data-center with Virtualization
-
Managing Virtualization infrastructures with oVirt
-
Integrating the power of oVirt and Foreman
OUR GOAL IS TO LEAD IN SCALE, MANAGMENT, PERFORMENCE USER FRIENDLY
-
ALTERNATIVE
-
FEATURE REACH – EVERYONE CAN REGUEST
-
BASE KVM
OVIRT 8 YEARS OLD PROJECT
-
CONTRIBUTERS IN THE INDESTRY
-
SHIPPED WITH FEDORA AND SUPPORT UBUNTO
-
THE RED HAT CHANNELS SHIPS IT AS RHEV
OLD 2011, BUT STILL SHOWS THE ROAD
-
SECOND AFTER VMWARE ON MANAGEMENT ANALYSES (OVIRT)
-
HYPER V AND CITRIX
-
DON&apos;T BELEIVE IT, TRY YOURSELF
STACK OF PROJECTS
-
ENGINE – THE MANAGEMENT ITSELF
-
VDSM – VIRTUAL DESKTOP SYSTEM MANAGER – THE HYPERVISOR
HISTORY – AVI KIVITI 8 YEARS AGO
-
STARTED IN QEMRANET WHICH ACQUIRED LATER BY REDHAT
-
NO NEED FOR SPECIFIC OS , OR USER SPACE MECHANIZEM
-
SOME OF YOU, LINUX NINJAS MIGHT SAY THAT WHY NOT TO USE COMMAND LINE
* MANY ASPECTS – STORAGE, NETWORK VM LIFE CYCLE QOS AND MANY MORE
THIS IS THE ADMIN CONSOLE
-
WEB BASED UI
-
HANDLES ALL THE MANAGED ENTITIES
-
DC, CLUSTER, HOSTS, VMS, NET, STORAGE,
-
WE WILL DECLARE EACH ENTITY TOGETHER AND SEE WHAT OPTIONS WE HAVE
MAIN ACTORS IN OVIRT
-
Data Center
-
Guest = VM
-
Storage Pool (NFS, Iscsi, Fiber channel)
Network Devices
Hypervisor = Host = Server
Cluster (NEXT SLIDE)
What makes up a hypervisor ?
Hardware management
Device drivers
I/O Stack
Resource Management
Scheduling
Access Control
Power Management
Memory Manager
Device Model (emulation)
Virtual Machine Monitor
EASY, SMALL AND COMPACTIC OS FOR HOST TO SERVE ONLY AS HYPERVISOR.
-
JUST PUT THE DISK AND ENGINE WILL RECOGNIZE THE HOST FOR YOU.
What makes up a cluster?
Group of hosts\hypervisors
Same specification for all hypervisors in cluster
Share same storage array
Ability to reach communication to each entity inside the cluster
Provides migration abilities
What is a VM
User level process
-
Controls part of the hypervisor hardware
-
Attached to storage disk
-
Exposes VDI access control
MANGE DATACENTER – USE ONE OF THE HOST AS OUR HYPERVISOR
-
AFTER OVIRT INITIALIZED THE HOST WE CAN START USE IT TO MANAGE VMS ABOVE
THIS SHOWS MULTIPLY DATACENTER
-
AND AS YOU SEE, IT CAN INCLUDE MANY DC, CLUSTER AND VM AND DO THE CORELLATION BETWEEN ALL THE ENTITIES
-
LETS SEE BIT OF THE FEATURES YOU GET BY USING OVIRT
IF WE GET BACK TO LIVE MIGRATION -
WE MOVE THE VM WITHOUT ANY INTEVENTION
-
APPLICATIONS STILL RUN
-
ITS DYNAMICLY , THE VM PROCESS JUST START IN THE SECOND CHOICE
SET OF RULES ON SPECIFIC VM TO ALLOW HIGH AVALIABILITY
-
IN SCENERIOS AS HIGH LOAD ON HOST , FALL BACK ON FAILURES
-
AUTOMATICALLY RESTART VM IF SOMETHING GET STUCK
DO USAGES MANIPULATION BASED ON RESOURCES
-
DYNAMICLY BALANCE BASED ON POLICIES
WE CAN EVEN DEFINE POLICY FOR THE PICK HOURS. LIKE MONDAY MORNING EVENT WHEN ALL EMPLOYERS OPEN THEIR DESKTOP AT THE SAME TIME
-
IN SOME PLACES THEY STILL KEEP COMING AT 8 :)
MORE AUTHENTICATION OPTIONS – OPEN LDAP , RHDS
-
WILL GET INSIDE THE ENGINE, VDSM AND THE VM
THE ENGINE FIRST TAKES CARE FOR AUTHENTICATION AND THE INVENTORY AS ABSTRACT REASPOSIBILITY
-
THEN EACH USER HAVE ITS OWN HOSTS THAT BEING MANIPULATED
-
ABOVE IT WE HAVE THE NETWORK AND STORAGE MANIPULATIONS
-
AND THEN THE SPECIFIC CONFIGURATION FOR VIRT, LOAD BALANCING AND HA
WHAT VDSM DOES
-
VM CUT IT DIRECTLY TO THE GUEST
-
KSM - Kernel SamePage Merging
identical memory pages amongst different processes or virtualized guests.
-
DUPLICATE PAGES
WHAT HAPPENS INSIDE THE VM – THE GUEST
-
VIRT-IO DRIVERS
BALOON – MANAGING MEMORY EXTEND
-
SINGEL SIGH ON
INSTALLING PHASE – SHORT AND SIMPLE
-
YOU CAN EVEN TRY IT WITH ALLINONE SETUP OR OUR LIVE CD
-
USERS INTERFACE THAT WE ARE ABOIUT TO SEE AND ANALYZE
-
USER OVIRT NODE
-
EASY CONFIGURATION
THE WAY WE DEVELOP AND COLLABORATE WITH OUR CUSTOMERS AND SUPPORTERS
-
RELEASES
-
CI
-
ACTIVE USERS
SO HOW DOES IT LOOK ?
-
ADMIN CONSOLE
-
Search driven
-
Tree view
-
Components (DC, Cluster, Host)
-
Networks
Storage pool
SO HOW DOES IT LOOK ?
-
ADMIN CONSOLE
-
Search driven
-
Tree view
-
Components (DC, Cluster, Host)
-
Networks
Storage pool
SO HOW DOES IT LOOK ?
-
ADMIN CONSOLE
-
Search driven
-
Tree view
-
Components (DC, Cluster, Host)
-
Networks
Storage pool
SO HOW DOES IT LOOK ?
-
ADMIN CONSOLE
-
Search driven
-
Tree view
-
Components (DC, Cluster, Host)
-
Networks
Storage pool
SO HOW DOES IT LOOK ?
-
ADMIN CONSOLE
-
Search driven
-
Tree view
-
Components (DC, Cluster, Host)
-
Networks
Storage pool
SO HOW DOES IT LOOK ?
-
ADMIN CONSOLE
-
Search driven
-
Tree view
-
Components (DC, Cluster, Host)
-
Networks
Storage pool
WILL TALK ABOUT IT IN MY NEXT SESSION ON 4:30
NO LINUX KNOWLEDGE IS REQUIRED
SO HOW DOES IT LOOK ?
-
ADMIN CONSOLE
-
Search driven
-
Tree view
-
Components (DC, Cluster, Host)
-
Networks
Storage pool
- VDI –GIVE THE USER THE EXPERIENCE SUCH AS PYSICAL HARDWARE
-
SPICE PROTOCOL ALLOWS MULTI-MONITOR, High Quality Videos, bi directional VIDEO AUDIO (WEB CAMS + MICROPHONE)
-
SPICE FULLY INTEGRATED WITH OVIRT
-
USES ACTIVEX FOR WIN
-
XPI PLUGIN FOR FIREFOX – WEB INTERFACE
SEARCH IS A MUST WHEN MANAGING THOUSANDS OF VMS
-
AUTO COMPLETION
NETWRKING IN VIRT INCLUDE PLATFORM AND Vms NETWORK
-
HERE WE LOOK AT THE HOST PHYSICAL NETWORK LAYOUT
THE INTERFACES AND BRIDGES
BASIC NETWORK KNOWELGE REQUIRED. NO NEED FOR LINUX KNOWELEGE
LAB MANAGER/ QA MANAGER CAN CREATE VMS or TEMPLATES AND DELEGATE ACCESS TO THEM
-
NO HOST/STORAGE?NETWORK DEFINITION
DATA WAREHOUSE FOR ALL OVIRT INFORMATION
-
STATES, FEEDS, TRENDS, SPECIFIC VIEWS
-
HERE WE COMPARE RHEL GUEST VS WINDOWS GUESS IN TERM OF TIME
MANIPULATIONS AND EXTRA OPTIONS
-
HELPS FOR TESTING
-
EXAMPLE: VM STATS, FAKE CPUS
-
Examples in next slide
YOU CAN CHANGE THE FORM OF THE VM BY CHANGE THE XML CONTECT
JAVA SCRIPT CODE TO ADD LOGIC SCREENS AND TABS FOR THE ADMINISTRATOR PORTAL
-
SEARCH ON GOOGLE FOR EXAMPLES
-
FOREMAN PLUGIN
JSON RPC FOR THE COMUNICATION BETWEEN THE HYPERVISOR AND THE ENGINE
-
IMPORT STORAGE DOMAIN AFTER FAILURE IN DB
-
STILL AIMING TO MATURE SCALE
AS I MENTIONED, OVIRT IS AVAILABLE IN FEDORA REPOS, YOU CAN DOWNLOAD IT, OR USE THE LIVE USB
-
I ALSO ENCOURAGE TO GET THE SOURCE FROM GERRIT AND START CONTRIBUTING IF ITS CLOSE TO YOU
NEXT VERSION
DONT TRUST ME THAT ITS SO GOOD AS I SAY, D/L IT AND TRY YOUSELF.
MY NEXT SESSION IN AN HOUR ABOUT INTEGRATION BETWEEN OVIRT AND FOREMAN WHICH PROVIDES BARE METAL PROVISIONING
ILL EXPLAIN WHAT IS BARE METAL AND HOW THE INTEGRATION PROCESS IS BEING DONE