The document summarizes a presentation given by Marian Marinov on August 29-30, 2009 in Prishtina about using the GlusterFS file system to create clusters. The presentation covered the design of GlusterFS, including its kernel components, engine, protocols, translators, storage, and performance. It also provided some benchmarks comparing the performance of GlusterFS to Lustre.
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Clusters with gluster fs
1. Kosova Sofware Freedom
Conference 2009
Clusters with GlusterFS
Marian Marinov - mm@yuhu.biz
System Architect - Siteground.com
Prishtina 29-30.Aug.2009
5. Facts
GlusterFS project starts in August 2006
It is not actual Filesystem
Server only for Linux
Client running on Linux & FreeBSD
Very scallable
Very easy to install and maintain
5
Prishtina 29-30.Aug.2009 4/29
13. GlusterFS Desgin
The picture explained:
ClientX:
volume serverX - defines a name for a remote server
subvolumes brick0 - defines in which of all exported volumes from
the remote server we are interested
some performance translators
volume unify - defines that we will use unify cluster translator
subvolumes serverX serverY - defines which already connected storage
volumes will be used
13
Prishtina 29-30.Aug.2009 12/29
14. Gluster Filesystem Design
Transport Modules:
For TCP/IP transport
transport-type tcp/server
For Infiniband SDP transport
transport-type ib-sdp/server
For Infiniband Verbs transport
transport-type ib-verbs/server
14
Prishtina 29-30.Aug.2009 13/29
22. Gluster Filesystem Design
Other translators
➢ client
➢ server
➢ posix
➢ posix-locks
➢ bdb - very new
➢ rot-13
➢ trace
22
Prishtina 29-30.Aug.2009 21/29
23. Gluster Filesystem Design
In the feature
➢ Live addition/removal of nodes
➢ Automatic File Reordering
➢ Web GUI
➢ mod_glusterfs
23
Prishtina 29-30.Aug.2009 22/29
28. Benchmarks
Apache Web Server Benchmark
Apache served 12039 files (595 MB) over HTTP protocol.
wget client fetched the files recursively.
Time
Lustre Failed after downloading 33 MB out of 585 MB in 11 mins.
GlusterFS 3 mins 11 secs
Archive Creation
'tar utility created an archive of 12039 files (595 MB) served through GlusterFS.
Time
Lustre 41 secs
GlusterFS 25 secs
Archive Extraction
Time
Lustre FAILED No space left on device.
GlusterFS 43 secs
Note: Lower means faster.
28
Prishtina 29-30.Aug.2009 27/29
29. Sources of Information
Project's site:
http://www.gluster.com
Official GlusterFS documentation wiki:
http://www.gluster.org/docs/index.php/GlusterFS
On IRC:
irc.freenode.net #gluster
The mailing list:
gluster-devel@nongnu.org
29
Prishtina 29-30.Aug.2009 28/29