The Hadoop Ecosystem Builder -Buildoop- provides interoperable tools, metadata, and processes that enable the rapid, repeatable development of a Linux Hadoop based system.
With Buildoop you can build a complete set of Hadoop ecosystem components based on RPM or DEB packages, make integration tests for this tools on a RedHat/CentOS, or Debian/Ubuntu virtual system, and maintain a set of configuration files for baremetal deployment.
2. The Buildoop Project
“
Open source collaboration project that
provides templates and tools to help
you create custom Linux-based systems
based on Hadoop ecosystem.
4. Buildoop dissection
●
●
●
“buildoop recipes” specify how a particular package is built. It
includes all the package dependencies, source code locations,
configuration, compilation, build, install and remove instructions.
“Configuration artifacts” set of configuration management files
for operating system deploy and software configuration.
“SIT” the individual software modules are combined and tested
as a group by means of virtualized infrastructure.
5. Buildoop: Build package 1/4
●
List of available BOM – Bill Of Materials. Set of components to
manufacture an end product.
$ buildoop -bom
Available BOM targets:
test.bom
openbus-0.0.1.bom
stable.bom
bigtop-0.7.0.bom
TARGET=CentOS-6.x
conf/bom/
├── bigtop-0.7.0.bom
├── openbus-0.0.1.bom
├── stable.bom
└── test.bom
HADOOP_VERSION=2.2.0_openbus-0.0.1-r1
ZOOKEEPER_VERSION=3.4.5_openbus-0.0.1-r1
HBASE_VERSION=0.94.16_openbus-0.0.1-r1
PIG_VERSION=0.11.1_openbus-0.0.1-r1
HIVE_VERSION=0.11.0_openbus-0.0.1-r1
SQOOP_VERSION=1.4.4_openbus-0.0.1-r1
OOZIE_VERSION=4.0.0_openbus-0.0.1-r1
FLUME_VERSION=1.4.0_openbus-0.0.1-r1
STORM_VERSION=0.9.0.1_openbus-0.0.1-r1
KAFKA_VERSION=0.8.0_openbus-0.0.1-r1
HUE_VERSION=3.5.0_openbus-0.0.1-r1
PROTOBUF_VERSION=2.5.0_r1