This paper describes how ArcelorMittal Gent is driving its manufacturing and business systems more effectively by introducing IBM Tivoli Workload Scheduler to control very large numbers of highly variable processing tasks.
Visit http://bit.ly/KWh5Dx to 'Follow' the official Twitter handle of IBM India Smarter Computing.
IBM Flex System Reference Architecture for Microsoft SQL Server 2012 High Ava...
ArcelorMittal Gent gains control over process workflow with IBM Tivoli Workload Scheduler
1. IBM SAP International Competence Center
ArcelorMittal Gent gains control
over process workflow with
IBM Tivoli Workload Scheduler
2. “ The RFP listed in very specific terms
the functionality needed to resolve
pressing and frustrating problems
and weaknesses that existed with
our current mix of internally
developed and product-specific
scheduling tools. Tivoli Workload
Scheduler had unique and powerful
functionality that allowed us to not
only solve all of the problems and
challenges but could do things that
we could only dream about before.
The results exceeded our
expectations.”
Ann Muys
SAP Systems Specialist
ArcelorMittal Gent
“ We were able to reduce workflow
implementation times by roughly
one third.”
Ann Muys
SAP Systems Specialist
ArcelorMittal Gent
3. ArcelorMittal Gent gains control over process
workflow with IBM Tivoli Workload Scheduler
About this paper
This paper describes how ArcelorMittal Gent is driving its manufacturing and business systems more effectively by introducing
IBM Tivoli Workload Scheduler to control very large numbers of highly variable processing tasks.
Customer Objectives
• Intercept, optimize and manage submitted workload • Job interception allows tasks to be prioritized according to
containing essential commercial data from operations units business rules
• Ensure business-critical reports due at 8.00am are • Job throttling helps to improve the SAP scheduling
delivered on time every day efficiency and reduce the batch window for SAP jobs to a
• Keep financial data up-to-date for executives minimum.
• Automate workflow control over both SAP and third-party • Variant handling allows dynamic modification of jobs and
applications priorities when required
• Enable an overview of processes across multiple source • Automation and scheduling of event creation to start and
and destination systems stop jobs
• Cut the costs of managing a highly variable processing • Flexible and detailed priority classes for scheduling and
workload coordination
• Meet agreed service levels for delivery of business • Ability to connect with multiple applications on different
information platforms
• Increase business efficiency and achieve operational • Standardizing to Tivoli Workload Scheduler reduces the
targets. number of products required to connect SAP and other
applications, and provides a shared interface that is easier
IBM Solution to use and more productive to operate
• IBM Tivoli Workload Scheduler 8.5.1 • Reviewing and optimizing business workflows and
• IBM Tivoli Workload Scheduler for Applications 8.5 processes during the migration to Tivoli Workload
• Four IBM Power 570 servers each with 16 POWER5 Scheduler itself has a beneficial effect on the design of the
processors underlying business processes
• Four IBM Power 550 servers each with eight POWER6 • Tivoli Workflow Scheduler makes it easier to optimize code
processors and workflow processes for new business executive
• IBM System Storage DS8100. requests, by identifying dependencies and business
priorities as part of the wider enterprise workload.
Customer Benefits • Detailed feedback on performance allows developers to
• Essential reporting and online dashboards for monitoring optimize existing workload using current processor,
and control can be achieved by scheduling workload memory and bandwidth resources, rather than investing in
effectively additional hardware
• Business service levels can be achieved by exploiting • Integration with IBM Tivoli Workload Manager offers the
existing capacity to the maximum with Tivoli Workload prospect of managing workload and data storage from a
Scheduler, avoiding unnecessary investment in hardware shared interface across the enterprise.
capacity
3
4. Background, starting point and objectives
About ArcelorMittal Gent
ArcelorMittal is one of the world’s leading steel companies, with To take invoice generation as an example, using the data from
operations in more than 60 countries, serving the automotive, the production plants, the central SAP applications produce
construction, household appliances and packaging markets. In daily invoice runs. If the file processing is not completed in time,
2009, ArcelorMittal had revenues of $65.1 billion and crude steel then sales will be missed from an invoice run, which in turn could
production of 73.2 million tonnes, representing approximately 8 delay payment. Because most customers have specific payment
percent of world steel output. terms based on calendar months, a delay of a couple of days in
producing invoices could have significant knock-on effects in
ArcelorMittal Gent in Belgium specializes in developing terms of payment date and cashflow.
innovative steel products, production processes, finishes and
coatings, using sophisticated mathematical models combined The commercial data in the files is extracted overnight from the
with advanced production facilities. The software systems play a local systems, consolidated centrally, and provided to managers
crucial role in controlling the product quality and in the efficient and executives as standard reports by 8.00am the next day. The
operation of the production process, which includes the logistics reports contain historic as well as current data, which helps
and production scheduling. management make informed decisions on likely demand and
compare performance against forecast.
Some 15 percent of ArcelorMittal Gent’s research and
development investment is directed towards environmentally- As the files arrived, they were added to the appropriate queue for
friendly measures. For example, each cubic meter of water is processing on an ad-hoc basis. There was no way to predict the
reused 25 times to help minimize environmental impact. arrival times of the files, and no way to balance the demands of
importing the new data against the requirements to continue with
Business challenges and project objectives day-to-day processing needs and provide acceptable system
ArcelorMittal Gent runs a somewhat federated business model. performance.
The individual plants are responsible for production planning,
quality and operations, while sales orders, finances and To minimize the impact on production systems, the ArcelorMittal
administration are carried out centrally. Gent team analyzed the total workload, and intervened to halt or
enable processing queues. Typically it would make sense to
Details of sales orders, purchases and the related operational complete smaller and faster jobs first, depending on the urgency
data are transferred from local systems to the central SAP and importance of the task and whether it affected the critical
applications as a series of files for processing. The local systems management reports. The systems administration work was
are a mix of SAP, custom, legacy and third-party solutions. On gradually rising, and occasionally manual errors were
some days, more than 2,000 files might arrive, containing introduced. Without an automated solution, valuable time was
valuable sales, financial, quality and similar data, destined to be being lost, and business users were not being well served.
analyzed and imported into the core SAP systems.
4
5. ArcelorMittal Gent had deployed a mix of monitoring and The SAP applications at ArcelorMittal Gent are running on IBM
scheduling tools to automate as much of the work as possible, Power 570 servers with IBM POWER5 processors and on IBM
but with multiple interfaces and different connectors to the Power 550 servers with IBM POWER6 processors, with IBM
underlying applications, this approach soon became part of the System Storage DS8100 for data storage. The Gent location runs
same problem. Changing process workflows was slow and some 80 SAP instances, supporting up to 4,000 users for
difficult, and there was no single view of end-to-end processes ArcelorMittal in Western Europe.
spanning several systems. IT staff productivity was impacted as
they tried to discover and rectify root causes of issues – for Initial IT environment
example where data had not been delivered to a dependent In many cases, independent manufacturing systems must
system – and executives were frustrated at the sometimes slow complete specific tasks before the next step in the process
and irregular delivery of reports. becomes possible, and information generated from each area
must be forwarded reliably and rapidly from application to
Without centralized control of the workflow, the IT team found application. During production, the systems create valuable
themselves at the mercy of the users. If a user sent a stream of data, for example on sales order progress, inventory and raw
very large files for processing, this new workload could materials requirements. ArcelorMittal Gent uses SAP ERP
significantly impact, and in some cases even halt, production applications and SAP NetWeaver Business Warehouse to
tasks, as the initial task might spawn multiple sub-tasks that capture and analyze this information, and combine it with
could not then be interrupted. financial, logistics and other operational data, to provide
managers with a complete picture of business performance.
The ArcelorMittal Gent team wanted to:
The existing environment relied on the scheduling capabilities of
• Intercept, optimize and manage submitted workload the SAP software, extensive scripting, calendar-driven programs
• Automate workflow control over both SAP and third- and basic application scheduling. This mixture of in-house,
party applications third-party and SAP event-driven process control was difficult to
• Enable an overview of processes across multiple manage, and required constant attention from the IT team.
source and destination systems
• Cut the costs of managing a highly variable processing
workload
• Meet agreed service levels for delivery of business
information
• Increase business efficiency and achieve operational
targets.
5
6. The IBM solution
ArcelorMittal Gent prepared a detailed RFP document, IBM created a pilot solution that would demonstrate the
providing examples of the processing workload in terms of capabilities offered by IBM Tivoli Workload Scheduler, covering
numbers of files, arrival times and the target schedules. The RFP approximately 10 percent of the jobs submitted. On this basis,
included analysis of the existing systems and the dependencies the ArcelorMittal Gent team took the opportunity to plan the
of the SAP and third-party applications. larger implementation to best advantage. In particular, the
ArcelorMittal Gent looked at specific workflow and scheduling
Because a sales order for a specific product might be fulfilled issues and mapped them to the Tivoli Workload Scheduler
from a manufacturing plant many thousands of miles away from solution and discovered how the challenges could be resolved.
the customer, all the ArcelorMittal Gent divisions exchange data
to a greater or lesser extent, and all the operations report their ArcelorMittal Gent selected four IBM Power 570 servers each
financial and administrative data to the headquarters location. with 16 POWER5 processors, and four IBM Power 550 servers
Although the RFP applied to ArcelorMittal in Gent in Belgium and each with eight POWER6 processors. The Power servers are
to Dunkirk in France, these two were chosen as Proof of Concept both divided into logical partitions (LPARs), sized to provide the
sites with a view to extending a successful solution globally. most efficient combination of processor, memory and bandwidth
to support the applications in each LPAR. The system shares the
The objective was to provide a global view of all job schedules total resources across the LPARs, assigning greater capacity
and status, and identify dependencies of the SAP applications during a particular LPAR’s peak workload and then reassigning
awaiting data from external applications, and the dependencies that capacity elsewhere as demand shifts. This allows
of the third-party software awaiting data from SAP applications. ArcelorMittal Gent to maximize the workload throughput with the
most cost-efficient system design.
ArcelorMittal Gent selected IBM Tivoli Workload Scheduler to
act as the single point of control for all its workload scheduling, SAP Landscape
Production DB+ CI
spanning SAP and external applications and across the IBM - Entitled CPU : 6
- Virtual CPU : 12
- Memory : 34 GB
Power Systems platform, mainframe and distributed systems.
AS (Dialog) AS (Dialog) AS (Batch) AS (Batch)
- Entitled CPU : 2 - Entitled CPU : 2 - Entitled CPU : 2.8 - Entitled CPU : 2.8
- Virtual CPU : 6 - Virtual CPU : 6 - Virtual CPU : 5 - Virtual CPU : 5
- Memory : 22 GB - Memory : 22 GB - Memory : 22 GB - Memory : 22 GB
Acceptance
Business Testing IT Testing
DB+ CI DB+ CI
- Entitled CPU : 0.8 - Entitled CPU : 2.7
- Virtual CPU : 4 - Virtual CPU : 6
- Memory : 18 GB - Memory : 18 GB
Development
DB+ CI
- Entitled CPU : 0.4
- Virtual CPU : 2
Figure 1: ArcelorMittal Gent operates this server landscape for its - Memory : 8 GB
principal SAP and other business applications:
6
7. Technical Solution in detail
Job Interception
ArcelorMittal Gent is using multiple Tivoli Workload Scheduler For ArcelorMittal Gent, the job interception capabilities of Tivoli
SAP scheduling functionalities to monitor and manage SAP jobs, Workload Scheduler have produced the greatest transformative
with Tivoli Workload Scheduler 8.5.1 and Tivoli Workload effects. All tasks arrive at Tivoli Workload Scheduler, which
Scheduler for Applications 8.5. intercepts potentially disruptive batch processes. Each job is
assigned a priority according to pre-set policies based on the
The key deciding functionalities in favor of IBM Tivoli Workload nature of the job, which ensures that workload across the entire
Scheduler were: system is processed according to business rules rather than
submitted time.
• Job interception, which allows tasks to be prioritized
according to business rules Job Interception is a feature of the SAP BC-XBP 2.0 interface. It
• Job throttling, which helps to improve the SAP enables Tivoli Workload Scheduler to have a very sophisticated
scheduling efficiency and reduce the batch window for control over the jobs launched by SAP users from the SAP
SAP jobs to a minimum graphical interface.
• Variant handling allows dynamic modification of jobs
and priorities when required The job interception mechanism becomes active when the SAP
• Automation and scheduling of event creation to start job scheduler is about to start an SAP job, and examines the
and stop jobs start conditions. It checks the job parameters (job name, creator,
• Flexible and detailed priority classes for scheduling client) against the entries in the SAP table TBCICPT1, and when
and coordination the job parameters match the criteria, the SAP job is set back to
• Scheduled reporting and online dashboards for the scheduled status and is marked with a special flag, denoting
monitoring and control that the job has been intercepted.
• Ability to connect with multiple applications on different
platforms.
7
8. Job Throttling
If Tivoli Workload Scheduler has been set up to handle job The job throttling feature will help ArcelorMittal Gent to improve
interception, it periodically runs its own job to retrieve a list of the efficiency of scheduling on SAP systems and reduce the
intercepted jobs and reschedules them. This job can be referred batch window for SAP jobs to a minimum. Using advanced XBP
to as the interception collector job. 2.0 and 3.0 functions, such as the job interception and parent-
child, the job throttler function ensures that the SAP system is not
To enable the Job Interception feature, run ABAP report overloaded and the number of released jobs does not exceed the
INITXBP2. This report shows you the current status of the job total number of SAP background work processes in the system.
interception and parent-child features, and allows you to toggle
the status of both features. Job Throttler is a Java tool that uses JCo (Java SAP Connector),
enquiring intercepted jobs and releasing them when the
Because intercepted jobs remain in the scheduled status until background work processes that they need on the SAP server or
they are relaunched, you need to define a Tivoli Workload SAP server group are available. The queue of intercepted jobs is
Scheduler job that uses the SAP interception collector task to sorted by scheduling time and priority. When the SAP parent-child
collect and restart them. feature is enabled, child jobs inherit their progenitor’s priority so
that new urgent jobs are run before other planned jobs.
The most interesting use of this feature is that the Job Throttler can
be configured to have the intercepted job inherit the priority class
from its progenitor (the top-level job in the hierarchy), if the
progenitor class is higher than the intercepted job class. This
setting automatically enables the parent-child feature on the SAP
system.
Figure 2: SAP Job Interception table. The SAP Job Interception
criteria can be set via Tivoli Workload Scheduler interface.
8
9. SAP Job Variants Dynamically Created Jobs
Tivoli Workload Scheduler allows the team to handle job variants ArcelorMittal Gent will be looking at the use of dynamically
on-the-fly, enabling changed business priorities to be reflected created jobs. At submission time, Tivoli Workload Scheduler can
immediately. For example, the names of inbound files sent by create “on-the-fly” a new background job on SAP and submit it.
other users do not necessarily follow the agreed conventions, The dynamically created background job is used for that
and the existing priorities or rules for that job may not meet submission only. The Tivoli Workload Scheduler job definition
current needs. contains all the information needed to create an SAP
background job (such as the steps, print parameters). The
Tivoli Workload Scheduler enables the team to change filenames information is stored in the Tivoli Workload Scheduler database,
and over-rule priorities and variants for a single or group of jobs, and at the same time it is possible overwrite a template SAP job
without having to rewrite each individual job and ensuring that from the SAP database with new values from Tivoli Workload
the correct conditions are passed to the SAP applications. Scheduler.
The priority classes are based on operational roles of the Event Handling
submitter, workload type and forecast total run time, offering a To monitor system and job conditions, Tivoli Workload Scheduler
very great deal of fine-grained control. The policies take account delivers scheduled reports and online dashboards for IT team
of the business priorities, and Tivoli Workload Scheduler enables and business unit use. The reports and dashboards include the
intelligent scheduling of workload to ensure that user requests ability to drill down to the underlying data, which enables teams
are met as promptly as possible. to identify the processes and dependencies of each job, should
an issue arise.
For example, a low-priority job that is known to run quickly can
be scheduled before a high-priority job that will take several Job Dependencies are prerequisites that must be satisfied
hours to complete, where there is sufficient time to ensure that before a job or job stream can start. Internetwork dependencies
both jobs will be finished within agreed service levels. The Tivoli are dependencies checked by the extended agent workstation
Workload Scheduler Interface allows ArcelorMittal to create/ to which they belong. In response to an internetwork
modify/delete standard SAP Jobs. This includes the functionality dependency, the SAP extended agent checks for the
to manage the variant definition of SAP jobs. For each job variant occurrence of the SAP background event specified in the
details are available. dependency. As soon as the SAP event is raised, the SAP
extended agent commits the event and instructs Tivoli Workload
Scheduler to resolve the corresponding internetwork
dependency.
Only the SAP background events stored in the SAP event history
table are considered by Tivoli Workload Scheduler to check for
internetwork dependencies resolution. As a prerequisite, the
SAP administrator must create the appropriate event history
profiles and criteria on the target SAP system.
Figure 3: An example of the panel: view/edit/modify a variant
9
10. Tivoli Workload Scheduler event handling allows single point of Tivoli Workload Scheduler provides automation and scheduling
monitoring and control for batch workload and batch for both SAP applications and external work requests. Tivoli
environments. Workload Scheduler comes with pre-built connectors for an
extensive range of applications, removing the need to write
• Monitor workload jobs events (e.g. job start/end) and custom software each time the ArcelorMittal Gent team wishes
alerts (i.e. job in error, late, long) to integrate a new business acquisition. This significantly
• Monitor events related to scheduling SAP application reduces the in-house IT developer workload, and provides a
and infrastructure health common, central interface for all workload scheduling tasks.
• Monitoring of SAP business critical jobs, critical path,
critical predecessors, risk level.
Figure 4: Triggering SAP events from Tivoli Workload Scheduler
10
11. Reporting and analysis
Tivoli Workload Scheduler includes reporting and analysis tools Tivoli Storage Manager helps to control storage management
capable of monitoring the entire job workload. As part of costs with ease-of-use features, and to increase visibility into the
production processes, reports are generated which show data protection environment by providing advanced features for
summary or detail information about the previous or next operational monitoring and historical reporting.
production day. These reports can also be generated ad-hoc.
To improve the availability of the SAP database servers,
For ArcelorMittal Gent, these reports show job statistics and ArcelorMittal Gent uses Tivoli Storage Manager for Enterprise
production summaries for operational and business functions to Resource Planning (ERP), which reduces the SAP database
allow the team to compare past performance and adjust future administration workload through automated data protection
workload. designed for SAP environments.
Central planning and calendar Tivoli Storage Manager for ERP is an SAP Certified solution,
Another important Tivoli Workload Scheduler option used by supporting large-volume data backups and recovery, data
ArcelorMittal Gent is the central planning and calendar cloning and disaster recovery of multiple SAP database servers.
functionality.
ArcelorMittal Gent uses Tivoli System Automation, which is
A calendar is a list of scheduling dates. Each calendar can be mainly employed to initiate, execute and coordinate the
assigned to multiple job streams. Assigning a calendar to a job automated starting, stopping, restarting and failing-over of
stream causes that job stream to run on the dates specified in the individual SAP application components or entire composite
calendar. A calendar can be used as an inclusive or as an application landscapes.
exclusive run cycle, which helps ArcelorMittal Gent to align the
workload to local calendar needs and dependencies. Taking advantage of its advanced, policy-based automation
capabilities, ArcelorMittal Gent uses Tivoli System Automation to
More Tivoli– Tivoli Storage Manager and Tivoli System Automation ease the operational management of its complex infrastructure.
Alongside the Tivoli Workload Scheduling solution, ArcelorMittal Using the Tivoli solution, the system administrator can more
Gent uses Tivoli Storage Manager and Tivoli System Automation effectively manage planned outages and protect against
software to help manage its wider application environment. operational errors. This reduces costs by automating manual,
labor-intensive and error-prone operational tasks.
ArcelorMittal Gent uses IBM Tivoli Storage Manager, with its
wide range of storage management capabilities, to address Though its use of Tivoli System Automation, ArcelorMittal Gent
business continuity, by helping to shorten backup and recovery has achieved:
times and helping to maximize application availability with
advanced data recovery management technologies. • easier management of its complex IT infrastructure
• reduced skill requirements
• flexible, advanced automation functionality.
11
12. Project achievements
Performance improvements Benefits and next steps
During the Proof of Concept stage, mapping business The ArcelorMittal Gent implementation has demonstrated how
processes to Tivoli Workload Scheduler highlighted many areas the entire ArcelorMittal Group could benefit from integrating and
where dependencies had not been clearly defined, and priorities optimizing workload across both SAP and other applications.
had not been set. Migrating the workload to Tivoli Workload The current Tivoli Workload Scheduler deployment will be
Scheduler allowed the team to build a complete picture of the extended to encompass all of the SAP tasks and other
work processes, managed from a single place, which in turn applications, providing enterprise-wide control while enhancing
suggested ways to improve the underlying business processes. the effectiveness of the SAP landscape.
For example, when business executives asked for new For ArcelorMittal Gent, a worldwide enterprise that has grown in
processes or reports, using Tivoli Workload Scheduler made it part through acquisition and merger, Tivoli Workload Scheduler
easier for the developers to identify dependencies and schedule offers the opportunity to share a common interface in all the data
the work correctly. This ensures that jobs do not start and centers. The lessons learned from ArcelorMittal Gent are:
subsequently wait for input, and run – as far as possible –
correctly, first time. This reduces the total number of jobs running • Standardizing to Tivoli Workload Scheduler reduces
at a particular moment, and reduces the drain on system the number of products required to connect SAP and
resources. In addition, with Tivoli Workload Scheduler, other applications, and provides a shared interface that
developers are now able to examine the wait time and run time is easier to use and more productive to operate
for each job, and compare historic performance data. • Reviewing and optimizing business workflows and
Where a job waits longer or runs more slowly than previously, the processes during the migration to Tivoli Workload
developer uses Tivoli Workload Scheduler to examine root Scheduler itself has a beneficial effect on the design of
causes and review the job coding, dependencies and priority. the underlying business processes
• Tivoli Workflow Scheduler makes it easier to optimize
Without this detailed feedback, ArcelorMittal Gent had been code and workflow processes for new business
forced into addressing workload issues – such as delayed executive requests, by identifying dependencies and
reporting or poor performance – by investing in processor or business priorities as part of the wider enterprise
memory capacity. Tivoli Workload Scheduler allows the team to workload
identify the exact workload challenge and consider re- • Detailed feedback on performance allows developers
scheduling work or optimizing processes before investing in to optimize existing workload using current processor,
hardware. memory and bandwidth resources, rather than
investing in additional hardware
• Integration with IBM Tivoli Workload Manager offers the
prospect of managing workload and data storage from
a shared interface across the enterprise.
12
13. “ The rigor of the RFP process paid
off, as we started seeing payoff and
real benefit after the first month of
operations.”
Ann Muys
SAP Systems Specialist
ArcelorMittal Gent
“ With the process visibility provided
by Tivoli Workload Scheduler, we
developed a much better
understanding of processes and
workflows. With this knowledge, we
began to think about what could be
changed to optimize processes and
operations. The Tivoli Workload
Scheduler interface made it easy to
change processes and workflows, the
resulting optimization improved
customer services and job
satisfaction for the staff.”
Ann Muys
SAP Systems Specialist
ArcelorMittal Gent