1. - 1 -
PROBLEMS WITH THE IMPLEMENTATION OF PERFORMANCE
MEASUREMENT SYSTEMS IN THE PUBLIC SECTOR WHERE
PERFORMANCE IS LINKED TO PAY: A LITERATURE REVIEW DRAWN
FROM THE UK
MIRAL METAWIE
PhD student in Industrial Relations
KBS Annex
University of Kent at Canterbury
Tel: 01227 82-3375
E-mail: mm248@kent.ac.uk
DR. MARK GILMAN
Senior Lecturer in Industrial Relations/HRM
KBS
University of Kent at Canterbury
CT2 7PE
Tel: 01227 823797
Fax: 01227 761187
E-mail: m.w.gilman@kent.ac.uk
3rd
Conference on Performance Measurements and Management Control (Nice
September 22-23, 2005)
2. - 2 -
Abstract
According to Robert Kaplan and David Norton, (1992; 1996; 2001; 2004), 'the final
linkage from high-level strategy to day-to-day actions occurs when companies link
individuals' reward programs to the Balanced Scorecard'. The objectives of this linkage are,
first, to focus employees' attention on strategic priorities, and second, to provide extrinsic
motivation by rewarding employees when they and the organisation reach their targets.
Performance related pay (PRP) which has been widely introduced especially in the public
sector holds out the promise of providing such a link. Yet, in practice performance
measurement in the public sector has been a problematic area with PRP. This paper will
attempt to address the problems of applying performance measurement systems (PMS) in
linkage to pay systems in the public sector through reviewing the literature of the UK.
An extensive portion of the literature on PMS has been concerned with the economic
benefits of the application of such systems as strategic control systems to increase
productivity through monitoring employees’ activities and influencing their behaviours
(Kaplan and Norton, 1996b; Neely, 1995). This however, brings attention to two issues that
raise doubts in the lucidity of this literature and the validity of using, mainly, economic
theories to assess the benefits of PMS. The first is that though one can note that the most
important element influencing organisational performance is the human factor, economists
and scholars have mostly referred to the success of performance measurement (PM) and
incentive systems in terms of productivity, which though incorporating both financial and
non-financial measures still ignores employee relations and organisational behaviour
theories. In fact if we look at the assessment of PRP systems in several industries within the
public sector (e.g. Civil Service, Local Government, and Nationalized Industries) we come to
the conclusion that whilst it may be successful in generating increased productivity;, its
impact on employees’ behaviours, such as motivation, has been proved negative in most
research. The second is that while there is a logical link between PRP and PMS, in practice
such links seem less coherent than suggested in the literature (e.g. Kaplan and Norton,
1992; 1996b). Yet there is a lack of research on what might be the cause of such
incoherence, even worse, there is a lack of research on the strength of such link. In other
words, overlooking the link between rewards and PMS, leads to neglecting the problems
inherent in measuring the performance of the public sector and the difficulties in finding
unproblematic performance measures.
By looking into different fields namely industrial-psychology, sociology and
economics this paper will identify problems of performance measurement when performance
is linked to pay (PRP). For the purpose of this paper, a literature review of the UK public
sector is conducted in order to highlight gaps in the research area of PRP and PM.
3. - 3 -
INTRODUCTIONINTRODUCTIONINTRODUCTIONINTRODUCTION
There has been a substantial body of literature on performance measurement in both
the public and the private sector. Though there have been some differences of interest in
researching both sectors – in the fact that while more clear examples of application and
success have been reviewed in the private sector very few are found in the public sector
where it has been reported more problematic – most papers assessing the work on
performance measurement and performance measurement models have been mainly
presented in the management accounting literature. Historically, PMS have, therefore, been
restricted to the traditional financial accounting measures such as Return on Investment,
Earning per Share, and Economic Value Added [Kaplan and Norton, 1992; Morisawa, 2002;
Neely, 1995; Ballantine and Brignall, 1996], and to the use of frameworks and theories
primarily drawn from the discipline of economics (Otley, 1999).
This approach, viewed as successful in the past; has proved more deficient in today’s
rapidly changing environment driven by political, economic, technological, and social forces.
Politically the increasing importance of corporate governance has held organisations
accountable for not only its economic performance but also its social performance which
affects the wider external environment. In other words, there has been a shift from adopting
a shareholders approach where performance measurements are concerned with the
profitability of the business to a stakeholders approach. Due to the growth of the importance
of the human resources of organisations, there has also been an increased emphasis on the
behavioural aspects of management accounting though still through an economic approach
often related to the agency theory (Otley, 1999) – i.e. assessments of the impact of
accounting systems on employees’ behaviours such as increased effort, distortion of results,
and productivity rather than the softer aspects such as motivation, commitment, and job
satisfaction. Similarly, economically, there has been a growth in the importance of the
human factor as a calculative receptor, and hence in the need to affect its daily activity
through a management control system. Consequently, since the early 1990s more balanced
approaches incorporating multi-dimensional performance measures were developed. These
include the balanced scorecard developed by Kaplan and Norton (1990-1992), the
performance pyramid (the SMART system) developed by Cross and Lynch (1992), the
results/determinants matrix (Fitzgerald et al., 1991), and the Performance Prism (Neely et
al., 2000-2001).
Before a brief review of these approaches is presented it is important to turn attention
to defining performance measurement. In order to identify the problems of PMS, the
following section includes a review of the definition of performance measurement, the
rationale behind its implementation and a brief review of the advanced approaches
mentioned above. The focus is on the balanced scorecard which has received more
attention in the literature, is the most frequently used across sectors, and has also been
used for reward reasons.
PERFORMANCE MEASUREMPERFORMANCE MEASUREMPERFORMANCE MEASUREMPERFORMANCE MEASUREMENT: DEFINITIONENT: DEFINITIONENT: DEFINITIONENT: DEFINITION
Though the term performance measurement has been used since the late 1970s,
there has not been a universal definition for the term. The Government Accountability Office
(GAO), 1980, defined performance measurement as “an assessment of an organisation’s
performance, including the measures of:
• Productivity, which quantifies the outputs and inputs of an organisation and
expresses the two as a ratio. Generally, the ratio is expressed as output to input.
• Effectiveness, which determines the relationship of an organisation’s outputs to
what an organisation is intended to accomplish.
4. - 4 -
• Quality, which examines an output or the process by which an output is
produced. Quality is indicated by attributes such as accuracy (or error rate),
thoroughness, and complexity.
• Timeliness, which evaluates the time involved producing an appropriate output.
(Citizen-Driven Government Performance, 2004)
The most commonly used definition of performance measurement is that of Neely,
(1998): “the process of quantifying the efficiency and effectiveness of past actions through
acquisition, collation, sorting, analysis, interpretation and dissemination of appropriate data”
(as cited in Moullin, 2003, p.3). Though this definition has not stated what the nature of the
data collected should be (i.e. financial vs. non-financial) it seems to be concerned with the
process itself of measuring performance in the management accounting field rather than its
purpose, and restricted to quantitative measures rather than qualitative ones. Hence,
Moullin, (2002), defines performance measurement in terms of its purpose emphasizing the
assessment of how well organisations are managed and the value they deliver for
stakeholders.
Based on the above and using a contingency approach, particularly as in the public
sector uncertainty lies in the problems of linking the means (inputs) to the ends (outputs)
(Johnsen, 2000), it will be highlighted that performance measurement is a contextually
defined phenomenon in that similar measures may have varying importance and meaning in
different organisations (Euske et al., 1993). Hence, scholars tend to focus on issues
associated with the design of PMS (e.g. Neely et al., 1995), the values and characteristics of
performance measurement (e.g. Newcomer, 1997), the identification of the measures the
system should include in different industries (e.g. Haktanir and Harris, 2005, in the hotel
industry; Goddard et al., 1999; Ballantine et al., 1998, in the public health services) and the
development of new performance measurement frameworks.
It has been widely argued that organizations using balanced PMS report better
performance than those that do not (Lingle and Schiemann, 1996). PMS have undergone
considerable changes in the last twenty years with a number of different models developing
to help organisations define an appropriate set of balanced – financial and non-financial –
performance measures. Yet the most popular model is that of Kaplan and Norton, (1990-
1992), the balanced scorecard. The following section, hence, provides a brief review of the
most commonly used balanced frameworks as well as the latest developments, highlighting
both their strengths and weaknesses, which, in turn, will help identify problems of using
these models in determining pay.
PERFORMANCPERFORMANCPERFORMANCPERFORMANCE MEASUREMENT MODELSE MEASUREMENT MODELSE MEASUREMENT MODELSE MEASUREMENT MODELS
Performance measurement has received considerable criticisms in the 1980s and
early 1990s for being restricted to financial measures and robust accounting methods in
evaluating the performance of organisations or more specifically their profitability. Mostly, it
is argued, that these measures ignore the softer less measurable performance indicators as
well as the relationship between different business units and their variable objectives (Euske
et al., 1993; Ghalayini et al., 1997; Jagdev et al., 1997; Kaplan and Norton, 1992; Nanni et
al., 1992; Neely, 1995). Many researchers have also referred to the number of problems that
arise from relying on such systems such as short-termism (Crawford and Cox, 1990;
Ghalayini et al., 1997; Hill, 1995; Kaplan and Cooper, 1998; Neely, 1995). In response to
these criticisms and dissatisfactions with the traditional system new performance
measurement frameworks have developed, out of which, the most well-known and
commonly used is the balanced scorecard.
5. - 5 -
Balanced scorecard
The balanced scorecard was developed by Norton and Kaplan, (1990-1992), to
include both financial measures that report the results of actions already taken and
operational measures on customer satisfaction, internal processes, and the improvement
activities – operational measures that are drivers for the future financial performance (Kaplan
and Norton, 1992, p.71). More specifically, the balanced scorecard is based on the
combination of four key perspectives in performance measurement: financial perspective,
customer perspective, internal business processes, and learning and growth. Evidently,
unlike the traditional systems the balanced scorecard puts strategy, vision and
communication in the centre rather than control.
Figure 1. balanced scorecard four key measures
(Source: Paul Arveson, 1998 accessed, 24/06/05)
Evidence on the success of the balanced scorecard has been reported across many
industries and within the public sector in the US (Hepworth, 1998). Though, attention was
drawn to the complexity of the system and the need for commitment towards accepting it for
the success of its application, and many pitfalls and problems were identified in practice
(Kaplan and Norton, 1996b), no failures of the concept were identified (Hepworth, 1998).
According to Ghalayini et al., (1997, p.209), the main weakness of the balanced scorecard is
that it is primarily designed to provide senior managers with an overall view of performance;
thus, is not intended for, nor applicable, at the factory operations levels. Moreover, as a
multi-stakeholders approach, the balanced scorecard has been criticized for not considering
the interests of all stakeholders, such as suppliers, competitors, regulators, and community
(Neely et al., 1995; Ghalayini and Noble, 1996; Atkinson et al., 1997). Brignal and Modell,
(2000), further argue that the balanced scorecard literature has neglected the relative
bargaining power of different stakeholders in determining whose interests will predominate in
an organisation and the consequent effects on what aspects of performance are measured,
reported and acted upon.
6. - 6 -
The Performance Pyramid (SMART)
Cross and Lynch, (1992), have recognized the hierarchical levels that exist within an
organisation and thus provided a link between the performance measures at each of those
different levels so that each function and department strives towards the same objectives
which they placed on the summit of the “pyramid”. This model shows recognition for the
importance of the human resources in achieving the company’s vision by placing four key
operational measures (quality, delivery, cycle, and waste) at department and workcentres on
a daily basis at the bottom of the pyramid. The middle level indicators which bridge the gap
between the top level indicators and the day-to-day operational indicators include customer
satisfaction, productivity, and flexibility. Although this model considers layers between the
business units and individual business activities, and hence integrates corporate objectives
with operational performance indicators it also combines financial, non financial as well as
operational and strategic indicators. It does not, however, provide any mechanisms to
identify key performance indicators, nor does it explicitly integrate the concept of continuous
improvement (Ghalayini et al., 1997). It should be also noted that the system has not been
empirically tested.
The Performance Prism
The performance prism is considered the latest development in performance
measurement. As the result of noting that none of the existing frameworks broadly focused
on stakeholders, Neely et al., (2001), recognize the importance of taking a holistic approach
to stakeholder management in today’s culture of involvement. Its advantages are that it
explicitly addresses all stakeholders – not only investors but also customers, employees,
suppliers, regulators and communities (Powell, 2004). According to the performance prism
vision one of the fallacies of performance measurement is that measures should be derived
from strategy. Yet to derive measures from strategy is to fundamentally misunderstand the
purpose of measurement and the role of strategy. Hence performance prism starts its
process by thinking about the stakeholders and what they want. In fact out of the five facets
of the performance prism the first is stakeholders’ satisfaction. The other four include
strategies, processes, capabilities, and stakeholders’ contribution. By calling it prism, Neely
et al., recognize the complexities surrounding performance and its measurement. Though
this model has only been developed recently, it has been tested in few cases (e.g. DHL,
London Youth, and the House of Fraser), where feedback has been overwhelmingly positive
(Neely et al., 2001). However, given that the attention is placed on the process of finding the
right strategies that performance measurement should be based on, performance prism
tends to neglect issues such as how the performance measures are going to be realized,
hence, little concentration is given to the process of designing the system (Tangen, 2004).
At this stage it should be noted that although there are numerous balanced
performance measurement frameworks, few researches have looked into their effectiveness
and the economic benefits they yield (Neely et al., 2002) – with most research focusing on
the balanced scorecard in particular as it remains the most popular measurement framework
– and even less have explored the problems associated with their application.
This paper highlights the problems that still exist, although rather neglected, in the
application of current PMS in the public sector when performance is linked to pay. By using a
variety of theoretical approaches, not just thos of economics and accounting, it will also
identify new problems that were ignored in narrow evaluations of the systems. Given the
purpose of this paper, the following section considers the nature of the public sector, the
history of performance measurement, and the development of its application in relation to
rewards across the sector.
7. - 7 -
PERFORMANCE MEASUREMPERFORMANCE MEASUREMPERFORMANCE MEASUREMPERFORMANCE MEASUREMENT INENT INENT INENT IN THE PUBLIC SECTORTHE PUBLIC SECTORTHE PUBLIC SECTORTHE PUBLIC SECTOR
Like the private sector, public sector organisations around the world face pressure to
improve service quality, lower their costs, become more accountable, customer focused and
responsive to stakeholders’ needs. While PMS have long been advocated as successful in
the private sector, it was once, considered impossible to measure performance in the public
sector. The first attempts at the evaluation and review were associated with the failed
attempts at large scale strategic planning in the 1970s and it was not until the appearance of
organisational and managerial reforms introduced by the conservative governments in the
1980s and 1990s that public sector performance measurement became firmly established
(Boland and Fowler, 2000, p.417). It should be noted at this stage that the justification of this
paper for drawing evidence from the UK in particular is based on the fact that New Public
Management prescriptions have been applied in that country more consistently than in many
other countries over a quarter of a century (Cutler and Waine, 2005).
Over time there has been change in the form of PMS in the public sector in the UK
with most systems moving towards a balanced scorecard approach. In a review of the use of
performance systems across the UK public sector, Goddard and Mannion, (2000), conclude
that there have been clear shifts from collecting data on a narrow range of dimensions of
performance to a broader range of performance indicators based on the assessment of the
activities of the organisation. Additionally, shifts are also clear in the use of performance
information; instead of being used for internal purposes they are now used for external
control and accountability. There have also been shifts away from informal performance
assessments to formal peer reviews, as well as linking PMS to financial rewards (Propper
and Wilson, 2003).
Examples of PMS in the public sector exist in schools where there are two main
systems for measuring schools performance: OFSTED (Office for Standards in Education)
established in 1992, which involves an in-depth evaluation of the school’s processes and
outcomes, and PI (Performance Indicators) which involves the collection and publication of
summary performance indicators including truancy rates and GCSE pass rates.
Furthermore, in the NHS, the government has adopted a balanced scorecard approach in
their measurement system “Performance Assessment Framework” (PAF). As noted in a
recent consultation document:
“The Performance Assessment Framework … is based on the balanced
scorecard approach. The use of the balanced scorecard allows different
organisations to get more rounded view of performance by identifying different
key elements of performance and understanding how changes in them may have
implications for others.”
(Department of Health, 2001, p.2 as cited in, Chang et al., 2002, p.350)
Similarly, the government modernization agenda has been witnessed in the Civil
Service Reform. In 2002, Sir Andrew Turnbull, (head of the home civil service) has stated his
personal vision for the UK Civil Service in 2005 is:
“ Be respected as much for its capability to deliver as for its policy skills;
Think creatively and operate strategically; Be an organisation that young and
successful people want to join and work with; and Create value for the public
and have values of:
• integrity and trust
• impartiality and readiness to serve all citizens and governments
8. - 8 -
• recruitment and advancement on merit
• a make-up that reflects our society ”
It was also stated that emphasis is placed on the civil servants’ own personal
performance targets and how these relate to both their departments’ and government’s
policy objectives and outcomes (Stephenson, 2003).
Overall, it can be stated that, performance measurement is a central aspect of the
public sector reform.
It is essential to point out at this stage that performance measurement in the public
sector has had several labels differing between disciplines and perspectives; for example “in
public administration both review, evaluation, cost benefit, and policy analysis are employed
as characterizations (Simon, 1947; 1997; Wildavsky, 1966, 1969, 1978); in contingency
theory (Thompson, 1967) labels as search, surveillance and monitoring were used, and in
the resource dependence perspective (Pfeffer and Salancik, 1978) performance
measurement was termed as benchmarking, environmental scanning, and monitoring”
(Johnsen, 2000, p.7).
While the term performance measurement has been restricted, in some papers, to
the old financial-based measurement systems in the public sector most PMS are now based
on a balanced scorecard approach (with only few differences) but under different labels (i.e.
Performance Assessment Framework, (PAF), in the NHS, and the Office for Standards in
Education, (OFSTED)). Therefore in this paper the terms will be utilized interchangeably.
Although, as stated earlier, there is a gap in the literature about a clear and coherent
link between performance measurement and rewards, there seems to be some parallelism
between the development of PMS in the public sector and their performance indicators and
the development of PRP schemes. For example, in schools, PRP is based on pupils’
progress being the key performance indicator. Similarly, in 2002, the government has begun
piloting “value added” school performance data to supplement the raw data that were
previously based on schools’ scores. Equally, in the NHS, traditionally some basic
information about the performance of hospitals in England and Wales were made available
for internal use by hospital managers; however, it was argued that this information was of
little use because there was no link of the performance to financial rewards. Evidence of the
government’s support for a salient role for PRP in public sector performance can be found in
the 1999 White Paper Modernizing Government where it was stated that:
“the links between pay and objectives are not always clear. We must use
our pay systems – and performance pay in particular – in creative ways to
provide effective incentives to sustained high-quality performance…” (Cabinet
Office, 1999, p.21, as cited in, Cutler and Waine, 2005, p.78).
Arguments in favour of the use of scorecard rewards include focusing employees’
attention on strategic priorities, providing extrinsic motivation by rewarding employees when
they and their organisations reach their targets, minimizing gaming and sub-optimization
(which will be covered later) through the inclusion of multi-dimensional performance
measures.
Before trying to lay down some of the problems that exist from linking performance
measurement to pay it would be helpful to explore the nature of the public sector, which
might underpin some of those problems.
THE NATURETHE NATURETHE NATURETHE NATURE OF THE PUBLIC SECTOOF THE PUBLIC SECTOOF THE PUBLIC SECTOOF THE PUBLIC SECTORRRR
9. - 9 -
Many scholars have referred to profit maximization as the main difference between
the private and the public sector (e.g. Boland and Fowler, 2000), and hence the lack of a
bottom line against which performance can be measured in the public sector. On the other
hand, some argue, that since there still exists an equivalent financial measure to profitability
in the public sector which is “value for money”, then, there is no considerable difference
between both sectors (Jackson, 1990). In this respect, it can be argued that difficulties with
PMS in the public sector do not lie in the lack of bottom line performance measure but in the
complexities surrounding its measurements. Notably, however, given a profitability measure
and the objective of making a profit, the various levels of a private firm can in principle relate
their activities to the contribution they make to the firm’s profitability (Jackson, 1986). The
lack of clear objectives for the public sector organisations, on the other hand, makes it
problematic to set intermediate objectives for all levels of employees within the public sector.
It should be noted at this stage that a key potential role of performance indicators in
performance measurement in the public sector is clarification of objectives, which becomes
even more important with the presence of PRP and performance management systems such
as OFSTED in schools (Mayston, 2000).
According to Dixit, (2002), the one distinguishing feature of the public sector is the
presence of multiple principles which influences the optimal performance measurement and
incentive structure. Moreover, as a service provider, the public sector will be faced with the
difficulties of quantifying their main performance measures such as customer satisfaction,
and quality of service (Jackson, 1990); which also mainly rely on human resources who
being calculative receptors have discretion over their effort and hence need consistent
monitoring and directing towards the organisation’s goals (Neely et al., 1995). As mentioned
earlier, reinforcing the daily performance indicators of general employees is done through
linking performance measures to rewards. In fact one of the characteristics of performance
measurements consistently mentioned is that PM should be derived from the organisations’
business strategies and hence can be used as a strategic control system to influence
employees’ behaviours (Robert and Kaplan, 1992; Neely et al., 1995). This is particularly
relevant to the public sector where the overall performance is dependent on the human
factor. In fact, according to Lynch and Cross’s (1992) performance pyramid, the translation
of measures goes from bottom up, where the bottom represents the departments and work
centres which are daily monitored against four performance measures. Though Norton and
Kaplan’s (1992) balanced scorecard ignores the hierarchical relation between factors leading
to the end goal, when defining the measure of internal business perspective, they state that
managers should focus on the internal operation from which customer satisfaction is derived.
Based on the above, it can be concluded that, first, performance measurement is not
an end in itself and unless it can direct efforts towards organisational goals and influence
future performance it would only represent a tool for measuring past activities. Second, it is
by linking performance measurement to rewards that organizations can improve future
performance. In fact, a recent survey of scorecard implementation in the US found that 70
per cent of the respondents already use the balanced scorecard for compensation purposes
and 17 per cent actively considering its use for this purpose (Perrin, 1996, as cited in Ittner
et al., 1997, p.5). Furthermore, several authors have highlighted the importance of linking
business PMS to rewards (Kaplan and Norton, 1992; 1996; 2001; Eccles, 1991; Neely et al,
1995; Moon and Fitzgerald, 1996; Otley, 1999). However, most of the research in this area
has been merely descriptive. For instance, while proponents of the balanced scorecard
concept contend that this approach provides a powerful means for translating a firm’s vision
and strategy into a tool that effectively communicates strategic intent and motivates
performance against established goals, (Kaplan and Norton, 1996), the balanced scorecard
literature provides little discussion of the scorecard’s role in compensation decisions, despite
the fact that the majority of adopters use it for this purpose (Perrin, 1996, as cited in Ittner et
al., 1997, p.2). Evidently, this has brought only the potential benefits of the system to the
forefront making companies over-enthusiastic about its application. Nevertheless, there are
many problems associated with performance measurement when it comes to measuring
individual’s performance in the public sector and even worse when linking it to pay. These
10. - 10 -
problems can be classified under two main categories, one related to an economic approach
and the other to a psychological one. The rest of this paper will, hence, be organized in two
sections, the first will review the economic literature and theoretical underpinning for
performance measurement and PRP identifying problems emanating from the use of the
economic approach; and the second will look into the psychological literature and its
relevance for identifying problems with performance measurement and pay systems and will
point at the fact that using the economic literature has rather simplified those problems.
PROBLEMS WITH PMPROBLEMS WITH PMPROBLEMS WITH PMPROBLEMS WITH PMSSSS ANDANDANDAND PRPPRPPRPPRP IN THE PUBLIC SECTOIN THE PUBLIC SECTOIN THE PUBLIC SECTOIN THE PUBLIC SECTORRRR
ECONOMICECONOMICECONOMICECONOMIC APPROACHAPPROACHAPPROACHAPPROACH
Principal-agent model
The moral hazard model of incentive design is the main tool economists have used to
understand the construction of PMS and the provision of incentives (Courty and Marschke,
2003). According to economists, in many service professions such as in the public service’s
individuals (agents) have discretion over their effort, hence, being self-interested, will tend to
provide the minimum possible effort that may go unnoticed. Kreps, (1997), states that in the
standard model of Agency Theory, without extrinsic incentives, effort is necessarily at the
lowest possible level. Shareholders (principals) will, therefore, act to protect their interest
through incentive compensation – described by Jensen and Meckling, (1976), as “Agency
costs” – that steers the action of the agent towards the principal’s objectives. Given the
nature of the public sector (often serving several principals: tax payers, service users,
politicians, and professional organisations with conflicting goals), however, makes it
problematic to identify the right performance indicators, which if not clearly defined and
communicated, can result for dysfunctional and unintended behaviours.
Dysfunctional behaviour
In designing a PRP system principals should put higher incentives towards the tasks
that can be accurately measured so there would be less manipulation on effort and results,
however, this might cause agents to neglect the other less measurable tasks and spend
more effort on the high powered rewards. With multi-tasking in the public sector linking
performance measurement with pay to monitor and influence behaviour captures the notion
that the investment allocation that maximizes performance outcomes does not necessarily
correspond to the allocation that maximizes value-added (Courty and Marschke, 2003).
When individuals respond to performance indicators in a way that maximizes their
benefits this is known as the gaming response; and may include neglecting unrewarded
tasks, and manipulating and distorting results. Examples of gaming exist across the whole of
the public sector.
In the education sector, where performance measures were based on tests scores
changing students’ grades and “teaching the test” in order to boost the results-based
rewards in schools occurred. Additionally, there was a focus on pupil attainment neglecting
some of the activities that lead to productivity but are not rewarded such as teaching
citizenship, conflict resolution, and interpersonal skills whose development is an important
aim in primary schools (Courty and Marschke, 2003).
The recognition of most of the problems mentioned earlier concerning public sector
multi-tasking, multi-principals, and the lack of objectives, was one of the drivers for the
development of a new system entailing additional performance measures including
academic and non-academic indicators. Under the new scheme, first applied in July 2000,
teachers’ performance indicators are assessed against five main criteria:
11. - 11 -
•Pupil progress.
•Wider professional effectiveness (two dimensions).
•Teaching and assessment (three dimensions).
•Knowledge and understanding.
•Professional characteristics.
Source: (DfES, 2001a)
Clearly by placing pupils’ progress on top of the criteria there is a shift to value-added
based rewards. Little research was conducted to evaluate the impact of the new school PRP
system on teachers’ effort, based on the economic approach, and concluded that an
increase effort and test score gains were evident (e.g. Burgess and Croxson, 2001; Burgess
et al., 2001; Atkinson et al., 2004). However, by only focusing on one criterion (i.e. pupils’
progress) there is a lack of data on whether the improved results represented extra effort on
performance as a whole or only on this criterion and, hence, is merely a diverted effort from
other professional activities rather than improved performance. Consequently, in consistently
following the agency theory approach, it can still be argued that since agents tend to
produce the least effort or the necessary amount that leads to the benefits, then, under the
new system problems of sub-optimization, distortion, and gaming still arise. However, this is
only a suggestion based on a theoretical ground. Hence, more research is needed to
evaluate the progress in other criteria such as professional effectiveness, professional
characteristics and knowledge and understanding.
In respect to the gains in the test scores and improved pupil performance another
problem arise which is the sub-optimization of the educational outcomes compared to the
wider social goals and misalignment of performance measurement objectives with the
objectives of reward. Sub-optimization occurs when there is a lack of congruence between
PRP measures and the global objectives of the organisation. Mayston, (2000), argues that
one of the measures valued by society is student satisfaction. The current priority given to
pupil’s progress and maximizing the reported examination results may lead students to
experience additional stress and pressures from further increasing their examination results
which will consequently reduce their satisfaction and sense of fulfillment from the
educational process itself. Even worse the drop in students’ satisfaction, in turn, may impair
their examination performance (Mayston, 2000).
Moreover, given that, PRP operating in schools is an individual-based scheme,
where teachers are assessed individually against the performance measures and are given
an incremental progression up through a scale of nine increments which once reached
become permanent in their salaries two hypothesis can be derived. The first is that, since
PMS in this case are school-based as opposed to teachers’ individual assessment, there is a
misalignment of the objectives of PRP and PMS. The second is based on the fact that since
reward increments go into teachers’ permanent salary meaning that even if performance
drops the salary will remain the same, then, performance measurement in linkage to pay
would only be a tool for monitoring past performance and controlling the wage bill rather than
improving future performance.
Evidence on unintended responses and dysfunctional behaviours is also apparent in
the health sector. Goddard et al., (2000), found evidence of gaming concerning efficiency,
where respondents were reluctant to produce improvement in costs for fear that the following
year’s efficiency targets would be set at a higher level. He also noted that “financial regime in
which Trusts operate encouraged Trusts to fail to meet their financial target as these were
often “bailed out” by the region” (p.105).
Clearly the performance assessment framework being based on a balanced
scorecard approach includes wider performance measures based on financial, clinical and
patient-care indicators for hospitals (Popper and Wilson, 2003). Yet, the lack of measures
12. - 12 -
relating to clinical outcomes was evident in Goddard’s et al., (2000) study on Performance
Assessment Framework, which they called tunnel vision. In the same study, two other
problems were reported. It can be assumed that the first one which is misrepresentation
corresponds to distortion of data in the educational sector. Distortion and misrepresentation
of data can exist in the appraisal process itself where agents (teachers or clinical staff) can
only focus on the positive sides of their achievement (Forrester, 1998) since many of the
data used to measure performance are under the direct control of those staff (Goddard et al.,
2000). Similar to the reasons of gaming in the health sector, misrepresentation of data can
sometimes be negative, extending waiting times because again there is tendency to provide
additional funds to Trusts who fail to meet their objectives (Goddard et al., 2000). In this
respect, selecting performance measures that optimally trade off the desire of controllability
with the need of goal alignment are argued to be crucial for the success of PRP [Baker,
2002].
Subjectivity and perception of fairness
To avoid the problems associated with basing pay on more or less objective
measures such as misallocation of effort by the agent, gaming, misrepresentation and
distortion, and short-termism principals have to weaken the power of incentives on the more
accurately measured tasks (Burgess and Ratto, 2003). This, however, gives rise to issues
surrounding the difficulties of determining the relative weights to place on various measures
when determining rewards. Evidently the flexibility in weighting quantitative performance
measures against qualitative indicators will result in the introduction of subjectivity into the
reward process. Consequently, problems such as inequity, unfairness, and mistrust will
arise.
The issues of equity and fairness have been addressed by different theories,
reciprocity theory, equity theory, and relative deprivation theory.
According to equity theory (Adam, 1963; Adams, 1965) people compare the ratios of
their own perceived work outcomes to their own perceived work inputs to the corresponding
ratios of a comparison with others (as cited in Greenberg, 1990, p.400). If employees’
investments are not proportionate with the rewards given, inequity arises and employees will
attempt to restore the balance, which in turn, results in a range of undesired outcomes. In
fact, recent research supporting the predictions of equity theory shows that neglecting
internal comparisons of fairness may have a deleterious impact on the health of the
psychological contract since inequity is associated with job satisfaction (Perry, 1993; Ago et
al., 1993; Witt and Nye, 1992; Berg, 1991; Summers & Hendrix, 1991; Moorman, 1991;
Covin et al., 1993, as cited in Balkin et al., 1998), absenteeism and turnover (Geurts,
Schaufeli, & De Jonge, 1998; Iverson &Roy, 1994; Van Yperen, Hagedoorn, & Geurts, 1996
as cited in Taris et al., 2002; Covin et al. 1993; Weiner, 1980, as cited in Balkin et al., 1998),
and lack of organisational commitment (Schaufeli, Van Dierendonck, & Van Gorp, 1996 as
cited in Taris et al., 2002). Though it is difficult to argue with the basic principle: “that it is
equitable to reward employees according to their contribution” (Thompson and Milestone,
2001, p.35), there is a large behavioural literature arguing that treating employees differently
from each other is detrimental to employee morale (Baker et al., 1988). In their evaluation of
PRP in the NHS, Richardson and Dowling, (1997, p. 354), further argued that the inclusion
of qualitative data in performance measurement produced frequent scepticism, both on the
possibility of measuring the job performance of NHS managers at all properly, and on the
likelihood of subjective judgments .
While it was stated in that study that only a minority, 24 per cent felt that their
appraisal interviews were not conducted appropriately, 26 per cent did not understand how
their performance was measured, 30 per cent felt that their performance was not measured
fairly, 67 per cent thought that there was a significant degree of subjective judgment in the
making of PRP awards. Stronger evidence of unfairness is also apparent in the research
conducted in BT (British Telecom) where only 6.5% of the respondents said PRP at BT had
brought an improvement in managerial performance, while as many as 63% believed it had
13. - 13 -
been applied unfairly in practice causing de-moralization (Kimble, 2005). In the Inland
Revenue, it was added that de-motivation also arose from perceiving the whole concept as
unfair. In order to maintain trust and effective working relationship with their peer group
managers tend to distribute the pot of PRP fairly between the team rather than reward high
performers. This, nevertheless, raised doubts in operating PRP fairly in a cash limited
environment like the public sector. In respect to subjective performance measurement
Lawler, (1971), concludes that “pay plans based on subjective criteria have little chance of
success” because employees don’t trust superiors to accurately evaluate their performance.
He, further, argues that, “the more subjective the measure, the higher the degree of trust
needed, because without high trust there is little chance that the subordinate will believe that
his pay is really fairly based on performance.” (p.171, as cited in Baker et al., 1988).
It should be noted that the notion of fairness not only exists in the appraisal process
but also in the process of negotiating the contract. It is the reciprocity theory that postulates
that agents prefer a condition of fairness in their exchange relationship with the principal. In
this respect, the perception of fairness of a contract is an important element of the
psychological contract, which helps predict the kind of reward employees are expecting in
exchange for their level of effort invested in the company (Hiltrop, 1996). However, once
more, standard agency models tend to rather simplify this type of interaction between the
agent and the principal (Herpen, et al., 2003).
Based on the above it can be hypothesized that by ignoring the psychological
interaction in the process of performance measurement economists tend to ignore issues
such as social comparison, equity, and trust.
Though equity has been treated within the economic literature, little attention has
been placed on equity as one of the variable leading to motivation, thus more attention
needs to be paid to the psychological consequences of systems such as performance
measurement on behaviours.
PSYCHOLOGICAL APPROAPSYCHOLOGICAL APPROAPSYCHOLOGICAL APPROAPSYCHOLOGICAL APPROACHCHCHCH
Although agency theory has been used by most economists as a theoretical
underpinning for PMS and incentives, economic literature has largely neglected the various
psychological effects of monetary rewards on behaviour and thus on effort (Frey, 1997).
Similarly, evidence of increased effort and productivity in the public sector is apparent in
many of the studies based on an economic approach (e.g. Burgess and Croxson, 2001;
Burgess et al., 2001; Atkinson et al., 2004) as well as a psychological approach (Richardson
and Dowling, 1997; Marsden and French, 1994; Heery, 1996; Marsden and French, 1998);
hence PRP systems were sustained. Yet, impact of these systems on employees’ behaviour
such as motivation has been negative (Thompson, 1992; Marsden and French, 1998;
Marsden and French, 1994; Richardson and Dowling, 1997; and Marsden, French and
Kubo, 2001).
Despite the fact that agency theory contributes to understanding the behaviour of
agents and provides a rich fund of practical implications for the design of incentive contracts
(Pfuff and Kunz, 2002), evidently, economists have taken a clinical approach to human
motivation, meaning that the behaviour of agents is assumed to be rational (Herpen et al.,
2003). Employee resistance towards pay for performance systems in the public sector may
therefore be little understood by economists, given the perceived potential benefits of tying
pay to performance. Industrial organisational psychology, organisational behaviour, and
sociology, on the other hand, have paid greater attention to the complexities of the concept
of motivation, looking at both, intrinsic and extrinsic motivation, thus, providing alternative
explanations for why monetary rewards may be counter-productive.
The following section will draw attention to the importance of the psychological, social
psychological, sociological, and organisational behaviour theories and their relevance to
14. - 14 -
performance measurement and rewards with the aim of highlighting their contribution to
performance measurement and reward studies.
Problems with motivation
Though economic arguments for the introduction of PRP, based on agency theory,
are often flawed, motivation is always referred to as the main reason for the increased level
of efforts. Consequently, the rationale and objectives of PRP have been mostly reported as
to better motivate staff by basing salary on performance rather than seniority. Hence, most
empirical researches have tested the impact of PRP on employees’ motivation in the public
sector through the lenses of two main theories; expectancy and goal-setting theory.
According to the expectancy theory motivation is affected by three factors. The
first is expectancy which concerns the individual’s perception that effort is positively
correlated with performance. The second factor is instrumentality, which concerns an
individual’s expectation that this reward is closely tied to his performance; and the third is
called valence and is a measure of the degree to which an individual values a particular
reward. Although expectancy theory has been criticized for being based exclusively on
extrinsic rewards, ignoring the role played by other intrinsic incentives in motivating
individuals, it should be noted that the theory indicates that money can act as a motivator
only if it is perceived as a means of achieving goals in the presence of a clear link between
effort and reward. Thus, the emphasis is on the intrinsic motivation of the perceived
relationship effort and good outcome for effort incentives (Sloof and Praag, 2005).
It is argued that the second and third factors of the model can be translated into the
agency model, where instrumentality is given by the incentive intensity in the agency model,
while valence refers to the arguments that appear in the agent’s utility factor – i.e. wage and
effort (Sloof and Praag, 2005, p.8). The only factor that differentiates the two theories is
expectancy which might explain the agent’s reaction to the pay-performance sensitivity when
they select their level of effort. Though it was found that levels of efforts are invariant to
expectancy (Sloof and Praag, 2005), and thus productivity increased regardless of that
factor, motivation was reported as negative (Thompson, 1992; Marsden and French, 1998;
Marsden and French, 1994; Richardson and Dowling, 1997; and Marsden, French and
Kubo, 2000).
From the above it is evident that imperfect performance measurement remains one
of the central reasons for employees’ disenchantments with PRP in the public sector. In fact,
Marsden, (2004), maintains that the quality of appraisal which plays a central part in both
expectancy and agency theory is the key independent variable for the perceived incentive
and divisiveness of PRP.
Murnane and Cohen, (1986), claim that PRP works best where there are clearly
measurable outcomes, which, does not apply to the case of the service sectors [Chamberlin,
et al., 2002, p34]. In the public sector jobs, where measurable outcomes are unclear, where
PRP has been introduced, no evidence was reported of improved motivation. Marsden,
(2004), provides summary evidence on employees’ responses to PRP in six areas of he
public sector: Inland Revenue, (1991 and 1996), the Employment Service, two National
Health Service Trusts Hospitals, and head teachers in primary and secondary schools in
table 1.
15. - 15 -
(Marsden, 2004, p.357)
In studying the effect of PRP on employees’ behaviours in four different local
authorities in the local government, Heery, (1996), concludes that:
“… PRP schemes of the kind operated in local government tend to have
a rather limited impact on workers’ behaviour. The process of work in the four
authorities, it seems, runs along its established course and PRP has been
insufficient to jolt it down a radically new path… PRP in this respect appears to
be something of a damp squib” (p. 219).
Similarly, in their study conducted in the Inland Revenue, Marsden and Richardson,
(1994), concluded that:
‘The positive motivational effects of Performance Pay . . . were at most
very modest . . . Even worse, there is clear evidence of some de-motivation’ (p.
253).
16. - 16 -
Moreover, in the follow-up study conducted by Marsden and French in the Inland
Revenue in 1996, a significant rise in the reported adverse behavioural effect with the
system was evident, indicating that familiarity with the system do not generate more
approval (Richardson, 1999). Similarly, in the Employment Services, Marsden and French,
(1998), found that most staff did not believe it had raised their own motivation, and hence,
concluded that the net effect of performance pay on motivation has been negative. Echoing
the above results are teachers’ responses to the effect of PRP in two schools, where
motivation has been reported negative (Marsden and French, 1998).
Contrary to the above, however, is the study of the NHS, where there were
significantly higher percentages of reported motivation; though not higher than 30 per cent,
this number is still significant given that the rest of the respondents did not report de-
motivation but rather no effects (Richardson and Dowling, 1997). It should be noted that,
appraisal systems, in this case, operated in light of the goal-setting theory, which might set
the explanation why the scheme appears to be more motivating to managers.
Goal-setting theory places less emphasis on rewards and stresses the motivating
power of defining appropriate work goals and engaging employee commitment to them
(Marsden, 2004, p.354). A number of studies have attempted to examine the relationship
between goal-setting and performance. It was found that the majority of evidence suggests
strong support for the theory. In fact, it is where managers were not sure of their objectives,
doubts into the credibility of the system evolved. Marsden, et al., (2001), found that when
employees thought PRP had led managers to set targets more clearly (because they have to
appraise them afterwards), and if they thought their last appraisal fair, then they were more
likely to experience positive incentive effects (p. 11). Additionally, evidence on the fact that
PRP helps setting goals more clearly was apparent in the Inland Revenue and the NHS
where the clarification of objectives, that the scheme had introduced, was seen as more
effective motivator than money and was seen as one of the main pillars of the success of the
scheme (Marsden and French, 1998).
Inevitably, however, some contrary findings are especially evident when identifying
performance dimensions by using a goal-setting theory is followed by another set of issues
concerning how these dimensions and goals can be measured [Mullins, 1999]. In the Inland
Revenue, there was no evidence that clearer goals helped motivation towards better
performance particularly that the majority of individuals felt that they were already working at
their maximum level of effort. Similarly, in 1996, research conducted in a multi-divisional
company in Ireland argued that, despite the fact that 87 per cent of managers considered
that their set objectives were 'clear and specific', 78 per cent still ranked 'measurement of
performance' as one of the top three disadvantages with the system, indicating that clear
and specific objectives do not necessarily result in an adequate measure of performance
(Kelly and Monks, 1996). Additional difficulties with the measurement of performance were
also evident in the comments which reflected the problems involved in defining and
measuring goals, especially for managerial positions: 'True goals are hard to clarify and
harder still to judge' (manager, 1996, as cited in Kelly and Monks, 1996).
Once more, the role of clear measures and fair performance measurement system is
apparent in need for a successful reward system as a motivator. Moreover, extrinsic rewards
were not perceived as the prime motivator given the nature of the public sector (i.e. serving
the community). In fact, it was claimed that PRP contradicts the personal standards or the
ethos of the NHS, as one manager stated (Dowling and Richardson, 1997):
Pay in the NHS is definitely NOT a motivator. Most of my colleagues
work far in excess of their contracted hours for little or no financial rewards.
17. - 17 -
…Having worked as a professional paramedic for 18 years before going
into general management I have never been motivated I believe by financial
reward and this continues to be the case in general management. My motivation
is to get the job done to the best of my ability. (p. 356)
From the above statement there is clear evidence that managers are more
intrinsically motivated by the desire to produce public value from which the community will
benefit.
Moreover, it is argued that setting financial rewards based on performance may
actually be counter-productive in that it may send the signal that the relationship between the
workers and the organisation is a pure market relationship (Burgess and Ratto, 2003, p.10).
Yet economists have tended to exclusively use the agency theory to analyse the linkage
between and working of performance measurement and reward system, neglecting the
importance of providing a balance between intrinsic and extrinsic motivation, and it was not
until recently that attempts have been made to insert psychological approaches in economic
theory (Frey, 1997; Frey and Jegen, 2001; Osterloh and Frey, 2000).
The basic idea that extrinsic rewards may have a deleterious effect on intrinsic
motivation stems from the psychological theory called cognitive evaluation theory (Deci,
1975) which argues that individuals strive to fulfil two basic needs: self-determination and
competence. Subsequently, Deci, (1975), argues that providing financial rewards, places
emphasis on the extrinsic motivation driving the focus away from the intrinsic one. Moreover,
he differentiates between two aspects of every reward, a controlling and an informational
one. If rewards place emphasis on the control factor, feelings of self-determination and
competence decrease in light of restricting the individual’s action and hence, diminish
intrinsic motivation; contrastingly, emphasizing the informational aspect can increase the
intrinsic motivation since it provides individuals with information about their level of
competence and self-determination (Kunz and Pfaff, 2002). Recently, the concept of intrinsic
motivation has enjoyed increasing popularity in the economic field. The integration of
psychological theories in the economic theory, consequently, resulted in the development of
the motivation crowding theory (Frey, 1997), which is closely related to the cognitive
evaluation theory. The crowding theory by suggesting that monetary incentives will crowd
out intrinsic motivation opposes the economic view held by the agency theory that levels of
effort will be affected by the level of incentives. Although, Frey, (1997), states that the
motivation crowding theory explores the psychological effects of monetary rewards and effort
in order to treat the weakness of economic theories which only considered the absolute
monetary incentives and strategic benefit, more empirical research need to be done in that
area in order to examine the effectiveness of performance measurement and reward
systems and their impact on employees’ behaviours particularly on the long-term.
It is worth mentioning at this point that from an agency theory perspective, it might be
argued that the negative motivational impact and the divisiveness of PRP reported in the
public sector could simply be the result of employees’ resentment to the system since
according to the agency theory such systems oblige employees to produce more effort. By
arguing that there is only a minority of employees in the public sector who would “shirk”
because of high levels of organisational commitment among public servants Marsden,
(2002), implies questioning one of the factors presented in the agency theory and its
relevance to the public sector: providing minimum level of efforts. However, with recent
studies referring to new employment relation and the changing state of the psychological
contract in the public sector (Anderson and Schalk, 1998; Millward and Hopkins, 1998;
Rousseau, 2000; Hecker et al., 2002; Rousseau, 2004) one should reconsider measuring
the state of commitment among public servants. In fact, Le Grand, (1997), argues that the
18. - 18 -
nature of public services is changing from one where employees were seen as serving the
community to one where all parties are self-interested. On the other hand, this change in the
nature of the psychological contract can be argued to be the result of more flexible
measurement and pay systems, as it is noticed that this change only came about at the
same time that rewards were transformed from being based on seniority to one where
employment contracts lack security given a reward based on performance.
CONCLUSIONCONCLUSIONCONCLUSIONCONCLUSION
Performance measurement systems, which assess an organisation’s performance
against its performance indicators, have been widely applied in the public sector after the
modernisation agenda characterised under the heading “Public Sector Management”.
Although performance assessment is not a new phenomenon to the public sector,
performance measurement has undergone considerable changes over the past decade with
an increasing emphasis on the use of a combination of financial and non-financial
performance measures following the extensive criticism traditional systems have received for
being short-term and lacking a link to business strategy. One of the central aspects of this
change and a central defining feature of the New Public Management is linking the
measurement of the public services’ performance to financial rewards. In fact, several
scholars have highlighted the importance of linking performance measurement systems and
particularly the balanced scorecard to rewards. Hence, the past decade has witnessed a
growing body of literature on performance measurement and performance related pay in the
public sector.
Benefits of linking performance measurement to rewards include providing a powerful
means of linking and communicating the organisation’s strategy to all levels employees, and
motivating employees by clarifying goals and targets (e.g. Kaplan and Norton,1992; 1996;
2001; Eccles, 1991; Neely et al, 1995; Moon and Fitzgerald, 1996; Otley, 1999). However,
by reviewing the literature of performance measurement and performance related pay, this
paper suggests that there still remains a gap in the literature concerning three main issues.
First, the literature on the balanced scorecard provides little discussion of the scorecard’s
role in determining rewards. Thus, companies are left with deciding on the choice of multiple
measures and their weights with little information on how to create a balance in the
compensation scheme. Second, there is a lack of evidence on the strength of the linkage of
performance measurement and reward systems in practice. Evidently, by reviewing the
literature of both performance measurement systems and performance related pay systems
in the public sector, this paper hypothesises that there is a misalignment of objectives
between both systems. For example, in the education sector performance measurement
systems (OFSTED) produce school-based reports while rewards are based on individual
performances, which is claimed to discourage teamwork. However, few empirical researches
have evaluated this linkage. Yet, their findings are not consistent. For instance, while Kaplan
and Robert, (2004; 2001), show positive effects of using performance measurement in
determining rewards, Ittner et al., (1997; 2003), and Goddard et al., (2002), show that linking
performance measurement to rewards may result in dysfunctional behaviours, including
gaming, tunnel vision, misrepresentation, neglecting tasks, and short-termism. Moreover, the
level of subjectivity found in the process of measuring performance has proved to have a
negative impact on employees’ behaviour and cause demoralisation when it comes to linking
pay to performance (Marsden and French, 1998; Dowling and Richardson, 1997; Marsden
and Richardson, 1994; Heery, 1996). The third gap arising here is that, though few
researchers attempt to insert psychological approaches in economic theory most research in
this area has been presented in the economic field and has rather simplified its interrelation
with other fields such as sociology, industrial relations, and organisational psychology, which
in fact draw more attention to the importance of the human resources and hence to the
psychological aspects and consequences of performance related pay on employees’
behaviours. Subsequently, again this seems to weaken the linkage between performance
measurement and performance related pay systems.
19. - 19 -
A central element to reviewing performance measurement systems is the nature of
the public sector. Many scholars have recognised the differences between the nature of the
public sector and the private one, referring to the presence of multiple tasks and multiple
principles as well as the lack of profit maximisation as the main differences and hence the
main complexities surrounding the application of performance measurement and
performance related pay systems in the public sector. However, there has been a disregard
or rather a simplification of the psychological aspects inherent in the public sector namely
public service ethos. Traditionally under the notion of public sector ethos employees
benefited from an open-ended employment contract, which, in turn, created a psychological
contract that is relational in nature where employees were motivated and committed to
providing maximum effort and best quality services to the community in exchange for long-
term job security. With the New Public Management Reform increasingly importing practices
from the private sector in order to improve quality and performance, it is suggested that the
public sector economy is becoming more market-driven which is suggested may be
endangering the public sector ethos (Morgan and Allington, 2003) and changing the nature
of the psychological contract (Hiltrop, 1996). It is argued that changing rewards from
seniority based to more flexible rewards based on performance, have affected employees’
feelings of job security, and hence, tend to reduce the peculiar commitment and motivation
previously found among public sector workers.
Although, as stated earlier, advocates of the agency theory might argue that the
resentment of employees against systems such as performance measurement and
performance related pay is due to the fact that agents are expected to ‘shirk’ and with the
studies suggesting a change in the psychological contract, one would believe such
argument, Marsden et al., (2001), concluded that employee commitment was the main factor
sustaining performance related pay systems in the public sector albeit combined with a
negative impact on behaviour. It is, hence, important to draw more attention to the level of
commitment in the public sector, the nature of the psychological contract, and the impact of
such systems on not only behaviours (i.e. motivation) but also attitude (i.e. commitment).
Finally this means that more attention and investigation is required into the nature of the
effort bargain from multiple perspectives: economic, sociological and psychological, to name
but a few.
20. - 20 -
References
Anderson, N. and Schalk, R. (1998) “The Psychological Contract in Retrospect and Prospect”,
Journal of Organisational Behavior, No. 19, pp. 637-649.
Arveson, P. (1998) “What is the Balanced Scorecard?”, [www],
http://www.balancedscorecard.org/basics/bsc1.html, (Accessed 24 June 2005).
Atkinson, A.A., Waterhouse, J.H. and Wells, R.B. (1997) “A stakeholder's approach to strategic
performance measurement”, Sloan Management Review, Spring, pp. 25-37.
Atkinson, A.A., Burgess, S., Croxson, B., Gregg, P., Propper, C., Slater, H. and Wilson, D.
(2004), “Evaluating the Impact of Performance Related Pay for Teacher in England”,
Working Paper, CMPO.
Baker, G. (2002) “Distortion and Risks in Optimal Incentive Contracts”, Forthcoming Journal of
Human Resources, [www],
http://www.sync-relations.at/2003/downloads/George%20Baker/Distortion_and_Risk.pdf.
(Accessed 14 June 2005).
Baker, P.B., Jensen, M. C. and Murphy, K. J. (1988) “Compensation and Incentives: Practice
VS. Theory” Journal of Finance, Vol. 13, No. 3, pp.593-616.
Balkin, D., Sire, B. and Tremblay, M. (1998) “The Role of Organisational Justice in Pay and
Employee Benefit Satisfaction, and its Effects on Work Attitudes”, CIRANO.
Ballantine, J., Brignall, S. and Modell, S. (1998) “Performance measurement and management
in public sector health services: a comparison of U.K and Swedish practice”, Management
Accounting Research, 1998, No. 9, pp.71-94.
Ballantine, J. and Brignall, S. (1996) “Performance measurement in service businesses
revisited”, International Journal of Service Industry Management, Vol. 7, No. 1, pp. 6-31.
Boland, T. and Fowler, A. (2000) “A systems perspective of performance management in
public sector organisations” The International Journal of Public Sector Management, Vol. 13,
No. 5, pp. 417-446.
Bourne, M., Neely, A., Mills, J. and Platts, K. (2003) “Implementing Performance Measurement
Systems: a literature review”, International Journal of Business Performance Management,
Vol. 5, No. 1, pp.1-24.
Brignall, S. and Modell, S. (2000) “An institutional perspective on performance measurement
and management in the “New Public Sector””, Management Accounting Research, Vol. 11,
No. 3, pp. 281-306.
Burgess, S. and Croxson, B. (2001) “The impact of teacher pay reform on pupil attainment: an
outline of the CMPO research project on the performance threshold”, Working Paper,
CMPO, No. 01/36.
Burgess, S., Croxson, B. and Gregg, P. (2001) “The Intricacies of the Relationship Between
Pay and Performance for Teachers: Do Teachers Respond to Performance Related Pay
Schemes?”, Working Paper, CMPO, No. 01/035.
Burgess, S., Propper, C. and Wilson, D. (2002) “Does Performance Monitoring Work? A
Review of the Evidence from the UK Public Sector, Excluding Health Care” Working Paper,
CMPO, No. 02/049.
Burgess, S. and Ratto, M. (2003) “The Role of Incentives in the Public Sector: Issues and
Evidence”, Working Paper, CMPO, No. 03/071.
Citizen-Driven Government Performance, A brief guide for performance measurement in local
government, up-dated 09 February 2004, [www],
21. - 21 -
http://www.andromeda.rutgers.edu/~ncpp/cdgp/teaching/brief-manual.html [accessed 10 July
2005].
Chamberlin, R., Wragg, T., Haynes, G., and Wragg, C. (2002) “Performance-related pay and
the teaching profession: a review of the literature”, Research Papers in Education, Vol. 17,
No. 1, pp 31-49.
Chang, L., Lin, S. and Northcott, D. (2002) “The NHS Performance Assessment Framework: a
“balanced scorecard” approach?”, Journal of Management in Medicine, Vol. 16, No. 5, pp.
345-358.
Courty, P. and Marschke, G. (2003) “Dynamics of Performance Measurement Systems”, Paper
prepared for the Oxford Review of Economic Policy, pp. 1-29.
Cross, K. F. and Lynch, R. L. (1992) “For good measure”, CMA Magazine, Vol. 66, No. 3,
pp.20-24.
Crawford, K. and Cox, J. (1990) “Designing Performance Measurement Systems for just in
time operations”, International Journal of Production Research, Vol. 28 No. 11, pp. 2025-36.
Cutler, T. and Waine, B. (2005) “Incentivizing the Poor Relation: ‘Performance’ and the Pay of
Public-sector ‘Senior Managers’”, Competition and Change, Vol. 9, No. 1, pp.75-87.
Dixit, A. (1997) “Power of incentives in private versus public organisations”, The American
Economic Review, Vol. 87, No. 3, pp.378-382.
Dixit, A. (2002) “Incentives and organisations in the public sector: An Interpretive Review”,
Journal of Human Resources, Vol. 37, No. 4, pp. 696-727.
Dowling, B. and Richardson, R. (1997) “Evaluating Performance Related Pay for managers in
the National Health Service”, The International Journal of Human Resource Management,
Vol. 8, No. 3, pp.348-366.
Eccles, R.G. (1991) “The performance measurement manifesto”, Harvard Business Review,
Jan/Feb., pp.131–137.
Euske, K. J., Lebas, M. J. and McNair, C. J. (1993) “Performance Measurement in international
setting”, Management Accounting (US), October, pp.41-44
Fitzgerald, L., Johnson, R., Brignall, T. J., Silvestro, R., and Voss, C. (1991) “Performance
Measurement in Service Businesses”, The Chartered Institute of Management Accountants,
London.
Fitzgerald, L. and Moon, P. (1996) “Performance Measurement in Service Industries: Making it
Work”, The Chartered Institute of Management Accountants: London.
Forrester, G. (1998) Performance-related pay for teachers: an examination of the underlying
objectives and its application in practice, Public Management Review, Vol. 3, No. 4, pp. 617-
625.
Frey, B. S. (1997a). “Not Just for The Money, An Economic Theory of Personal Motivation”,
Cheltenham, UK and Brookfield, USA: Edward Elgar
Frey, B. and Oberholzer-Gee, F. (1997) “The cost of price incentives: an empirical analysis of
motivation crowding-out”, The American economic review, No. 87, pp.746-755.
Frey, B. and Jegen, R (2001) “Motivation crowding theory: a survey of empirical evidence”,
Journal of economic surveys, No. 15, pp.589-611.
Ghalayini, A.M. and Noble, J.S. (1996) ‘The changing basis of performance measurement’,
International Journal of Operations and Production Management, Vol. 16, No. 8, pp.63–80.
Ghalayini, A.M., Noble, J.S. and Crowe, T.J. (1997) “An integrated dynamic performance
measurement system for improving manufacturing competitiveness”, International Journal of
Production Economics, Vol. 48, pp.207–225.
22. - 22 -
Goddard, M., Mannion, R. and Smith, P. C. (1999) “Assessing the Performance of NHS
Hospital Trusts: the role of ‘Hard’ and ‘Soft’ information”, Health Policy, Vol. 48, No. 2,
pp.119-134.
Goddard, M., Mannion, R. and Smith, P. (2000) “Enhancing performance in health care: a
theoretical perspective on agency and the role of information”, Health Economics, Vol. 9,
pp.95-107.
Goddard M. and Mannion R. (2000) “The Impact of Performance Measurement in the NHS”,
Report 1, Empirical Analysis of the Impact of Public Dissemination of the Scottish Clinical
Resource and Audit Group Data.
Greenberg, J. (1990) “Organisational Justice: Yesterday, Today, and Tomorrow”, Journal of
Management, Vol. 16, No. 2, pp. 399-432.
Haktanir, M. and Harris, P. (2005) “Performance measurement practice in an independent
hotel context: A case study approach”, International Journal of Contemporary Hospitality
Management, Vol. 17, No. 1, pp. 39-50.
Heery, E. J. (1996) “Performance-related pay in Local Government: a case study of the New
Industrial Relations”, Ph.D. Thesis, University of London.
Hepworth, P. (1998) “Weighing it up: a literature review for the balanced scorecard”, Journal of
Management Development, Vol. 17, No. 8, p. 559-563.
Herpen, M. V., Praag, M. V. and Cools, K. (2003) “The Effects of Performance Measurement
and Compensation on Motivation”, Tinbergen Institute, Discussion Paper, No. 048/3.
Hill, T. (1995) “Manufacturing Strategy: The Strategic Management of the Manufacturing
Function”, 2nd ed., Macmillan: London.
Hiltrop, J. M. (1996) “Managing the changing psychological contract”, Employee Relations, Vol.
18, No. 1, pp. 36-49.
Ittner, C. D., Larcker, D. F. and Meyer, M. W. (1997) “Performance, compensation, and the
balanced scorecard”, The Wharton School, University of Pennsylvania, November 1, pp.1-40
Ittner, C.D., Larcker, D.F. and Meyer, M.W. (2003) “Subjectivity and the Weighting of
Performance Measures: Evidence Form a Balanced Scorecard”, Accounting Review,
Jackson, P. (1986) “Performance Measurement and Value for Money in the Public Sector: The
Issues, IN: The Institute of Chartered Accountants of Scotland, The Chartered Institute of
Public Finance and Accountancy, “Performance Measurement in the Public and the Private
Sectors”, Research Conference.
Jackson, P. (1990) “Measuring Performance in the Public sector”, Collected Papers from The
Second Public Sector Conference of the Fédération des Experts Comptables Européens
(FEE), pp. 11-22.
Jagdev, H., Bradley, P. and Molloy, O. (1997) “A QFD based performance measurement tool”,
Computers in Industry, Vol. 33, pp. 357-66.
Jensen M.C, & Meckling W.H (1976) “Theory of the firm: Managerial behaviour, Agency Costs
and ownership structure”, Journal of Financial Economics, Vol. 3, No. 3, pp. 305-360
Johnsen, A. (2000) “Public sector performance measurement uncertainty, ambiguity and
epistemic communities”, Department of Accounting and Business Method, The University of
Edinburgh, 9th
version, pp.1-40.
Kaplan, R. S. and Cooper, R. (1998) “Cost and Effect: Using Integrated Cost Systems to Drive
Profitability and Performance”. Boston, MA: Harvard Business School Press
Kaplan, R. S. and Norton, D. P. (1992) “The balanced scorecard - Measures that drive
Performance”, Harvard Business Review, January-February, pp.71-79.
23. - 23 -
Kaplan, R. S. and Norton, D. P. (1996a) “Using the balanced scorecard as a strategic
management system”, Harvard Business Review, January-February, pp. 75-85.
Kaplan, R. S. and Norton, D. P. (1996b) “The Balanced Scorecard: Translating Strategy into
Action”, Harvard Business School Press, Cambridge, MA.
Kaplan, R. S. and Norton, D. P. (2001) “Transforming the Balanced Scorecard from
Performance Measurement to Strategic Management: Part I”, American Accounting
Association, Vol. 15, No. 1, pp. 87-104.
Kaplan, R. S. and Norton, D. P. (2004) “the strategy map: a guide to aligning intangible
assets”, Strategy and Leadership, Vol. 32, No. 5, pp. 10-17.
Kelly, A. and Monks, K. (1996) “Performance related pay: What Makes a successful Scheme?,
DCUBC Research Paper 1996-1997, No. 18, [www],
http://www.dcu.ie/business/research_papers/no19.htm [accessed 29 June 2005].
Kimble, C. “MIS Case Study Notes”, [www],
http://www-users.cs.york.ac.uk/~kimble/teaching/mis/case_study_two/case_study_two.pdf,
(accessed 28 June 2005).
Kreps, D. (1997) “Intrinsic motivation and Extrinsic incentives”, The American Economic
Review, Vol. 87, No. 2, pp. 359-364.
Kunz, A. H. and Pfaff, D. (2002) “Agency theory, performance evaluation, and the hypothetical
construct of intrinsic motivation”, Accounting, Organisations, and Society, No. 27, pp.275-
295.
Le Grand, J. (1997) “Knights, Knaves or Pawns?”, Human Behaviour and Social Policy,
Journal of Social Policy, Vol. 26, No. 2, pp.149-169.
Marsden, D. & Richardson, R. (1994) Performance for pay? The effects of “merit pay” on
motivation in a public sector. British Journal of Industrial Relations, June, pp.243-261.
Marsden, D. and French, S. (1998) “What a Performance: PRP in public services”, Discussion
paper published by: CENTRE for ECONOMIC PERFORMANCE.
Marsden, D. French, S. and Kubo, K. (2000) Why Does Performance Pay De-motivate?
Financial Incentives versus Performance Appraisal. Discussion paper published by:
CENTRE for ECONOMIC PERFORMANCE.
Marsden, D., French, S. and Kubo, K. (2001) “Does Performance Pay De-motivate, and does it
matter?” Discussion paper published by: CENTRE for ECONOMIC PERFORMANCE.
Marsden, D. (2004) “The role of performance-related pay in renegotiating the “effort bargain”:
the case of the British public service”, Industrial and Labour Relations Review, Vol. 57, No.
3, pp. 350-370.
Mayston, D. (2000) “Performance Management and Performance Measurement in the
Education Sector”, The University of York, Discussion Papers in Economics, No. 2000/40,
pp.1-30.
Milward, L.J. and Hopkins, L.J. (1998) “Psychological Contracts, Organisational and Job
Commitment”, Journal of Applied Social Psychology, Vol. 28, No. 16, pp. 1530-1556.
Morgan, P. and Allington, N. (2003) “Private Sector ‘Good’ Public Sector ‘Bad’? Transformation
or Transition in the UK Public Sector”, Scientific Journal of Administrative Development, Vol.
1, No. 1, pp. 22-53.
Morisawa, T. (2002) “Building Performance Measurement Systems with the Balanced
Scorecard Approach”, Nomura Research Institute, No. 45, pp.1-17.
Moullin, M. (2002) Delivering Excellence in Health and Social Care. Buckingham: Open
University Press.
24. - 24 -
Moullin, M. (2003) “Perspective on Performance”, Performance Measurement Association, Vol.
2, No. 2, pp.1-25.
Mullins, L. (1999) Management and Organisational Behaviour, 5th ed. Financial Times: Pitman
Publishing.
Nanni, A. J., Dixon, J. R. and Vollmann, T. E. (1992) “Integrated performance measurement:
management accounting to support the new realities”, Journal of Management Accounting
Research, Fall, pp.1-19
Neely, A. (1995) “Performance measurement system design: theory and practice”,
International Journal of Operations and Production Management, Vol. 15, No. 4.
Neely, A., Mills, J.F., Gregory, M. J. and Platts, K (1995) “Performance measurement design –
a literature review and research agenda” International Journal of Operations and Production
Management, Vol. 15, No. 4, pp.80-116.
Neely, A. (1998) “Measuring Business Performance: Why, What and How”, The Economist
Books: London.
Neely, A., Mills, J., Platts, K., Richard, H. and Bourne, M. (2000) “Performance measurement
system design: developing and testing a process-based approach”, International Journal of
Operations and Production Management, Vol. 20, No. 10, pp.1119-1145.
Neely, A., Adams, C., and Crowe, P. (2001) “The performance prism in practice”, Measuring
Business Excellence, Vol. 5, No. 2, pp.6-12.
Neely, A., Adams, C. and Kennerley, M. (2002) “The Performance Prism: The Scorecard for
Measuring and Managing Business Success”, Financial Times-Prentice Hall: London
Newcomer, K. E. (1997) “Using Performance Measurement to Improve Programs”, New
Direction for Program Evaluation, No. 75, pp. 5-14.
Otley, D. (1999) “Performance management: a framework for management control systems
research”, Management Accounting Research, No.10, pp.363-382.
Popper, C. and Wilson, D. (2003) “The use and usefulness of performance measures in the
public sector”, Oxford Review of Economic Policy, Vol. 19, No. 2, pp.250-267.
Powell, S. (2004) “The challenges of performance measurement”, Management decision, Vol.
42, No. 8, pp. 1017-1023.
Richardson, R. (1999) “Performance Related Pay in Schools – An Assessment of the Green
Papers”, Report prepared for the National Union of Teachers, pp. 1-32.
Sloof, R. and Praag, M. V. (2005) “Performance Measurement, Expectancy and Agency
Theory”, Tinbergen Institute, Discussion Paper, No. 026/1.
Stephenson, B. (2003) “Civil Service Reform in the UK” No. 2, [www], http://www.spa.msu.ru/e-
journal/2/31_2.php (Accessed 27 June 05).
Tangen, S. (2004) “Performance measurement: from philosophy to practice”, International
Journal of Productivity and Performance Management, Vol. 53, No. 8, pp. 726-737.
Taris, T. W., Kalimo, R. and Schaufeli, W. B. (2002) Inequity at work: its measurement and
association with worker health, Work and Stress, Vol. 16, No. 4, pp. 287-301.
Thompson, M. (1992) Pay and Performance: The Employer Experience. The Institute of
Manpower Studies, June, report No. 218.
Thompson, P. and Milsome, S. (2001) Reward Determination in the UK, The CIPD, Research
Report.