Presentation by Christiane Arndt, Programme Co-ordinator Measuring Regulatory Performance, OECD, at the 6th Expert Meeting on Measuring Regulatory Performance: Evaluating Stakeholder Engagement in Regulatory Policy, The Hague, 16-18 June 2014. Further information is available at http://www.oecd.org/gov/regulatory-policy/

1. Launch of the publication
“OECD Framework for Regulatory Policy
Evaluation”
Christiane Arndt, Programme Co-ordinator Measuring
Regulatory Performance, OECD
6th Expert Meeting on Measuring Regulatory Performance
17 June 2014

2. Why?
Evaluation of regulatory policy helps to:
• Target scarce resources for reform efforts
• Communicate progress
• Generate the political support needed for
implementing regulatory policy reforms

3. • Identify a framework that countries can take and
apply in their own country as a diagnostic tool
for regulatory policy evaluation
• Develop options for a set of indicators for the
domestic evaluation of the performance of
regulatory policy
• Provide consolidated information on how
regulatory policy performance is currently
evaluated across OECD countries
How?

4. • Engagement of Steering Group
• Expert papers (2011-2012)
• Workshop in Madrid “Developing a Framework for Measuring
Regulatory Performance in OECD countries” (2011)
• Approval of Framework at the RPC meeting (2012)
• Testing the Framework in Canada and the Netherlands (2012-
2013)
• Survey on Regulatory Policy Evaluation in OECD countries
(2012-2013)
• Launch of publication (June 2014)
Process

5. 1. There is no “holy grail” to simply demonstrate a causal link
between the design and implementation of regulatory policy
measures on the one hand and the achievement of strategic
outcomes in the economy on the other hand
2. There is great value in systematically evaluating the design
and implementation of regulatory policy, against the
achievement of strategic regulatory objectives.
3. There is not enough data and information available to
evaluate the functioning and impact of regulatory policy in
most OECD countries.
4. Every OECD country can take steps to improve the
evaluation of regulatory policy.
Key policy conclusions

6. Framework for Regulatory Policy Evaluation
Have the good
practices been
implemented
?
 E.g.
percentage of
RIAs that
comply with
formal
requirements
 e.g. quality of
post-
implementation
reviews
Are
requirements
for good
regulatory
practices in
place?
 E.g.
requirements
for objective-
setting,
consultation,
evidence-based
analysis,
simplification,
risk
assessments
(e.g. indicators
of regulatory
management
type), aligning
regulatory
changes
internationally
What
resources are
committed?
 E.g. budget,
staffing,
expertise
Have good practices
helped to get quality
regulation?
 E.g. % of those
involved in the
regulatory process that
think RIA has improved
the quality of regulation
as opposed to being a
tick-the box-exercise;
comparison of
costs/benefits of initial
regulatory proposal to
those of actual
regulation that was
passed
• Regulatory system • Regulatory impacts
• Other factors that influence outcome
Feedback loop
Input Process Output
Intermediate
outcome
Have strategic objectives for regulatory policy in general been
achieved?
 Economic: Net benefits (possibly in comparison with counterfactual and
alternatives)
 Efficient and streamlined: Compliance costs and burdens (possibly
integrated into net benefits; Reduced enforcement costs)
 Perception of regulatory quality in general
 Improved compliance rate
 Transparent and easy to access
Regulatory quality
Have strategic objectives for regulatory policy in a specific sector
been achieved?
 Effectiveness – market failure/problem/risk was solved or mitigated
 Protection and benefits of the public, responsive and accountable
Facts-based and perception based sector-specific indicators:
 ENVIRONMENT
e.g. SOx and NOx emissions, concentration of air pollutants in urban areas
 SAFETY
 HEALTH
Regulatory outcomes
Set strategic
objectives for
regulatory
policy in
general
Set strategic
objectives for
regulatory
policy in
specific
sectors (e.g.
Health,
Environment,
Education)
Design Implementation Strategic outcome
I II III IV V
easy hard
OECD Framework for Regulatory Policy Evaluation

7. Current country practices
20
8
4
21
0
5
10
15
20
25
on RIA on draft
regulations
on consultation practices
on draft regulations
on ex-post analysis
(reviews) of existing
regulations
on administrative
simplification and burden
reduction programmes
Numberofjurisdictions
Performance reports published online
Source: OECD survey on Regulatory Policy Evaluation (2012)

8. Current country practices
14
6
2
20
0
5
10
15
20
25
RIA Consultation Ex-post analysis Administrative simplification
and burden reduction
programmes
Numberofjurisdictions
Performance indicators published online on:
Source: OECD survey on Regulatory Policy Evaluation (2012)

9. • The Secretariat thanks Canada and the
Netherlands for their financial contributions
and for piloting the Framework
• We are also grateful to Spain for hosting an
expert workshop on Measuring Regulatory
Performance in Madrid in 2011
• Overall, the work has benefitted from the
active engagement of the Steering Group on
Measuring Regulatory Performance
Acknowledgements

10.  OECD (2014), OECD Framework for Regulatory Policy Evaluation
• Coglianese, Cary (2012), Measuring Regulatory Performance - Evaluating
the Impact of Regulation and Regulatory Policy, Expert Paper, No. 1,
OECD, Paris.
• Radaelli, Claudio and Oliver Fritsch (2012), Measuring Regulatory
Performance - Evaluating Regulatory Management Tools and
Programmes, Expert Paper, No. 2, Paris.
• Parker, David and Colin Kirkpatrick (2012), Measuring Regulatory
Performance - The Economic Impact of Regulatory Policy. A Literature
Review of Quantitative Evidence, Expert Paper, No. 3, Paris.
• Regulatory Policy Committee (2014), Room document 3, “The Framework
for Regulatory Policy Evaluation of the OECD in the light of experience with
the General Administrative Law Act: a pilot study”
OECD materials

11. • Christiane Arndt, Programme Co-ordinator
Measuring Regulatory Performance, E-mail:
christiane.arndt@oecd.org, Tel. +33 (0) 1 45 24 76
56
• Antonia Custance Baker, Economist / Policy
Analyst, E-mail: antonia.custancebaker@oecd.org,
Tel.: +33 (0) 1 45 24 93 22
• Laura Seiffert, Junior Policy Analyst, E-Mail:
laura.seiffert@oecd.org, Tel.: +33 (0) 1 45 24 13 37
Contacts