International Journal of Government Auditing – January 2015
We argue that SAIs can play an important role in advancing evidencebased policy-making and regulatory quality. We will demonstrate that in recent years several SAIs have conducted audits on policy-making processes and that this can be considered as a transnational field of performance auditing. We urge SAIs to share share experiences on the topic so that auditors can be encouraged to recognize relevant audit questions and methods.
Editor’s Note: In addition to research and the authors’ auditing experience, this article is inspired by discussions at two workshops: the paper builds on the discussions at the workshop “Auditing Policy-Making Process: How to Create Better Regulation” delivered by the writers at the Young EuroSAI congress in Rotterdam in November 2013, and the workshop “The Role of Audit Offices in Regulatory Policy,” which was run by the OECD at the International Regulatory Reform Conference in Berlin, February 2013.
In this article two terms, “policy-making” and “law-making” are used to describe the preparation of legal norms. In the English language, the term “policy-making” emphasizes the role of political decision-makers, while the term “law-making” refers more to the technical work carried out by civil servants. However, in some other languages and jurisdictions, this distinction cannot be easily made.
Careful formulation of legal rules may contribute to efficient use of public resources, competitiveness, and social welfare. Regulatory failure may have disastrous effects; the financial crisis of 2008 partly resulted from incomplete regulation and implementation. Auditing creates an incentive for government officials to make better impact assessments, to consult relevant stakeholders, and to develop regulatory management.
Policy-making itself may be a function involving significant public spending. Depending on the scope of the jurisdiction, there can be hundreds or thousands of government officials directly involved in the preparatory work. Hence, evaluation of policy-making can also be justified by direct economic significance.
Citizens and members of parliament expect SAIs to evaluate policy-making processes. This call, or wish, expressed by SAIs’ “clients” is the final argument for the need to audit policy-making. In some countries, SAIs may also be the only public authority in a position to independently evaluate policy-making processes.
Policy cycle and audit questions (Accessible Text: TXT)
In the past few years, several SAIs have audited regulatory policy. A recent survey by the OECD found that in 14 of the 34 member countries, SAIs had audited regulatory management tools or programs (OECD. 2014, OECD Framework for Regulatory Policy Evaluation:68-72, ). OECD considers this as a moderate result and indirectly calls for a strengthened role of SAIs in the field.We examined what types of audit have been conducted by European SAIs. Examples of recent audit reports of seven SAIs are listed in the information box below. When reviewing audit reports on policy-making, we found that the following four topics had been audited by more than one SAI:
Our brief comparison indicates that the policy-making process is a transnational topic for performance auditing. Still, national SAIs may not be aware that the same audit questions have also been posed elsewhere by several other SAIs as, to our knowledge, this field of auditing has not been widely discussed in the international government auditing community. Our argument is that the SAIs auditing policy-making processes may benefit from recognizing that the same topic has also been evaluated in other countries. Understanding the context of a policy-making process may help an and quality criteria, as will be shown in the next section.
There are a number of generally recognized criteria for evaluating the quality of a policy-making process. Policy-making should be analytical, evidence-based, open, and participative.
During the process, alternative regulatory options should be taken into consideration. At the final stage, members of parliament should be provided with all the necessary information to decide on the proposed law. The following chart illustrates the policy cycle and presents audit questions that should be asked at different stages.
These normative criteria have been articulated in several government guidelines. The most influential is the OECD’s Recommendation of the Council on Regulatory Policy and Governance (http://www.oecd.org/governance/ regulatory-policy/49990817.pdf). The OECD recommendation strongly emphasizes the role of an implicit whole-of-government policy for regulatory quality with institutions and mechanisms to implement and oversee the policy.
When a policy-making process is audited, official preparatory documents are in most cases an essential source for the analysis. The empirical methods typically include interviews of government officials, parties affected by the regulation, and other experts. Quantitative data on the realized impacts of a regulation can be gathered and this data can be compared with the initial goals of the regulation and estimates of its impacts.
There are at least three main reasons why SAIs should audit policy-making processes. First, careful design of regulations may contribute to saving public resources. Second, SAIs are in a position to independently audit preparatory work. Third, both the general public and the parliament often expect SAIs to audit it− in fact, in recent years several SAIs have already audited policy-making processes. However, national SAIs may not have been totally aware that the same audit questions have also been analyzed by other SAIs. We suggest that the awareness of the common field could help auditors to recognize relevant audit questions and methods. In the future, a discussion platform or network for changing experiences between SAIs might be fruitful.