Innovative Approaches in Performance Auditing: Comparative Lessons from Supreme Audit Institutions

Author: Alfredo Campos Lacoba, Auditor – Deputy Director, Presidency of the Audit Section, Spanish Court of Audit

Abstract

Performance auditing is undergoing significant transformation within the international public auditing community. Supreme Audit Institutions (SAIs) are increasingly moving beyond traditional economy-efficiency-effectiveness assessments toward more sophisticated evaluation-oriented approaches based on data analytics, impact assessment, risk analysis, and evidence-based policymaking.

This article presents a comparative analysis of innovative methodologies and practices identified in the submissions to the first Award of the INTOSAI Working Group on the Evaluation of Public Policies and Programs (WGEPPP). Drawing on experiences from Brazil, Costa Rica, France, the Czech Republic, Morocco, Romania, Spain, and Thailand, the paper identifies emerging trends shaping the future of performance auditing.

The study highlights innovative tools such as geospatial analysis, econometric models, artificial intelligence, maturity scales, visual scoring systems, data triangulation, and participatory methods. It also examines how SAIs are addressing complex and cross-cutting public policies through multidisciplinary and data-driven approaches.

The article argues that these innovations strengthen the capacity of SAIs to generate meaningful findings, improve policy evaluation, and enhance public value and accountability.

1. Introduction

Performance auditing has evolved considerably over the last decade. Increasingly complex public policies, growing demands for accountability, and the expansion of evidence-based governance have pushed SAIs to adopt more advanced analytical and evaluative approaches.

This transformation is reflected in recent initiatives promoted within the INTOSAI community, particularly through the Working Group on the Evaluation of Public Policies and Programs (WGEPPP). The first WGEPPP Award showcased innovative audit practices capable of improving the evaluation of public programs and generating more useful insights for decision-makers and citizens.

The submissions reveal a common trend: performance auditing is progressively incorporating techniques traditionally associated with policy evaluation, data science, behavioural analysis, and impact assessment. Rather than focusing exclusively on compliance or operational deficiencies, SAIs are increasingly examining whether public interventions achieve their intended outcomes and societal impacts.

The comparative analysis of these international experiences offers valuable lessons for the modernization of external public auditing.

2. Beyond Traditional Performance Audit: Emerging Evaluative Approaches in Supreme Audit Institutions

One of the clearest trends identified across the analysed experiences is the transition from traditional performance auditing toward evaluation-oriented auditing.

Several SAIs now apply methodologies that explicitly assess intervention logic, policy coherence, outcomes, and impacts. This shift is particularly visible in the work developed by the French Cour des comptes, the Brazilian Federal Court of Accounts (TCU), and the State Audit Office of Thailand.

For example, the French evaluation of biogas development policies combined econometric techniques, benchmarking, and administrative databases to estimate the real economic impact of public support mechanisms on agricultural resilience. Similarly, France’s evaluation of alternatives to imprisonment used statistical and econometric analysis to assess recidivism and reintegration outcomes, demonstrating how evidence-based approaches can strengthen auditing in politically sensitive sectors.

These experiences illustrate how SAIs are increasingly incorporating analytical techniques capable of addressing complex policy questions that cannot be answered through conventional audit procedures alone.

3. Data-Driven Auditing and Advanced Analytics

A second major trend is the growing use of advanced data analytics and digital tools in performance auditing.

The Brazilian TCU provides some of the most innovative examples. Its audit of the National Immunization Program combined multivariate statistical models, large-scale surveys, field inspections, and interactive dashboards developed in Power BI,  an interactive data visualization, database management, and data modeling software. The audit also incorporated artificial intelligence tools to support the synthesis and organization of findings.

In another Brazilian audit concerning social policy databases, auditors combined automated cross-checking of administrative records with household verification visits to identify inconsistencies in poverty-related registries. This triangulation methodology strengthened the reliability of findings and enabled the quantification of financial impacts associated with poor-quality data.

Costa Rica’s audits also demonstrate the growing importance of territorial and geospatial analytics. The audit on sustainable urban services used QGIS geoprocessing techniques, clustering analysis in R, and Gini coefficients to identify inequalities in access to public services within intermediate cities. This territorial perspective allowed auditors to detect patterns that would have remained invisible using traditional audit techniques.

These examples show how data-driven methodologies improve the depth, robustness, and credibility of audit conclusions while enabling auditors to address increasingly complex policy environments.

4. Structuring Professional Judgment through Innovative Methodologies

Another relevant innovation concerns efforts to systematize and structure professional judgment in performance auditing.

The Czech Supreme Audit Office developed a methodological framework based on graduated effectiveness and efficiency scales applicable to public programs and subsidies. Rather than relying on purely subjective assessments, the methodology establishes clearly defined criteria and descriptors for different performance levels. This approach improves consistency among audit teams, facilitates aggregation of results, and enhances transparency in communication with audited entities.

Brazil’s energy transition audit introduced another innovative tool: a visual scoring system combining qualitative judgment with color-coded quantitative representations. The audit also used an “Audit Canvas” methodology to organize risks, actors, objectives, and evidence sources visually during the planning phase.

Such methodologies contribute to reducing arbitrariness and increasing the comparability and communicability of audit findings.

5. Auditing Complex Governance Systems

Many of the analysed audits focus on policies characterized by multi-level governance, institutional fragmentation, and cross-cutting objectives.

The Brazilian coordinated audit of the National Immunization Program involved cooperation between the Federal Court of Accounts and twenty subnational audit institutions. The audit adopted a Whole-of-Government perspective to assess coordination among institutions responsible for vaccine logistics and implementation.

Similarly, Morocco’s audit of delegated waste management contracts analysed the entire contractual cycle, from planning and procurement to execution and monitoring. The risk-based approach revealed how weaknesses in governance structures affected service quality, financial sustainability, and policy coherence.

Romania’s audit of civil defense systems also illustrates the importance of systemic auditing approaches. Through extensive fieldwork and administrative data analysis, auditors evaluated institutional resilience and preparedness in a context of growing geopolitical risk.

These experiences demonstrate that modern performance auditing increasingly requires systemic analysis capable of capturing interactions among institutions, governance arrangements, and policy instruments.

6. Participation, Communication, and Citizen-Centered Auditing

Several audits reveal a growing emphasis on participation, communication, and user-centered approaches.

Costa Rica’s audit of refugee status procedures incorporated empathy maps, civil society workshops, and stakeholder participation mechanisms to better understand users’ experiences with migration services. Artificial intelligence tools were also used to support interview transcription and communication activities.

These participatory methodologies represent a significant evolution in public auditing. They allow SAIs to complement quantitative evidence with qualitative insights derived from beneficiaries and stakeholders.

Communication itself is also becoming a strategic dimension of auditing. Several institutions used visual scoring systems, dashboards, audiovisual materials, and simplified summaries to make audit findings more accessible to non-specialized audiences.

This trend reflects a broader understanding of audit impact: findings only generate public value if they are effectively understood and used by decision-makers, stakeholders, and citizens.

7. Measuring the Public Value of Auditing

One of the most innovative contributions identified in the comparative analysis is the growing interest in measuring the social value generated by auditing itself.

The Spanish Court of Audit proposed a Social Return of Public Auditing (SRPA) framework designed to estimate the societal impact of performance audits. The proposal combines qualitative and quantitative dimensions and is explicitly linked to INTOSAI-P12 principles concerning the value and benefits of SAIs.

The framework includes four innovation-oriented laboratories:

• Data LAB;
• Social LAB;
• Public Policy Evaluation LAB;
• Cross-cutting Sustainability LAB.

The proposal also explores advanced analytical techniques such as machine learning models, institutional simulations, and Shapley-value analysis to compare the potential effects of traditional versus innovation-oriented audit models.

Although experimental, this initiative reflects an important institutional evolution: SAIs are no longer focused solely on auditing public value creation by governments but are increasingly seeking to assess and demonstrate their own contribution to better governance and societal outcomes.

8. Conclusions

The comparative analysis of the WGEPPP award submissions demonstrates that performance auditing is entering a new methodological phase characterized by innovation, interdisciplinarity, and stronger orientation toward policy impact.

Several converging trends emerge from the international experiences analysed:

• Greater reliance on data-driven analysis and advanced analytics;
• Increased use of econometric and geospatial techniques;
• Expansion of participatory and citizen-centered approaches;
• Development of structured evaluation methodologies;
• Growing attention to governance complexity and institutional resilience;
• Stronger emphasis on communication and measurable public value.

These innovations enhance the ability of SAIs to evaluate complex public policies, produce evidence-based conclusions, and contribute meaningfully to public sector improvement.

The experiences examined also confirm that innovation in performance auditing does not weaken the rigor of external control. On the contrary, advanced analytical tools, multidisciplinary approaches, and evaluation-oriented methodologies strengthen the credibility, relevance, and societal impact of public auditing.

As governments face increasingly complex challenges related to sustainability, inequality, digital transformation, and institutional resilience, SAIs will need to continue evolving toward more sophisticated and evidence-oriented audit models. International cooperation and knowledge sharing within INTOSAI will remain essential drivers of this transformation.