Case studies

Cross-country analysis for a continental impact evaluation

The data analysis for an impact evaluation spanning more than twenty African countries, from harmonising datasets to the benchmarks that guided funding.

· Governance · December 2024

The challenge

A major international foundation was evaluating the impact of its programmes across more than twenty African countries. The data existed, but it existed country by country, in shapes that did not line up. Compared directly, it would have produced misleading conclusions.

The evaluation needed analysis that could hold twenty-plus countries to a common standard, produce benchmarks that were genuinely comparable, and give funders a defensible basis for where resources should go next.

The approach

The first task was harmonisation: bringing country-level datasets into a common structure so that a figure meant the same thing everywhere. Without that step, every comparison downstream is unsafe.

From there, country-level indicators were analysed and regional performance benchmarks engineered, so performance could be read both within a country and across the whole programme. The reporting was automated, so the analysis reached decision makers quickly and repeatably rather than being rebuilt by hand each cycle. The findings fed directly into funding decisions.

What was built

  • Harmonised, comparable datasets across more than twenty African countries
  • Analysis of country-level indicators against a common standard
  • Regional performance benchmarks for reading results within and across countries
  • An automated reporting workflow, cutting delay between analysis and decision
  • Analysis that informed programme funding decisions

Have something similar in mind?

Describe the problem and we will tell you honestly whether we can help.

Start a project