Guidance

Evaluation Registry FAQs

Updated 2 August 2024

Evaluation Registry FAQs

[Q. What is the Evaluation Registry?]

[Q. Why do we need an Evaluation Registry?]

[Q. Does my policy/project/programme need to be evaluated?]

[Q. Which evaluations need to be entered on the Evaluation Registry?]

[Q. Who is responsible for registering evaluations?]

[Q. Why do we need to register planned evaluations?]

[Q. Why do we need to provide planned publication dates for evaluation reports?]

[Q. When do planned evaluations need to be registered?]

[Q. What is the sign-off or approval process for making an entry on the Registry?]

[Q. What information do I need to provide for a Registry entry?]

[Q. The evaluation I am working on will produce multiple reports. Should I create an entry per report, or one entry for all the reports?]

[Q. Do I need to register historical evaluations on the Registry?]

[Q. Are there any exemptions to the mandatory requirements?]

[Q. Do I need to publish my evaluation report on GOV.UK as well as the Registry?]

[Q. Can I access the Evaluation Registry? / Who can access the Evaluation Registry?]

[Q. What happens if Departments don’t comply with mandatory requirements?]

[Q. I am moving on from my team. How can I transfer ownership of my Registry entries?]

[Q. I have found an entry on the Registry which is inaccurate, or is a duplicate of another entry. What should I do?]

[Q. I have questions or feedback about the Evaluation Registry - who can I talk to?]

0.1 Q. What is the Evaluation Registry?

1. The Evaluation Registry is the new home for all Government evaluations. It is a website where all planned, live and published evaluations conducted or commissioned by Government Departments are registered. Evaluations on the Registry can be searched and browsed by users looking to learn from previous evaluations of Government policies, projects and programmes. 

It is mandatory for all Government evaluations to be registered on the Registry. This requirement was announced by the Minister for the Cabinet Office and Chief Secretary to the Treasury in correspondence to all Secretaries of State in March 2024. 

0.2 Q. Why do we need an Evaluation Registry? 

1. All government evaluations should be published and made available to the public by default, as per the Government Social Research publication protocol, which states that “outputs from the evaluation of policy/delivery initiatives/pilots and trials” should be “made publicly available in accordance with the government’s commitment to openness as underpinned by Freedom of Information (FoI) legislation.” 

However, not enough evaluations or planned evaluations are currently being published, and those that are published can be difficult to find and compare. The Registry makes it easier than ever before to search and browse published evaluations, whether you’re a project manager looking for evidence to support a new business case or an evaluation specialist looking to compare research designs.

0.3 Q. Does my policy/project/programme need to be evaluated?

1. All policies, programmes and projects should be subject to proportionate evaluation. The Green Book states that all proposals for funding should include a proportionate budget, and a management plan, for monitoring and evaluation. 

Not all interventions will require the same level of scrutiny or have the same learning needs. In the case of a low-risk, well-evidenced and low priority intervention, a light-touch monitoring and evaluation exercise to ensure it has been delivered as intended and achieved the predicted outcomes is likely to be all that is necessary. On the other hand, a high risk, high profile, high spend and/or high learning potential intervention is likely to require a large-scale evaluation. 

It is compulsory for Government funded interventions to be evaluated in cases where the intervention meets one or more of the following criteria:

1. The intervention is part of the Government Major Projects Portfolio
2. HM Treasury has requested an evaluation of the intervention is conducted.

0.4 Q. Which evaluations need to be entered on the Evaluation Registry?

1. All planned and live evaluations and evaluation reports signed off from 1st April 2024 onwards should be registered on the Evaluation Registry. Evaluation reports should be published and entered on the Registry within 12 weeks of sign-off by the relevant internal Departmental governance processes.

“Evaluation” refers to impact, process, and value for money evaluation studies conducted in line with the Magenta Book. The Magenta Book defines evaluation as “as a systematic assessment of the design, implementation and outcomes of an intervention.”

In the context of the Registry, this includes:

• Pilot evaluations
• Impact evaluations
• Process evaluations
• Value for Money evaluations (cost benefit and cost effectiveness analyses)
• Evidence syntheses, including systematic reviews, rapid evidence assessments, meta-analyses, meta-ethnography and realist synthesis 
• Post implementation reviews, in cases where these apply one or more evaluation methods outlined in Annex A of the Magenta Book

This does not include:

• Regulatory or Enactment Impact assessments, also known as regulatory impact assessments or final impact assessments, used for policy regulation
• Feasibility studies
• Literature reviews
• Post implementation reviews, in cases where these do not apply evaluation methods outlined in Annex A of the Magenta Book
• Benefits monitoring and realisation reports (excluding cost benefit or cost effectiveness analyses)
• Outputs from user research, where this is not part of an evaluation
• Cases in which the evaluation in question is currently subject to embargo, is classified as SECRET or TOP SECRET, or is exempt from publication under Freedom of Information legislation for any other reason.

Where an entry for a planned or live evaluation has been created, the same evaluation entry should then be amended to include the results of the evaluation or edited if the scope, method or plans for the evaluation change. Evaluation findings should be published no more than 12 weeks following the agreement of final outputs, as per the Government Social Research (GSR) Publication Protocol, which states that “Outputs from the evaluation of policy/delivery initiatives/pilots and trials” should be “made publicly available in accordance with the government’s commitment to openness as underpinned by Freedom of Information (FoI) legislation.” 

This applies to planned evaluations, live evaluations, and evaluation reports produced by all Central Government Departments. “Central Government Departments” refers to all Ministerial Departments, HM Revenue and Customs, and the UK Statistics Authority (including the Office for National Statistics, the Government Analysis Function, and the Office for Statistical Regulation). It also applies to evaluations of all Major Projects in the Government Major Projects Portfolio, including those which are being delivered by external bodies.

This does not mandate the registration of evaluation plans or reports exclusively undertaken by Devolved Administrations, Arms Length Bodies (including executive agencies, non-departmental public bodies, and non-ministerial departments), Agencies or Public Bodies. These organisations are able to use the site and are encouraged to register evaluations, but this is not a mandatory requirement with the exception of cases where Major Projects are being delivered and/or evaluated by external bodies as above. 

0.5 Q. Who is responsible for registering evaluations?

1. The organisation responsible for delivering the evaluation of an intervention is responsible for creating and updating the Registry entry for the evaluation. The individual responsible for creating the Registry entry will vary between departments (for example, in some departments central evaluation teams manage all entries, whereas in others the policy or project delivery colleagues may be responsible for this). Check with your central evaluation team or lead if you are not sure who should create and maintain the entry. 

This will typically be the Department or Arms Length Body delivering the intervention, but in cases where multiple organisations are working together to deliver an intervention the organisation responsible for overseeing the evaluation of said intervention should be responsible for creating the Registry entry. If there is no single organisation responsible for the evaluation, please discuss with your central evaluation team/lead to decide which organisation is best placed to take on this responsibility.

Organisations outside of Government (for example, research companies or contractors who may be undertaking the evaluation) cannot log into the Registry to create entries, and therefore in these cases the organisation managing the company or contractors is responsible for registering the evaluation.

In the case of Major Projects which are being delivered by external organisations (i.e. not a Government Department, Arms Length Body or What Works Centre), the Registry entry for your Major Project should be created and maintained by the associated Departments’ central evaluation team or lead. If you are unsure who this is, please get in touch: evaluation.registry@cabinetoffice.gov.uk 

0.6 Q. Why do we need to register planned evaluations?

1. The GSR Publication Protocol states that “Departments should make high level information publicly available on all research and analysis commissioned externally, and internal research where there is an intention to publish. Announcements should be made as early as is practicable”. Please refer to the GSR Publication Protocol for more information.

To register a planned evaluation on the Registry, all you need to do is complete the minimum required fields on the site which outline the proposed evaluation type, methods, intervention description, policy area and planned publication date. This demonstrates a public commitment to evaluating the intervention in question. 

There is no requirement to upload an evaluation plan or framework in a document format. However, it is best practice to publish evaluation plans formally on GOV.UK in addition to registering them. The published plan can then be hyperlinked in the associated Registry entry. 

Entries for planned evaluations should be updated to include the findings and report/s from the evaluation once available.

0.7 Q. Why do we need to provide planned publication dates for evaluation reports?

1. The Registry aims to implement the terms of the Government Social Research publication protocol, which states that “Publication dates should be preannounced. If this is not feasible, for example due to short notice requirements, departments need alternative approaches, where possible, to promote public trust in the transparency and objectivity of release arrangements.”

The field requiring a publication month and year for a new Registry entry is mandatory in order to enable the Evaluation Task Force to monitor which evaluations are still ongoing, and which are due to publish results shortly. This information also helps the Task Force identify where evaluation evidence is being withheld, and ensure results are published where appropriate.

The date provided on the Registry can easily be amended and updated on the site at any time, and users should look to ensure these dates remain up to date if publication timelines change. The Task Force will only look to follow up in cases where the publication date given on a Registry entry has passed without the addition of a hyperlink to a published evaluation report and summary of evaluation findings.

0.8 Q. When do planned evaluations need to be registered?

1. Teams should register planned evaluations “as early as is practicable” under the terms of the GSR Publication Protocol. For the Registry this means registering planned evaluations at the stage at which the plan for the evaluation, including evaluation type (impact, process, value for money or a combination), methods and timeline, has been approved through the relevant internal governance processes. In all cases plans should be registered before the first round of data collection for the evaluation takes place. 

We appreciate this timeline will vary: in some cases this will happen at the Full Business Case (FBC) stage, and in others the FBC will be seeking funding to commission the evaluation plan externally or may want to commission feasibility studies or further research to finalise the plan. 

We know evaluation plans may also change along the way in relation to scope change or feasibility of planned methods. Users are able to edit and update entries on the Registry to reflect changes in evaluation plans whenever they need to. Entries should be regularly maintained as an up-to-date record for the planned evaluation. 

0.9 Q. What is the sign-off or approval process for making an entry on the Registry?

1. Before registering evaluations on the platform, individual users are responsible for ensuring that the planned evaluation or report has been approved through the relevant internal governance processes prior to registration. If you are unsure of the approvals you require before creating a new Registry entry, please get in touch with your Department’s central evaluation team or lead to check. 

New entries, and updates to existing entries, will need to be approved on the site by someone with publisher site permissions within your department. Once you have created a new entry (or made an update to an existing entry) on the site you can submit it for approval via the “submit for approval” button.

If you have further questions, please email evaluation.registry@cabinetoffice.gov.uk.

0.10 Q. What information do I need to provide for a Registry entry?

1. You will need to know the title of the evaluation and all organisations (e.g. departments) involved in the evaluation. 

You will need to know the type of evaluation (i.e., impact, process or value for money) and you will be asked about the research methods for this, like whether the impact evaluation is using an experimental method such as an RCT or theory-based methods. 

You will be asked to give a brief description of the intervention, and tell us whether your intervention is funded by a grant, and whether your evaluation is in the Major Projects portfolio (for more information see here). You will then be asked to choose from a list of relevant policy areas for your evaluation.

Finally, you will be asked the start date, end date and publication date/s of your evaluation. You will also be asked to provide the link to the published report, a brief summary of the evaluation findings, and the total cost of the evaluation, if available.

The cost figure should represent the total cost of the evaluation (rather than per year). You should include both commissioning costs - in cases where aspects of the work have been commissioned to an external supplier - and internal resource costs. This should cover all aspects of scoping, planning, and delivering the evaluation. The figure should be given in pounds (£). 

0.11 Q. The evaluation I am working on will produce multiple reports. Should I create an entry per report, or one entry for all the reports?

1. Users should create one Registry entry per evaluation, not per report. If an evaluation contains multiple aspects, for example, a cost benefit analysis and a randomised control trial, these should both be included in a single entry. Users can add links to multiple published reports in a single entry, and should not create multiple entries per evaluation report. 

0.12 Q. Do I need to register historical evaluations on the Registry?

1. If the evaluation was completed before April 2024, it is not a requirement to register this. All planned and live evaluations and evaluation reports signed off from April 2024 must be registered.

However, the more evaluations we have on the Registry, the more useful it will be as a source of evidence for people planning evaluations, or new projects and policies - so if you would like to register historical evaluations currently missing from the site, we encourage you to do so.

The Registry has been pre-populated with over 1000 reports which were published on GOV.UK prior to the Registry launching. While this covers the majority of published evaluation reports this should not be regarded as a comprehensive list of all historical government evaluations (please note that not all evaluations published by the Scottish Government are listed here). 

0.13 Q. Are there any exemptions to the mandatory requirements?

1. Evaluation falls under the Government Social Research publication protocol, which states that research should be published and made available to the public by default. Departments are not expected to publish research (including evaluation reports) on the rare occasions when publication would threaten national security, destabilise the economy, or would otherwise not be in the public interest. For more information, see the Information Commissioner’s Office Freedom of Information guidance.

Planned, ongoing or completed evaluations relating to Government policies, projects, or programmes which are classified above “OFFICIAL” classification, i.e. classified “OFFICIAL-SENSITIVE”, “SECRET” or “TOP SECRET”, should not be entered on the Registry. Similarly, if the policy, project or programme in question is currently under embargo it should not be entered on the Registry until the end of the embargo period. These requirements are different for Major Projects classified above “OFFICIAL” - see below for more information.

In some cases, aspects of an intervention will be subject to restrictions as noted in 2.3, rather than the entire intervention. In these circumstances, restrictions apply to the specific part of the intervention classified as “OFFICIAL-SENSITIVE”, “SECRET” or “TOP SECRET” (or otherwise under embargo, or exempt under Freedom of Information legislation) rather than the intervention as a whole. Decisions about classification or embargo of evaluation documents must be made by Departments internally. 

In the case of Major Projects classified above “OFFICIAL”, an entry should be created including the minimum required fields on the site unless the name of the Major Project is not publicly available, or the specific content required to populate those fields is exempt from reporting under the Freedom of Information (FOI) Act. Major Projects can be exempted from reporting under 7 sections of the FOI Act for any of the following reasons: 

• Section 22 - information intended for future publication
• Section 24 - National Security
• Section 26 - Defence
• Section 27 - International relations
• Section 31 (1) - Law enforcement
• Section 35 - Formulation of government policy
• Section 43 - Commercial interests.

In such cases where evaluation plans or reports cannot be shared as a matter of security, this should be made clear in writing to the Evaluation Task Force. For more information, see the Information Commissioner’s Office Freedom of Information guidance and the Freedom of Information (FOI) Act.

0.14 Q. Do I need to publish my evaluation report on GOV.UK as well as the Registry?

1. Evaluation reports must be published separately online before they can be entered on the Registry. This may be on GOV.UK or it may be on another site. Linking an evaluation report to an existing Registry entry just requires you to copy and paste the link to the published evaluation report in the relevant field. All government evaluations should be published and made available to the public by default, as per the Government Social Research publication protocol. 

Evaluation plans, however, do not need to be published separately online before they can be entered on the Registry (although Departments are encouraged to do so as a matter of best practice). Completion of the compulsory fields for registering a planned or live evaluation on the site is all that is required to register a planned evaluation, although there is an option to add a link to a published evaluation plan if you wish to.

0.15 Q. Can I access the Evaluation Registry? / Who can access the Evaluation Registry?

1. Any employee of a Government Department, Arms Length Body, or What Works Centre in the UK can create an account for the Registry in order to log in, browse, and register evaluations. If you are having difficulty accessing the Registry, please get in touch with the team: evaluation.registry@cabinetoffice.gov.uk. 

If you are not employed by one of the organisation types listed above, you will not be able to access the Registry until the public-facing launch in Summer 2024. Following the public-facing launch, any member of the public will be able to view and browse the evaluations on the Registry. Members of the public will not be able to register evaluations on the site.

0.16 Q. What happens if Departments don’t comply with mandatory requirements?

1. The Evaluation Task Force will be monitoring uptake and usage of the Evaluation Registry on an ongoing basis. In cases where Departments which have been mandated to use the Registry fail to enter required evaluation plans and reports on the tool, the Evaluation Task Force will follow up in the first instance with Departmental central evaluation teams or leads. 

In the case of continued failure to comply, the issue will be escalated to the Office for Statistical Regulation under the existing terms of the Code of Practice for Statistics and GSR Publication Protocol in addition to HM Treasury spending teams, which the Evaluation Task Force works closely with to ensure Departments are complying with all evaluation requirements for Government Departments. 

0.17 Q. I am moving on from my team. How can I transfer ownership of my Registry entries?

1. Please email evaluation.registry@cabinetoffice.gov.uk. We can assign or reassign existing entries to new users to make changes or updates if needed.

0.18 Q. I have found an entry on the Registry which is inaccurate, or is a duplicate of another entry. What should I do?

1. Please email evaluation.registry@cabinetoffice.gov.uk with a link to the entry in question. We can assign or reassign existing entries to new users to make changes or updates if needed, and we can also ensure duplicate entries are removed or merged with original entries.

0.19 Q. I have questions or feedback about the Evaluation Registry - who can I talk to?

1. If we haven’t answered your question here, get in touch with the team: evaluation.registry@cabinetoffice.gov.uk. We want to make the Registry as useful and accessible as possible, so we welcome your feedback.