Energy security and net zero modelling: Quality Assurance (QA) tools and guidance
Tools and guidance to help people Quality Assure (QA) new and existing energy security and net zero models, including those developed by third parties.
Documents
Details
Effective Quality Assurance (QA) ensures that decisions are made with an appropriate understanding of evidence and risks, and helps analysts ensure the integrity of the analytical output.
Within the Department for Energy Security and Net Zero (DESNZ), we have a range of tools and guidance to help people with Quality Assurance of analytical models. We use this guidance to ensure that models have been proportionately quality assured, with supporting documentation and evidence to demonstrate that.
The tools and templates are subject to periodic review. Please ensure you refer to the latest copy.
Contact for feedback or queries: modellingintegrity@energysecurity.gov.uk.
How to use the templates
Excel template
Using this template to set up your Excel model will reduce the time for new users to familiarise themselves with the model and reduce QA time. It provides all the mandatory logs and tables in a single document, and guidance to develop and document your model following best practice.
Model report template
The template provides comprehensive coverage of the key information to understand a model. Using the model report template meets the documentation requirements of the QA Log.
Full log template (Excel and non-Excel models)
The QA log is a list of assurance activities such that if carried out they provide confidence that a given version is fit for purpose. All DESNZ in-house models must have a log. The main model developer must ensure the log is kept up-to-date. It should be completed during model development by the model developer and those performing quality assurance.
Scope development checklist
Used to bring together modellers, customers and other stakeholders to think about the task at hand before the project begins.
For use at project initiation, it provides a common understanding of what the model will and will not do (‘acceptability criteria’) given time and resource constraints. It aims to stimulate discussion during an initiation meeting. It is recommended that notes are recorded against each point.
Clearance statement template
This template provides a record of peer review outcomes, together with clearance and approval decisions. It is used to support the Department’s analytical Quality Assurance process. The report should be stored with the product in question. It is included when the product is submitted to the relevant approvers who must factor into their decision the analysis and evidence quality, and the quality assurance undertaken.
Assumptions log template
The assumptions log documents inputs and assumptions, giving information about the source, methodology, update dates and sign-off process. It also allows teams to identify assumptions which may carry higher risk. A good assumptions log will help models score highly on the criteria linked to Data and Assumptions in the the Department’s Quality Assurance log.
This assumptions log template is used by model-owners within the Department, and it should also be used for all new models procured by DESNZ.
Logging assumptions correctly is an important part of the Quality Assurance of any model. It ensures that there is a clear justification for decisions made about which data and methodologies are used in model.
An assumption might be a number (such as a historical data point or series, a projected data point or series, a conversion or efficiency factor, a technology parameter) or a methodological assumption (such as a method for extrapolation, a behavioural assumption, a statistical assumption, a choice of calculation methodology).
Background
The tools and guidance are compliant with the recommendations of:
- the Macpherson Review of quality assurance of government models
- the AQuA Book