Theory of Change (HTML)
Published 31 January 2022
Evaluation Task Force (ETF) Objective: To ensure that robust evidence on the effectiveness of policies and programmes sits at the heart of government spending decisions
Inputs
- Circa £950 thousand investment 2021-2022 covering 15 Full Time Employees. Post 2022 investment yet to be decided
- £15 million 2022-2025 for the Evaluator Accelerator Fund
- What Works Trial Advice Panel (TAP)” and What Works National Adviser
- Senior level governance and oversight
Activities
- Build relationships with key stakeholders across government including the policy, analytical and finance community
- Advise and support departments on design and delivery of robust, proportionate evaluations
- Set up and deliver Evaluation Task Force (ETF) support services (e.g Timebank, TAP)
- Fund evaluations via the Evaluation Accelerator Fund
- Deliver ‘Policy that Works’ conference
- Embed evaluation requirements in department reporting mechanisms and processes (e.g. Outcome Delivery Plans)
- Rapid scrutiny of evaluation plans attached to business cases submitted to Her Majesty’s Treasury (HMT) spending teams
- Challenge departments on evaluation activity via ministerial engagement e.g. challenge panels
- Develop and deliver a What Works Network (WWN) strategy
- Manage and promote the WWN and relevant outputs across government
- Create an ETF website to encourage publication of data, evaluation plans and evaluation results
- Develop data sharing project and requirements
Outputs
- Advice to departments on improving robustness of evaluation plans
- Advice to departments on building experimental and quasi-experimental methods into evaluation designs
- Advice to departments on commissioning evaluation
- Advice to departments on evaluation publication and reporting
- Advice and sign off on evaluation plans for innovation funds
- Feedback to HMT spending teams on evaluation design and findings
- Conditions on funding decisions following scrutiny of evaluation plans accompanying business cases
- Conditions on department-wide evaluation arrangements attached to fiscal events
- Assessments of departmental performance on evaluation
- ETF website and public register of evaluation plan summaries, trial protocols, data and results
- Escalation of data sharing/publication barriers to No.10 and HMT
(Intermediate) Outcomes
- Increased number of spending and operational decisions made by departments considering evidence
- Increased number of spending decisions made by Spending Teams considering evidence
- Increased scale and quality of evaluations (with a focus on experimental approaches) across government.
- Improved transparency of evaluation plans, data, and results
- Improved evaluation culture across government
Impacts
- Increased effectiveness and efficiency of government spending