Guidance

Checklist: developing a continuous improvement assessment framework

Published 30 September 2024

Ask the standards team for advice on themes before starting to develop and iterate your framework, and for the agreed text that should be included in the introductory sections of a function’s assessment framework.

1. Develop a continuous improvement assessment framework iteratively

1.1 Create a working group

Many minds are better than one, and workshops with a group of knowledgeable people are essential. In the same way as you needed a reference/working group to create a functional standard you should work with a representative group of experts to derive your assessment framework. It will be iterative.

1.2 Consider what good/better/best means for your function

At the outset, ask your group to consider what - in broad terms- ‘good’ means for your area of work. Do the same for ‘better’ and ‘best’. This will be a useful reference as you move into setting criteria for individual practice areas. Try to keep to 75 to 100 words to describe each level.

2. Brainstorm your initial thoughts

Your initial thoughts and instincts based on your knowledge can help you outline what themes and you would expect to see covered in the assessment framework. Brainstorm this in the group and come to a consensus. Keep this output for later reference to check against it once you have developed the framework.

CHECKPOINT: capture and keep a record of early thinking on good/better/best and themes.

3. Develop your themes

The structure and sub-headings of the functional standard should usually be replicated in the themes and practice areas of the assessment framework. This ensures relevance, ease of cross-reference and that the framework is comprehensive.

Keep visible and to hand: - The principles and all the ‘shall’ statements from the standard - The table of contents of the standard

Work through the standard section by section and choose themes that reflect the content.

For the life cycle and practices sections (or equivalent) of your standard, you should start with one theme for each step/ phase/ practice.

For the practices section, decide which are significant and need their own themes, which can be left out (if any) and which can be grouped (as they are often related and used together).

Do not worry if you have too many themes. You might find, as you develop the assessment framework, that some of the practices can be incorporated into the life cycle steps or phases.

Check the initial list of themes with the ‘brainstormed list’ (see brainstorm your initial thoughts). With your working group ask yourselves: - is anything missing? - did the brainstorm uncover a theme which can draw in many of the practices across the standard together?

CHECKPOINT: update and adjust the themes.

4. Create the practice areas for each theme

Each theme should comprise 3 to 5 practice areas, each stating the purpose of the practice. In the standard, practices are usually preceded by a purpose statement (a ‘shall’ or a ‘should’). A practice area may relate to one or more clauses in the functional standard.

Remember that practice areas and associated criteria need to be statements which can be proven and demonstrated by the organisation assessing itself against the standard. The practice areas and criteria should reflect what is observed to be happening in the organisation (with evidence) so are written as ‘is’ or ‘are’ statements.

While some aspects of a standard are binary, which means that statements about meeting these binary requirements can be established quickly, a ‘shall’ might not always be binary. There can be good, better or best ways of meeting a mandatory requirement.

Similarly, some aspects of the standard can be mapped onto a maturity scale or continuum. For example, a percentage: the percentage of people professionally qualified to undertake a particular role, where ‘good’ would be 50 %, ‘ better’ would be 70% and ‘best’ would be 90%.

Take one of the themes and find the related functional standard text. Use the text to discuss with your working group, and derive up to five practice areas for each theme. At this stage, identify headings only.

Ask yourselves if these practice area headings, brought together, cover enough of the themes. If not, rework them.

Draft a ‘purpose’ statement for each practice area. A practice area can group together many practices from across the standard.

CHECKPOINT: review and capture the practice area headings and purpose statements.

5. Derive appropriate criteria for the practice areas

Each practice area should be supported by up to 4 or 5 assessment criteria, each of which should be a statement of what the organisation should, through verifiable evidence, be doing.

Criteria may be: - distinct, to distinguish between good/ better/ best as you observe something different being done at the higher level than at the lower level - similar across the levels, but with different metrics for maturity levels: for example, you could have a planning horizon changing from 12 months for good, to 2 years for better, to 3 years for best - chosen from international and/or industry norms: you should use insights from professional bodies

If organisations do not meet at least ‘good’, they are by default ‘developing’, therefore there is no need to set criteria for ‘developing’.

5.1 Start by defining ‘good’

As you work with your expert group (see 1.1), start by defining the criteria for ‘good’. Check the principles and the ‘shalls’ to make sure they are covered in some way in relation to the themes. When you have covered them, tick them. All the ‘shalls’ from the standard ought to appear under ‘good’ along with the most important ‘shoulds’. This is the minimum level you want organisations to perform at.

Then, move to ‘better’ and discuss what else you would expect to observe. Then move on to ‘best’. This is the real stretch: you would expect very strong evidence if organisations are to meet it.

5.2 Keep track of the ‘shalls’

Criteria directly drawn from a ‘shall’ statement in the standard should be coloured red and appear under ‘good’. Similarly, any criteria drawn from the principles in the standard should be coloured red. This colour coding makes it easier to keep track of the ‘shalls’ to ensure they have all been covered in the assessment framework – make sure you don’t delete any red coloured criteria as you update or change the assessment framework.

CHECKPOINT: put your agreed emerging framework onto your function’s template.

6. Test and pilot your assessment framework

6.1 Test with a broader group of stakeholders

Once you have some outputs you are satisfied with, validate them on some of your stakeholders. You can create another working group with some of your key stakeholders and test and pilot the assessment framework with them. Look at organisations of different sizes and configurations.

When you consult your stakeholders, ask them if they think the themes, practice areas and criteria work for them. They can help you uncover issues with the practice areas and criteria such as: - the practice areas and/or criteria are too vague and are therefore very difficult to evidence - on the contrary, the practice areas and/or criteria are too precise and do not allow enough flexibility for organisations of different sizes to evidence their compliance

Your stakeholders can also help you verify that no crucial aspect of functional work has been overlooked in the assessment framework.

Improve and update your assessment framework accordingly then retest it.

6.2 Test with the standards policy team and other functions

You might find that other functions have similar themes and have discovered neat ways to express particular types of criteria. Swap notes. You can use the functional standards Peer Group to raise issues.

7. Allow for tailoring

Organisations might want to augment the assessment framework by drawing metrics from suitable benchmarked information, including the Public Value Framework and the functions quality survey. They could add to the assessment framework locally to reflect a specific issue crucial to their business, where they want performance to be at a higher level than in other organisations.

CHECKPOINT: there is no final checkpoint - from here you should iterate, iterate and iterate.

8. Publish

See the Guide to governance and management frameworks for positioning your assessment framework if you propose to publish on GOV.UK (recommended). Note that completed assessments by organisation are not intended to be published (see section 8 of the Guide to continuous improvement against functional standards).