DRAFT Alternative Academic and Alternative Technical Qualifications Qualification Level Conditions
Updated 10 January 2023
Applies to England
Introduction
About this document
This document is part of a suite of documents which sets out our regulatory requirements for awarding organisations offering Alternative Academic and Alternative Technical Qualifications at Level 3. These conditions and requirements come into effect at [time] on [date].
This document sets out the following rules:
- our Qualification Level Conditions for Alternative Academic and Alternative Technical Qualifications, which we have set using our powers under section 134 of the Apprenticeships, Skills, Children and Learning Act 2009, and
- our requirements in relation to assessment strategies, qualification purposes, assessments, and standard setting.
With respect to all Alternative Academic and Alternative Technical Qualifications, awarding organisations must also comply with:
- our General Conditions of Recognition, which apply to all awarding organisations and qualifications, and
- all relevant Regulatory Documents.
Condition ATQ1: Interpretation and Definitions
ATQ1.1
The rules of interpretation and definitions outlined in General Condition J1 shall apply to the Alternative Academic and Alternative Technical Qualifications Qualification Level Conditions.
ATQ1.2
Except in the circumstances described in Condition ATQ1.3, the requirements imposed by the Alternative Academic and Alternative Technical Qualifications Qualification Level Conditions apply in addition to the requirements imposed by the General Conditions of Recognition.
ATQ1.3
To the extent that there is any inconsistency between –
- (a) a requirement of an Alternative Academic and Alternative Technical Qualification Level Condition and an awarding organisation’s ability to provide either a particular type of Reasonable Adjustment or Special Consideration, such that the awarding organisation is prevented from providing that Reasonable Adjustment or Special Consideration, the awarding organisation may provide that Reasonable Adjustment or Special Consideration and is not obliged to comply with the requirement of the Alternative Academic and Alternative Technical Qualifications Qualification Level Condition,
- (b) in all other cases, a requirement of an Alternative Academic and Alternative Technical Qualifications Qualification Level Condition and a requirement of a General Condition of Recognition, such that an awarding organisation could not comply with both such requirements, the awarding organisation must comply with the requirement of the Alternative Academic and Alternative Technical Qualifications Qualification Level Condition and is not obliged to comply with the requirement of the General Condition of Recognition.
ATQ 1.4
In these Conditions, the following words shall have the meaning given to them below (and cognate expressions should be construed accordingly) –
Alternative Academic Qualification
A qualification –
- (a) that is approved by the Secretary of State for Education on or after [DATE] for public funding as an [Alternative Academic Qualification],
- (b) to which an awarding organisation has assigned Level 3 under Condition E9.1, and
- (c) that is not –
- (i) a qualification to which any Qualification Level Conditions other than the Alternative Academic and Alternative Technical Qualification Level Conditions apply,
- (ii) an International Baccalaureate diploma,
- (iii) a performing arts graded examination, or
- (iv) a core maths qualification.
This includes a qualification that fell within paragraph (a) at any time on or after the date on which these conditions came into effect, but which is no longer publicly funded for any reason.
Alternative Technical Qualification
A qualification –
- (a) that is approved by the Secretary of State for Education on or after [DATE] for public funding as a technical qualification,
- (b) to which an awarding organisation has assigned Level 3 under Condition E9.1,
- (c) that is not a Technical Qualification, and
- (d) that falls within one of the following categories as defined by the Institute for Apprenticeships and Technical Education –
- (i)…
This includes a qualification that fell within criterion (a) at any time on or after the date on which these conditions came into effect, but which is no longer publicly funded for any reason.
Alternative Academic and Alternative Technical Qualification
An Alternative Academic Qualification or Alternative Technical Qualification, as the case may be.
Alternative Academic and Alternative Technical Qualifications Qualification Level Condition
A Condition of Recognition that applies to an Alternative Academic and Alternative Technical Qualification, except where that Condition has been disapplied under Condition ATQ7.2, and which uses the numbering format ‘ATQn.n’, where ‘n’ denotes a number.
Condition ATQ2: Assessment strategies
ATQ2.1
In respect of each Alternative Academic and Alternative Technical Qualification which it makes available, or proposes to make available, an awarding organisation must –
- (a) establish and maintain an assessment strategy for that qualification,
- (b) ensure that the assessment strategy complies with any requirements which may be published by Ofqual and revised from time to time, and
- (c) have regard to any guidance in relation to assessment strategies which may be published by Ofqual and revised from time to time.
ATQ2.2
In particular, an awarding organisation must ensure that the assessment strategy for an Alternative Academic and Alternative Technical Qualification sets out how the awarding organisation intends to secure, on an ongoing basis, compliance with its Conditions of Recognition in respect of the assessments for that qualification.
ATQ2.3
An awarding organisation must ensure that all assessments for an Alternative Academic and Alternative Technical Qualification which it makes available, or proposes to make available, are designed, set, delivered and marked in compliance with its assessment strategy for that qualification.
ATQ2.4
An awarding organisation must –
- (a) keep under review its assessment strategy for an Alternative Academic and Alternative Technical Qualification, and revise it where necessary, so as to satisfy itself that the assessment strategy meets at all times the requirements of Conditions ATQ2.1 and ATQ2.2,
- (b) review its assessment strategy for an Alternative Academic and Alternative Technical Qualification promptly upon receiving a request from Ofqual to do so, and subsequently ensure that its assessment strategy complies with any requirements that Ofqual has communicated to it in writing, and
- (c) promptly notify Ofqual of any revisions made by it to any assessment strategy.
ATQ2.5
An awarding organisation must –
- (a) upon receiving a request from Ofqual to do so, demonstrate to Ofqual’s satisfaction that it has complied with its assessment strategy for an Alternative Academic and Alternative Technical Qualification in respect of any particular assessment for that qualification, or provide an explanation to Ofqual as to why it has not so complied, and
- (b) give effect to any recommendation that Ofqual may make in respect of its compliance with its assessment strategy.
Condition ATQ3: Alternative Academic and Alternative Technical Qualification Review
ATQ3.1
Following any review by Ofqual of an Alternative Academic and Alternative Technical Qualification which it makes available, or proposes to make available, an awarding organisation must comply with any requirements, and have regard to any guidance, specified to it by Ofqual in relation to the qualification.
Condition ATQ4: Titling
ATQ4.1
In respect of each Alternative Academic and Alternative Technical Qualification which an awarding organisation makes available, or proposes to make available, Condition E2.1 does not apply.
ATQ4.2
An awarding organisation must ensure that the title on the Register of each Alternative Academic Qualification which it makes available includes the following information –
- (a) the name of the awarding organisation,
- (b) the level of the qualification,
- (c) the type of the qualification (where the qualification has a type),
- (d) a concise indication of the content of the qualification,
- (e) the number of hours which it has assigned to that qualification for Total Qualification Time, and
- (f) any Endorsement.
ATQ4.3
For the purposes of Condition ATQ4.2(c), an awarding organisation must ensure that the type used in the title of each Alternative Academic Qualification which it makes available –
- (a) is [TO BE CONFIRMED], and
- (b) does not refer to any other qualification type.
ATQ4.4
An awarding organisation must ensure that the title on the Register of each Alternative Technical Qualification which it makes available includes the following information –
- (a) the name of the awarding organisation,
- (b) the level of the qualification,
- (c) the type of the qualification (where the qualification has a type),
- (d) a concise indication of the content of the qualification, which must, where applicable, reflect the relevant occupational standard published by the Institute for Apprenticeships and Technical Education under section ZA11 of the Act,
- (e) [reference to IfATE brand depending on decisions from the IfATE consultation], and
- (f) whether the competence indicated by the award of the qualification is occupational or specialist.
ATQ4.5
For the purposes of Condition ATQ4.4(c), an awarding organisation must ensure that –
- (a) the type used in the title of any Alternative Technical Qualification which it makes available is [TO BE CONFIRMED],
- (b) does not refer to any other qualification type, and
- (c) in particular, the title of the qualification does not imply that the qualification is a Technical Qualification.
Condition ATQ5: Assessment
ATQ5.1
An awarding organisation must ensure that in respect of each assessment for an Alternative Academic and Alternative Technical Qualification which it makes available, or proposes to make available, it complies with any requirements, and has regard to any guidance, which may be published by Ofqual and revised from time to time.
ATQ5.2
An awarding organisation may apply for an exemption from any requirement published under Condition ATQ5.1 with respect to which Ofqual has stated that it will accept such an application.
ATQ5.3
Condition ATQ5.1 does not apply to the extent that an awarding organisation has been granted an exemption by Ofqual following an application under Condition ATQ5.2.
Condition ATQ6: Specified levels of attainment
ATQ6.1
An awarding organisation must ensure that in setting out the specified levels of attainment in the specification for each Alternative Academic and Alternative Technical Qualification which it makes available, or proposes to make available, it complies with any requirements and has regard to any guidance which may be published by Ofqual and revised from time to time.
ATQ6.2
An awarding organisation may apply for an exemption from any requirement or guidance published under Condition ATQ6.1 with respect to which Ofqual has stated that it will accept such an application.
ATQ6.3
Condition ATQ6.1 does not apply to the extent that an awarding organisation has been granted an exemption by Ofqual following an application under Condition ATQ6.2.
Condition ATQ7: Withdrawal of public funding from Alternative Academic and Alternative Technical Qualifications
ATQ7.1
In respect of an Alternative Academic and Alternative Technical Qualification which it makes available, an awarding organisation must –
- (a) promptly notify Ofqual where for any reason that qualification will, or is likely to, no longer be approved for public funding by the Secretary of State for Education, and
- (b) provide, as part of the notification, a description of the circumstances in which the need for the notification has arisen.
ATQ7.2
Where Condition ATQ7.1(a) applies –
- (a) Ofqual may decide, upon application by the awarding organisation or otherwise, that the Alternative Academic and Alternative Technical Qualifications Qualification Level Conditions should no longer apply to that qualification, and
- (b) the awarding organisation must comply with any requirements communicated to it by Ofqual in writing as part of that decision.
ATQ7.3
Any decision by Ofqual under Condition ATQ7.2 may include a decision that the Alternative Academic and Alternative Technical Qualification Level Conditions shall not apply to the relevant qualification from a particular date.
Condition ATQ8: Alternative Academic Qualification purposes
ATQ8.1
In respect of each Alternative Academic Qualification which an awarding organisation makes available, or proposes to make available, Conditions E1.1 – E1.2 do not apply.
ATQ8.2
An awarding organisation must ensure that each Alternative Academic Qualification which it makes available, or proposes to make available –
- (a) meets the general purposes for such qualifications published by Ofqual and revised from time to time, having regard to any guidance which may be published by Ofqual and revised from time to time, and
- (b) has one or more specific purposes which are consistent with the general purposes.
ATQ8.3
An awarding organisation must ensure that each Alternative Academic Qualification which it makes available, or proposes to make available, is designed so as, where there is a conflict between two or more purposes such that compliance with one purpose will reduce the degree to which an awarding organisation can comply with another –
- (a) priority is given to the principles in accordance with their hierarchy, with the greatest priority being given to compliance with purposes further up the hierarchy, and
- (b) without prejudice to the above requirement, compliance is secured with all of the purposes to the greatest extent possible.
Condition ATQ9: Content
ATQ9.1
An awarding organisation must ensure that the knowledge, skills and understanding that will be assessed as part of each Alternative Academic Qualification which it makes available, or proposes to make available, are appropriate in relation to –
- (a) the qualification’s purposes,
- (b) the level of the qualification,
- (c) the design of the assessments to be taken for the qualification, and
- (d) the number of hours for Total Qualification Time assigned to the qualification.
Condition ATQ10: Standard setting
ATQ10.1
In respect of each Alternative Academic Qualification which it makes available, an awarding organisation must comply with any requirements, and have regard to any guidance, which may be published by Ofqual and revised from time to time in relation to –
- (a) the promotion of consistency between the measurement of Learners’ levels of attainment in that qualification and similar qualifications made available by other awarding organisations, and
- (b) the setting of specified levels of attainment.
ATQ10.2
In setting the specified levels of attainment for an Alternative Academic Qualification which it makes available, an awarding organisation must have regard to an appropriate range of qualitative and quantitative evidence.
ATQ10.3
In respect of each Alternative Academic Qualification which it makes available, the range of evidence to which an awarding organisation has regard for the purposes of Condition ATQ10.2 will only be appropriate if it includes evidence of –
- (a) the Level of Demand of the assessments for that qualification,
- (b) the level of attainment demonstrated in those assessments by an appropriately representative sample of Learners taking that qualification,
- (c) where available, the level of attainment demonstrated by Learners taking that qualification in a –
- (i) prior assessment (which was not for that qualification), whether or not that assessment was for a regulated qualification, or
- (ii) prior qualification, whether or not that qualification was a regulated qualification, and
- (d) the level of attainment demonstrated by Learners who have previously been awarded the qualification.
ATQ10.4
An awarding organisation must maintain a record of –
- (a) the evidence to which it has had regard in setting the specified levels of attainment for each Alternative Academic Qualification which it makes available, and
- (b) its rationale for the selection of and weight given to that evidence.
Assessment strategy requirements
Condition ATQ2.1(a) requires an awarding organisation to establish and maintain an assessment strategy for each Alternative Academic and Alternative Technical Qualification which it makes available or proposes to make available. Condition ATQ2.2 requires an awarding organisation to ensure that the assessment strategy for an Alternative Academic and Alternative Technical Qualification sets out how the awarding organisation intends to secure, on an ongoing basis, compliance with its Conditions of Recognition in respect of the assessments for that qualification.
Condition ATQ2.1(b) requires an awarding organisation to have regard to any requirements in relation to assessment strategies published by Ofqual.
We set out our requirements for the purposes of Condition ATQ2.1(b) below.
Assessment strategy requirements for Alternative Academic Qualifications
Condition ATQ2.1(a) requires an awarding organisation to establish and maintain an assessment strategy for each Alternative Academic and Alternative Technical Qualification which it makes available or proposes to make available. Condition ATQ2.2 requires an awarding organisation to ensure that the assessment strategy for an Alternative Academic or Alternative Technical Qualification sets out how the awarding organisation intends to secure, on an ongoing basis, compliance with its Conditions of Recognition in respect of the assessments for that qualification.
Condition ATQ2.4 requires an awarding organisation to keep its assessment strategy under review, and to promptly notify Ofqual of any revisions made. An assessment strategy should be treated as a live working document which should be updated as necessary, considering evidence from assessment development, delivery and monitoring so qualifications and assessments continue to be fit for purpose.
Condition ATQ2.1(b) requires an awarding organisation to comply with any requirements, and have regard to any guidance, in relation to assessment strategies published by Ofqual.
We set out our requirements for the purposes of Condition ATQ2.1(b) below
General Requirements
There are three key properties of effective assessment strategies:
- A coherent and logical narrative
- The use of argument and justification with evidence
- A focus on the fitness for purpose of the qualification
1. A coherent and logical narrative
An assessment strategy must present a coherent and logical narrative demonstrating how an awarding organisation will seek to ensure that the qualification meets the requirements in the Conditions in relation to assessments. The detailed requirements section below sets out the aspects of the qualification that need to be covered within the assessment strategy. However, the assessment strategy should not be presented as a set of discrete responses to the matters set out below, as this approach risks lacking coherence. Rather, it must demonstrate consistency between different justifications and explanations, by –
- linking back to previously referred aspects (for example the assessment model should be demonstrably consistent with the purpose of the qualification), and
- demonstrating clear consideration and understanding of the consequences of decisions (for example, of the implications of the assessment model used for the approach to setting and maintaining standards).
Many decisions entail trade-offs (for example between Comparability and Manageability in tasks where centres might have a choice of task depending on their access to resources). These should be addressed as appropriate, so that the thinking behind the key decisions that the awarding organisation has made in developing the qualification is clear.
2. The use of argument and justification with evidence
In an assessment strategy, all statements that may have implications for the fitness for purpose of the qualification should be underpinned with clear and concise argument and evidence. Such statements should not constitute only assertion. For example, the following statements provide no evidence or justification to support the assertions that they make:
The two external assessments will comprise only multiple-choice questions. This question type aligns best with the type of content we are assessing in this qualification.
The types of evidence produced by the assessments lends itself to internal marking.
The reasoning and evidence behind such assertions must be provided. An awarding organisation should focus on the inclusion of material that supports its arguments for the fitness for purpose of the qualification.
For example, an awarding organisation should not include descriptions of processes or include or refer to pre-existing process documentation if the relevance of this content to the Validity and fitness for purpose of the assessments has not specifically been drawn out.
3. A focus on the fitness for purpose of the qualification
The purpose of an assessment strategy is to explain the choices that have been made in the development of the qualification and the approach to its ongoing monitoring will help ensure that the qualification meets the Conditions and is thus Valid and otherwise fit for purpose.
In particular, where an awarding organisation seeks an exemption under Condition ATQ5.2 from any requirement in relation to assessment, it must highlight this intention and ensure that its alternative approach is fully justified within the assessment strategy, including consideration of the consequential risks
Assessment strategy structure
It is up to an awarding organisation to decide how to structure its assessment strategy. The assessment strategy is a live document that will be used and updated throughout the lifetime of the qualification. The awarding organisation should structure it in a way that supports this.
In doing this an awarding organisation may, for example, choose to develop separate parts of its assessment strategy that:
- are specific to an individual qualification (for example a Level 3 Award in Childcare)
- apply to suites of related or similar qualifications (for example a suite of qualifications in Education and Childcare)
- are generic to a particular group of qualifications or to all of its qualifications (for example, all of its Level 3 Awards in all subjects).
An awarding organisation should explain clearly how any separate parts of an assessment strategy relate to each other. It should also explain how each of these separate parts will be kept under review, and revised where necessary, in light of the others. Taken together, such parts should form a coherent and integrated whole.
Detailed requirements
We set out below our detailed requirements on the specific information and evidence an awarding organisation must include in its assessment strategy. The requirements are set out in eight sections, as shown below. These sections are intended to represent the key stages in the lifecycle of a qualification, and an awarding organisation’s assessment strategy must be structured so as to reflect them. Depending on the approach to structuring its assessment strategy, an awarding organisation may find it useful to cover content from these sections in both an overarching document that covers its approach to a suite of qualifications and a document specific to an individual qualification.
- Qualification purpose
- Content
- Assessment design
- Assessment delivery
- Marking or assessing performance and standardisation
- Attainment and reporting
- Standard setting and maintenance
- Qualification monitoring
For each of the eight sections, indicative content is provided within a table that includes subheadings, corresponding questions, an explanation of the importance of those questions, and the Conditions to which they relate. In many cases, the column explaining the importance of information will also make clear where links should be made to other aspects of the qualification to aid the coherence of the document.
The subheadings, key questions and explanations in each section have been specifically written to reflect the key areas of qualification development that should be addressed and to reflect their approximate sequence as part of the qualification lifecycle. Assessment strategies must address the subheadings and questions contained in them. They may be structured according to the sections in the table. However, they must also reflect the need for decisions to be linked back appropriately to previous sections and must demonstrate clear consideration and understanding of their consequences (see general requirements under ‘A coherent and logical narrative’ above). Depending on the nature of a particular qualification, there may also be additional areas that require focus. Similarly, some areas covered in the table may require more extended focus, while other areas may not be applicable.
Assessment strategies should refer, as appropriate, to the proposed or existing assessment materials (for example questions, tasks and mark schemes) to exemplify any points or arguments made within the document. Assessment strategies should also refer, as appropriate, to existing policies or procedures to support the awarding organisation in demonstrating how it will seek to ensure that the qualification meets the requirements in the Conditions in relation to assessments (for example Centre Assessment Standards Scrutiny strategies).
Section 1: Qualification purpose
This refers to the initial approach to scoping the specification, including clearly defining the purposes of the assessment.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Purposes | How does the qualification fulfil the general purposes specified under Condition ATQ8.2 for Level 3 Alternative Academic qualifications? What are the specific purposes of the qualification? How does the qualification fulfil those purposes? Where there are competing purposes (including general purposes specified under Condition ATQ8.2), what trade-offs have been considered, and how have these been resolved? |
Key aspects of the qualification, including the content and assessment structure, must be designed to be consistent with the qualification purpose. A clear purpose will ensure that users of the qualification are not misled. A qualification typically has a number of different purposes that it is seeking to fulfil. When defining the purposes of a qualification, awarding organisations should consider them from different perspectives. These include the following: • The use to which the qualification outcomes will be put. The results of a qualification are likely to be used in different ways by a range of potential users. For example, results for individual learners may be used to identify appropriateness for recruitment to employment or further study, to signify licence to practise, and/or by the learner to make decisions regarding their own future. Results may also be used in aggregate from across learners. For example, results may be combined across learners taking qualifications within a centre for measures used to hold that centre to account. • The expertise that learners will acquire through participation in the qualification, and the nature of that expertise. For example, a qualification may develop understanding of a broad body of knowledge, skills and understanding in a particular area, or it may support the mastery of specified skills relevant to a defined discipline. • The role participation in the qualification plays in engaging learners. The existence of a qualification and the assessment(s) it contains will play a role in engaging learners. That may be engaging learners in education or training in general or be in relation to the specific area to which the qualification is relevant. For example, some qualifications may have the specific purpose of seeking to (re)engage learners likely to have particular previous experiences or reflect a particular context within which the qualification will be encountered. Defining the purposes of a qualification in these terms, and considering their relative importance – including in terms of the intended priority order set out in Condition ATQ8.2 – is likely to aid an effective qualification design process by informing the range of trade-offs required when making design decisions. These trade-offs and design decisions should be documented in the assessment strategy. |
Condition ATQ8 |
Section 2: Content
This refers to the skills, knowledge and understanding to be taught and assessed in the qualification.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Structure | What are the fundamental knowledge and skills inherent in the qualification, and how are they represented? Refer to the key elements of the content where applicable, such as: • learning outcomes • topics (and their weightings) • content statements • assessment objectives How will it be ensured that the knowledge, skills and understanding that will be assessed as part of the qualification are appropriate in relation to: •the qualification’s purpose •the level of the qualification •the design of the assessment to be taken for the qualification the size of the qualification. |
Poorly defined content can lead to: • Learners being insufficiently prepared for assessments • the development of assessments and assessment criteria or mark schemes that fail to appropriately target the content in a way that is fair and/or transparent • the qualification failing to meet one or more of its general or specific purposes. An awarding organisation must describe how the content has been developed to align with the purposes, level and target group(s) of the qualification. |
Condition ATQ9 |
Qualification Size | What is the size of the qualification and what is the rationale for this? | The awarding organisation must justify the Total Qualification Time and number of Guided Learning Hours in relation to the purposes, level, content and target group(s) of the qualification. | Condition E7 |
Demand | What steps were taken to ensure that the demand of the qualification content is set appropriately? | The awarding organisation must demonstrate that they have considered the demand of the qualification in relation to the target group(s) and, where appropriate, to other qualifications at the same level. | Condition D1 |
Optional content | Is there optional content in the qualification? Where there is content that is intended to be optional, how has it been ensured that the content for optional routes is appropriate? | The presence of optional routes may have implications for content coverage (for example, where one or more routes may omit key elements of the content). Where optional routes are included, the awarding organisation must explain its rationale for including them and how it has determined the content for each optional route. This may include justification as to how different routes represent a comparable Level of Demand and volume. |
Condition G1.2(a) |
Section 3: Assessment design
This refers to all aspects of the structure and development of the assessments.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Assessment structure | What is the model of assessment used? • How many assessments are there in total and what is the rationale for this? • What different elements of the content are targeted by the different assessments and is there a differential weighting between the assessments? What is the justification for the approach? • Does a ‘nested’ structure apply? (Where a number of different sizes of related qualifications share individual assessments.) How does this this approach support Learner and Centre needs? • What is the overall assessment time, and what is the rationale for this? • What are the theoretical and practical considerations that have been taken into account when determining the best method of assessment to assess a particular construct? • What is the balance between Assessment by Examination and Non-exam Assessment and how has this been determined? • How has the awarding organisation taken account of the needs of Learners with particular protected characteristics in designing the assessment model? |
An awarding organisation must justify how the key structural aspects of the assessment have been designed to be: • consistent with the purposes of the qualification • appropriate in relation to the content • conducive to the development of robust standard setting and standards maintenance processes |
Condition D1 Condition E1 Condition E4.2 Condition G1 Condition ATQ5.1 |
Assessment development | What is the process for developing assessment materials? •What are the different stages involved? •Who is involved at each stage? •What is the approach to training individuals who will be responsible for setting assessments, including ensuring security and mitigating any conflicts of interest? •Will any assessments be developed by the Centre? If so, what support will be offered to ensure these are Valid and fit for purpose? •What is the approach taken to develop assessment criteria, for example, mark schemes or performance criteria? •What are the principles or controls that are utilised when articulating assessment criteria, to ensure the reliability of the judgements that are made against the criteria? •What steps are taken to identify the risk of any adverse effect which may result from the awarding organisation’s approach to developing assessments? |
The process of assessment development must facilitate the development of Valid and fit for purpose assessments. | Condition A4 Condition D1 Condition E4.2 Condition G1 Condition G3 Condition G4 Condition G9.1 – G9.2 Condition ATQ5.1 |
Question and task Validity | How does each assessment method seek to maximise Validity? What steps are taken to ensure that assessment tasks elicit the assessment evidence they ought to elicit? For example: •that each task elicits its intended learning outcomes •that Learners understand what each task is asking them to do •that bias and other construct irrelevant factors are minimised •that Learners have sufficient time to complete tasks. |
Poorly designed assessments could impact on their ability to elicit reliable information regarding the proficiency of Learners. | Condition D1 Condition E4.2 Condition G1 Condition G3 |
Approach to content coverage | What is the approach to covering the range of content through the assessments? For example, is the content sampled over time or covered in its entirety in an individual assessment or set of assessments? If a sampling approach is used: •how is content sampled? •over what period will the full range of content be sampled? •if a sampling grid or equivalent is used to track coverage over time, what parameters will this record and what is the rationale for these? |
If a sampling approach is used, the methodology must demonstrate adequate coverage of the full range of content both over time and in relation to individual assessments. Alternative Academic qualifications may be intended to be curriculum-based with the assessments sampling from across a range of content and skills. An awarding organisation must fully justify its approach to content coverage in the context of the purpose of the qualification. |
Condition A6 Condition D1 Condition E4.2 Condition G1 Condition G9.3 |
Assessment by Examination | Which parts of the content are assessed through Assessment by Examination, and why? •What question or task types are used and why were these selected? •How has the balance between different question or task types been determined? •How are mark schemes designed, and what steps are taken to ensure they support reliable application? •What are the conditions in which the Assessments by Examination must be taken? •Is the awarding organisation seeking an exemption to the requirement for simultaneous sitting of the Assessment by Examination? If so, what is the justification for this? |
Assessments by Examination must be justified in relation to their: •alignment with the purposes of the qualification •effectiveness in assessing the knowledge and skills set out in the content •conduciveness to achieving reliable outcomes for Learners. An awarding organisation may request an exemption from the requirement that the Assessment by Examination should be taken simultaneously. For example, in certain subjects like performing arts, it may be more challenging for all Learners to take assessments at the same time. Awarding organisations should explain the mitigations of the risks that might arise from the chosen form of assessment and approach to sitting that assessment. |
Condition D1 Condition E4.2 Condition G1 Condition ATQ5.1 |
Non-exam Assessment | What parts of the content are assessed through Non-exam Assessment, and why? What type(s) of Non-exam Assessments are used, and why? What question or task types are used and why? •How has the balance between different question or task types been determined? •How are mark schemes or performance criteria designed, and what steps are taken to ensure they support reliable application? •What are the conditions in which assessments must be taken? Are the same Non-exam Assessments used over time, and if so, how will it be ensured that the Non-exam Assessments are not susceptible to issues of predictability and malpractice? What is the approach taken to determining the narrowness or flexibility of Non-exam Assessment briefs? What are the risks or benefits to validity of the narrowness or flexibility of the assessment? What are the principles that determine the approach for any given assessment? |
The use of Non-exam Assessment must be justified, with a particular emphasis on: •why this type of assessment is required in order to maximise assessment Validity •what the key threats to Reliability and Validity are, and how these have been mitigated. |
Conditions A6 Condition D1 Condition E4.2 Condition G1 Condition G9.3 Condition ATQ5.1 |
Centre adaptation | What approach is taken to whether Centre adaptation of tasks will be permitted? To what extent will Centres be otherwise required to interpret or expand tasks set by the awarding organisation? What is the rationale for the approach? What measures are in place to support Centres in making acceptable and effective adaptations where appropriate? What monitoring is in place to ensure that the awarding organisation has visibility of any modifications and their appropriateness? |
It is important to demonstrate how Comparability is assured in relation to any Centre adaptation (or similar) of assessments set by the awarding organisation. | Condition D1 Condition E4.2 Condition G1 Condition G9 Condition ATQ5.1 |
Controls | What are the principles that determine which level of control or configuration of variable is selected for each task? What controls are specified? •Will Learners have access to any assessment materials before the assessment is taken? •Are assessments to be completed within specified time limits? •Are Learners permitted to ask for support? •Are Learners permitted to access resources (for example, class notes or the internet)? •How are Learners supervised? •Is collaboration permitted between Learners? •How is work Authenticated? |
It is important that any controls have been fully considered and specified to ensure assessments are Valid, Reliable and appropriate for the qualification purpose. | Condition G8 Condition G9 |
Generating outcomes (assessment level) | What is the approach to generating outcomes for individual assessments? Are outcomes based only on a Learner’s overall attainment within a Component? Or are there any areas that must be demonstrated, irrespective of performance elsewhere? |
It is important to ensure that the approach to generating outcomes: •discriminates effectively between Learners of different abilities •enables awarding organisations to monitor and control standards. •is in line with the purposes of the qualification and the aspects of the content that it is assessing. An awarding organisation must justify how their approach will ensure this. |
Condition G1.2(a) |
Optional assessment | If applicable, what elements of the assessments are optional? How will the Comparability of optional routes be appropriately managed? |
It is important to ensure that standards are maintained when there are optional routes. | Condition G1.2 |
Section 4: Assessment delivery
This refers to the available modes of delivery and the availability of assessments.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Modes of assessment delivery (all assessment) | What modes of assessment delivery are available (for example, paper-based, computer-based)? | The modes of delivery must be: •appropriate for the target group •Manageable for Centres •optimal in terms of eliciting evidence of the knowledge, skills and behaviours described in the content. An awarding organisation must justify its approach to this. Any prioritisation between these requirements must be detailed. |
Condition D1 Condition E4.2 Condition G1 Condition G9 |
Assessment availability | What approach is taken to the availability of assessments, including •number of assessments to be available •type of assessment (for example, online and/or paper-based) What is the approach to permitting Learners to re-take assessments? Will the awarding organisation be providing: •one or two opportunities for the Assessment by Examination on set dates per academic year? •one or two windows for submitting outcomes for Non-exam Assessment per academic year? For Non-exam Assessment, where a Learner re-sits, is entirely new evidence required from the Learner for the re-take, or are they permitted to re-work evidence where a requirement for new evidence would be unreasonable? What is the rationale for the approach? In light of the approach to availability, what specific risks have been identified, how will these be mitigated, and how will particular challenges be addressed, including: •ensuring Comparability of assessments •minimising predictability of assessments •ensuring security of assessments. |
An awarding organisation must: •justify its approach in relation to the purpose of the assessment. •detail specific risks that have been identified (such as to the Comparability and predictability of assessments), and how these have been mitigated. If an awarding organisation has applied for an exemption to the simultaneous sitting of the Assessment by Examination, it may also apply for an exemption to the requirement to provide two opportunities for the Assessment by Examination on set dates. An awarding organisation should explain and justify its approach. |
Condition A6 Condition D1 Condition E4.2 Condition G1 Condition G9 Condition ATQ5.1 |
Security | What approach is taken to ensuring the secure transmission, distribution and storage (including by Centres) of assessment materials? What approach is taken to ensuring the security of any assessment materials that Learners have access to prior to assessments being taken? |
Inadequate approaches to security can undermine Reliability – if, for example, assessment scores do not accurately reflect Learners’ attainment. | Condition G4 Condition G9 |
Centre feedback | What approach is taken to ensuring that Centres provide appropriate feedback on Centre marked assessments to Learners? What mitigations are in place to prevent Centre Assessors from providing feedback that is excessively frequent or excessively directive? |
If feedback from Centre Assessors to Learners is provided excessively frequently and/or is excessively directive about what must be included or addressed as part of the assessment, this creates the potential that assessment scores do not accurately reflect Learners’ attainment. | Condition C1 Condition C2 Condition G9 |
Section 5: Marking or assessing performance and standardisation
This refers to the approach taken to the marking of all assessments.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Approach to marking or assessing performance (all assessments) | What approach is taken to marking or assessing performance? What steps are taken to identify the risk of any adverse effect which may result from the awarding organisation’s approach to marking or assessing performance? |
The approach to marking or assessing performance is key to ensuring that outcomes are as consistent and accurate as possible. An awarding organisation must justify its approach to marking in relation to the qualification purposes and the need for Reliable outcomes. |
Condition A6 Condition D1 Condition H1 Condition H2 Condition H5 |
Monitoring marking or assessing performance (all assessments) | What processes are in place to monitor accuracy and consistency of marking or assessing performance and issuing of results, and to take remedial action where necessary? | An awarding organisation must justify its approach to monitoring in relation to the need for Reliable outcomes. | Condition H1 Condition H2 Condition H5 Condition H6.1(d) |
Assessor standardisation (all assessments) | What are the characteristics of reliable Assessors? What steps are or will be taken to recruit such Assessors? What approach is taken to training and standardising Assessors, including details of standardisation procedures and any wider training? |
It is important to clearly articulate the knowledge, skills and experience that Assessors will need in order to ensure the Reliability of the judgements that are made. An awarding organisation must explain the steps it will take to recruit such Assessors. An awarding organisation must describe its approach to training and standardising Assessors (both external assessors and Centre assessors). This could include, for example, any specific training for new or senior Assessors, as well as any wider training available. An awarding organisation must describe its standardisation procedures, including, for example, how it will determine whether an Assessor can assess reliably. |
Condition G1.3 Condition H1 Condition H2 Condition H5 |
Centre Assessment Standards Scrutiny (Centre marking or assessing) | What is the approach to Centre Assessment Standards Scrutiny, and the rationale for this approach? What are the risks with this approach, and how will they be managed? |
An awarding organisation must justify its approach to Centre Assessment Standards Scrutiny in relation to the need for Reliable outcomes. It will be important for an awarding organisation to link to its Centre Assessment Standards Scrutiny strategy in the justification of its approach. |
Condition A6 Condition C1 Conditions C2.1 and C2.3(j) Condition D1 Condition H2 Condition H5 |
Centre training and monitoring (centre marking or assessing) | What approach is taken to the provision of guidance and training to Centres around marking or assessing performance? How are Centres monitored? |
An awarding organisation must justify its approach to training in relation to the need for Reliable outcomes. | Condition C1 Condition H1 Condition H5 |
Section 6: Attainment and Reporting
This refers to the identified levels of attainment and the grading structures used to characterise these levels.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Specified levels of attainment | What are the specified levels of attainment (i.e. grading scales) for the qualification? What is the justification for the approach? How do the assessments generate Reliable information in line with the proposed grading? If specifying different levels of attainment: •what characteristics differentiate learners who have demonstrated different levels of attainment? •what steps have been taken to ensure that there is sufficient difference between adjacent levels of attainment? |
The characteristics of the intended levels of attainment must follow clearly from relevant elements of the content. An awarding organisation’s approach to differentiating between adjacent levels of attainment must be justified in terms of the scope to generate Reliable information. |
Condition D1 Condition E4.2 Condition G1.3 Condition ATQ6.1 |
Aggregation (qualification level) | What is the approach to aggregation? For example, to what extent do Learners’ results for the qualification reflect their overall attainment across all assessments, or their attainment in particular assessments? What is the justification for the approach? If applicable, what is the approach to scaling marks from individual assessments for the purpose of aggregation? If individuals are permitted to re-sit assessments, are there any changes to the aggregation rules in these instances, and what is the rationale for the approach? |
The approach must be justified in relation to the content and purposes of the qualification. An appropriate aggregation method and, if relevant, scaling method is needed to ensure appropriate discrimination between Learners. |
Condition D1 Condition E4.2 Condition H5.4 Condition ATQ10.1b |
Reviews and/or Appeals | What steps are taken to ensure that concerns over inaccuracy of assessment results are addressed adequately and appropriately? For example: •that they are investigated fairly, thoroughly and in a timely fashion •that justified concerns over inaccuracy are resolved by following an appropriate process. |
An appropriate process is fundamental to ensuring that appropriate inferences are drawn from results. | Condition I1 |
Section 7: Standard setting and maintenance
This refers to the processes for setting and maintaining standards, and the types of evidence that are used.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Approach | What is the approach to setting and maintaining appropriate grading standards within the qualification? For example, are grading standards determined up-front by individual assessors and applied at the point of assessment, or are they determined through an awarding process separate to marking? If standards are determined through an awarding process separate to marking: •Within an individual Component, are the requirements (such as number of marks) to achieve a given grade set out upfront or determined after the assessment(s) have been taken? •What is the process for setting grade boundaries at qualification level? If qualifications have a nested structure, how will the awarding organisation manage and mitigate any risk in being able to effectively set and maintain standards? For all approaches, how will the awarding organisation take account of any impact on Learners who share a particular protected characteristic? |
If qualifications include directly graded outcome-based assessments, it is important that the approach to standard setting and maintenance links to marking or assessing performance, standardisation, Assessor training and the approach to Centre Assessment Standards Scrutiny. If standards are determined through an awarding process separate to marking, it is important the approach to standard setting and maintenance follows an appropriate technical methodology. An awarding organisation must set out the technical methodology for determining Component and qualification level grade boundaries. In each case, an awarding organisation must fully justify its approach to effectively setting and maintaining appropriate grading standards within the qualification, both over time and with similar qualifications it makes available. Where possible, an awarding organisation must also demonstrate how it will effectively set and maintain standards with similar qualifications offered by other awarding organisations. |
Condition H3 Condition ATQ10 |
Evidence | What quantitative and qualitative information is used? How is the weighting of evidence determined when multiple sources of evidence are used? (This may include worked examples, for illustrative purposes, as necessary.) |
It is important the approach to standard setting and maintaining: •includes full consideration of the strengths and limitations of the different types of available evidence, and the weight given to different evidence •leads to securing fair and Reliable outcomes over time and between Learners. |
Condition H3 Condition ATQ10 |
Modes of assessment | Where there are multiple modes (for example, paper and computer), how is Comparability of standards maintained? | It is important to ensure that standards are maintained when there are multiple modes of assessment. An awarding organisation must describe how it ensures comparability between different modes of assessment, for example when assessments are set, marked and assessed, including any separate awarding processes. |
Condition D1 Condition E4.2 |
Section 8: Qualification monitoring
This refers to the processes that are applied on an ongoing basis to monitor the Validity of key aspects of the specification, such as its assessments, susceptibility to malpractice and maladministration, and standard maintenance processes.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Approach | Describe the techniques and measures used to monitor all key aspects of the qualification that may affect its Validity. This may include, for example: •reviewing of functioning of previous assessments •security or malpractice issues or incidents •feedback through engagement with Users of the qualification What sources of evidence are evaluated to identify any issues with the ongoing Validity of qualifications? How does the awarding organisation assess whether any aspect of the qualification may be disadvantaging a group of Learners who share a protected characteristic? |
Failure to consider the ongoing Validity of the qualification increases the likelihood of threats manifesting themselves and/or assessment processes ceasing to remain fit for purpose. | Condition A5.2(b) Condition A6 Condition A8.1 Condition D1 Condition D3 Condition E4.2 Condition G1 Condition G4 Condition G9.3 |
Availability of Data | What data will be collected to monitor the delivery and performance of the qualification? What systems and procedures are in place to ensure that any qualification or Component-level data that may be required by Ofqual can be provided within a reasonable time? |
It is important to demonstrate that this data is used where appropriate by awarding organisations at relevant points in qualification development. | Condition A5.2(b) Condition B4 |
Reviewing the assessment approach | How is the assessment approach reviewed and, where applicable, refined over time, based on evidence of its effectiveness? What sources of evidence and feedback are included when reviewing the effectiveness of a qualification? |
It is important to have appropriate processes in place to review and evaluate the effectiveness of the qualification to maintain its ongoing Validity. | Condition D3 |
Assessment strategy requirements for Alternative Technical Qualifications
Condition ATQ2.1(a) requires an awarding organisation to establish and maintain an assessment strategy for each Alternative Academic and Alternative Technical Qualification which it makes available or proposes to make available. Condition ATQ2.2 requires an awarding organisation to ensure that the assessment strategy for an Alternative Academic or Alternative Technical Qualification sets out how the awarding organisation intends to secure, on an ongoing basis, compliance with its Conditions of Recognition in respect of the assessments for that qualification.
Condition ATQ2.4 requires an awarding organisation to keep its assessment strategy under review, and to promptly notify Ofqual of any revisions made. An assessment strategy should be treated as a live working document which should be updated as necessary considering evidence from assessment development, delivery and monitoring so that qualifications and assessments continue to be fit for purpose.
Condition ATQ2.1(b) requires an awarding organisation to comply with any requirements, and have regard to any guidance, in relation to assessment strategies published by Ofqual.
We set out our requirements for the purposes of Condition ATQ2.1(b) below
General requirements
There are three key properties of effective assessment strategies :
- A coherent and logical narrative
- The use of argument and justification with evidence
- A focus on the fitness for purpose of the qualification
1. A coherent and logical narrative
An assessment strategy must present a coherent and logical narrative demonstrating how an awarding organisation will seek to ensure that the qualification meets the requirements in the Conditions in relation to assessments. The detailed requirements section below sets out the aspects of the qualification that need to be covered within the assessment strategy. However, the assessment strategy should not be presented as a set of discrete responses to the matters set out below, as this approach risks lacking coherence. Rather, it must demonstrate consistency between different justifications and explanations, by –
- linking back to previously referred aspects (for example, the assessment model should be demonstrably consistent with the purpose of the qualification), and
- demonstrating clear consideration and understanding of the consequences of decisions (for example, of the implications of the assessment model used for the approach to setting and maintaining standards).
Many decisions entail trade-offs (for example, between Comparability and Manageability in tasks where centres might have a choice of task depending on their access to resources). These should be addressed as appropriate, so that the thinking behind the key decisions that the awarding organisation has made in developing the qualification is clear.
2. The use of argument and justification with evidence
In an assessment strategy, all statements that may have implications for the fitness for purpose of the qualification should be underpinned with clear and concise argument and evidence. Such statements should not constitute only assertion. For example, the following statements provide no evidence or justification to support the assertions that they make –
The two external assessments will comprise only multiple-choice questions. This question type aligns best with the type of content we are assessing in this qualification.
The types of evidence produced by the assessments lends itself to internal marking.
The reasoning and evidence behind such assertions must be provided. An awarding organisation should focus on the inclusion of material that supports its arguments for the fitness for purpose of the qualification.
For example, an awarding organisation should not include descriptions of processes or include or refer to pre-existing process documentation if the relevance of this content to the Validity and fitness for purpose of the assessments has not specifically been drawn out.
3. A focus on the fitness for purpose of the qualification
The purpose of an assessment strategy is to explain the choices that have been made in the development of the qualification and the approach to its ongoing monitoring will help ensure that the qualification meets the Conditions and is thus Valid and otherwise fit for purpose.
Assessment strategy structure
It is up to an awarding organisation to decide how to structure its assessment strategy. The assessment strategy is a live document that will be used and updated throughout the lifetime of the qualification. The awarding organisation should structure it in a way that supports this.
In doing this, an awarding organisation may, for example, choose to develop separate parts of its assessment strategy that:
- are specific to an individual qualification (for example, a Level 3 Award in Childcare)
- apply to suites of related or similar qualifications (for example, a suite of qualifications in Education and Childcare)
- are generic to a particular group of qualifications or to all of its qualifications (for example, all of its Level 3 Awards in all subjects).
An awarding organisation should explain clearly how any separate parts of an assessment strategy relate to each other. It should also explain how each of these separate parts will be kept under review, and revised where necessary, in light of the others. Taken together, such parts should form a coherent and integrated whole.
Detailed requirements
We set out below our detailed requirements on the specific information and evidence an awarding organisation must include in its assessment strategy. The requirements are set out in eight sections, as shown below. These sections are intended to represent the key stages in the lifecycle of a qualification, and an awarding organisation’s assessment strategy must be structured so as to reflect them. Depending on the approach to structuring its assessment strategy, an awarding organisation may find it useful to cover content from these sections in both an overarching document that covers its approach to a suite of qualifications and a document specific to an individual qualification.
- Qualification purpose
- Content
- Assessment design
- Assessment delivery
- Marking or assessing performance and standardisation
- Attainment and reporting
- Standard setting and maintenance
- Qualification monitoring
For each of the eight sections, indicative content is provided within a table that includes subheadings, corresponding questions, an explanation of the importance of those questions, and the Conditions to which they relate. In many cases, the column explaining the importance of information will also make clear where links should be made to other aspects of the qualification to aid the coherence of the document.
The subheadings, key questions and explanations in each section have been specifically written to reflect the key areas of qualification development that should be addressed and to reflect their approximate sequence as part of the qualification lifecycle. Assessment strategies must address the subheadings and questions contained in them. They may be structured according to the sections in the table. However, they must also reflect the need for decisions to be linked back appropriately to previous sections and must demonstrate clear consideration and understanding of their consequences (see general requirements under ‘A coherent and logical narrative’ above). Depending on the nature of a particular qualification, there may also be additional areas that require focus. Similarly, some areas covered in the table may require more extended focus, while other areas may not be applicable.
Assessment strategies should refer, as appropriate, to the proposed or existing assessment materials (for example, questions, tasks and mark schemes) to exemplify any points or arguments made within the document. Assessment strategies should also refer, as appropriate, to existing policies or procedures to support the awarding organisation in demonstrating how it will seek to ensure that the qualification meets the requirements in the Conditions in relation to assessments (for example, Centre Assessment Standards Scrutiny strategies).
Section 1: Qualification Purpose
This refers to the initial approach to scoping the specification, including clearly defining the purposes of the assessment.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Purposes | How does the qualification fulfil the relevant category purpose set out by the Institute for Apprenticeships and Technical Education? Does the qualification have any further specific purposes? If so, how does the qualification fulfil those specific purposes and ensure their coherence with the relevant category purpose set out by the Institute for Apprenticeships and Technical Education? Where there are competing specific purposes, what trade-offs have been considered, and how have these been |
Key aspects of the qualification, including the content and assessment structure, must be designed to be consistent with the qualification purpose. A clear purpose will ensure that users of the qualification are not misled. A qualification typically has a number of different purposes that it is seeking to fulfil. When defining the purposes of a qualification, awarding organisations should consider them from different perspectives. These include the following: • The use to which the qualification outcomes will be put. The results of a qualification are likely to be used in different ways by a range of potential users. For example, results for individual learners may be used to identify appropriateness for recruitment to employment or further study, to signify licence to practise, and/or by the learner to make decisions regarding their own future. Results may also be used in aggregate from across learners. For example, results may be combined across learners taking qualifications within a centre for measures used to hold that centre to account. • The expertise that learners will acquire through participation in the qualification, and the nature of that expertise. For example, a qualification may develop understanding of a broad body of knowledge, skills and understanding in a particular area, or it may support the mastery of specified skills relevant to a defined discipline. • The role participation in the qualification plays in engaging learners. The existence of a qualification and the assessment(s) it contains will play a role in engaging learners. That may be engaging learners in education or training in general or be in relation to the specific area to which the qualification is relevant. For example, some qualifications may have the specific purpose of seeking to (re)engage learners likely to have particular previous experiences or reflect a particular context within which the qualification will be encountered. Defining the purposes of a qualification in these terms, and considering their relative importance – including in terms of any intended priority order set out by the Institute for Apprenticeships and Technical Education – is likely to aid an effective qualification design process by informing the range of trade-offs required when making design decisions. These trade-offs and design decisions should be documented in the assessment strategy. |
Condition E1.1 and E1.2 |
Section 2: Content
This refers to the skills, knowledge and understanding to be taught and assessed in the qualification.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Structure | How has the content been developed with reference, as appropriate, to the qualification category, and to the relevant employer-led occupational standard(s) published by the Institute for Apprenticeships and Technical Education? Where there is no such standard, how has suitable content been established? How are the relevant knowledge skills and behaviours represented in the specification? Refer to the key elements of the specification content where applicable, such as: •learning outcomes •topics (and their weightings) •content statements •performance criteria |
Poorly defined content can lead to: • Learners being insufficiently prepared for assessments • the development of assessments and assessment criteria or mark schemes that fail to appropriately target the content in a way that is fair and/or transparent • the qualification failing to meet one or more of its general or specific purposes. An awarding organisation may draw as necessary on the detailed information it provides to the Institute for Apprenticeships and Technical Education to give an overview of the content structure and how this has been developed. This may include, as appropriate, references to the mapping of relevant knowledge, skills and behaviours, and the evidence of employer engagement. |
Condition D1 |
Qualification Size | What is the size of the qualification and what is the rationale for this? | The awarding organisation must justify the Total Qualification Time and number of Guided Learning Hours in relation to the purposes, level, content and target group(s) of the qualification. | Condition E7 |
Demand | What steps were taken to ensure that the demand of the qualification content is set appropriately? | An awarding organisation must demonstrate that they have considered the demand of the qualification content, in relation to the relevant occupational standard(s) as applicable. | Condition D1 |
Optional content | Is there any optional content in the qualification? Where there is content that is intended to be optional, how have you ensured that the content for optional routes is appropriate and comparable? | The presence of optional routes may have implications for content coverage (for example, where one or more routes may omit key elements of the content). Where they are included, an awarding organisation must explain its rationale for including optional routes and how it has determined the content for each optional route. This may include how different routes reflect expectations of competence in alternative technical qualifications. |
Condition G1.2(a) |
Section 3: Assessment design
This refers to all aspects of the structure and development of the assessments.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Assessment structure | What is the model of assessment used? •How many assessments are there in total and what is the rationale for this? •What different elements of the content are targeted by the different assessments and is there a differential weighting between the assessments? What is the justification for the approach? •What is the overall assessment time, and what is the rationale for this? •What are the theoretical and practical considerations that have been taken into account when determining the best method of assessment to assess a particular construct? •What is the balance between different assessment methods and how has this been determined? •How has the awarding organisation taken account of the needs of Learners with particular protected characteristics in designing the assessment model? |
An awarding organisation must justify how the key structural aspects of the assessment have been designed to be: • consistent with the purposes of the qualification • appropriate in relation to the content • conducive to the development of robust standard setting and standards maintenance processes |
Condition D1 Condition E1 Condition E4.2 Condition G1 Condition ATQ5.1 |
Assessment development | What is the process for developing assessment materials? •What are the different stages involved? •Who is involved at each stage? How have employer representatives been engaged in the development process? •What is the approach to training individuals who will be responsible for setting assessments, including ensuring security and mitigating any conflicts of interest? •Will any assessments be developed by the Centre? If so, what support will be offered to ensure these are Valid and fit for purpose? •What steps are taken to identify the risk of any adverse effect which may result from the awarding organisation’s approach to developing assessments? |
The process of assessment development must facilitate the development of Valid and fit for purpose assessments. | Condition A4 Condition D1 Condition E4.2 Condition G1 Condition G3 Condition G4 Condition G9.1 – G9.2 Condition ATQ5.1 |
Question and task Validity | How does each assessment method seek to maximise Validity? What steps are taken to ensure that assessment tasks elicit the assessment evidence they ought to elicit? For example: •that each task elicits its intended learning outcomes •that Learners understand what each task is asking them to do •that bias and other construct irrelevant factors are minimised •that Learners have sufficient time to complete tasks. |
Poorly designed assessments could impact on their ability to elicit reliable information regarding the proficiency of Learners. | Condition D1 Condition E4.2 Condition G1 Condition G3 |
Approach to content coverage | What is the approach to covering the content through the assessments? For example, is the content sampled over time or covered in its entirety in an individual assessment or set of assessments? If a sampling approach is used: •how is content sampled? •over what period will the full range of content be sampled? •If a sampling grid or equivalent is to be used to track coverage over time, what parameters will this record and what is the rationale for these? |
If a sampling approach is used, the methodology must demonstrate adequate coverage of the full range of content both over time and in relation to individual assessments. Some qualifications aligned to occupational standards may be intended to signal competence. An awarding organisation must consider this in any justification of its approach to content coverage |
Condition D1 Condition E4.2 Condition G1 Condition G9.3 |
Assessment methods | What assessment methods are used to assess the content and why? For all assessments: •What question or task types are used and why? •How has the balance between different question or task types been determined? •How are mark schemes or performance criteria designed, and what steps are taken to ensure they support reliable application? •What are the principles and controls that are utilised when articulating assessment criteria, to ensure the reliability of the judgements that are made against the criteria? In addition, for assessments which may be set and marked by Centres: •If the same assessments are used over time, including where the same assessments are available on demand, is predictability a risk to Validity? If so, how will it be ensured that they are not susceptible to issues of predictability and malpractice? •Where assessment briefs are used: •what is the approach taken to determining the narrowness or flexibility of these? • what are the risks or benefits to Validity of the narrowness or flexibility of these? |
Assessments methods must be justified in relation to their: •alignment with the purposes of the qualification •effectiveness in assessing the knowledge, skills and behaviours laid out in the content •conduciveness to achieving reliable outcomes for Learners. The use of assessment which may be set and marked by Centres must be justified, with a particular emphasis on: •why this type of assessment is required in order to maximise assessment Validity •what the key threats to Reliability and Validity are, and how these have been mitigated. |
Condition D1 Condition E4.2 Condition G1 Condition G9.3 Condition A6 |
Centre adaptation | What approach is taken to whether Centre adaptation of tasks will be permitted? To what extent will Centres be otherwise required to interpret or expand tasks set by the awarding organisation? What is the rationale for the approach? What measures are in place to support Centres in making acceptable and effective adaptations where appropriate? What monitoring is in place to ensure that the awarding organisation has visibility of any modifications and their appropriateness? |
It is important to demonstrate how Comparability is assured in relation to any Centre adaptation (or similar) of assessments set by the awarding organisation | Condition D1 Condition E4.2 Condition G1 Condition G9 Condition ATQ5.1 |
Controls | What are the principles that determine which level of control or configuration of variable is selected for each task? What controls are specified? •Will Learners have access to any assessment materials before the assessment is taken? •Are assessments to be completed within specified time limits? •Are Learners permitted to ask for support? •Are Learners permitted to access resources (for example, class notes or the internet)? •How are Learners supervised? •Is collaboration permitted between Learners? •How is work Authenticated? |
It is important that any controls have been fully considered and specified to ensure assessments are Valid, Reliable and appropriate for the qualification purpose. | Condition G8 Condition G9 |
Generating outcomes (assessment level) | What is the approach to generating outcomes for individual assessments? Are outcomes based only on a Learner’s overall attainment within a Component? Alternatively, is there a requirement for some or all aspects of the Component to be attained individually? Linked to this, does the assessment for the Component use numerical marks or an alternative such as grading criteria? |
It is important to ensure that the approach to generating outcomes: •discriminates effectively between Learners of different abilities •enables awarding organisations to monitor and control standards. •is in line with the purposes of the qualification and the aspects of the content that it is assessing. An awarding organisation must justify how their approach will ensure this. |
Condition G1.2(a) |
Optional assessment | If applicable, what elements of the assessments are optional? How will the Comparability of optional routes be appropriately managed? |
It is important to ensure that standards are maintained when there are optional routes. | Condition G1.2 |
Section 4: Assessment delivery
This refers to the available modes of delivery and the availability of assessments.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Modes of assessment delivery (all assessment) | What modes of assessment delivery are available (for example, paper-based, computer-based)? | The modes of delivery must be: •appropriate for the target group •Manageable for Centres •optimal in terms of eliciting evidence of the knowledge, skills and behaviours described in the content. |
Condition D1 Condition E4.2 Condition G1 Condition G9 |
Assessment availability | What approach is taken to the availability of assessments, including: •number of assessments to be available •type of assessment (for example, online and/or paper-based) •scheduling of assessments (for example, timetabled or on-demand) What is the approach to permitting Learners to re-take assessments? Is entirely new evidence required from the Learner for the re-take, or are they permitted to re-work evidence where a requirement for new evidence would be unreasonable? In light of the approach to availability, what specific risks have been identified, how these will be mitigated, and how will particular challenges will be addressed, including: •ensuring Comparability of assessments •minimising predictability of assessments •ensuring security of assessments. |
An awarding organisation must: •justify its approach in relation to the purpose of the assessment. •detail specific risks that have been identified (such as to the Comparability and predictability of assessments), and how these have been mitigated. |
Condition A6 Condition D1 Condition E4.2 Condition G1 Condition G9 Condition ATQ5.1 |
Security | What approach is taken to ensuring the secure transmission, distribution and storage (including by Centres) of assessment materials? What approach is taken to ensuring the security of any assessment materials that Learners have access to prior to assessments being taken? |
Inadequate approaches to security can undermine Reliability – if, for example, assessment scores do not accurately reflect Learners’ attainment. | Condition G4 Condition G9 |
Centre feedback | What approach is taken to ensuring that Centres provide appropriate feedback on Centre marked assessments to Learners? What mitigations are in place to prevent Centre Assessors from providing feedback that is excessively frequent or excessively directive? |
If feedback from Centre Assessors to Learners is provided excessively frequently and/or is excessively directive about what must be included or addressed as part of the assessment, this creates the potential that assessment scores do not accurately reflect Learners’ attainment. | Condition C1 Condition C2 Condition G9 |
Section 5: Marking or assessing performance and standardisation
This refers to the approach taken to the marking of all assessments.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Approach to marking or assessing performance (all assessments) | What approach is taken to marking or assessing performance? What steps are taken to identify the risk of any adverse effect which may result from the awarding organisation’s approach to marking or assessing performance? |
The approach to marking or assessing performance is key to ensuring that outcomes are as consistent and accurate as possible. An awarding organisation must justify its approach to marking in relation to the qualification purposes and the need for Reliable outcomes. |
Condition A6 Condition D1 Condition H1 Condition H2 Condition H5 |
Monitoring marking or assessing performance (all assessments) | What processes are in place to monitor accuracy and consistency of marking or assessing performance and issuing of results, and to take remedial action where necessary? | An awarding organisation must justify its approach to monitoring in relation to the need for Reliable outcomes. | Condition H1 Condition H2 Condition H5 Condition H6.1(d) |
Assessor standardisation (all assessments) | What are the characteristics of reliable Assessors? What steps are or will be taken to recruit such Assessors? What approach is taken to training and standardising Assessors, including details of standardisation procedures and any wider training? |
It is important to clearly articulate the knowledge, skills and experience that Assessors will need in order to ensure the Reliability of the judgements that are made. An awarding organisation must explain the steps it will take to recruit such Assessors. An awarding organisation must describe its approach to training and standardising Assessors (both external assessors and Centre assessors). This could include, for example, any specific training for new or senior Assessors, as well as any wider training available. An awarding organisation must describe its standardisation procedures, including, for example, how it will determine whether an Assessor can assess reliably. |
Condition G1.3 Condition H1 Condition H2 Condition H5 |
Centre Assessment Standards Scrutiny (Centre marking or assessing) | What is the approach to Centre Assessment Standards Scrutiny, and the rationale for this approach? What are the risks with this approach, and how will they be managed? |
An awarding organisation must justify its approach to Centre Assessment Standards Scrutiny in relation to the need for Reliable outcomes. It will be important for an awarding organisation to link to its Centre Assessment Standards Scrutiny strategy in the justification of its approach. |
Condition A6 Condition C1 Conditions C2.1 and C2.3(j) Condition D1 Condition H2 Condition H5 |
Centre training and monitoring (centre marking or assessing) | What approach is taken to the provision of guidance and training to Centres around marking or assessing performance? How are Centres monitored? |
An awarding organisation must justify its approach to training in relation to the need for Reliable outcomes. | Condition C1 Condition H1 Condition H5 |
Section 6: Attainment and Reporting
This refers to the identified levels of attainment and the grading structures used to characterise these levels.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Specified levels of attainment | What are the specified levels of attainment (i.e. grading scales) for the qualification? What is the justification for the approach? Where appropriate, what characteristics signal the minimum competence standard? How do the assessments generate Reliable information in line with the proposed grading? If specifying different levels of attainment: •what characteristics differentiate learners who have demonstrated different levels of attainment? •what steps have been taken to ensure that there is sufficient difference between adjacent levels of attainment? |
The characteristics of the minimum competence standard and, if applicable, different levels of attainment identified, must follow clearly from relevant elements of the content. An awarding organisation’s approach to differentiating between adjacent levels of attainment must be justified in terms of the scope to generate Reliable information. |
Condition D1 Condition E4.2 Condition G1.3 Condition ATQ6.1 |
Aggregation (qualification level) | What is the approach to aggregation? For example, to what extent do Learners’ results for the qualification reflect their overall attainment across all assessments, or their attainment in particular assessments? What is the justification for the approach? If applicable, what is the approach to scaling marks from individual assessments for the purpose of aggregation? If individuals are permitted to re-sit assessments, are there any changes to the aggregation rules in these instances, and what is the rationale for the approach? |
The approach must be justified in relation to the content and purposes of the qualification. An appropriate aggregation method and, if relevant, scaling method is needed to ensure appropriate discrimination between Learners. |
Condition D1 Condition E4.2 Condition H5.4 |
Reviews and/or Appeals | What steps are taken to ensure that concerns over inaccuracy of assessment results are addressed adequately and appropriately? For example: •that they are investigated fairly, thoroughly and in a timely fashion •that justified concerns over inaccuracy are resolved by following an appropriate process. |
An appropriate process is fundamental to ensuring that appropriate inferences are drawn from results. | Condition I1 |
Section 7: Standard setting and maintenance
This refers to the processes for setting and maintaining standards, and the types of evidence that are used.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Approach | What is the approach to setting and maintaining appropriate grading standards within the qualification? For example, are grading standards determined up-front by individual assessors and applied at the point of assessment or are they determined through an awarding process separate to marking? If standards are determined through an awarding process separate to marking: •Within an individual Component, are the requirements (such as number of marks) to achieve a given grade set out upfront or determined after the assessment(s) have been taken? •What is the process for setting grade boundaries at qualification level? For all approaches, how will the awarding organisation take account of any impact on Learners who share a particular protected characteristic? |
If qualifications include directly graded outcome-based assessments, it is important that the approach to standard setting and maintenance links to marking or assessing performance, standardisation, Assessor training and the approach to Centre Assessment Standards Scrutiny. If standards are determined through an awarding process separate to marking, it is important the approach to standard setting and maintenance follows an appropriate technical methodology. An awarding organisation must set out the technical methodology for determining Component and qualification level grade boundaries. In each case, an awarding organisation must fully justify its approach to effectively setting and maintaining appropriate grading standards within the qualification, both over time and with similar qualifications it makes available. Where possible, an awarding organisation must also demonstrate how it will effectively set and maintain standards with similar qualifications offered by other awarding organisations. |
Condition H3 |
Evidence | What quantitative and qualitative information is used? How is the weighting of evidence determined when multiple sources of evidence are used? (This may include worked examples, for illustrative purposes, as necessary.) |
It is important the approach to standard setting and maintaining: •includes full consideration of the strengths and limitations of the different types of available evidence, and the weight given to different evidence •leads to securing fair and Reliable outcomes over time and between Learners. |
Condition H3 |
Modes of assessment | Where there are multiple modes (for example, paper and computer), how is Comparability of standards maintained? | It is important to ensure that standards are maintained when there are multiple modes of assessment. An awarding organisation must describe how it ensures comparability between different modes of assessment, for example when assessments are set, marked and assessed, including any separate awarding processes. |
Condition D1 Condition E4.2 |
Section 8: Qualification monitoring
This refers to the processes that are applied on an ongoing basis to monitor the Validity of key aspects of the specification, such as its assessments, susceptibility to malpractice and maladministration, and standard maintenance processes.
Subheading | Key questions | Why this is important and what must an awarding organisation include in its assessment strategy | Examples of relevant conditions |
---|---|---|---|
Approach | Describe the techniques and measures used to monitor all key aspects of the qualification that may affect its Validity. This may include, for example: •reviewing of functioning of previous assessments •security or malpractice issues or incidents •feedback through engagement with Users of the qualification What sources of evidence are evaluated to identify any issues with the ongoing Validity of qualifications? How does the awarding organisation assess whether any aspect of the qualification may be disadvantaging a group of Learners who share a protected characteristic? |
Failure to consider the ongoing Validity of the qualification increases the likelihood of threats manifesting themselves and/or assessment processes ceasing to remain fit for purpose. | Condition A5.2(b) Condition A6 Condition A8.1 Condition D1 Condition D3 Condition E4.2 Condition G1 Condition G4 Condition G9.3 |
Availability of Data | What data will be collected to monitor the delivery and performance of the qualification? What systems and procedures are in place to ensure that any qualification or Component-level data that may be required by Ofqual can be provided within a reasonable time? |
It is important to demonstrate that this data is used where appropriate by awarding organisations at relevant points in qualification development. | Condition A5.2(b) Condition B4 |
Reviewing the assessment approach | How is the assessment approach reviewed and, where applicable, refined over time, based on evidence of its effectiveness? What sources of evidence and feedback are included when reviewing the effectiveness of a qualification? |
It is important to have appropriate processes in place to review and evaluate the effectiveness of the qualification to maintain its ongoing Validity. | Condition D3 |
Assessment requirements
Condition ATQ5.1 allows us to specify requirements and guidance in relation to the assessment of Alternative Academic and Alternative Technical Qualifications.
We set out our requirements for the purposes of Condition ATQ5.1 below.
We also set out the requirements in relation to which an awarding organisation may apply for an exemption under Condition ATQ5.2.
Requirements for Alternative Academic qualifications
Assessment by Examination
An awarding organisation must ensure that the assessments for an Alternative Academic Qualification include one or more Assessments by Examination[footnote 1] through which at least 40% of the contribution to the overall qualification grade is made available.
In each academic year, an awarding organisation must provide up to two assessment series on set dates during which Learners can complete the Assessment(s) by Examination for an Alternative Academic Qualification.
An awarding organisation may apply for an exemption to the requirement that the Assessment by Examination is taken simultaneously by all Learners. Where it applies for such an exemption, it may also apply for an exemption to the requirement to provide up to two assessment series on set dates. However, an awarding organisation may not apply for an exemption to the assessment series requirement where it is not also applying for an exemption to the requirement that the Assessment by Examination is taken simultaneously by Learners.
Any exemption to the requirements above will be only granted where an awarding organisation is able to demonstrate to Ofqual’s satisfaction that –
- (a) its alternative assessment approach will improve the Validity of the qualification, and
- (b) the controls which it proposes to put in place are sufficient to manage any risks to which its alternative approach gives rise.
Non-exam Assessments
An awarding organisation must set all assessments for an Alternative Academic Qualification which are not Assessments by Examination (‘Non-exam Assessments’).
An awarding organisation may permit a Centre to adapt questions or tasks in Non-exam Assessments for the purpose of making those assessments more accessible to Learners.
In each academic year, an awarding organisation must provide up to two deadlines for the submission of proposed marks (or, where approved, grades) in relation to any Non-exam Assessment marked by Centres.
Retaking Non-exam Assessments
An awarding organisation may allow a Learner to retake a Non-exam Assessment for an Alternative Academic Qualification through submission, in a new or revised form, of evidence generated by that Learner which he or she has submitted for the purposes of taking the assessment on a previous occasion.
Marking of assessments
An awarding organisation must ensure that evidence generated by Learners in the Assessments by Examination for an Alternative Academic Qualification is marked by the awarding organisation or a person connected to it.
Evidence generated by a Learner in a Non-exam Assessment for an Alternative Academic Qualification may be marked –
- (a) by the awarding organisation or a person connected to the awarding organisation,
- (b) by a Centre, or
- (c) through a combination of (a) and (b).
In any event, the awarding organisation must demonstrate to Ofqual’s satisfaction in its assessment strategy that –
- (a) it has taken all reasonable steps to identify the risk of any Adverse Effect which may result from its approach to marking the assessments (and to Moderation where appropriate), and
- (b) where such a risk is identified, it has taken all reasonable steps to prevent that Adverse Effect or, where it cannot be prevented, to mitigate that Adverse Effect.
Qualification purposes for Alternative Academic Qualifications
Condition ATQ8.2(a) allows us to specify requirements in relation to the general purposes which an Alternative Academic Qualification must meet, as well as how the qualification’s general and specific purposes must be balanced.
We set out our requirements for the purposes of Condition ATQ8.2(a) below.
General purposes
An awarding organisation must ensure that each Alternative Academic Qualification which it makes available, or proposes to make available, meets the following general purposes –
- (a) Providing Users of the qualification with reliable evidence to differentiate between Learners’ attainment in relation to the knowledge, skills and understanding assessed as part of the qualification and, in particular, supporting decisions regarding the selection of Learners for further study (General Purpose A).
- (b) Providing an engaging course of learning for, while being accessible to, both Learners in full-time education and those studying part-time (General Purpose B).
- (c) Providing Learners with knowledge and understanding of theoretical content, and the skills required to apply it in a range of contexts, preparing them for progression into higher education (General Purpose C).
- (d) Providing a basis for schools and colleges to be held accountable for the performance of their Learners (General Purpose D).
- (e) Either –
- (i) is likely to be the sole element of a Learner’s programme of study or the majority qualification that forms the core element of a Learner’s programme of study (General Purpose E(i)), or
- (ii) forms a substantial part of a Learner’s programme of study, typically delivered alongside a number of other qualifications in the case of a full-time Learner (General Purpose E(ii)).
In the design of each Alternative Academic Qualification which it makes available, or proposes to make available, if there are potential trade-offs to be made between the general purposes, an awarding organisation must –
- (a) give priority to the general purposes in accordance with their hierarchy, with the greatest priority being given to compliance with purposes further up the hierarchy, and
- (b) without prejudice to the above requirement, secure compliance with all of the purposes to the greatest extent possible.
-
For the purposes of these requirements an Assessment by Examination is defined as an assessment which is:
(a) set by an awarding organisation,
(b) designed to be taken simultaneously by all relevant Learners at a time determined by the awarding organisation, and
(c) taken under conditions specified by the awarding organisation (including conditions relating to the supervision of Learners during the assessment and the duration of the assessment). ↩