Impact assessment

Impact Assessment 2023 to 2024

Published 30 July 2024

Summary

The Competition and Markets Authority (CMA) is the UK’s lead competition and consumer authority and its primary duty is to promote competition, both within and outside the UK, for the benefit of consumers. The CMA has a wide range of tools to use in addressing competition and consumer problems including carrying out investigations into mergers and markets, enforcing competition and consumer law, and working with sector regulators. The CMA also has a function to consider regulatory references and appeals.

As part of the framework agreement between the CMA and the Department for Business, Energy & Industrial Strategy,[footnote 1] the CMA is required to report annually on:

  • the delivery of a target of expected direct financial benefits to consumers of at least 10 times its relevant costs to the taxpayer (measured over a rolling 3-year period)

  • the ratio of direct financial benefits to consumers and costs for its principal tools[footnote 2]

In this tenth CMA Impact Assessment, we report on the performance against this target for the financial year 2023 to 2024. As the target is measured as a 3-year rolling average, for 2023 to 2024 the calculation is based on the performance of the past 3 financial years.

For the period 2021 to 2022 and 2023 to 2024, the estimated direct financial benefit to consumers was £8,245.6 million in aggregate, representing annual average consumer savings of £2,748.5 million. The average ratio of direct benefits to cost over the last 3 years was 23.1 to 1. The largest projects contributing to this year’s estimates were the road fuel market study[footnote 3] and mobile radio network services[footnote 4] market investigation.

Table 1: Estimated average annual CMA consumer savings and costs for 2021 to 2022 and 2023 to 2024

£m
Area of CMA work Direct benefits
Competition enforcement 123.5
Consumer protection enforcement 175.2
Merger control* 685.2
Market studies and market investigations 1764.7
Total benefits 2748.5
Costs 118.8†
Benefit/costs 23.1:1

*The CMA has a duty to investigate mergers that legally qualify for scrutiny. This means that CMA merger control work is demand-led and not discretionary, unlike most other areas of the CMA’s work. Given that the number of qualifying mergers can vary considerably from year-to-year (because of fluctuations in the economic cycle for example), the number of investigated mergers and the direct consumer benefits of the CMA’s merger control work can also vary significantly from year-to-year.

†This is total CMA costs (actual spend) minus the costs of the CMA work on regulatory appeals.

The assessment is undertaken by the CMA and is reviewed by an external expert. This year the expert was Dr Franco Mariuzzo of the University of East Anglia.[footnote 5] The methodology used by the CMA is based on that developed and used by the Office of Fair Trading (OFT) and the Competition Commission (CC),[footnote 6] validated by successive independent academic reviewers and consistent with approaches now regarded by the OECD as international good practice.[footnote 7]

Impact assessments for cases are conducted immediately after they have finished. They are based only on information available during the case and on assumptions regarding the expected impact of our interventions and, as such, are considered to be ‘ex ante’ evaluations.[footnote 8] For example, for market studies and investigations the impact estimates capture the expected future benefits of remedies, rather than an ex post assessment of their effectiveness in practice. In general, the assumptions we apply are cautious and, hence, we consider our estimates to be conservative. To gain further understanding of the impact of the CMA’s work, we also conduct ex post evaluations for a small subset of cases that help us to critically assess the effects of past interventions, drawing lessons and implications to inform future decision making at the CMA.[footnote 9]

Our estimates exclude the impact of a number of cases where the CMA’s intervention is likely to generate considerable consumer benefits, but these benefits were difficult to quantify in a sufficiently robust manner. The estimate of benefits excludes the CMA’s compliance work,[footnote 10] international activities,[footnote 11] and regulatory appeals.[footnote 12] In the latter case this is because the CMA’s role is an appellate one rather than being the primary regulator.[footnote 13] The benefits from our advocacy to government are also excluded.[footnote 14]

In addition, the focus on direct financial benefits means that we exclude many important wider impacts of the competition regime. For example, we do not take into account the deterrence effect of our work, such as the deterrence of anti-competitive mergers or of anti-competitive conduct. Evidence from existing academic studies,[footnote 15] previous OFT research,[footnote 16] and an ex-post evaluation conducted in 2018,[footnote 17] indicate that such deterrence can be substantial, and a multiple of direct effects, albeit very difficult to measure precisely. The impact of this deterrence is likely to be particularly strong in the areas of competition and consumer protection enforcement, and is a major part of the overall impact that the CMA has on competition across the economy.

Studies also show that increases in competition in a market are often associated with increases in productivity, and that competition policy interventions can, therefore, improve productivity.[footnote 18] This impact on productivity is not captured in our impact assessment. In sum, evidence suggests that the direct impact of interventions is only a part of the overall positive impact of the CMA’s work.

Overview of our methodology

The impact estimates included within this report focus on the direct financial benefits to consumers of the CMA’s work completed over the past 3 financial years. We average the benefits over 3 years to reduce yearly fluctuations in the impact estimates due to uneven caseload[footnote 19] and to reflect the fact that some of our cases take more than one year to complete. The direct financial benefits to consumers may include, for example, the direct reduction in prices to consumers or the value to consumers of improvements in quality, service, or information provision following an intervention.

We present estimates of the impact of our work for each of the following areas:

  • competition law enforcement
  • consumer protection enforcement
  • merger control
  • market studies and market investigations (collectively referred to as ‘markets work’ in this document)

For merger control and markets work, the CMA is both the phase 1 and phase 2 authority in a two-stage process (phase 1 cases being referred to phase 2 where there are sufficient competition concerns to require further, more in depth, investigation). Although the decision makers at phase 2 comprise a group of independent members drawn from the CMA panel (to ensure a transparent and distinct process), the CMA has responsibility for both phases including their resourcing. Where cases have been referred to phase 2, benefit estimates are only made once the phase 2 process has been completed, although both phase 1 and phase 2 costs are part of the impact assessment.

For confidentiality reasons, we do not publish impact estimates for individual cases and projects. However, our estimates have been independently reviewed by Dr Franco Mariuzzo to ensure that our benefit estimates are reasonable and robust.[footnote 20]

The CMA impact assessment estimates include benefits from cases where the outcome is under appeal at the time of publication of the report. We include these benefits as we consider this ensures the impact assessment is the best estimate of the likely impact of CMA cases at the time of the publication of the report. In addition, this approach also ensures that the benefit estimates are included in the impact assessment at roughly the same time as the costs the CMA incurred in carrying out the case.[footnote 21]

To calculate the impact of any case or project, the CMA usually estimates the following components based on information and evidence available from the original investigation:

  • the size of the affected turnover

  • the price, quality or other negative effect removed or avoided due to the CMA’s intervention (usually increased price, but may be in the form of decreased quality, decreased choice, et cetera)

  • the length of time the detriment (for example, higher prices) would have prevailed absent the intervention

First, we estimate the annual impact on consumers by multiplying the turnover of the affected goods and services by the assumed price increase that was removed or avoided due to our action. Second, we estimate future consumer savings by multiplying the annual impact by the number of years we believe the detriment to consumers would have prevailed. We discount future accruals of benefits (see end of Overview of our methodology).

Data on the size of the turnover affected by our intervention (referred to as ‘affected turnover’) is usually gathered by the case team as part of its evidence-gathering and can be recalled from the original investigation. To be conservative, the CMA typically applies a narrow definition of the affected turnover by estimating it as the turnover of the directly affected firms. That is, we typically assume that the price of the goods or services competing with those offered by the firm(s) subject to the investigation in the market are unaffected, even though it is likely that, in some circumstances, they would also be affected by our intervention. At other times, where the CMA tackles a sector more widely (for example, through markets or consumer protection work), to estimate the affected turnover we need to make assumptions on the size of the market that is affected by our action.

In relation to the effect avoided or removed due to the CMA’s intervention, where possible, we base our estimates on information collected during the original investigation. This may be, under rare circumstances, information on the actual effect (for example, the price overcharge due to an unfair pricing practice, or the amount refunded to customers after cancellations due to restrictions related to Covid-19). More frequently, this is an estimation of the likely effect on consumers (which can be informed by the magnitude of upward pricing pressure resulting from a merger) as assessed by the case teams during the original investigation. Where such information and data are unavailable, we apply rules of thumb that are conservative interpretations of estimated effects and consistent with recent academic research.

Similarly, when estimating the expected future duration of the detriment prevailing absent our intervention, we draw on information collected at the time of the original investigation. As a starting point, we tend to take a default duration value that is based on, but not necessarily equal to, existing international practice and academic research, and we adjust this value where case-specific information suggests this would be appropriate.

Ex ante estimates of impact are based on the best information available at the time of estimation, which is typically when the decision or recommendations have been made but the full impact is not yet observable. In contrast, ex post evaluations are usually more robust and are based on information gathered after the recommendations or remedies have been implemented and the resulting impact realised, often several years after the case has been completed. The CMA commissions independent ex post evaluations on a regular basis to consider the effects of enforcement and merger review in key markets.

For example, in 2022 the CMA hired the economic consultancy E.CA Economics to undertake an ex-post assessment of merger control decisions involving vertically-related firms.[footnote 22] E.CA Economics evaluated the CMA’s assessment of vertical theories of harm in 4 merger clearance decisions.[footnote 23] The project drew on evidence relied upon by the CMA during the original investigation as well as additional evidence gathered ex-post to determine (among other things) whether the CMA made the right decision. Other ex-post evaluations include an evaluation of the impact and deterrence effect resulting from 5 competition enforcement cases, carried about by the economic consultancy DotEcon and published in 2018.[footnote 24] This review estimated the change in behaviour and competition awareness of firms in industries where the CMA had previously taken enforcement action. The review found that awareness of competition law was higher in both the industry where the CMA took enforcement, and in adjacent industries, than the average across businesses in the UK. It also found that some businesses had modified (or intended to modify) an agreement or commercial initiative as a result of enforcement action in their industry.

In line with central government techniques for discounting future accruals of benefits or costs, we discount future consumer savings by the HM Treasury endorsed Social Time Preference Rate (3.5%).[footnote 25]

Under certain circumstances we also need to use the Consumer Price Index to bring the benefits to the price level of the current year. This is the case when, due to the CMA’s investigation, consumers are able to seek redress for any past harm suffered or more generally whenever the consumer detriment that is remedied by CMA action did not take place in the same year that the case was closed

Consumer savings by area

Competition enforcement

The CMA engages in a range of activities aimed at ensuring compliance with the Competition Act 1998 (CA98), including formally investigating and taking enforcement action against anti-competitive practices and using ‘softer’ tools such as providing guidance and targeted compliance initiatives.[footnote 26] Under the Enterprise Act 2002 (EA02), the CMA can also investigate and prosecute individuals for certain breaches.

We estimate that the CMA’s interventions in this area saved consumers at least £370.4 million in aggregate during the financial years from 2021 to 2022 and 2023 to 2024, representing annual average consumer savings of £123.5 million. These figures are based on anticipated price reductions that are likely to follow the break-up of a cartel or the termination of other unlawful conducts.

Our impact figure for the 2023 to 2024 financial year is based on 2 completed competition enforcement investigations concluded by the CMA in this period. The 2 investigations were into Meta’s (formerly Facebook) use of data[footnote 27] and into Amazon’s Marketplace.[footnote 28] This is similar to the number of competition cases concluded in 2022 to 2023 and 2021 to 2022 (2 cases and one case respectively). Competition enforcement cases often last for multiple years, so the number of cases concluding in a particular year does not necessarily reflect the amount of work undertaken in that year.

There were competition enforcement cases that concluded in 2023 to 2024 where the offending practice ceased prior to our investigation, meaning that we have not included them in the impact assessment.[footnote 29] Whilst these cases do not involve direct benefits, they are likely to have significant deterrent effects, as demonstrated by the DotEcon report on the deterrence effect of competition enforcement cases mentioned earlier.[footnote 30]

Consumer protection enforcement

The CMA’s consumer protection enforcement work seeks to change trader behaviour that appears to contravene consumer protection legislation using a range of interventions such as publishing guidance, issuing informal warnings, accepting undertakings under the EA02, or obtaining court orders. All interventions are aimed at protecting consumers, particularly vulnerable consumers, from rogue trading, unfair commercial practices, and other breaches of consumer protection legislation.

The CMA often works together with other organisations, for example Trading Standards,[footnote 31] who are also responsible for consumer protection enforcement and tackling unfair trading practices. It also cooperates with other national authorities within the Consumer Protection Cooperation Network to apply and enforce consumer rights legislation. In our impact assessment, we include consumer benefits resulting from these joint actions, where these have been led or significantly influenced by the CMA, by allocating a proportion of the benefits to the CMA.

For the financial years 2021 to 2022 and 2023 to 2024, the aggregate consumer benefit from relevant consumer enforcement work is estimated to be £525.7 million, giving an average of £175.2 million per year. These benefits may include a reduction in consumer detriment as a result of stopping unlawful practices, or the estimated price impact of the CMA’s interventions, for example as a result of increased transparency and more informed consumer decisions. The CMA’s Unit Pricing investigation was the only consumer case concluded in 2023 to 2024, and therefore makes up the impact figure for consumer enforcement for this financial year.[footnote 32]

Our estimates, as already noted, do not include the deterrent effect of the CMA’s consumer protection activities, even though we tend to prioritise cases where we expect that changing the behaviour of one business would set an important precedent or have other market-wide implications.

Merger control

The CMA operates both stages of the UK two-stage merger regime. Businesses can (voluntarily) notify a merger to the CMA and, in addition, the CMA has a duty to keep merger activity under review and can investigate mergers that have not been notified to it. At phase 1, the CMA reviews merger situations falling within its jurisdiction[footnote 33] and refers to phase 2 any cases where there is a realistic prospect of a substantial lessening of competition (SLC) in a UK market. The CMA has the power to accept undertakings in lieu (of reference to phase 2) (UiLs) from the merging parties at phase 1, if these are deemed to address potential concerns identified in the course of its investigations.

At phase 2, a CMA panel of independent members conducts an in-depth investigation to assess if a merger is expected to result in an SLC. If an SLC is expected, the CMA panel decides on the remedies required and can impose remedies by order if it is not able to agree on them with the businesses.

Our estimates of consumer savings in this area include merger proposals amended through UiLs, mergers that are abandoned, and mergers amended or prohibited by the CMA at phase 2.

The impact of phase 1 mergers is scaled down by the ‘SLC rate’ (which is defined below) to reflect the fact that not all cases where the merger parties remedied the CMA’s concern, either through UiLs or abandoning the merger, would have resulted in an SLC at phase 2. The SLC rate is calculated as the proportion of phase 2 mergers completed in the past 3 years which resulted in SLCs after the parties had offered UiLs that were rejected in phase 1. This approach is in line with our updated methodology explained in detail in the 2016 to 2017 report.[footnote 34] The SLC rate used to scale down the impact of all phase 1 mergers in the 2023 to 2024 assessment is 67%.[footnote 35]

Using the approach described above, our estimates show that during the past 3 financial years (2021 to 2022 and 2023 to 2024) the merger regime saved consumers £2,055.6 million in total, giving an average of £685.2 million per year.[footnote 36]

Our impact figure for the 2023 to 2024 financial year is based on 9 phase 1 and 5 phase 2 merger inquiries. This represents a significant decrease relative to last year, where the impact figure was based on 15 phase 1 and 8 phase 2 merger inquiries. The merger inquiry which made the most substantial contribution to our overall impact figured was Hitachi/Thales, where the CMA required a divestiture, having found a substantial lessening of competition regarding the procurement of Network Rail’s Train Control Systems Framework.[footnote 37]

The benefits from the UK merger regime are dependent on the cases that come to the CMA for assessment and are, therefore, driven in part by the economic climate and can vary significantly from year to year. Benefit figures for mergers do not include the wider benefits, such as deterrence, of the CMA’s mergers work and the wider merger regime. We would expect deterrence effects to be significant and, therefore, that having an effective merger control regime in itself prevents anticompetitive mergers from being proposed.[footnote 38]

Market studies and market investigations

Market studies are examinations of whether particular markets are not working well for consumers and often lead to proposals as to how they might be made to work better. They take an overview of regulatory and other economic drivers in a market and patterns of consumer and business behaviour.

Markets may be referred for a market investigation for further analysis where there are reasonable grounds for suspecting that any feature, or combination of features, of a market in the UK is preventing, restricting, or distorting competition. In estimating consumer savings, we consider the impact of both market studies that have not resulted in a market investigation and completed market investigations. Given the wide variety of projects that our markets work covers, the exact method used to estimate impact differs from case to case. We include ex ante estimates of impact from those projects where the CMA’s recommendations and/or orders are expected to be implemented by the relevant bodies (for example, regulators and other government departments) and, therefore, have a positive impact on consumers.

When estimating our impact from any markets project, we also consider how likely the recommendations or orders are to be implemented by the relevant bodies. To account for the uncertainty associated with the market and policy context and, therefore, with the overall effectiveness of the remedies, we use cautious assumptions when estimating the benefits. Moreover, where we think that the proposed remedies may not be fully implemented, estimates are further scaled down according to the assumed likelihood of implementation.

We estimate that the direct consumer benefits from the CMA’s interventions through the markets regime were £5,294.0 million in total during the financial years from 2021 to 2022 and 2023 to 2024, giving an average of £1,764.7 million per year.

The road fuel market study[footnote 39] was the markets case which made the largest contribution to our overall figure. The CMA identified evidence of weak competition at a national level, local level and on motorways, and recommended that the government create an open data fuel finder scheme and an accompanying fuel monitoring function. The impact assessment in this case was arrived at by estimating the additional cost to consumers of the increase in average fuel margins by supermarkets (the price leaders in the market) and applying this figure across the whole market.

The second largest contributor to the 2023 to 2024 impact assessment was the mobile radio network services market investigation[footnote 40], which examined the market for the emergency services’ communication network, the Airwave Network, in Great Britain. The CMA found that the Airwave Network’s single supplier, Airwave Solutions (owned by Motorola), has unilateral market power and can charge prices above the level expected in a competitive market. The CMA’s main remedy proposal was to impose a charge control on the price for which Airwave Solutions provides the Airwave Network and services. The impact assessment for this case was calculated by comparing Motorola’s revenues under the charge control with its estimated revenues absent it.

A large proportion of the total was also contributed by the housebuilding market study[footnote 41], where the CMA investigated the supply of new homes to consumers in England, Scotland and Wales and suggested a number of reforms across various aspects of the industry. The impact assessment for this case was calculated separately for the 3 categories of reforms (changes to the private management of public amenities on housing estates, housing quality improvements and reforms to planning systems).

Costs

To ensure that yearly fluctuations in the cost figure which are not reflective of the true cost of running the CMA do not distort the picture for the CMA’s impact, we use a 3-year moving average for total costs. This is consistent with the way in which we report estimated benefits.

For the purposes of calculating the benefit to cost ratio, the total costs of the CMA exclude the costs incurred in fulfilling the CMA’s function with regard to the determination of regulatory appeals as we do not include any benefits from these in the impact assessment.

On this basis, the average annual CMA cost over the financial years 2021 to 2022 and 2023 to 2024 is estimated to be £118.8 million.

  1. BEIS (August 2021), Framework Agreement Between: The Competition And Markets Authority and The Department for Business, Energy and Industrial Strategy

  2. Ibid, paragraph 9.2. 

  3. Road fuel market study 

  4. Mobile radio network services market investigation 

  5. Dr Franco Mariuzzo is an Associate Professor in Econometrics at the University of East Anglia. 

  6. OFT (July 2010), Guide to the OFT’s impact estimation methods

  7. OECD (April 2014), Guide for assessing the impact of competition authorities’ activities

  8. In rare circumstances we have used ex post information to improve our impact assessments. 

  9. See examples in Overview of our methodology

  10. For example, engaging with small and medium enterprises, their trade associations and intermediary advisors in England and the Devolved Nations. 

  11. For example, engaging with international networks and organisations. 

  12. For example, the 2023 Energy Licence Modification appeal

  13. The CMA’s duty in this area is to act according to the relevant legal framework rather than necessarily acting in the immediate interest of consumers. 

  14. This includes advice, support and recommendations to government to help promote competition and consumer interests in the policymaking process. 

  15. As collated in the CMA’s 2017 literature review, The deterrence effect of competition authorities’ work – literature review

  16. See The impact of competition interventions on compliance and deterrence, OFT1391 and The deterrent effect of competition enforcement, OFT 962

  17. DotEcon (2018), Evaluation of direct impact and deterrent effect of CA98 cases.    

  18. CMA (2015), Productivity and competition: a summary of the evidence

  19. Although some areas of the CMA’s work are proactive, such as market studies and investigations, other areas depend on factors outside of the CMA’s control. For further discussion of this issue see Market studies and market investigations

  20. Consistent with the purposes of the review exercise, we asked Dr Mariuzzo to confirm the accuracy of the calculations of impacts. He also commented on the consistency of the estimates with our published guidance, and consistency of approach taken between different cases. He was not asked to comment on the underlying assumptions where these were based on analysis carried out as part of individual cases (for example, the estimates of affected turnover in the SLC market). In his report he made several suggestions for the revision of the methodological guidelines for consideration in future impact assessments. 

  21. It can be several years before appeals are concluded leading to a significant lag between the inclusion of the benefits and costs of certain cases. 

  22. E.CA Economics (April 2022), Ex-post evaluation of vertical mergers. 

  23. Tulip/Easey, Heineken/Punch, Mastercard/Vocalink, and Tesco/Booker. 

  24. DotEcon (2018), Evaluation of direct impact and deterrent effect of CA98 cases. Based on the results of a survey of businesses, DotEcon assessed awareness of 5 CA98 cases and of competition law more generally, and sought to quantify the indirect, deterrent effect on firms not subject to the original enforcement action. DotEcon found a clear link between CMA/OFT intervention and greater levels of awareness and understanding of competition law, specifically in relation to the illegality of specific infringing behaviour in the selected CA98 cases. Furthermore, there is evidence to support the view that awareness of cases pursued by the CMA/OFT changes the perception of being caught and prosecuted, ultimately deterring infringing behaviour by other firms. DotEcon estimated that the indirect deterrence effect is plausibly a multiple of the direct effect. Although the effect per firm is small, there is a significant benefit due to the large number of businesses being deterred from engaging in anti-competitive behaviour. 

  25. See HM Treasury, The Green Book: Appraisal and Evaluation in Central Government

  26. The benefits from these softer tools are not typically included in the quantified estimate of benefits. 

  27. Investigation into Meta’s (formerly Facebook) use of data 

  28. Investigation into Amazon’s Marketplace 

  29. For example, Anti-competitive behaviour in relation to the sale of Leicester City FC-branded products and merchandise 

  30. DotEcon (2018), Evaluation of direct impact and deterrent effect of CA98 cases. For further discussion, see Overview of our methodology

  31. For an evaluation of the activities of Trading Standards, see OFT (June 2009), An evaluation of the impact of the fair trading work of local authority Trading Standards Services in the UK, OFT1085

  32. Unit pricing 

  33. Up to 31 January 2020, mergers that fulfilled certain conditions fell within jurisdiction of the European Commission. 

  34. CMA (July 2017), CMA impact assessment 2016/17

  35. In 2022 to 2023 it was 75% and in 2021 to 2022 it was 71%. 

  36. Estimates exclude any impact to non-UK customers. In particular, we use the conservative approach of accounting for the impact of mergers with a global frame of reference only on UK sales. For example, if we had accounted for the impact of phase 1 merger Tronox/Tizir which concluded in 2020 to 2021 on the global market instead of the UK only, its estimate would have been more than 14 times larger. 

  37. Hitachi/Thales merger inquiry 

  38. We note that there can also be an effect of ‘chilling’ where pro-competitive or benign mergers are deterred due to the merger control regime; however, we would expect this effect to be low because the CMA operates in a voluntary notification framework. 

  39. Road fuel market study 

  40. Mobile radio network services market investigation 

  41. Housebuilding market study](https://www.gov.uk/cma-cases/housebuilding-market-study)