Research and analysis

Background quality report: international defence statistics 2020

Published 17 December 2020

Introduction

Overview

These statistics present comparative information on UK defence spending and that of other countries. The underlying data are used for a wide range of purposes both within the Department and externally to provide accountability and transparency to parliament and the public.

The International Defence Expenditure Bulletin (henceforth in this document ‘International Defence’) is produced annually and contains spending data from the most recent full calendar year for which data are available.

This Bulletin presents defence expenditure of NATO member states and expenditure as a percentage of their GDP. A comparison of two international defence spending data sources focuses on the top worldwide spenders. Defence expenditure trends for the UK, Germany, France and the USA are also displayed.

The Bulletin comprises of an HTML report, which focuses on commentary and data visualisations, and is supported by separate data tables that contain the data behind the text and visualisations.

Background and Context

The Ministry of Defence (MOD) has published international comparison statistics since 2001. Prior to 2013, these statistics were published as part of an annual MOD statistics UK Defence Statistics Compendium for the year 2010 onwards). Since 2013 these figures have been published as the standalone International Defence Bulletin. Although this Bulletin began relatively recently, the external data sources we use allow some of the time series we report to extend back to 1980.

The 2020 Bulletin includes: NATO countries’ expenditure (in real terms and as a percentage of GDP), NATO countries’ equipment expenditure as a percentage of defence spending, top world-wide military spenders, the differences between two widely used sources of international defence spending estimates, and a section providing in-depth focus on the UK and some key NATO allies (USA, France and Germany) on a set of key comparators (percentage of GDP spent on defence, defence spending per person, spend per service person, and the number of military personnel per thousand population).

Methodology and Production

These statistics are produced by the Analysis-Expenditure area within Defence Statistics, which is part of MOD. The responsible statistician for these statistics can be contacted by emailing Analysis-Expenditure-PQ-FOI@mod.gov.uk. Further details about how to contact Defence Statistics can be found under Statistics at MOD or at the end of this report.

The data underlying Tables 1-3 (as listed in the supplementary data tables) and associated charts are taken from NATO’s Defence Expenditures of NATO Countries (2013-2020) publication (published 22/10/2020). The expenditure data for Table 4 is taken from the SIPRI Military Expenditure Database 2019 and the PPP rates used are those published by the International Monetary Fund (IMF, updated October 2020). Table 5 figures are taken from the IISS Military Balance 2019 publication plus the SIPRI military expenditure database also. The data for the remaining tables relating to close NATO allies has been taken from the NATO release (details above), and population estimates have been sourced from the IMF (details above). All data sources are fully signposted in the footnotes to the tables.

A detailed methodology is given towards the end of the Bulletin.

Relevance

These statistics are often used within the MOD to provide context in papers, press lines and briefings. In 2010 and 2015 they were used to underpin benchmarking work for the UK Strategic Defence and Security Review (as well as for the Australian SDSR) and to inform the corresponding Spending Review settlements. The production of the tables has placed the Analysis-Expenditure branch (the producers of this Bulletin within MOD) in a position to offer guidance on the use of these statistics to others within the Department and they have formed the basis of several international collaboration projects; this is a strength of the International Defence Bulletin.

There have been some internal requests for performance metrics measuring international defence capabilities. There is consistent interest in making international comparisons based on defence ‘outputs’ rather than ‘input’ measures, and these statistics provide information solely about the latter of these. The lack of ‘output’ measures could be considered a weakness of this Bulletin.

Externally to the MOD, policy think tanks such as the Royal United Services Institute (RUSI) and International Institute for Strategic Studies (IISS) have used the data for policy papers and think pieces. Occasionally contextual questions from academics and interested parties are received.

Accuracy

There are a number of issues surrounding the accuracy of NATO, SIPRI, and IISS data which include compliance with definitions, different treatment of pension contributions and tax regimes, and conversion methods. This is explained further in this document under the Coherence and Comparability section. In addition, as some countries do not provide returns to SIPRI or IISS, some of their figures are estimates. MOD has no control over the quality, reliability and coverage of the data contained in tables sourced from these organisations.

Revisions

Revisions made by the statistics producers are reflected with ‘r’ markers. We follow the Defence Statistics revisions policy.

Timeliness and Punctuality

Timeliness

The aim is to publish this Bulletin in late summer and the statistics usually refer to the previous Calendar Year. However, the timeliness of the Bulletin ultimately depends on when the source data is released by NATO, SIPRI and IISS.

In 2013, no expenditure data was published by NATO. This delay meant that there was no International Defence Bulletin in 2013, and the 2014 Bulletin contained both the 2012 and 2013 data.

In 2020, NATO delayed release of its expenditure data until the NATO Defence Ministers Meeting in late October due to Covid-19, and as a result the Bulletin release date was forced back to December.

Punctuality

The International Defence Bulletin is not an official statistic publication so does not appear on the MOD’s Calendar of Upcoming Releases section of GOV.UK.

Accessibility and Clarity

Accessibility

An HTML version of this Bulletin and accompanying data tables are published and freely available on the GOV.UK website. Screen readers can be used and alternative text has been provided for every chart.

Clarity

The level of detail in the Bulletin and accompanying tables is limited by the available data but the formats chosen should be clear and understandable.

The strengths of these statistics include the clarity of presentation and the clear signposting of data limitations. The selection of key facts to focus on in the commentary and charts is also a strength, helping the reader make sense of the large amount of underlying data.

Coherence and Comparability

Coherence

The statistics in all tables are consistent with those published by NATO, SIPRI and IISS. Where MOD has converted data into US dollars or to constant prices, this methodology has been agreed with NATO statistical experts.

NATO, SIPRI and IISS have different definitions of military expenditure which, additionally, differ from the definition of Defence Expenditure used to compile the MOD’s accounts, presented in the Departmental Resources Statistical Bulletin. It is not therefore possible to easily compare spending figures from these different sources.

Comparability

When undertaking international comparisons of defence it is important to consider some well documented issues relating to the comparability and granularity of the international source data. Making direct comparisons will never be straightforward because:

• Whilst there are standardised definitions of defence spending and accounting conventions used by international organisations, principally the UN and NATO, not all countries record and publish their defence spending in accordance with such definitions and conventions. The standards themselves are not always transparent, adding to the difficulties of comparing estimates produced by different organisations. More information relating to the revised NATO definition can be found on the NATO website. Expenditure is included for countries that provide Military Assistance; expenditure is not included for countries receiving assistance. More information relating to the SIPRI definition of military expenditure can found on the SIPRI website.
• Some countries’ actual defence expenditure may be very different from their budgeted expenditure.
• Differences in national tax regimes and the treatment of pension contributions can lead to significant distortions in expenditure.
• Departments other than defence departments may be deemed to contribute to defence whilst some spending by defence departments can be categorised as supporting other activities.
• The choice of conversion method (e.g. Market Exchange Rates (MER) or Purchasing Power Parity (PPP) rates) used to convert to a common currency can result in significantly different rankings of global defence spending. Using MER for instance tends to undervalue the currency, and hence the scale of expenditure, for countries with lower national incomes. Attempts are often made to circumvent this problem using PPP rates. These use currency conversion rates which equalise the overall price of a bundle of goods and services in each country. However PPP rates can be highly inaccurate because of the difficulty of allowing for differences in quality and devising appropriate and relevant “weightings” of individual goods and services. Civilian based PPPs may also not be representative of defence goods and services. Further information on the measurement and uses of Purchasing Power Parity (PPP) rates can be found in the Organisation for Economic Co-operation and Development’s Statistics Brief (published March 2002).

Trade-offs between Output Quality Components

There is occasionally a trade-off between timeliness and comparability; the timing of the publication of these statistics ultimately depends on when the source material is released.

Assessment of User Needs and Perceptions

Users are encouraged to provide feedback on Statistical Bulletins. The Further Information section included at the end of each Bulletin provides details on how to contact the responsible statistician and there is also the opportunity to do so through the feedback pages on the GOV.UK website. Users can be informed of the latest changes to statistics through the GOV.UK website and through consultation exercises where significant change is proposed.

More informally, requests for information received from within the MOD and from outside, are monitored and responded to accordingly.

Current assumptions about users and uses of these statistics were discussed above in the Relevance section. If you use these statistics in another way please contact us.

Performance, Cost and Respondent Burden

The tables provided alongside the Bulletin are produced purely using data collected by external organisations. The Bulletin published by MOD placed no additional burden on the respondents.

Confidentiality, Transparency and Security

In producing these statistics, MOD adheres to the Defence Statistics confidentiality policy.

MOD maintains good links with policy colleagues to ensure that these statistics are understood and prevent misuse. The International Defence Bulletin contains commentary explaining these statistics.

Contact Details

Analysis-Expenditure Head of Branch

Tel: 030 679 84442

Email: Analysis-Expenditure-PQ-FOI@mod.gov.uk

Defence Statistics (Analysis-Expenditure) Ministry of Defence
Oak 0 West, #6028
MOD Abbey Wood North
Bristol
BS34 8QW

Last updated: 09 December 2020