Accredited official statistics

Port freight statistics: background quality report

Published 19 July 2023

Introduction

This background quality report relates to the quarterly and annual port freight statistics for UK ports. The purpose of this document is to provide users of the statistics with information about the quality of the outputs, measured against different dimensions of statistical quality. It also provides information about how the department has responded to previous user feedback, as well as planned developments.

As a result, this document helps to demonstrate how the department complies with the Code of Practice for Statistics.

For information about the release and the tables, including comparisons between the port freight series and other data sources, see the technical notes and definitions.

1. Section 1: Background to the statistics

Using currently available data, around 95% of all goods entering and leaving Britain are moved by sea and the maritime sector directly contributed £18.7 billion in gross value added to the UK economy in 2019.

As an island our ports are fundamental to our global success as an outward-facing trading nation. The port freight statistics series produced by the Department for Transport (DfT) helps to quantify and monitor the contribution of this critical industry.

Data are collected on all ports handling freight within the UK, on a quarterly basis. More detailed information is collected annually on ports handling over 1 million tonnes, as well as other ports of significance (these are classed as major ports in the port freight series).

This data is used to produce quarterly tables, detailing information on total tonnage and units by port, as well as an annual release in summer of each year, which goes into detail of cargo types handled, and the routes taken. Data are collected in line with UK Directive - Statistical Returns in Respect of Carriage of Goods and Passengers by Sea. The port freight cargo categories were originally from the EU statutory instrument to aid reporting to Eurostat, and will continue to maintain a consistent time series and allow comparisons with other countries.

1.1 Principal ports, port groups and inland waterways in the UK

1.2 Methodology and Production

Port freight traffic statistics are based on a combination of data reported to the DfT by port authorities and shipping lines or their agents. Prior to 2000 reporting was by port authorities only.

The current collection arrangements for port freight traffic statistics were introduced in 1 January 2000 to meet the requirements of the EC Maritime Statistics Directive (Council Directive 95/64/EC on statistical returns in respect of the carriage of goods and passengers by sea, recast as Directive 2009/42/EC).

Information is required quarterly on foreign and domestic tonnages and freight units, for major ports (for example, those that have over one million tonnes of freight per annum) by route, ship and cargo type. Much less information is required for smaller ports.

Most of the detailed freight information is collected from shipping lines, operators and shipping agents, because the detailed route and ship flag information required by the Directive is only generally available from them. The ports supply more limited information quarterly and annually, which is used to provide control totals and also to publish more timely provisional results.

The full guidance for data providers is available via a dedicated section of the DfT website, including the forms, instructions for their completion and code lists.

1.3 Shipping lines and agents information

Shipping lines or their agents complete detailed returns of their inwards and outwards traffic at each major port for each ship, on each route, quarterly.

Major ports are those handling more than 1 million tonnes a year, plus a few selected ports with less tonnage. The returns give the gross weight of goods in tonnes of liquid bulks, dry bulks, unitised traffic and other general cargo, by individual category.

Additionally for unitised traffic, the returns give the numbers of units, broken down where appropriate into those with cargo and those which are empty. A full list of the cargo categories, and a comparison with the categories used in the previous system, can be found in the notes and definitions.

1.4 Ports information

The port authorities or other undertakings at major ports complete quarterly returns comprising 4 figures: the gross weight of goods inwards, the gross weight of goods outwards, the total number of units inwards and the total number of units outwards.

Units include containers, road goods vehicles, passenger cars and unaccompanied trailers. Results from the quarterly returns have been used since the beginning of 2009 to produce provisional quarterly port freight statistics which are published via the DfT Transport Statistics website.

More cargo details are supplied annually via Excel forms, which uses the same cargo type categories as the agent quarterly returns. The port annual returns are used to provide more detailed grossing totals for the final annual results, and are also the basis of the final annual results published about 6 months after the year end on the DfT Transport Statistics website.

Minor ports provide information on total tonnages in and out, annually via Excel forms. Ports also provide quarterly returns listing the shipping agents, lines and operators active at the port.

As of April 2019, the data collection for the port freight statistics is handled in-house by the department. Prior to then, the data collection was handled by the department’s collection agent who initially received and checked the data before sending it on to the department. The current collection process is essentially unchanged, the only difference being is the department receives the data from ports and agents directly, rather from the collection agent. The current process is outlined below:

Quarterly data collection

At the end of every calendar quarter, ports and shipping agents are required to submit data on freight handled for that quarter.

Agent data is recorded at the level of an individual ship moving between 2 ports. If the same ship makes multiple journeys on this route however, it can be aggregated into a single row for that quarter, with the total number of voyages given. This is reported on a minimum quarterly basis.

Port data contains the total tonnage and units of freight that passed through the port during that quarter, as well as whether the direction of travel was inwards or outwards.

Non-respondents receive reminders from the department.

Once data is received, it is checked by the department for accuracy. The port and agent returns are checked together in an attempt to identify missing or miscategorised data when the data is submitted. Any discrepancies are resolved before being approved by a senior member of the team, who will check not only the numerical accuracy but also the presentation of the report.

Each quarterly release is published 10 weeks after the end of the quarter (for example, Quarter 1 2021 which relates to January to March 2021, was published in June 2021).

Annual data collection

At the start of January, all major ports have to submit an annual report form, in addition to their regular quarterly return. This collects total tonnage and units (loaded, empty, and total) for a set of cargo categories.

Non-respondents are chased up by the department.

The department conducts extensive checks:

• annual port returns are compared to the four quarterly port returns to ensure that totals match

• annual port returns are compared to the quarterly agent returns to try to identify miscategorised or missing lines

• domestic port-to-port flows from the agent returns are compared in both directions (“mirror checks”) to identify errors

The data is also checked by looking at long term trends, and comparing the resultant trends with news articles and published stories to check consistency. Comparisons are also made with other sources of data where this is available at this point, including HMRC data by port (for non-EU cargo), Department for Energy Security and Net Zero (DESNZ) energy statistics (for oil and gas cargos) and DfT roll-on, roll-off (Ro-Ro) statistics (Ro-Ro cargo).

The final data is used to produce the annual port freight release and tables, before being checked by a statistician. Any discrepancies between the release and the tables are resolved before being approved by a senior member of the team, who will check not only the numerical accuracy but also the presentation of the report.

The annual port freight release and tables are published in the summer.

2. Section 2: Quality Assessment

In this section, the quality of the statistics is considered in relation to the different dimensions of quality as stated in the European Statistical System (ESS) quality framework.

3. 1. Relevance

Relevance is the degree to which a statistical product meets user needs in terms of content and coverage.

The statistical outputs presented within port freight statistics include:

• a statistical release containing key findings, trends over time and signposts to further information and related datasets

• ODS data tables containing information on freight passing through UK ports, as well as the number of ship arrivals, and the registered countries of ships transporting freight to and from UK ports

• a document with technical notes and definitions

• a PowerBI dashboard which allows users to interact with the data with more freedom

Known users and uses of the statistics

Within the DfT, the statistics are used:

To inform maritime policy, both in terms of ports as well as international trade. Examples include:

• the Transport Connectivity to Ports review of the current status and future infrastructure recommendations

• the Maritime Growth Study, reviewing the opportunities and challenges faced by the UK with regards to its position as a leading maritime centre

• the DfT planning for, and responding to, the Network and Information Systems (NIS) Directive

• the Ports Good Governance guidance

• the Maritime 2050 strategy, providing a full long-term strategy to inform the government approach with the sector

• COVID-19, to quality check early operational indicators during the COVID-19 pandemic, and EU exit analysis, and operational crisis response

To assist maritime economists and analysts. Examples include the work for the relevant EU exit sectoral reports

To assist with forecasting ports and traffic in the UK maritime sector.

Outside DfT, known users who have either published material based upon our statistics, or who have used it for their own work, include:

• research analysts, such as the Freight Transport Association

• maritime sector associations, such as the UK Harbour Masters Association, the UK Major Ports Group and the British Ports Association, for example in briefing and promotional work

• specific port authorities and corporations, such as DP World, the Association of British Ports (ABP), and the Port of London Authority (PLA). These statistics cover the entire sector so allow the relative ranking of specific ports to be assessed

• university researchers for either their research work, or dissertations/theses

• organisations interested in news and statistics, for example Full Fact and the [BBC]( (https://www.bbc.co.uk/news/uk-politics-46142188)

• other UK government departments, such as HMRC, the Department for Business, Energy and Industrial Strategy (BEIS), the Department for Environment, Food & Rural Affairs (DEFRA), Cabinet Office, and Transport Scotland

• other national governments, such as the Republic of Ireland.

How the department engages with users:

DfT regularly engages with users by social media, email and face to face methods when possible. This includes requesting feedback on the quarterly and annual statistics series, with contact details provided in every statistical release. Each publication is promoted via Twitter. DfT also regularly analyses web page hits, ad-hoc requests and social media analytics to monitor activity over time and identify which products are more useful.

In recent years, specific engagement activities include:

Presentations to the Transport Statistics User Group and UK Harbour Masters Association.

A user engagement exercise assessing how well the statistics meet user needs as well as data collection burdens and potential methodology changes was carried out in 2016, with a summary of the results published in March 2017.

Another user engagement exercise was carried out assessing the interest and use of a quarterly cargo group type breakdown for the port freight series. This is based off cargo proportions provided by the shipping agents, and is badged as experimental statistics. The Department continues to seek feedback via a feedback survey to improve the quality and presentation of these estimates.

DfT also published a user feedback exercise in March 2018 that sought user’s opinions on the port freight tables that were published in the 2016 annual port freight release. The feedback from the exercise has been reviewed, where tables have been updated with respect to the feedback received.

In line with the Code of Practice for Statistics, users will be informed about any changes or revisions to the data series and given the opportunity to feedback prior to any changes being made. Proposed and recent changes are typically highlighted on the statistical release and collection pages on GOV.UK, such as combining quarterly port freight tables and publishing an HTML report, replacing the PDF report, covering key trends from the statistics.

How well the statistics meet user needs:

Based on engagement as outlined above, we have received a range of feedback from users of the statistics. Overall, we understand that these statistics are generally considered to be fit for the purposes for which they are used. However, recent user feedback requests have resulted in some suggestions for improvement and areas of unmet needs.

Sometimes users are looking for the ultimate origin or destination of the cargo. Our data captures the ports of loading and unloading, however this may not be the ultimate source. “Transhipment” is where cargo is offloaded on the portside by a vessel, and then re-loaded onto another vessel. This results in our statistics reporting the port of load as, say Rotterdam when the cargo may have actually originated in a completely different country. The Office of National Statistics has previous attempted to quantify this effect, but there has been little impact made on this issue. The maritime statistics team have begun a project with the Department for International Trade to update our understanding of the effect of transhipment on trade and port freight statistics in 2021.

Feedback from the 2018 user engagement exercise specifically related to the published data tables suggested that users:

• found it difficult to identify the correct tables

• could not identify certain popular splits, for example, EU/Non-EU

• could not easily distinguish between major and minor ports

• would like/prefer more filterable tables, like PORT0499

Following this feedback, a clearer naming structure was created with a lookup to detail which breakdown was available in which table, along with a map comparing the old table structure to the new structure. In addition, some tables were consolidated allowing fewer tables to be published, with nearly all of the new tables having filters to allow the user to select the data they are interested in. Many also all contain the raw data which is open for use by the users, so that expert users can conduct their own analysis. The few tables which do not contain a separate data table already contain the lowest level data available.

As well a publishing an updated set of tables, the relevant GOV.UK webpages have been redesigned. Previously the port freight data tables were split across 6 separate webpages, 1 for each area of interest (for example, port freight by tonnage, port freight by unit). Now with the consolidated collection of tables these are all published on a single page, with the full table name in the link (as opposed to just the title, PORT0204 for example).

Work done to develop these statistics since in the latest year:

Continued to develop and modernise the collection and streamline data validation, which includes (but not limited to):

• developing a more robust process of conducting the mirror checks on domestic routes on a more frequent basis throughout the year

• use of the website’s cargo description information to reduce the risk of miscategorisation

• developing a process to aid correcting miscategorised shipping agent cargo data

• making the process of migrating the data from the website into DfT SQL databases more efficient

• use of alternate data sources, such as automatic identification system (AIS) data used in Sea/ by Maritech platform, to validate shipping agent data where there was a discrepancy

• improving the process for monitoring non-response from ports and agents, ensuring the department chases the right contacts for data, and identifying new contacts

Further development of the website for the collection of agent and port data, which includes basic checks when data is inputted, as well as the option to create “mirror records” if the agent handled the cargo at both ports

For the statistics in the latest year, we have:

• added more detail on the users and use of the statistics up front

• ensured that relevant information related to any caveats in the statistics is included at relevant points throughout the release

• updated a PowerBI dashboard with inclusion of sea passenger statistics to allow users to explore maritime statistical data in more depth

• developed and published new table including traffic between Great Britain and Northern Ireland by route, following user feedback

• visited a port to better understand the data we collected and how it is gathered

• improved accessibility of tables and charts

Future work to develop these statistics:

Given what has been achieved in the most recent release, DfT plans to continue developing the port freight statistics further in response to user feedback. Below is a summary of planned developments for the next year (2024).

• consulting users about dropping quarterly table port0501

• improving efficiency of our quarterly publication process by using Reproducible Analytical Pipelines (RAP)

Plans are subject to change depending on circumstances, including any further feedback from data suppliers or users, as well as external events impacting on the legislative framework for data collection. We will keep the above updated to reflect current plans.

4. 2. Accuracy and Reliability

Accuracy refers to how close the estimated value in the output is to the true result.

These statistics aim to provide a true picture of the movement of freight in and out of UK ports. To this end, there are a number of checks that take place during the collection, data processing, analysis and publication. While it is not possible to quantify the accuracy of the statistics, the results of checks and comparisons with other sources give us confidence that overall the results are sufficiently accurate at the aggregate level, though there may be issues at a more detailed level. For example, with the publication of the quarterly cargo group estimates (PORT0503), our assessment of the accuracy of the estimate is provided in the table.

4.1 Quality management approach

The following summarises potential sources of risks or errors which may arise throughout the process of compiling the port freight statistics.

Error	Source	Mitigation	Error identification	Corrective actions
Data provider fails to submit a required form	Data provider	Providers are all contacted at the start of the collection period to remind of requirements	Comparison of received forms against a contact database	Email provider to provide form, Call provider to identify issues and provide assistance
Information is submitted on the wrong form (for example, agent data provided on port form)	Data provider	Guidance provided for data providers on DfT website. New information email supplied to new data providers	Comparison of received forms against a contact database, Sudden change in reported tonnage or units for that port/agent, Sudden change in reporting patterns for port or agent	Email provider to provide form, Call provider to identify issues and provide assistance
Lines of data missing from submitted shipping agent returns	Data provider	Guidance available for data providers on DfT website. New information email supplied to new data providers	Shipping agent versus annual port return checks show large differences	Time series checks reveals large changes DfT contacts shipping agent to investigate missing data
Cargo is incorrectly categorised	Data provider	Guidance available for data providers on DfT website. New information email supplied to new data providers. Categorisation flowchart available to walk data provider through choice	Shipping agent versus annual port return checks show large differences Time series checks reveals large changes	Compare reported agent data to port data, to identify lines which could have been miscategorised. Contact data provider to seek resolution. If cannot be resolved, apply corrections based on comparable source, for example port annual totals can be split using agent reported totals, or agent reported totals can be grossed up to match the port annual totals
The wrong port is given (e.g. Boston in the US as opposed to Boston in the UK)	Data provider	First part of the location code (“locode”) contains the country. Guidance provided for data providers on DfT website	Shipping agent vs annual port return checks show large differences. Time series checks reveals large changes. Unusual route/cargo combinations identified, using alternate data sources, such as AIS and CERS, to try and identify the correct port if unclear	Compare reported agent data to port data, to identify lines which could have been miscategorised. Contact data provider to ask if they are sure
Data incorrectly imported to the database	DfT	DfT data import instructions	Data validation checking spreadsheets highlight errors. Time series reveal large changes	Drop offending rows/tables from the database. Re-import data
Numerical errors in data tables	DfT	Tables are designed to automatically fill from a raw SQL output posted into the workbook, reducing the chances of human error	Quality assurance check of the table by the author, followed by checks by a senior statistician, who checks figures against the database as well as across different tables, and finally also look for trend anomalies	Correct the error. Apply change to the table formulae/SQL query to reduce frequency of repeating the error. Documentation updated to highlight errors which are easily repeatable
Numerical errors in statistical release	DfT	A log is kept of referenced statistics included in the release. Any statistics referenced directly from the database have the query and results table stored in a log	Quality assurance check of the release by the author, followed by checks by a senior statistician. These checks looks to check figures against the database as well as the tables. Checks are also made of the narrative, ensuring it is consistent with media articles, other government publications, and realistic against previous trends.	Correct the error. Apply change to the SQL query in the log to reduce frequency of repeat, where appropriate Investigate table or other source in case error is also present in the source. Documentation updated to highlight errors which are easily repeatable
Missing agent MSD1 data	Data provider	Providers are contacted at the start of the collection period and reminded during it of the requirements	Checks are conducted comparing shipping agent submissions from the previous quarter versus the current quarter to identify missing agent data	Email provider to chase missing data

The largest source of difference in the data supplied to DfT is between the total data reported by the agents over the year, and the annual form reported by the ports – typically as a result of misclassification of cargo, or incorrect port codes. Extensive work is taken to reconcile the two records – this largely involves correspondence with the parties involved to explore, understand, and agree amendments.

With the additional option for the shipping agents to provide a cargo description in the new data collection system, DfT has been better able to identify and correct miscategorised cargo. One example can be seen with containerised traffic: had we not corrected this, on a national level it would have appeared that there was a noticeable drop the number of 40 foot container units being handled at UK major ports, and a rise in the number of container units greater than 40 feet, when this was not the case.

As this additional detail is only available from 2019, it is possible that corrections to categorisations have caused changes to the time series trend. We estimate that these changes are minimal and trends at a cargo group level are generally unaffected by these corrections.

When no further reconciliation can be determined the agents data on their annual form is grossed to the port’s total annual figure to ensure that the totals match. Port totals are generally felt to be suitable for grossing as they tend to be stable over time (with any inconsistent trends being queried), complete and – in most cases – are likely to be based on data captured by ports for their own purposes. Where ports are unable to supply data in the precise form required, an estimation is made. This approach is used only for the port’s provisional quarterly data where, depending on which data is available, the estimate is based either off the shipping agents data, or the port’s quarterly return for the same quarter in the previous year. An assessment of whether the estimate is appropriate is conducted by DfT before publication.

Another check which is conducted is a mirror check: where a cargo moves between 2 UK ports, the amount reported to have travelled out of port 1 can be compared to the amount reported to have travelled into port 2 from port 1. These should match, however in practice discrepancies are sometimes found. There are a number of possible reasons for this:

Agents are typically only recording one side of the transaction (for example, an agent handling specific ships coming into a port, being responsible for the cargo at only that port) so there is a natural asymmetry in accuracy that will result.

Despite the number of checks that take place, it is possible that some rows of agent data will record a ship departing port A to go to port B, but without a corresponding report of the ship arriving at port B from port A.

Similar to the above, some ships do not have exact destinations defined on departure, and instead make port calls based upon the purchase of the cargo. An example of this are some oil tankers. This is usually only an issue for international traffic, as for domestic traffic the ship is typically chartered before departure.

For domestic flows, an attempt is made to identify and resolve the largest discrepancies, through communication with the agents involved, though some remain after even after this takes place.

DfT have a close working relationship with the data suppliers to ensure the quality of the data. Guidance is supplied to those who are responsible for providing data in order to ensure that this is as consistent as possible.

4.2 Grossing procedures

Major and minor port returns are normally received from virtually all significant operators. It is not possible to measure the response rate for agent returns except by comparing the resulting traffic totals with those from the quarterly and annual port returns.

The annual port data is used as control totals to gross up the information supplied by shipping lines and agents data, to make an estimated adjustment to correct for any missing agent returns. Each of the data variables for each port’s annual return, for example, the cargo categories for unitised and non-unitised traffic are divided by the corresponding estimates provided by shipping lines and agents to produce grossing factors.

These factors are then applied to all corresponding agent data variables to provide grossed totals.

This method allows the estimation of other variables, for example traffic by cargo type by port of loading and unloading, vessel characteristics, flag, which are unavailable from the ports quarterly or annual return. The grossing procedure applies to traffic to and from major ports; information for minor ports is added in separately.

Statistics on the differences encountered in the latest year’s data validation process, as well as the grossing factors applied can be found in the port and domestic waterborne freight table information.

4.3 Publication arrangements and provisional results

Port freight statistics are published in 2 stages in order to put usable information in the public domain as early as possible:

1. Provisional quarterly results are published approximately 10 weeks after the end of the quarter to which they relate, based on the quarterly port returns. Data are available for total weight of goods and number of units, inwards and outwards for each responding port. These figures may be subject to revision if subsequent checks against the agent data or the annual port data highlight anomalies. Typically, a very small number of ports do not provide data in time for publication, in which case an estimate is created, based either on the agent’s data, if available and complete, or the port’s quarterly return for the same quarter in the previous year. DfT assess the quality of these estimates before publication. The table below shows how the published quarterly indices for traffic at major ports have changed in each successive quarter since Quarter 1 2009. This illustrates the overall effect at national level of changes to the provisional figures after their initial publication.

2. Final detailed results are published about 7 months after the year end. These statistics are based on the major and minor annual port returns provided at the end of the year. A split into broad cargo type is available for each major port.

At this stage a full reconciliation of port and shipping agent data will have been carried out, and full checks of the major port’s quarterly and annual data against the agent’s data from shipping agents, and grossing of the final data, completed and checked. The detailed results are based on this grossed data. At this stage the full range of analyses, including those by route and vessel type are available.

4.4 Known accuracy and reliability issues

Despite the above validation work, there remain a number of known issues which are believed to impact on the accuracy of the published statistics, to some extent. These include:

• potential reporting differences for some cargos on some routes. Further details are given in the technical notes based on a comparison of different sources, including trade data figures published by HMRC

• estimation of cargo breakdowns for some types of unitised traffic (for example, containers of different sizes). Some ports are only able to provide totals, and splits are estimated from agent data where possible. This is unlikely to affect the overall trends or patterns shown for the main types of unitised traffic

• limitations in the published arrivals tables (as described in the technical note)

These issues are not considered to affect the overall fitness of purpose of the statistics for their main uses, though for more detailed analyses may need to be borne in mind by users.

4.5 Future plans to improve accuracy

The department will continue to develop the port freight statistics now that the collection and validation has been brought in-house, which has consisted of reviewing the current collection methodology to see if improvements can be made to the accuracy of the data.

Planned work for the next year (2024) includes:

Continuing to explore comparisons with other data, including drilling down to a more detailed level where the data permits (for example, detailed HMRC trade statistics, and DfT’s Road Freight statistics for HGV traffic volume comparisons), to allow cross-comparisons of trends.

The new system encourages suppliers to enter details of the specific cargo this allows more efficient validation of the data. Currently this is done manually, the next steps are to use code or machine learning to do this re-categorisation automatically.

Using data on ship arrivals to improve validation of data as submitted through the year (for example, to identify issues where port codes are used incorrectly). This includes work to exploit big data sources, such as AIS, working with the department’s data science team.

Conduct further analysis into cargo description fields, especially for dry bulks where products may be better aggregated into new categories.

5. 3. Timeliness and Punctuality

Timeliness: the time between the date of publication and the date to which the data refers.

Punctuality: the time between the actual publication and the planned publication of a statistic.

Port freight statistics are published quarterly, as well as a single annual release in late summer. Publication dates for these statistical releases are agreed at least 2 months in advance and dates are published on the GOV.UK release calendar.

To date, all port freight statistical releases have been published to the scheduled pre-announced date.

5.1 Port freight quarterly release:

Quarterly releases are published a total of 10 weeks after the quarter they refer to. For example, the 2022 Quarter 1 release (referring to January 2022 to March 2022) was published on the 8th June 2022.

The collection of the data commences at the end of the quarter in question. For example, the emails asking for data relating to January to March are sent at the end of March. Data providers have four weeks to supply their data, however the initial validations begin as soon as a return is received. If a return is not made within this period, 2 reminder emails are sent with a fortnight given to complete return. If at the end of this period there is still no return, DfT contacts the data provider directly with the aim of finding out the cause of the problem, and work with the provider to ensure the data is received. If this is not possible to collect in time, an estimate is created based of past data, which is then updated if the actual data is submitted.

Example of timescales for a port freight quarterly release:

Task Description	Timeline
DfT sends emails to request data	Week 0
Data is received from providers, and is checked by DfT	Week 1 to Week 4
First reminder emails sent to non-respondents. Validations continue.	Week 5
Final reminder emails sent to non-respondents. Validations continue.	Week 7
Tables are produced and then checked by a senior statistician. The release is written and then checked by a senior statistician, before the entire publication is given a final check by the head of division.	Week 10
Documents and tables are finalised and sent to web team for publication.	Week 11

5.2 Port freight annual release:

The annual release used to be published in August, 8 months after the year to which it refers to has ended. However, DfT have been working to bring this publication date forward and have published the 2020 port freight data in July 2021, with a plan to continue to bring this forward in 2022, following efficiencies in table production and the process overall.

The collection of the data commences at the end of the year in question. For example, the emails asking for annual port data are sent at the end of December. Data providers submit their annual port returns over the next 2 months. This data is then collated with the final quarterly data submissions (annual quarterly and port quarterly) forms before the full validation can begin.

The data is then further validated by DfT, by looking at long term trends and comparing the data to expected movements (for example, based on news articles or other industry publications, or other statistical sources include HMRC trade data and DESNZ energy statistics) to highlight issues, contacting the data suppliers with any queries to resolve.

Example of timescales for a port freight annual release:

Task Description	Timeline
DfT sends emails to request data	End of December
Annual port returns are received with quarterly data being received	January, February
Validation checks on data are performed, where any issues with the data are followed up with the data suppliers to resolve. Once the data has been validated and DfT are satisfied with the quality, the data is signed of as correct.	February to April
Tables are produced and then checked by a senior statistician. The release is written and then checked by a senior statistician, before the entire publication is given a final check by the head of division. Documents and tables are finalised and sent to web team for publication.	May to July

6. 4. Accessibility and Clarity

Accessibility: the ease with which users are able to access the data, also reflecting the format in which the data are available and the availability of supporting information.

Clarity: the quality and sufficiency of the metadata, illustrations and accompanying advice.

6.1 Accessibility:

The outputs are published on the GOV.UK DfT statistics page in accessible formats:

• quarterly and annual statistical releases are available as HTML reports

• data tables are available in Open Spreadsheet (ODS) file format which can be accessed by using free available software. These tables include filters which work through ODS formatting, allowing users to find the data they desire

• tables also include the raw data in a worksheet, for those users who would prefer to manipulate the data themselves, and a ‘metadata’ sheet which provides any key notes and definitions related to the interpretation of a particular table

• a PowerBI dashboard to disseminate the data published in the tables in an alternate format

6.2 Clarity:

The statistical releases use plain language, in which technical terms, acronyms and definitions are defined where appropriate. The main findings are presented using a series of text, charts and maps, with maps used to show the distribution of ports as well as their primary cargo/direction/route breakdowns. High-level details of the strengths and weaknesses of the data are provided at the end of each statistical report for users who are interested in this, with further details in the separate technical notes for those who need this. It is intended that any information that relates to the interpretation of the particular aspects of the bulletin is provided alongside the figures (for example, the ‘Rotterdam effect’ is noted in the section on routes by country).

In addition to the statistical releases, further relevant technical documentation is published, describing the collection process (and how it has changed), the grossing process and how ports are categorised. This document also features a more detailed comparison with other data sources for interested users.

7. 5. Comparability and Coherence

Comparability: the degree to which data can be compared over time and domain.

Coherence: the degree to which data that are derived from different sources or methods, but refer to the same topic, are similar.

7.1 Comparability

Over time: the statistical releases mostly cover trends since January 2000, with some selected datasets going back to 1965. The current definitions and collection methodology relate to an EU Directive which was effective from January 2000.

Prior to 1988, data was only collected on ports within Great Britain. From 1988 onwards this was expanded to include ports in Northern Ireland.

In 2005, more accurate recording of container/shipborne port-to-port trailer movements meant that the 2005 figures were not directly reported as containers, and were instead reported under ‘rail wagons, shipborne port-to-port trailers and barges’ in 2005. This provides a break in the time series for load-on load-off and roll-on roll-off traffic. Further detail on the effect this had on the time series is detailed in the technical notes and definitions.

DfT used a collection agent from 2000, where the same agent also undertook the validations for DfT in 2014. However, in April 2019, DfT brought the data collection in-house and now conducts all the validations.

By port: during the years that the series covers, many ports have transferred operations to other ports. However, these are mostly smaller ports which are aggregated up into “statistical ports” for publication. Therefore, the effect on the trends for ports is negligible. The collection agent tracked these changes to ensure continuity since 2000, and now the DfT monitors these changes.

In 2021, it was brought to DfT’s attention that the 2019 volumes submitted for 3 ports - Goole, Grimsby and Immingham and Hull - were incorrectly inputted by the data provider. DfT worked with the data provider to correct and amend the 2019 series, and the impact has been addressed in the 2020 port freight annual release (published on the 14th July 2021). See the Notes and Definitions for further information.

The new system used to collect the port freight data allows shipping agents to input more detailed cargo descriptions. With the 2020 data, this allowed DfT to assess whether certain cargo have been historically miscategorised and work with data providers to address this.

7.2 Coherence

These statistics provide data on freight through ports; they are used alongside other statistics to help in estimation of the share of international freight to and from the UK that arrives by sea, as well as providing data used in the calculation of the share of domestic freight moved by water. From the 2018 statistics release (published in August 2019), domestic waterborne freight was combined with the port freight release to improve the coherence of the report. In 2021, the 2020 DWF statistics were delayed due to a data issue found in the lookup tables.

A summary of the different sources of freight data is available as part of the annual Transport Statistics Great Britain publication guidance.

There is known user interest in intermodal freight journeys; current work is being done by the road freight statistics team in DfT to estimate the share of road freight that moves to or from maritime ports. A summary of the initial work can be found as part of the latest road freight statistics.

The technical documentation contains details of comparisons that are made with 2 other sources:

1. HMRC data is used to validate long terms trends in cargo commodities, and to shed light on commodity breakdown that we do not have access to in our dataset. There is good correspondence between HMRC and DfT port freight statistics teams to understand the reasons for any differences, for example HMRC does not always clear the goods at customs in the same location as it entered/exited the country.

2. The Digest of UK Energy Statistics is used to provide further context around crude oil, oil products, liquefied gas and coal transport and use. Most categories have good agreement with DfT port freight data, and these are detailed in the port freight technical documentation.

In addition to the above, data is taken from the Eurotunnel operator (GetLink) website with regards to vehicle movements, however this is used purely for comparison in a single table (PORT0104) of the annual release, and is not used for analysis.

7.3 The following four sections cover additional principles which Eurostat asks official statistics producers to comment on when reporting on quality, and we have continued to include for completeness.

8. 6. Trade-offs between Output Quality Components

Trade-offs between output quality components describes the extent to which different aspects of quality are balanced against each other.

The main trade-off is accuracy against timeliness. Data providers are given long periods to submit their returns to offset the burden, and have a full month where they are reminded twice. It is possible that quarterly publications could be a full month earlier if this timescale were shortened. However, the risk is that publication would occasionally be missing data that would have to be imputed.

Cargo categories relate primarily to how the cargo is transported as opposed to what it is. This was originally to align with reporting to Eurostat, however DfT will continue to collect the data on this basis but will not report to Eurostat. This will continue to allow the data to be compared against other EU countries and maintain a consistent time series. This does however clash with user’s perceptions of this categorisation. There is a potential for us to ask for more details on the cargo and thus make the statistics more relevant for users, however this is balanced against the burden on data providers, which is already considered moderate. This would increase the burden significantly, especially as there is no standardised approach for data collection, categorisation and storage within the maritime industry.

9. 7. Assessment of User Needs and Perceptions

Assessment of user needs and perception covers the processes for finding out about users and uses, and their views on the statistical products.

The ways in which the department engages with users to determine their views is covered as part of the ‘relevance’ section above.

10. 8. Performance, Cost and Respondent Burden

Performance, cost and respondent burden describes the effectiveness, efficiency and economy of the statistical output.

Both the quarterly and annual publications are produced using data supplied directly by ports, shipping agents, and shipping lines. This is gathered through a few routes, including an ASCII file upload, a GESMES-standard data file upload, and via a website.

The department has developed a website to replace the previous system (iSDES) to make efficiencies within the collection and validation process. There are several in-built validation checks and guidance in the website to help ensure the data entered by providers meets the criteria needed for the purpose of this publication. Some of these checks include a simple historical comparison, and the validation of codes, such as the IMO number for a vessel. In the short run, this may increase burden on providers when supplying the data, however it means that there is less chasing up of potentially incorrect data from the department which requires resources from both parties.

11. 9. Confidentiality, Transparency and Security

Confidentiality, transparency and security refers to the procedures and policy used to ensure sound confidentiality, security and transparent practices.

All data is stored, accessed and analysed using DfT secure IT systems. Data protection regulations are adhered to throughout the maritime statistics production process, and any information provided to DfT by agents, ports and shipping will be kept securely where access to data is controlled in accordance with departmental policy.

The information used to compile these statistics provides details on individual shipping journeys (for example, ship IMO number, both ports, cargo categorisation) and so could reveal information that is commercially sensitive. An example would be where only a single company moves a particular cargo between 2 specific ports. If we were to publish details at this level we would therefore potentially be revealing commercial information.

The published statistics do not therefore reveal any private information about any organisation. To prevent this, we consider port-to-port data as sensitive and do not publish this to users outside of the department. In addition, when providing data concerning individual ports and countries of load/unload, we aggregate small movements of data as “small flows” to ensure that these cannot disclose commercially sensitive flows (see diagram on next page). This is still used for internal analysis, but is not made publicly available.

DfT aims to publish as much data as is possible whilst ensuring that confidentiality is maintained. In line with this, a table (PORT0499) containing high level port freight traffic between ports and countries are published alongside the annual statistics.

DfT adheres to the principles and protocols laid out in the Code of Practice for Statistics and comply with pre-release access arrangements. The pre-release access lists are available on the DfT website.

12. Section 3: Further Information

This Background Quality Report presents information for users of the port freight statistics covering different aspects of their quality. The department concludes, on the basis of the assessment outline above, that the statistics are of a quality which is considered fit for the purposes for which the statistics are being used.

Comments and feedback on this report, or any other aspect of these statistics are welcome, and can be provided by using the contact details below.

13. Useful links

Maritime and Shipping Statistics

Guide to Maritime Statistics

Port Statistics: Notes and Definitions

14. Contact details

To hear more about DfT statistical publications as they are released, follow us on Twitter at DfTstats.