Skip to content

📊 Add long-run UK migration data - #6563

Draft
edomt wants to merge 15 commits into
masterfrom
data-add-longrun-uk
Draft

📊 Add long-run UK migration data#6563
edomt wants to merge 15 commits into
masterfrom
data-add-longrun-uk

Conversation

@edomt

@edomt edomt commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Written by Claude Fable 5 — @edomt at the wheel.

Part of https://github.com/owid/owid-issues/issues/2469 (child of https://github.com/owid/owid-issues/issues/2464).

What this adds

A new dataset migration/2026-08-03/uk_migration with six indicators for the United Kingdom, 1853–2025: immigration, emigration, and net migration, each in people and as a share of the population.

The series is OWID-maintained (processing_level: major): it joins two sources at 2012.

  • Up to 2011 — the Bank of England's research dataset A millennium of macroeconomic data (worksheet A19a), which splices four historical sources: ship passenger counts on extra-European routes (1853–1963), total migration counts (1964–1974), the International Passenger Survey (1975–1990), and Long-Term International Migration estimates (1991 onward). Converted from thousands to people; the Bank's share-of-population figures are kept as published (their denominator matches the UK's borders of the time, including all of Ireland before 1922).
  • From 2012 — the ONS's administrative estimates of long-term international migration (year-ending-December values, which cover calendar years). These replaced the survey-based estimates as the official measure and are considerably higher — the survey undercounted flows in both directions — so the Bank's survey-based 2012–2016 values are discarded. Shares of population for this period are computed from OWID's population estimates.

Notes

  • The indicator metadata spells out the five underlying sources period by period, the level shifts at each join (1964, 1991, 2012), the 1939–1946 gap, the pre-1922 boundary difference, and the 2001–2011 census revision of net migration.
  • Sanity checks assert the join behaves as expected, that net = immigration − emigration everywhere except 2001–2011, and that values stay in plausible ranges.
  • The Bank of England asks users to cite the workbook and the original sources of individual series; both are in the snapshot's citation_full.

🤖 Generated with Claude Code

@owidbot

owidbot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Quick links (staging server):

Site Dev Site Preview Admin Wizard Docs Docs Preview

Login: ssh owid@staging-site-data-add-longrun-uk

chart-diff: ❌
  • 0/2 reviewed charts
  • Modified: 0/0
  • New: 0/2
  • Rejected: 0
  • Data changes: 0
  • Metadata changes: 0
data-diff: ❌ 1 new — full report
+ garden/migration/2026-08-03/uk_migration (new dataset: 2 table(s), 8 column(s))

Automatically updated datasets matching excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included. Run locally with etl diff REMOTE data/ --include <dataset> --verbose.

Edited: 2026-08-10 12:09:42 UTC
Execution time: 24.62 seconds

@edomt

edomt commented Aug 3, 2026

Copy link
Copy Markdown
Contributor Author

@codex review

edomt and others added 2 commits August 3, 2026 15:22
Six indicators (immigration, emigration, net migration; each in people
and as a share of the population) for the United Kingdom, combining the
Bank of England's 'A millennium of macroeconomic data' (to 2011) with
the ONS's administrative estimates of long-term international migration
(from 2012).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@edomt
edomt force-pushed the data-add-longrun-uk branch from 39288a5 to 7c0ca71 Compare August 3, 2026 13:22
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 39288a51af

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread etl/steps/data/meadow/migration/2026-08-03/uk_migration.py
Comment thread snapshots/migration/2026-08-03/long_term_international_migration.xlsx.dvc Outdated
edomt and others added 12 commits August 3, 2026 15:34
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
… annotation and series labels, origin URL

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
From the Bank of England workbook's sheet A19c (Wrigley & Schofield's
parish-register reconstruction). Sign flipped from the source's net
emigration to net migration, in people and as a share of the population.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants