---
layout: ../layouts/MethodologyLayout.astro
title: Methodology & references
description: Where the data comes from and how to read the subject comparisons.
updated: 22 November 2026
---

## Where does the data come from?

| Coverage | Source | Used for |
| --- | --- | --- |
| KS4 (GCSE), 2023/24 | DfE [Key stage 4 performance](https://explore-education-statistics.service.gov.uk/find-statistics/key-stage-4-performance/2023-24), [GCSE subject transition matrices](https://explore-education-statistics.service.gov.uk/data-catalogue/data-set/f65c2e07-a857-4245-b5ba-8effb0f89ba8) | GCSE outcomes by earlier KS2 attainment in England’s state-funded schools; 35 subject categories |
| KS5, 2024/25 and 2025/26 | DfE [16 to 19 performance: 2024/25](https://explore-education-statistics.service.gov.uk/find-statistics/16-to-19-performance/2024-25/explore) and [2025/26](https://explore-education-statistics.service.gov.uk/find-statistics/16-to-19-performance/2025-26/explore), transition matrices | Outcomes by earlier GCSE attainment, with separate qualification types, sizes and grade scales |
| GCSE and A level, 2019, 2023 and 2024 | Brylka & He’s [Ofqual inter-subject comparability study](https://www.gov.uk/government/publications/inter-subject-comparability-in-gcses-and-a-levels-in-summer-2024) · [PDF](/references/ofqual-inter-subject-comparability-2024.pdf) | Published General Ability difficulty ranks |
| IB Diploma Programme, May 2019 | Badham, Meadows & Baird (2025), [construct comparability study](https://doi.org/10.3389/feduc.2025.1616879) · [PDF](/references/feduc-10-1616879.pdf#page=9) | Published General Ability thresholds, Table 4, Dataset 1 |

The DfE matrices are aggregate subject-entry counts, not linked individual records. A student can appear in several subjects. The Ofqual and IB studies use separate datasets and models; we reproduce their published results rather than fit those models to the DfE matrices. Subject coverage differs between sources.


## Data, notation and grade scales

### Counts and denominators

For subject $s$ and prior-attainment band $b$, $n_{sbg}$ is the count at grade $g$, $N_{sb}$ the relevant band total, and $p_{sbg}=n_{sbg}/N_{sb}$ the grade share. Percentages use counts from the selected subject, band and pupil group. Aggregate totals are never added to their component bands, and overlapping pupil groups are kept separate.

For GCSE transitions, X outcomes remain in percentage denominators but are excluded from numeric summaries. Unknown prior attainment is shown separately and excluded from the attainment-adjusted analyses. Each page specifies its usable bands and exclusions.

### Grade coding

Grades use consecutive steps from U = 0 up the course’s own ordered grading scale. Combined Science (GCSE) uses the average of its two grades. Equal grade steps are a calculation convention. Means may fall between grade labels; these scales do not establish equivalence between qualifications.

## Transition matrices and summaries

Exact-grade percentages show the share at each grade; cumulative percentages add that grade and all higher grades. The mean weights numeric grade points by entry counts. The median is the first grade reaching 50% when counting from the highest grade down, returning the higher grade at an exact tie.

Any display pooling sums counts before recalculating percentages and summaries. It does not change the source bands used for analysis. Explore [GCSE Subject transitions](/england_ks4/subject-transitions/) or [KS5 Subject transitions](/england_ks5/subject-transitions/).

## Difficulty from prior attainment

We adapt the prior-attainment weighted mean grade approach described by [He and Cadwallader (2023, §2.2)](https://www.gov.uk/government/publications/inter-subject-comparability-in-gcses-and-a-levels-in-summer-2022/inter-subject-comparability-in-gcses-and-a-levels-in-summer-2022#22-methods-of-analysis). Every eligible subject receives the same mix of earlier attainment: KS2 for GCSEs, and GCSE attainment for KS5. Our implementation uses DfE’s published bands and pooled entry weights, rather than the study’s ten equal-population bands.

### Calculating the weighted mean grade

Multiply each subject’s mean grade within a band, $\mu_{sb}$, by that band’s common reference weight, $w_b$, then add:

$$
\operatorname{WMG}_s=\sum_b w_b\mu_{sb},\qquad
w_b=\frac{\sum_{s\in S}N_{sb}}{\sum_{s\in S}\sum_c N_{sc}}.
$$

Here $N_{sb}$ is the usable entry count and $S$ the eligible subjects. Weights sum to 1. Reference weights are the pooled proportions of usable entries across eligible subjects in the selected comparison. Lower WMG means lower average grades under that common intake mix, so rank 1 is the most statistically difficult by this measure. The observed mean uses the subject’s own intake; adjustment = WMG − observed mean.

This adjustment accounts for differences between attainment bands, while differences within bands and other entrant characteristics remain. Changing the comparison group can change weights and ranks. The [GCSE](/england_ks4/prior-attainment/) comparison retains all 11 published KS2 bands; [KS5](/england_ks5/prior-attainment/) uses six bands: <4, 4–<5, 5–<6, 6–<7, 7–<8 and 8+. Subjects need usable results in every band. Size filters change eligibility and weights; search keeps them fixed. Each page shows its reference weights and excluded subjects.

## Correlation, association and spread

These measures use observed grade counts and each subject’s actual intake, rather than the common WMG weights.

- **Pearson correlation (r):** the direction and strength of a straight-line relationship between coded prior-attainment bands and grade points, from −1 to 1. Band coding cannot recover variation in exact prior scores.
- **Association (η²):** the proportion of grade variance associated with differences between band means, allowing patterns beyond a straight line.
- **Within-band SD:** how much grades vary among entrants in the same attainment band, calculated from the count-weighted within-band variances. Normalised SD expresses this relative to the full grading-scale range.

A required variance of zero leaves the corresponding statistic undefined. Correlation does not establish causation or individual prediction accuracy; within-band spread is not a tested prediction error.

For count-weighted prior-attainment scores $X$ and grade points $Y$:

$$
r=\frac{\operatorname{Cov}(X,Y)}{\sqrt{\operatorname{Var}(X)\operatorname{Var}(Y)}},
\qquad
\eta^2=\frac{V_{\mathrm{between}}}{V_{\mathrm{total}}},
\qquad
\mathrm{SD}_{\mathrm{within}}=\sqrt{V_{\mathrm{within}}}.
$$

Total variance = between-band + within-band variance. Within-band variance averages each band’s grade variance using its share of usable entries; normalised SD divides by the full grade-point range. These calculations use population denominators.

Closed prior-attainment bands use their midpoints. KS5 codes Below 1 as 0.5 and 9-or-above as 9.0. GCSE correlation excludes the open-ended “Less than 80” band, No prior score and X outcomes. Neither analysis includes unknown attainment or aggregate totals.

## General Ability

Rasch models estimate a shared academic ability from the subjects a student took, alongside each subject’s grade-specific difficulty. Higher estimated ability increases the likelihood of higher grades; a harder subject requires greater ability for comparable outcomes. This assumes that different subjects can be linked through a common ability, with limits caused by selection, subject-specific strengths and model fit.

For Ofqual, difficulty at grade $k$ is the ability at which the expected grade is $k-0.5$. Overall difficulty averages grades 3–8 for GCSEs and D–A for A levels. We display ranks from the published estimates, with rank 1 most statistically difficult. The [GCSE](/england_ks4/general-ability/) and [A level](/england_ks5/general-ability/) page footers explain rank reconstruction, coverage and source inconsistencies.

The [IB page](/ib/general-ability/) uses published Rasch–Thurstone thresholds in logits; its overall measure averages grades 5, 6 and 7. Each study has its own population and scale. Ranks cannot be compared across qualifications, and small rank differences alone do not establish meaningful differences or grading unfairness.

## References

- **Brylka, A. & He, Q. (2025).** [Inter-subject comparability in GCSEs and A levels in summer 2024](https://www.gov.uk/government/publications/inter-subject-comparability-in-gcses-and-a-levels-in-summer-2024). Ofqual. GCSE ranks: Figure 4 and Table A2; A level ranks: Figure 11 and Table A4.

- **He, Q. & Cadwallader, S. (2023).** [Inter-subject comparability in GCSEs and A levels in summer 2022: methods](https://www.gov.uk/government/publications/inter-subject-comparability-in-gcses-and-a-levels-in-summer-2022/inter-subject-comparability-in-gcses-and-a-levels-in-summer-2022#22-methods-of-analysis). Prior-attainment weighting and Rasch comparisons.

- **Badham, L., Meadows, M. & Baird, J.-A. (2025).** [Construct comparability and the limits of post hoc modeling: insights from International Baccalaureate multi-language assessments](https://doi.org/10.3389/feduc.2025.1616879). Table 4, Dataset 1.


Ofqual source material © Crown copyright 2025, licensed under the [Open Government Licence v3.0](https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/).

The IB study is © 2025 its authors and licensed under [CC BY](https://creativecommons.org/licenses/by/4.0/). Data extracted; layout and rankings adapted.
