Synthetic-LS-spines

Created by CALLS Hub - Source for downloading synthetic LS spines and related documentation


Project maintained by Fiona-C Hosted on GitHub Pages — Theme by mattgraham

Synthetic-LS-spines

Created by CALLS Hub - Source for downloading synthetic LS spines and related documentation

The England and Wales Longitudinal Study (ONS LS), Scottish Longitudinal Study (SLS) and Northern Ireland Longitudinal Study (NILS) are incredibly rich micro-datasets linking census and other health and administrative data (births, deaths, marriages, cancer registrations) for individuals and their immediate families across several decades. Whilst unique and valuable resources, the sensitive nature of the information they contain means that access to the microdata is restricted to approved researchers and LS support staff, who can only view and work with the data in safe settings controlled by the national statistical agencies. Consequently, compared to other census data products such as the aggregate statistics or interaction data, the three longitudinal studies are used by a small number of researchers - a situation which limits their potential impact.

Given that confidentiality constraints mean that open access is not possible with the real microdata, alternative options are needed to allow academics and other users to carry out their research more freely. To address this the SYLLS project (Synthetic Data Estimation for UK Longitudinal Studies) has been set up.  SYLLS is developing techniques to produce synthetic data which mimics the real data and preserves the relationships between variables and transitions of individuals over time, but is more freely accessible. This project is a collaboration between the three UK Longitudinal Study Research Support Units - CeLSIUS, SLS-DSU and the NILS-RSU - makes use of two complementary methods for generating synthetic data products (see http://calls.ac.uk/guides-resources/synthetic-ls-data/).

The repository hosted here allows you to download files and documentation relating to one of the strands of the SYLLS project, which created downloadable synthetic teaching datasets. A simple proportional fitting algorithm has been used to extend the national 2011 Census Microdata Teaching files (derived from the Samples of Anonymised Records) to include longitudinal transitions (currently a ten year transition back to 2001), derived from the real LS data. The Synthetic Spine state transitions are for some of the most commonly used variables in social science research, including health, marital status, social grade and religion, as well as estimates for the numbers of births and deaths. These data are for general use and will allow users who are unfamiliar with longitudinal data to get a feel for the kinds of questions that can be answered by following individuals through time and observing changes in their characteristics.

You can read more about the technique for creating synthetic spine datasets in this journal paper. More information can be found in this blog post by Dr Adam Dennett.

The following files are currently available:

Some useful links:

NOTE:

The datasets contain synthetic data based on the ONS Longitudinal Study for England and Wales (ONS LS), the Scottish Longitudinal Study (SLS) and the Northern Ireland Longitudinal Study (NILS) and do not contain real ONS LS, SLS or NILS data. The synthetic datasets have been developed for teaching purposes and for researchers to familiarise themselves with longitudinal data. Real ONS LS microdata are available in safe settings in London, Newport, South Wales and Titchfield in Hampshire. Real SLS microdata are available in the safe setting in Edinburgh. Real NILS microdata are available in the safe setting in Belfast. The microdata are never released outside these safe settings. Researchers may apply to use ONS LS data by contacting CeLSIUS, based at University College London, to use SLS data by contacting SLS-DSU, based at Ladywell House, Edinburgh or to use NILS data by contacting NILS-RSU, based at Queen’s University Belfast. The ONS LS, SLS and NILS synthetic spines are released under an Open Government Licence agreement.

CeLSIUS, SLS-DSU, NILS-RSU, CALLS Hub and SYLLS are funded by the Economic and Social Research Council (ESRC). For more information please visit the CALLS Hub website.