Part of Mental Health and Wellbeing Surveys Directions specification
Mental Health of Children and Young People Surveys
The Mental Health of Children and Young People (MHCYP) Surveys are a series of surveys which provide data about the mental health of young people living in Great Britain. The survey was first carried out in 1999 capturing information on 5 to 15-year olds living in Great Britain. The survey was carried out by ONS on behalf of the Department of Health (now known as the Department of Health and Social Care, DHSC), The Scottish Health Executive and the National Assembly for Wales. The next survey in the series was in 2004 and captured information from 5 to 16-year olds living in Great Britain. The survey included a follow up study at 6 months and again at 3 years. The survey was carried out by ONS on behalf of the DHSC and the Scottish Health Executive.
NHS Digital commissioned the 2017 survey on behalf of the DHSC, which captured information on 2 to 19-year olds living in England. The survey was carried out by a consortium, led by NatCen and including the ONS and Youth In Mind.
The Mental Health and Wellbeing Surveys Directions will also cover the transfer of the MHCYP 2020 wave 1 data that was originally carried out under the COVID-19 Public Health Directions 2020, as directed by Secretary of State for Health.
MHCYP steering group
Changes to the surveys will involve consultation with the wider user group and the public and guidance from a dedicated MHCYP Steering Group. The MHCYP Steering Group is chaired by NHS Digital with representatives from key stakeholders such as:
- Department of Health and Social Care
- Youth in Mind
- Department of Education
- Public Heath England
- NHS England
- Royal College of Psychiatrists
- The Anna Freud Centre
- Representatives from the research community
- Service user representatives
- The survey contractors delivering the survey
The role of the steering group is advisory, and the aim is to guide the delivery of the survey and help ensure it meets the needs of those involved in commissioning, providing or using mental health services. As part of this role members will be asked to:
- provide direction and recommendations on priorities relating to the surveys
- receive regular progress reports on milestones, risk and quality issues, including response rates and offer guidance where necessary
- provide advice and guidance on changes in data to be collected, methodology, questionnaires, survey materials, sample design, processing and presentation of results
- provide advice and guidance on statistical issues relating to the survey
- resolve conflict and escalate concerns where necessary through NHS Digital governance paths
Following recommendations from DHSC and the MHCYP steering group, this specification, will be reviewed and updated. This is expected to be completed under the relevant work package without the need for the Directions to be amended, provided any such changes are in scope of the Directions.
Data collection
Scope
The scope of the surveys includes all children and young people in the general population, aged between 2 to 19 years living in England.
The scope may change over time, for example widening of the age range, new question topics, inclusion of devolved nations (subject to approvals and governance arrangements). However, consideration will always be given to maintaining the time series to allow the monitoring of changes over time.
The scope of the surveys will be reviewed periodically, and feedback obtained from stakeholders to ensure that it meets current needs. Any changes will be reviewed by the MHCYP Steering Group and work packages will be updated to reflect the agreed changes.
Source
Historical data
There will be a one-off collection of historical MHCYP survey data held by Office for National Statistics for which DHSC was the data controller, this is the data for the surveys for respondents living in England that took place in 1999 (on 5 to 15-year olds), 2002 (looked after children by the local authority), 2004 (on 5 to 16-year olds) and the follow up studies for the series carried out at 6 months and 3 years later
The MHCYP survey data previously collected by NHS Digital on behalf of DHSC for the surveys carried out between 2017 and 2020 are also brought within the scope of these Directions
Subsequent surveys
An appropriate database is used to sample for children and young people living in England. In early surveys this was the Child Benefit Register. In the 2017 survey, the NHS Digital Personal Demographic Service was used. These Directions allow NHS Digital to use any appropriate dataset that it holds or that is freely accessible to provide a sampling framework to identify children and young people that are currently alive and living in England. The identified dataset e.g. the Personal Demographic Service is used to identify children based on age, gender and location to design a survey that will provide representative statistics for different groups. Once identified, children and their families are contacted to ask to participate in the survey.
The mode of the survey will be chosen depending upon survey content, timing, length and complexity of questionnaire, participant criteria and available budget. Different modes may also be chosen within the same survey year, e.g. face to face interview, paper, web or app self-completion. The 2017 survey was conducted as a face to face interview with the parent/guardian and/or child and an online survey was conducted with a nominated teacher. As part of the survey participants or their parent/guardian (if 16 years and under) are asked to consent for their contact details to be kept on file to allow for future contact for further research.
Where consent has been received to keep contact details on record, follow up studies of the survey cohorts will be carried out at appropriate intervals, this will allow for longitudinal analysis to show any changes in mental health over time and allow for the identification of risk factors. Previous follow up surveys have been carried out at 6 months and 3 years. NHS Digital will use all appropriate means to ensure that to the best of their ability, the identified follow up cohort contains the latest contact details for the participants and that all participants are currently alive e.g. checking contact details against the personal demographic service and updating for mortality information. The follow up study can take the format of an online survey, telephone survey or face to face survey, however the content of the survey should be tailored to the chosen methodology. The survey may include any aspect of the original survey content and any new content that will enable monitoring of mental health and improve care for patients.
Any change to the source will be managed through the NHS Digital’s MHCYP Steering Group and subsequent work packages.
Category
The NHS Digital database used for sampling (e.g. Personal Demographic Service) will contain:
- NHS Number (not shared with the survey contractor, held by NHS Digital for validation purposes for follow up and data linkage)
- Serial ID (NHS Digital assign unique ID to cohort)
- name
- address
- postcode
- telephone numbers
- email address
- date of birth
- gender
Where a person, or their parent/guardian (if 16 years and under), consents to future contact the survey contractor will share the serial ID, name, address, postcode, telephone and email address with NHS Digital. NHS Digital will validate these details against the personal demographic service and will provide any updates. A flag will also be placed on the cohort for anyone that has since died.
The MHCYP dataset and linked data will include the following personal data:
- NHS Number
- name
- address
- postcode
- telephone numbers
- email address
- date of birth
- gender
- date of death
And the following special category data
- ethnicity
- religion
- sexual orientation
- cause of death
- health and mental health related information based on survey responses and linked data
- education data (via linkage)
The full list of survey questions asked can be found as part of the relevant National Statistics Publication for the individual survey years.
Frequency
The timing of surveys will be specified by the sponsors, DHSC, depending upon the requirement for updated mental health information. So far surveys have been carried out in 1999, 2004 and 2017. Follow up studies have been carried out on the 2004 cohort at 6 months, and 3 years and the 2017 cohort at 3 years.
Analysis
Processing
NHS Digital contract a survey contractor to carry out the surveys on its behalf and produce the analysis as specified by NHS Digital. The survey contractor acts as a data processor on behalf of NHS Digital.
The survey contractor collects, processes and holds the MHCYP data on behalf of NHS Digital, the survey contractor for 2017 is NatCen and ONS. The NHS Digital database chosen for sampling will be processed by NHS Digital to identify contact details for children and young people living in England aged 2 to 19 years of age and will contain information about children that are currently alive only, so that unnecessary distress is not caused to a bereaved family, National Data Opt outs will be applied to the sample. The survey contractor will design sampling criteria to be applied to the sample to choose a random sample of children to survey ensuring that the sample is representative of the general population and that there is no evidence of bias for example. for age, gender, region. NHS Digital will apply the sampling criteria to the sample, and the resultant sampling dataset will be transferred securely to the survey contractor. Information about the survey will be sent to all chosen residences and participants will be able to decline to take part.
All survey responses are either captured electronically at the time of the interview, or via a paper self-completion questionnaire. The teacher survey is completed either via a postal questionnaire or online survey. All paper responses are transferred to an electronic record and are archived for 5 years before being destroyed. The created survey dataset is held electronically by the survey contractor.
Survey responses are validated for completeness and data quality and are carried out by the survey contractor. This includes checking that any information captured on paper has been transferred to electronic copy correctly, answers are valid e.g. coding consistently where a respondent answers yes to one question but no to a similar question later, and any non-responses are coded the same. Checks are carried out to ensure the responses are representative of the general population of children and that there is no evidence of bias, for example, age, season and region. Derived variables are created; this is when a new answer is created from the respondent’s answers to one or more questions e.g. calculating an overall well-being score. Weights are also created to allow the answers to be compared e.g. adjusting for ethnicity, age, region, presence of a mental health condition. Population trends are created to look at changes over time. This involves processing responses for past survey years to look at trends over time.
For the follow up study, contact details for survey respondents are updated by cross checking against relevant NHS Digital datasets, e.g. personal demographic service and mortality data, this is to ensure that information is not sent to the wrong address or unnecessary stress is caused to a bereaved family. Information for the follow up study is sent to the survey respondent asking them to take part in the follow up study. The survey responses are collated and held electronically, completeness and data quality checks are carried out as outlined above for the main survey and derived variables and weights created. The survey responses for the follow up study are linked by a serial number to the answers from the main survey to allow longitudinal analysis and measure change over time for the individual. This will be carried out by the survey contractor at the time that has been contracted to carry out the follow up study. N.B the survey contractor delivering the follow up survey may not be the same survey contractor that delivered the original survey.
For each survey, the analysis and reporting requirements will be defined by NHS Digital. This will be reviewed and agreed by the MHCYP Steering group. The agreed analysis and reporting requirements will enable reporting against current policy priorities. The survey contractor prepares responses to Freedom of Information requests and Parliamentary Questions on behalf of NHS Digital. The survey contractor also fulfils any data requests from external customers for bespoke analysis following and in line with NHS Digital approval through NHS Digital’s Data Access Request Service (DARS).
On completion of the survey, a number of different data files are transferred to NHS Digital via secure encrypted file transfer. The data files are stored in the NHS Digital Data Management Environment (DME). The types of data files for transfer are the same for the main survey and the follow up and include the complete data file (direct identifiers are held separately and a pseudo key is created to be able to identify individuals), and data anonymised in accordance with the ICO Anonymisation Code of Practice1 that can be made available to researchers. The direct identifiers will allow future linkage to other datasets that NHS Digital hold. The datasets will be used by internal NHS Digital staff for future analysis if commissioned to do so by the sponsor, linkage to other NHS Digital dataset, and onboarding to NHS Digital’s Data Access Request Service to allow government, researchers, charities to access the data. Currently the survey contractor holds these data files on behalf of NHS Digital. The anonymised dataset is also deposited with the UK Data Service. The UK Data Service is funded by the Economic and Social Research Council (ESRC) and provides access and support to researchers to a number of different data collections including major UK government-sponsored surveys, cross-national surveys, longitudinal studies and UK census data. The UK Data Service act as a data processor for NHS Digital and following instruction from NHS Digital grant access to the survey data to named researchers following approval through the NHS Digital Data Access Request Service (DARS).
Data linkage
Individuals or their parent or guardian (for children 16 years and under) are asked for their consent to use their NHS number to link their survey data with health information. Participants are asked to provide their consent to link to health data, hospital in-patient care, hospital emergency care, maternity, mental health, social care, primary care, diagnostic care, mortality, cancer and diabetes.
Data linkage involves using the child or young person’s contact details to validate their NHS number from the personal demographic service. This can then be used to link to other health information that NHS Digital hold.
Individuals, or their parent or guardian (for children 16 years and under), are also asked whether their survey responses may be linked to Education data held by the Department of Education, which includes information about attendance and exam results, subject to there Mental Health and Wellbeing Surveys Directions Specification v 1.1 Published 08/02/2021 Copyright © 2020 NHS Digital Page 19 of 21 being a legal basis for this to occur. These Directions do not give NHS Digital the legal authority to collect education data.
Respondents, or their parent/guardian (if 16 years and under), are also asked whether they will give permission for NHS Digital or their data processor acting on their behalf, to hold their contact details on file and approach them in the future to take part in follow up research. Those respondents that agree to this will be contacted to take part in the follow up studies.
Consultation
Prior to the 2017 survey a consultation took place with users of the statistics to understand what aspects of the survey were important to different users, what they wanted to be included, what could be taken out and any new content or changes to the survey methodology. The consultation was public and was viewed by over 600 people and organisations, with 225 responses. Respondents covered a range of areas including academic, clinical, public, private and voluntary sectors and members of the general public
The consultation was shared with the following organisations and was also made publicly available for all to respond to; DHSC, Public Health England (PHE), NHS England (NHSE), Department of Education, Local Authorities, Royal College of Psychiatrists, Royal College of Paediatrics & Child Health, NHS Clinical Commissioners, Faculty of Public Health and the London School of Economics. The consultation was shared with academics from different Universities including, Kings College London, University College London, Manchester, Exeter, Warwick and Sheffield University and third sector organisations such as Children & Young People’s Mental Health Coalition, Rethink, NSPCC, Family Action, Youth Access, YouthNet, Mind, Action for Children, Centre for Mental Health, British Association for Community Child Health and The Association of Primary Mental Health Work and Training.
Changes to the survey will involve consultation with the wider user group and the public and guidance from the dedicated MHCYP Steering Group. The Steering Group will guide the delivery of the survey and help ensure it meets the needs of those involved in commissioning, providing or using mental health services.
Dissemination/Sharing
Regular Dissemination/Sharing
Analysis will be undertaken ad-hoc to respond to Parliamentary Requests and FOI requests. Data Access Request Service (DARS) At the end of each survey year data anonymised in accordance with the ICO Anonymisation Code of Practice will be shared with the sponsor, DHSC subject to approval through DARS.
Data anonymised in accordance with the ICO Anonymisation Code of Practice which does not include information which could directly identify the respondent is created; name, date of birth, address and contact details are removed from it and the dataset is deposited with the UK Data Service. Researchers, analysts, charities, local government and national government organisations can apply to use the data for research and statistical purposes providing that the purpose is of benefit to health and they have a legal basis to do so. Customers apply to NHS Digital for access, and if approved by DARS the UK Data Service as NHS Digital’s processor will disseminate the data on NHS Digital behalf.
Customers can also apply to NHS Digital for bespoke data requests, for data items that have not been included in the anonymised dataset. If the application is approved via DARS, the survey contractor, subject to funding from the customer, will create the bespoke extract and disseminate to the customer on behalf of NHS Digital.
The MHCYP dataset is expected to be fully on-boarded into DARS and then disseminated to appropriate organisations as per NHS Digital’s dissemination process / policy.
In the future, the MHCYP dataset will be available for customers to access via the Data Access Environment (subject to approval from DARS).
Publication
Data to be published
A National Statistics report and subsequent tables and charts will be published on the NHS Digital website following each commissioned survey. The Code of Practice for Statistics will be followed for each publication.
Data prohibited from publication
NHS Digital must not publish information that has been anonymised in accordance with the ICO Anonymisation Code of Practice for release by DARS
Change management
Changes to this Specification will be managed and agreed with the Department of Health and Social Care (on behalf of the Secretary of State) to ensure that any such change is within scope of the Mental Health and Wellbeing Surveys Directions 2020.
Any changes to the survey methodology or questionnaire content will be discussed with the MHCYP Steering Group and the work package and this Specification will be updated to reflect agreed changes.
Last edited: 17 January 2022 2:47 pm