Publication, Part of Dentists' Working Patterns, Motivation and Morale
Dentists' Working Patterns, Motivation and Morale - 2022/23
Annex C – Representativeness of the Survey Data
The Dental Working Patterns (DWP) Survey took place during July and August 2023 and all primary care dentists in England, Northern Ireland, Scotland and Wales who had NHS/Health Service activity recorded for 2022/23 were invited to participate. Following the end of the survey, all returns were validated with the main inclusion criteria outlined below.
Table C1 shows the number of invitations sent to dentists in each country, the total number of returns collected, exclusions and the final sample for 2022/23
Table C1: Total number of exclusions by country, 2022/23
Country |
Invitations |
Returns |
Exclusions |
Final Sample |
England |
24,143 |
2,189 |
505 (23.1%) |
1,684 |
Northern Ireland |
1,313 |
161 |
29 (18.0%) |
132 |
Scotland |
2,636 |
241 |
34 (14.1%) |
207 |
Wales |
1,436 |
141 |
24 (17.0%) |
117 |
The inclusion criteria mean that the figures in each table of this report are based on a consistent group of dentists for each year. Annex B provides the sample and population sizes for the stratification variables underlying the weighting in each country. Tables C2-C5 show the survey response rates by country, broken down into the variables used to stratify each sample. Note that differences in response rates between the two years of each previous survey may be partly due to changes in the population.
Table C2: Dental Working Patterns survey response rates by dental type, gender and age, England, 2008/09 to 2022/23
Response Rate (%) | |||||||||||||
Variable | 2008/09 | 2009/10 | 2010/11 | 2011/12 | 2012/13 | 2013/14 | 2014/15 | 2015/16 | 2016/17 | 2017/18 | 2018/19 | 2019/20 | 2022/23 |
Providing-Performer | 54.1 | 55.7 | 37.2 | 38.0 | 40.6 | 41.6 | 30.8 | 31.0 | 27.9 | 28.8 | 25.0 | 25.8 | 12.3 |
Associate | 40.8 | 41.5 | 33.4 | 34.0 | 36.4 | 36.3 | 24.2 | 23.8 | 21.1 | 22.1 | 17.5 | 18.1 | 7.9 |
Male | 46.6 | 47.2 | 33.7 | 34.2 | 37.6 | 37.6 | 25.7 | 25.6 | 22.6 | 23.6 | 19.5 | 20.3 | 9.7 |
Female | 43.4 | 43.9 | 35.6 | 36.0 | 37.1 | 37.0 | 25.0 | 24.2 | 21.4 | 22.4 | 18.5 | 19.3 | 7.9 |
<35 | 36.3 | 37.1 | 30.7 | 30.7 | 32.5 | 30.9 | 19.4 | 17.2 | 15.9 | 16.2 | 12.4 | 12.6 | 5.2 |
35-44 | 45.4 | 44.1 | 33.8 | 34.2 | 37.0 | 37.4 | 26.1 | 26.7 | 23.9 | 24.4 | 19.6 | 19.6 | 8.0 |
45-54 | 56.9 | 57.0 | 41.6 | 40.8 | 43.9 | 44.0 | 31.6 | 30.9 | 27.7 | 28.2 | 25.8 | 25.8 | 12.1 |
55+ | 50.7 | 55.1 | 34.3 | 39.0 | 40.5 | 43.9 | 30.2 | 32.6 | 25.9 | 28.2 | 25.5 | 28.2 | 14.1 |
All Dentists | 45.4 | 45.9 | 34.5 | 35.0 | 37.3 | 37.3 | 25.4 | 24.9 | 22.0 | 23.0 | 19.0 | 19.8 | 8.8 |
Table C3: Dental Working Patterns survey response rates by gender and age, Northern Ireland, 2008/09 to 2022/23
Response Rate (%) | |||||||||||||
Variable | 2008/09 | 2009/10 | 2010/11 | 2011/12 | 2012/13 | 2013/14 | 2014/15 | 2015/16 | 2016/17 | 2017/18 | 2018/19 | 2019/20 | 2022/23 |
Male | 60.7 | 58.7 | 37.3 | 34.6 | 50.5 | 51.3 | 41.5 | 42.2 | 42.2 | 42.5 | 38.8 | 40.5 | 15.5 |
Female | 48.2 | 48.1 | 38.9 | 36.3 | 51.0 | 51.8 | 40.6 | 40.7 | 34.7 | 35.8 | 30.4 | 31.9 | 11.6 |
<35 | 48.7 | 46.8 | 40.3 | 33.8 | 49.9 | 51.4 | 42.8 | 41.1 | 36.2 | 38.0 | 32.0 | 33.6 | 10.1 |
35-44 | 56.5 | 55.4 | 36.7 | 36.2 | 51.0 | 50.2 | 41.8 | 44.1 | 42.9 | 42.4 | 37.8 | 38.3 | 13.1 |
45+ | 62.1 | 61.1 | 36.4 | 36.8 | 51.6 | 53.0 | 38.5 | 39.4 | 36.1 | 36.3 | 32.8 | 35.2 | 15.9 |
All Dentists | 54.7 | 53.6 | 38.0 | 35.5 | 50.8 | 51.5 | 41.0 | 41.4 | 38.2 | 38.8 | 34.1 | 35.7 | 13.2 |
Table C4: Dental Working Patterns survey response rates by gender and age, Scotland, 2008/09 to 2022/23
Response Rate (%) | |||||||||||||
Variable | 2008/09 | 2009/10 | 2010/11 | 2011/12 | 2012/13 | 2013/14 | 2014/15 | 2015/16 | 2016/17 | 2017/18 | 2018/19 | 2019/20 | 2022/23 |
Male | 57.1 | 55.7 | 36.1 | 35.6 | 38.0 | 39.4 | 33.5 | 34.4 | 38.7 | 40.2 | 39.5 | 41.8 | 8.8 |
Female | 54.0 | 52.6 | 39.2 | 40.3 | 39.7 | 41.8 | 31.3 | 32.3 | 39.2 | 40.5 | 44.7 | 46.6 | 8.9 |
<35 | 50.5 | 49.5 | 37.6 | 36.6 | 35.3 | 38.5 | 29.7 | 30.4 | 38.2 | 39.6 | 39.5 | 41.4 | 7.8 |
35-44 | 53.8 | 51.6 | 34.1 | 35.2 | 38.2 | 37.7 | 33.8 | 34.0 | 39.4 | 41.2 | 45.0 | 46.3 | 7.8 |
45+ | 62.6 | 61.6 | 39.5 | 40.5 | 43.2 | 44.9 | 34.9 | 36.6 | 39.6 | 40.7 | 43.1 | 46.3 | 11.0 |
All Dentists | 55.8 | 54.4 | 37.4 | 37.6 | 38.7 | 40.5 | 32.5 | 33.4 | 39.0 | 40.4 | 42.1 | 44.3 | 8.8 |
Table C5: Dental Working Patterns survey response rates by gender and age, Wales, 2018/19 and 2022/23
Response Rate (%) | |||
Variable | 2018/19 | 2019/20 | 2022/23 |
Male | 28.8 | 30.1 | 9.8 |
Female | 28.1 | 30.3 | 9.5 |
<35 | 22.7 | 25.5 | 7.5 |
35-44 | 26.3 | 26 | 9.2 |
45+ | 37.1 | 37.9 | 12.2 |
All Dentists | 28.5 | 30.2 | 9.7 |
The response rates are the percentages of dentists invited to participate in the survey who returned a completed survey (whether they worked a full year or not). Please note, a group of dentists in Northern Ireland were unintentionally omitted from those invited to take part in the survey in 2010/11 and 2011/12. These were either new (or returning) dentists or dentists who renewed their registration with Business Services Organisation (BSO) between September 2010 and March 2012 and who did not claim a practice allowance between their (re)-registration and the end of the relevant financial year. This meant there was a smaller sample size for the analysis covering those years, as shown in Table C3. The impact of not inviting these dentists to complete the survey is covered in the report for those years.
Table C6 shows the overall response rates for each country by way of comparison (i.e. the ‘All Dentists’ figures from Tables C2-C5).
Response Rate (%) | |||||||||||||
Country | 2008/09 | 2009/10 | 2010/11 | 2011/12 | 2012/13 | 2013/14 | 2014/15 | 2015/16 | 2016/17 | 2017/18 | 2018/19 | 2019/20 | 2022/23 |
England | 45.4 | 45.9 | 34.5 | 35.0 | 37.3 | 37.3 | 25.4 | 24.9 | 22.0 | 23.0 | 19.0 | 19.8 | 8.8 |
N. Ireland | 54.7 | 53.6 | 38.0 | 35.5 | 50.8 | 51.5 | 41.0 | 41.4 | 38.2 | 38.8 | 34.1 | 35.7 | 13.2 |
Scotland | 55.8 | 54.4 | 37.4 | 37.6 | 38.7 | 40.5 | 32.5 | 33.4 | 39.0 | 40.4 | 42.1 | 44.3 | 8.8 |
Wales | 28.5 | 30.2 | 9.7 |
Table C6 highlights that, overall, there has been a drop in response rates for the DWP survey in each country since 2008/09, with two main exceptions:
- An increase in 2012/13 and 2013/14 for Northern Ireland following lower rates in 2010/11 and 2011/12 due to an administrative error where a group of dentists in Northern Ireland were unintentionally omitted from those invited to take part in the survey in 2010/11 and 2011/12. The impact of not inviting these dentists to complete the survey is covered in the report for those years.
- A gradual increase in Scotland from the 2014/15 to 2019/20 surveys, making the response rate in Scotland in 2019/20 the highest since the 2010/11 and 2011/12 survey.
It is important to note that the 2008/09 and 2009/10 survey was the last to use a paper-based questionnaire and that response rates have been lower since then with the introduction of an online collection tool for the 2010/11 and 2011/12 and subsequent surveys. Furthermore, the surveys since 2012/13 and 2013/14 have generally shown an overall reduction in the motivation and morale of dentists in the UK, which may have also contributed to the decline in response rate.
The decreasing response rate in England since 2016/17 and for all other countries in 2022/23 may have been further exacerbated by sending only email invitations to dentists rather than sending hard copy letters.
Representativeness of the Survey Responder Population
To assess whether the composition of the survey responder population is representative of the dental population, the characteristics of the two populations are evaluated in this section.
Please note, unlike the results presented in the main body of the report, the figures in this and the next section (covering Tables C7-C12) are based on dentists who worked for either a full or part-year. Without survey data, it is not possible to accurately define this characteristic for non-responders, hence both cohorts of dentists were used to allow comparisons between the sample and population.
England
Table C7 shows that, overall, the distribution of dentists in 2022/23 was fairly similar for the dental and survey responder population. This can be assessed by comparing the Population (%) and Initial Sample (%) columns to each other, with their difference shown in the final column[1].
There are a few strata with higher levels of over or under representation when compared to others; most notably because younger dentists (<35 years) were less likely to return a survey compared to their older colleagues. However, aside from strata 9 and 13, the strata have percentage point differences of less than 5, suggesting that the population of survey responders is generally representative of the dental population; this helps to mitigate any effects that result from the drop in the response rate. In addition, stratifying the sample to account for the major variables of dental type, gender and age and weighting the average results to the population lessens some of the effects of this variation in the survey response rates.
Table C7: Number and percentage of dentists in each stratum of the dental population and survey responder sample, England, 2022/23
Strata | Type | Gender | Age | Population (Number)[2] | Initial Sample (Number) | Population (%) | Initial Sample (%) | Percentage Point Difference |
1 | Providing-Performer | Male | <35 | 231 | 24 | 1 | 1.2 | 0.2 |
2 | 35-44 | 859 | 82 | 3.6 | 4 | 0.3 | ||
3 | 45-54 | 1,022 | 129 | 4.3 | 6.3 | 1.9 | ||
4 | 55+ | 1,086 | 171 | 4.6 | 8.3 | 3.7 | ||
5 | Female | <35 | 128 | 9 | 0.5 | 0.4 | -0.1 | |
6 | 35-44 | 508 | 40 | 2.2 | 1.9 | -0.2 | ||
7 | 45-54 | 479 | 69 | 2 | 3.3 | 1.3 | ||
8 | 55+ | 273 | 41 | 1.2 | 2 | 0.8 | ||
9 | Associate | Male | <35 | 3,135 | 154 | 13.3 | 7.5 | -5.8 |
10 | 35-44 | 1,969 | 160 | 8.4 | 7.8 | -0.6 | ||
11 | 45-54 | 1,487 | 185 | 6.3 | 9 | 2.7 | ||
12 | 55+ | 1,283 | 169 | 5.4 | 8.2 | 2.7 | ||
13 | Female | <35 | 4,926 | 252 | 20.9 | 12.2 | -8.7 | |
14 | 35-44 | 3,403 | 258 | 14.4 | 12.5 | -1.9 | ||
15 | 45-54 | 2,003 | 221 | 8.5 | 10.7 | 2.2 | ||
16 | 55+ | 764 | 99 | 3.2 | 4.8 | 1.6 | ||
All Dentists | 23,556 | 2,063 |
Northern Ireland, Scotland and Wales
Table C8 shows that overall, the distribution of dentists in Northern Ireland in 2022/23 was similar for the dental and survey responder populations: that is, the proportion of dentists in most of the six strata used for weighting was quite similar based on the ‘Percentage Point Difference’ column. However, the difference column also shows that male dentists in Northern Ireland are more likely to return a survey than their female colleagues (i.e. difference column figures for strata 2 and 3, are both positive, compared to strata 4 to 6).
Table C8: Number and percentage of dentists in each stratum of the dental population and survey responder sample, Northern Ireland, 2022/23
Strata | Gender | Age | Population (Number)[2] | Initial Sample (Number) | Population (%) | Initial Sample (%) | Percentage Point Difference |
1 | Male | <35 | 104 | 9 | 9.1 | 6 | -3.1 |
2 | 35-44 | 121 | 17 | 10.5 | 11.3 | 0.7 | |
3 | 45+ | 233 | 45 | 20.3 | 29.8 | 9.5 | |
4 | Female | <35 | 271 | 29 | 23.6 | 19.2 | -4.4 |
5 | 35-44 | 222 | 28 | 19.4 | 18.5 | -0.8 | |
6 | 45+ | 196 | 23 | 17.1 | 15.2 | -1.9 | |
All Dentists | 1,147 | 151 |
Like Northern Ireland, the data for Scotland presented in Table C9, shows an under-representation of male dentists under 35 years old and over-representation of those 45 and over (i.e. strata 1 and 3). However, unlike Northern Ireland, Table C9 shows also shows a small over-representation of female dentists under 35 years old compared to their male counterparts (i.e. strata 1 and 4). It is difficult to predict what effect this will have on the figures reported, but stratifying the sample to account for the major variables of gender and age and weighting the average results to the population will lessen some of the effects of this variation in the survey response rates.
Table C9: Number and percentage of dentists in each stratum of the dental population and survey responder sample, Scotland, 2022/23
Strata | Gender | Age | Population (Number)[2] | Initial Sample (Number) | Population (%) | Initial Sample (%) | Percentage Point Difference |
1 | Male | <35 | 349 | 18 | 13.2 | 7.7 | -5.5 |
2 | 35-44 | 411 | 32 | 15.6 | 13.7 | -1.9 | |
3 | 45+ | 485 | 59 | 18.4 | 25.3 | 6.9 | |
4 | Female | <35 | 558 | 53 | 21.2 | 22.7 | 1.6 |
5 | 35-44 | 474 | 37 | 18 | 15.9 | -2.1 | |
6 | 45+ | 359 | 34 | 13.6 | 14.6 | 1 | |
All Dentists | 2,636 | 233 |
Table C10 shows the results for dentists in Wales, and like the results in England, there is a small over-representation of older dentists compared to their younger colleagues. Once again, stratifying the sample for gender and age and weighting the average results to the population lessens the effects of this variation.
Strata | Gender | Age | Population (Number)[2] | Initial Sample (Number) | Population (%) | Initial Sample (%) | Percentage Point Difference |
1 | Male | <35 | 202 | 13 | 14.7 | 9.8 | -4.9 |
2 | 35-44 | 195 | 20 | 14.2 | 15 | 0.9 | |
3 | 45+ | 285 | 34 | 20.7 | 25.6 | 4.9 | |
4 | Female | <35 | 294 | 24 | 21.4 | 18 | -3.3 |
5 | 35-44 | 185 | 15 | 13.4 | 11.3 | -2.2 | |
6 | 45+ | 215 | 27 | 15.6 | 20.3 | 4.7 | |
All Dentists | 1,376 | 133 |
[1] The Population (%) column shows how the entire dental workforce is distributed across the strata and the Initial Sample (%) column shows how survey respondents are distributed.
[2] The population in Tables C7-C10 covers all dentists who conducted NHS/Health Service activity in 2022/23, regardless of whether they worked for a full or part-year. For this reason, the total number is higher than the estimated full-year population in Annex B.
Dental Survey Responders Compared to Non-Responders
The representativeness of survey data can also be tested by considering average NHS/Health Service dental activity for those who did and did not participate in the survey. As this variable is held for the entire NHS/Health Service dental population in each country the comparison is straightforward, with the results for 2022/23 shown in the following sections.
England
Table C11: Average units of dental and orthodontic activity by dental type and survey response, England[1], 2008/09 to 2022/23
Year[2] |
Providing-Performer |
Associate |
||||
|
No Survey |
Survey |
Ratio |
No Survey |
Survey |
Ratio |
2008/09 |
4,173 |
4,639 |
0.90 |
3,792 |
4,706 |
0.81 |
2009/10 |
4,202 |
4,605 |
0.91 |
3,820 |
4,891 |
0.78 |
2010/11 |
4,264 |
4,526 |
0.94 |
4,053 |
4,803 |
0.84 |
2011/12 |
4,103 |
4,410 |
0.93 |
3,969 |
4,812 |
0.82 |
2012/13 |
3,815 |
4,352 |
0.88 |
3,764 |
4,634 |
0.81 |
2013/14 |
3,751 |
4,254 |
0.88 |
3,693 |
4,725 |
0.78 |
2014/15 |
3,628 |
4,293 |
0.85 |
3,783 |
4,727 |
0.80 |
2015/16 |
3,445 |
4,185 |
0.82 |
3,726 |
4,516 |
0.83 |
2016/17 |
3,476 |
4,215 |
0.82 |
3,729 |
4,464 |
0.84 |
2017/18 |
1,448 |
1,741 |
0.83 |
1,707 |
1,978 |
0.86 |
2018/19 |
3,499 |
4,271 |
0.82 |
3,548 |
4,123 |
0.86 |
2019/20 |
1,529 |
1,806 |
0.85 |
1,688 |
1,894 |
0.89 |
2022/23 |
3,462 |
4,055 |
0.85 |
3,036 |
3,660 |
0.83 |
[1] Results are based on dentists who worked for either a full or part-year. ‘Ratio’ column shows the ‘No Survey’ activity figure expressed as a ratio of the ‘Survey’ activity figure for each year. 2017/18 and 2019/20 figures are taken from a mid-year dental workforce dataset.
[2]2008/09 to 2017/18 figures are for England and Wales combined.
Table C11 shows that those dentists who returned a valid survey had higher levels of NHS dental activity on average and conducted more NHS dental activity than those who do not respond.
Northern Ireland, Scotland, and Wales
Table C12: Average dental activity by survey response (and per cent difference), Northern Ireland, Scotland and Wales, 2008/09 to 2022/23
Year | Northern Ireland | Scotland | Wales | ||||||
Average Items of Service | Av. Courses of Treatment | Average UDA + UOA | |||||||
No Survey | Survey | Ratio | No Survey | Survey | Ratio | No Survey | Survey | Ratio | |
2008/09 | 2,930 | 3,921 | 0.75 | 1,238 | 1,634 | 0.76 | z | z | z |
2009/10 | 2,858 | 3,938 | 0.73 | 1,139 | 1,670 | 0.68 | z | z | z |
2010/11 | 3,417 | 4,685 | 0.73 | 1,347 | 1,614 | 0.83 | z | z | z |
2011/12 | 3,467 | 4,568 | 0.76 | 1,361 | 1,686 | 0.81 | z | z | z |
2012/13 | 3,047 | 4,199 | 0.73 | 1,423 | 1,629 | 0.87 | z | z | z |
2013/14 | 3,037 | 4,264 | 0.71 | 1,440 | 1,656 | 0.87 | z | z | z |
2014/15 | 3,249 | 4,059 | 0.80 | 1,445 | 1,692 | 0.85 | z | z | z |
2015/16 | 3,534 | 4,391 | 0.80 | 1,433 | 1,741 | 0.82 | z | z | z |
2016/17 | 2,555 | 3,639 | 0.70 | 1,433 | 1,697 | 0.84 | z | z | z |
2017/18 | 1,728 | 2,063 | 0.84 | 1,320 | 1,563 | 0.84 | z | z | z |
2018/19 | 2,941 | 3,686 | 0.80 | 1,461 | 1,694 | 0.86 | 3,318 | 4,187 | 0.79 |
2019/20 | 1,511 | 1,866 | 0.81 | 735 | 864 | 0.85 | 1,544 | 1,846 | 0.84 |
2022/23 | 2,188 | 2,701 | 0.81 | 1,189 | 1,267 | 0.94 | 2,053 | 2,649 | 0.77 |
Note: Results are based on dentists who worked for either a full or part-year. ‘Ratio’ results show the ‘No Survey’ Average Number Courses of Treatment figure expressed as a ratio of the corresponding ‘Survey’ figure for each year. 2022/23 figures are taken from mid-year dental workforce datasets. 2008/09 to 20017/18 Wales results were combined with England as shown in Table C11.
Table C12 shows that those dentists who returned a survey claimed higher levels of NHS/Health Service dental activity, when compared to those who did not return a survey. However, the differences are generally less for the later surveys when compared to earlier ones in Northern Ireland and Scotland.
Once again, it is difficult to predict what effect this will have on the figures. For example, some non-responders may conduct more private work and cover similar total weekly hours compared to those responders showing high levels of NHS activity. This should be acknowledged when looking at the results in the report. Where it has been possible to account for differences in the survey responder population, this has been done by stratifying the sample to account for the major variables of dental and contract type, as well as gender and age; this will lessen some of the effects of variable response rates to the survey.
Last edited: 25 April 2024 9:23 am