Article Text

Download PDFPDF

Original article
Healthcare provider and service user perspectives on STI risk reduction interventions for young people and MSM in the UK
  1. Anupama Roy1,
  2. Carina King2,3,
  3. Richard Gilson2,
  4. Daniel Richardson4,5,
  5. Fiona Burns2,
  6. Alison Rodger2,6,
  7. Laura Clark4,
  8. Alec Miners7,
  9. Alex Pollard1,
  10. Sarika Desai8,
  11. Julia Bailey9,
  12. Maryam Shahmanesh2,
  13. Carrie Llewellyn1
  1. 1 Department of Primary Care & Public Health, Brighton & Sussex Medical School, Brighton, UK
  2. 2 Institute for Global Health, University College London, London, UK
  3. 3 Department of Public Health Sciences, Karolinska Institutet, Stockholm, Sweden
  4. 4 Sexual Health & HIV, Brighton & Sussex University NHS Trust, Brighton, UK
  5. 5 Sexual Health & HIV Medicine, Brighton & Sussex Medical School, Brighton, UK
  6. 6 Infection & Population Health, University College London, London, UK
  7. 7 Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
  8. 8 Blood Safety, Hepatitis, Sexually Transmitted Infections (STI) and HIV Service, National Infection Service, Public Health England, London, UK
  9. 9 Primary Care & Population Health, University College London, London, UK
  1. Correspondence to Dr Carina King, Institute for Global Health, University College London, London WC1E 6BT, UK; c.king{at}ucl.ac.uk

Abstract

Objective Behavioural interventions have been shown to reduce sexual behaviours associated with increased risk of sexually transmitted infections in young people (<25 years) and men who have sex with men (MSM) internationally, but evidence from England is limited. We aimed to explore service provider and user experiences and perspectives on behavioural interventions to reduce sexual behaviour risks, and the use of automated methods to triage individuals to these services.

Methods We conducted a sequential mixed methods study with sexual health service providers and users in 2015/2016. Qualitative interviews with providers and service users (heterosexual young people and MSM) in London and Brighton allowed us to explore a range of experiences and expectations. A subsequent national web-survey of service providers measured the feasibility of delivery within existing resources and preferences for intervention attributes.

Results We conducted 35 service user (15 heterosexual young people; 20 MSM) and 26 provider interviews and had 100 web-survey responses. We found considerable heterogeneity in prevention services offered. Service users and providers were broadly supportive of tailoring interventions offered, but service users raised concerns about automated, data-driven triage, particularly around equity and fairness of service delivery. Digital technologies, including social media or apps, were appealing to providers, being less resource intensive. However, one-to-one talking interventions remained popular with both service users and providers, being familiar, trustworthy and personal. Key tensions between desirability of interventions and availability of resources to deliver them were acknowledged/recognised by providers and users.

Conclusion Overall, behavioural interventions to reduce sexual behaviour risks were viewed favourably by service providers and users, with key considerations including: privacy, personalisation and convenience. However, introducing desirable targeted interventions within heterogeneous sexual health settings will require resources to adapt interventions and research to fully understand the barriers and facilitators to use within routine services.

  • STI
  • young people
  • MSM
  • risk reduction
  • intervention

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

View Full Text

Statistics from Altmetric.com

Introduction

Sexually transmitted infections (STIs) continue to impose a significant burden on health and health systems in England, with cases of syphilis and gonorrhoea increasing 20% and 22% respectively in 2017.1 This is particularly the case in young people (defined as <25 years) and men who have sex with men (MSM).1 Behavioural interventions can modify behaviours such as increasing condom use and STI testing, with some showing modest impacts on STI diagnosis rates.2–4 The UK National Survey of Sexual Attitudes and Lifestyles (NATSAL) found that a large proportion of individuals reporting sexual behaviours associated with increased risk of STI acquisition had attended sexual health clinics (SHC).5 Thus, SHCs provide an opportunity to offer effective targeted behavioural interventions, such as one-to-one counselling,6 7 directing patients to digital interventions or by displaying informational videos in waiting areas.8 9 However, a systematic review from 2014 of brief behavioural interventions involving young people or MSM found only three effective trialled interventions from the UK, none of which targeted MSM, highlighting the need for intervention adaptation prior to implementation.2

The rational targeting of interventions to those most at need may be key to demonstrating cost-effectiveness at scale. There has been a growing recognition of the potential to harness ‘big data’ for more efficient and effective targeting of health promotion.10 This is particularly important in sexual health, in a period of considerable budget restrictions.11 Exploiting routine sexual health data12 could provide a mechanism to triage service users into tailored health promotion interventions.

However, there is uncertainty about which evidence-based interventions could be adapted to the English setting and how to target these. The Medical Research Council (MRC) framework for complex behavioural interventions recommends formative research and pilot studies to iteratively adapt and develop context appropriate interventions.13 This paper presents the first step in this process, with the aim of exploring sexual health service provider and user perspectives on opportunities and challenges to implementing targeted, evidence-based behavioural interventions, including the use of an automated triage method.

Methods

We conducted a sequential mixed qualitative and quantitative study with healthcare providers and service users in England between July 2015 and July 2016, as part of a larger feasibility study (Santé Project; ISRCTN16738765).14

Design

Face to face semi-structured interviews with service users and telephone semi-structured interviews with healthcare providers were conducted to explore users’ and providers’ experiences and expectations of risk-reduction interventions. This was followed by a quantitative web-survey of all SHCs in England, to explore barriers and facilitators to intervention and triage implementation in clinics. A concurrent discrete choice experiment questionnaire administered to service users (this has been published elsewhere) was conducted to explore service user preferences of intervention attributes.15 The qualitative interviews informed the design of the quantitative tools (eg, multiple choice responses for intervention barriers and intervention attributes), to quantify opinions on preferences and feasibility of intervention delivery.

Population

For the qualitative interviews, service users were purposively recruited from two clinics in London and Brighton, with a minimum target of 15 MSM aged 16 and above and 15 heterosexuals aged 16–25 years old. The groups were stratified by age and for young people, also by gender. Participants were approached in the SHCs by research staff and provided with study information. Participants were offered a £20 voucher for taking part, and interviews were either scheduled for the same day or another mutually convenient time.

We aimed to recruit 30 service providers across England, including service leads, health advisors, doctors and nurses. Six clinics were purposively recruited, to include particular patient populations or known experience of interventions. The remaining SHC were stratified by geography, patient mix, clinic size and services provided and selected using simple random sampling. The clinic list was derived from those submitting Genitourinary Medicine Clinic Activity Data (GUMCAD) to Public Health England (PHE) in 2014. Participants from clinics run by Brook, a sexual health charity, were offered a £20 voucher for participation.

Qualitative interviews

Following written informed consent, service users completed a brief demographic questionnaire. Interviews were conducted in person, in a private room within the SHC. The interviews covered their experience of attending a SHC, their own risk perceptions and the triaging of services within this context and acceptability of different formats of sexual risk-reduction behavioural interventions (online supplementary file S1). Interviews specifically explored users’ view of videos in clinic waiting rooms, websites and mobile phone apps, peer group sessions and individual sessions with a healthcare provider (HCP) (including single or multiple sessions). These behavioural interventions were identified from a systematic literature review.2

Healthcare providers were invited by email to participate in interviews. Up to three invitations were sent before classifying the individual as non-responsive and a new service randomly sampled. Following a positive response, we sent the full study information sheet and arranged a time for a telephone interview. The interviews covered services currently offered by their clinic, their opinions on triaging and targeting services using automated methods and the feasibility of delivering different behavioural interventions in their setting (online supplementary file S2).

Interviews took approximately 30 min. All interviews were audio-recorded, then transcribed verbatim by an external medical transcription service and any identifying information removed. The interviewers were all female (Anupama Roy (AR), Carina King(CK) and Sarika Desai (SD)) and had received training on conducting qualitative interviews and analysis, including mock interviews with members of the Santé Patient Public Involvement group and Project Management Team, which included clinicians working in SHC.

Web survey

For the survey, a list of SHC in England who submitted data to PHE through GUMCAD in 2014 was used. Email contacts were collated from service websites, GUMCAD contacts and a previously collated list.16 Clinics were invited to participate in the web-survey by email, with up to three emails sent in the first round of recruitment (November–December 2015). A second round was sent in March 2016, using individually addressed emails to service leads. A third round of recruitment was completed in June 2016 through leaflets and posters advertising the web-survey at the 2016 BASHH conference.

Prior to distribution, the survey was piloted by three clinical researchers. The web-survey was delivered using Opinio and did not include collection of any identifiable information about the respondent; providing the clinic name was optional. The first page of the web-survey included study information, and consent was implied by participation. The survey used multiple choice questions (with a space for additional free text comments) and branching logic, depending on the respondents’ responses. Answering all possible questions took approximately 12 min. Questions covered the following topics: current triage approaches; perception of automated triage; electronic patient record (EPR) system; behavioural interventions currently or previously offered; perceptions of behavioural interventions not offered.

Analysis

Qualitative data were analysed thematically using a framework approach.17 Transcripts were independently reviewed and coded by CK and AR. Codes were based on predetermined questions and emergent themes were identified during the coding process and prospectively applied to subsequent transcripts. Coding was conducted separately for the service user and provider interviews. Following independent coding, the researchers discussed the interpretation for service users and providers together through a face to face meeting, triangulating common themes and exploring discrepancies. The interpretation was shared with the wider study team and then revised through discussion to reach consensus.

Survey data were described using proportions for binary and categorical data and means and medians for continuous data. Data were stratified by service type (Level-3 vs Level-2 and Level-1). Level-3 services offer complete STI testing and treatment services; Level-1 and Level-2 services offer a more limited testing and treatment service, excluding complex symptomatic cases.

Ethics

Ethical review was conducted by Westminster National Research Ethics Committee (15/LO/0690) and the University College London Research Ethics Committee (14/0835).

Results

We conducted 35 service user and 26 provider interviews (table 1). There were 100 web-survey responses representing 145 clinical services (response rate: 145/570, 25%), with 80% from Level-3 services (table 2), representing a higher response rate than from Level-2 and Level-1 services (31% vs 7%). Findings were combined and presented under the following headings: experiences and perceptions of triage; experience and perceptions of interventions. We did not find any consistent differences in perceptions of triage or intervention types between young people and MSM, although there was divergence in digital intervention preferences between older and younger respondents.

Table 1

Service provider and service user interview participants

Table 2

Description of web-survey respondent services and current intervention and triage approaches reported by Level-2 and Level-3 services in England

Perceptions and experiences of triage

From the survey, 77% of respondents reported currently operating a triage system. Clinics reported a range of approaches to triaging into health promotion interventions and different clinical pathways. The most common was a combination of proforma plus provider judgement (50%), with one Level-3 clinic reporting using an algorithm (table 2). Healthcare providers gave varied examples of triage rules, for example, ‘MSM with greater than X number of partners’ (Participant 1, Doctor, Level-3). One interview respondent reported using an electronic triaging system; however, standardised systems were not the norm: ‘We have sort of GUM guidelines, departmental guidelines, but it's down to the individual doctor or nurse seeing the patient to decide whether someone should see the health adviser’ (Participant 4, Doctor, Level-3). Interestingly, no service users perceived being triaged during their clinical visit.

We presented the concept of automated data-driven triage, using patients’ routine electronic data to predict their STI risk. This was widely seen by providers as something which was already done implicitly, resulting in some respondents questioning the utility and resource implications: ‘if anything was going to be developed that had a chance of being used it would have to not increase the length of time… you know, it shouldn’t interfere with the flow of patients’ (Participant 10, Doctor, Level-3). Others thought it was acceptable: ‘I think that would work because we do triage forms which give us a little bit of a clue’ (Participant 19, Health Advisor, Level-3).

Service users presented mixed views on triage. On the positive side, the process of having a score could potentially act as an intervention: ‘it’s something that people might not like, but you, kind of have to know, it’s better to know’ (Female, 23 years, Brighton). A key factor in accepting this approach was service user trust of healthcare providers knowing best: ‘you’re a registered healthcare professional, so I trust your reasoning’ (Heterosexual male, 18 years, Brighton). This also predicated on the triage being well-explained (ie, no ‘technical jargon’). Conversely, while acknowledging awareness of being ‘high-risk’ as useful, not all would be receptive: ‘I wouldn’t consider changing my behaviour actually, I would just see it as, yes, a warning’ (MSM, 22 years, London). Similarly, some felt it would be redundant, telling them something they already ‘know’: ‘either way I'm going to get tested, so I don’t know why they tell people really’ (Female, 23 years, London). An MSM participant highlighted the potential for feeling pigeon-holed for being from a certain demographic: ‘with gay culture being so sleazy you just sort of expect to be high risk all the time’ (MSM, 23 years, London).

Many service users expressed concerns about restricting access to interventions, but were conscious of the potential need for this due to resource limitations. Barriers to the success of automated triage from the provider’s perspective included time, resources, score reliability, training requirements and issues in adapting EPR systems. In the web-survey, four services reported being unable to amend their EPR system (table 2). On the other hand, standardisation, benefits of accurate prediction and patient acceptability were highlighted as opportunities.

Perceptions and experiences of behavioural interventions

Videos in waiting rooms

Mixed views were expressed by service providers and users on educational videos in SHC waiting rooms. For providers, the ease of broadcasting a message to a captive audience was the primary motivation reported in support of this intervention in the web-survey (table 3), although very few services reported currently or ever displaying videos (table 2). An important issue raised was the lack of targeting and appropriateness for clinics catering for diverse populations: we have a very heterogeneous waiting room for the walk-in clinic, you know. The challenge, I guess, would be how you target that, or do you have a number of different ones for different risk groups (Participant 7, Doctor, Level-3). This was echoed by service users who felt videos could make people feel awkward in mixed waiting rooms or increase anxiety. Service users expressed the view that education was generally positive good idea, and SHCs were the correct setting for sexual health education: ‘Why not?’ Information is a good thing. It’s a sexual clinic, so that’s why people are there, to talk about sex’ (MSM, 46 years, London). However, the content of videos was contested, with some desire for ‘shock tactics’, while most respondents suggested content should focus on statistics, text information and short advertisement or campaign style clips.

Table 3

Desirable interventions and their perceived benefits and current barriers to implementation in Level-2 and Level-3 sexual health services in England—responses to a national web-survey

Online and digital interventions (including ‘apps’)

Among web-survey respondents, only 15% reported offering referrals to apps or webpages (table 3). However, service users commonly reported searching the internet for sexual health information, being convenient and easily accessible; this was echoed by providers: We have quite an IT-savvy patient group, I would say, so something like that might appeal.’ (Participant 14, Health Advisor, Level-3). However, the ‘Google effect’ was apparent among service users: ‘you can go from headache to brain tumour in 2 minutes’ (MSM, 21 years, Brighton), highlighting the need for reliable and trustworthy online resources, such as NHS branded content.

Respondents expressed divergent views on their preferred digital intervention format, that is, websites, apps or social media. For services users, concerns about apps in particular came from younger respondents, with phones being a social rather than private possession: ‘people use my phone, so they would know my business’ (Female, 20 years, Brighton). In addition, apps were considered somewhat redundant if there was a website: ‘most information I can find it online, I don’t need an app just for that […] it’s not like you need to check it every day’ (MSM, 24 years, London). Integration into a more general health app or one that could book appointments was considered convenient. This contrasts with the enthusiasm that service providers expressed: Yeah, well, they love apps. I mean we suggest apps. I’m quite an elderly nurse now but even I know to suggest an app (Participant 16, Nurse, Level-2).

Use of social media for digital interventions raised concerns over anonymity, although not unanimously, with some MSM reporting they had ‘followed’ social media pages about sexual health. More specifically, apps and websites targeted at MSM such as Grindr were suggested as convenient for sexual health information. However, from the provider’s perspective the lack of perceived patient motivation was a barrier for uptake: There’s so much else to distract them on the internet, but unless it’s something they enjoy doing, the learning is not going to happen unless it’s couched in a very user-friendly, quick, vehicle’ (Participant 11, Doctor, Level 3). Moreover, as the web-survey suggests, the need for resources to develop and maintain this intervention type was a key barrier (table 3).

One-to-one interventions

One-to-one sessions with a clinical service provider (either in person or by phone), including motivational interviewing over multiple sessions, are offered by 67% of services, second only to providing leaflets (80%) (table 2). However, providers highlighted considerable challenges with offering one-to-one counselling, including lack of evidence and resourcing: ‘Commissioners, I think, will not fund anything that hasn’t been shown to be effective. And so I think you’ll have to demonstrate in some way that it is effective and not just that it’s acceptable’ (Participant 10, Doctor, Level-3).

Service providers were concerned about the amount of trained staff time needed to deliver one-to-one sessions; this was particularly pertinent to interventions involving more than one session (we’ve never had capacity to do that Participant 5, Health Advisor, Level-3). Despite these concerns, many providers felt that brief sessions were effective, even if this was hard to demonstrate: Yes I know that's probably not the most cost efficient. But I think that’s probably the most effective method of risk reduction, because it is tailored to the actual patient’s needs and you have time to explore what their risk is (Participant 21, Health Advisor, Level-3).

From the web-survey, of SHCs offering one-to-one sessions, half reported referring <10% of patients, but two clinics (3%) referred more than 50% of their patients to one-to-one sessions. Nearly a quarter (24%) of clinics felt they had capacity to refer more, while 41% reported being over capacity. Of clinics that reported no longer offering a particular intervention (n=20), a lack of funding and staff time was given as the reason in all but three instances, with poor patient uptake (groups), lack of impact (video) and lack of materials (video) as the other reasons. Overwhelmingly the funding for one-to-one sessions (92%) came from core service budgets, while video, app and online interventions either cost nothing (eg, existing NHS webpages) or were funded through research grants or charity initiatives.

The key benefits of one-to-one sessions, namely tailoring content to an individual patient and perceived privacy were highlighted by service users, with human interaction being key: ‘the thing about, you know, chatting to a human is, they're receptive’ (MSM, 20 years, London). Having the space and opportunity to ask questions was also seen as important, but service user expectations for sessions were linked to their trust of the healthcare providers who made referrals or delivered sessions.

Group interventions

On the whole, group interventions conducted within SHCs were not well received by providers or service users (eg, I think that’s a non-starter’—Participant 18, Health Advisor, Level-3). Concerns centred around privacy and not wanting to share personal, and potentially embarrassing, information with a group: ‘you share funny stories with your friends, and I do talk about sex quite a lot with my friends, but not about this part’ (Female, 22 years, London). This partly stemmed from a perception that the content might not be immediately relatable to them or participants would be judged by other service users. Despite these concerns, 12% (n=12) of web-survey responses reported currently offering group sessions, and six additional clinics reported previously offering this intervention.

Discussion

We conducted a mixed-methods evaluation of the desirability and acceptability of targeted evidence-based behavioural interventions in routine SHCs in England, to inform the feasibility of testing their effectiveness in these settings. We found that current SHC provision is heterogeneous, with both ad-hoc triage and a wide variety of interventions offered, suggesting that adaptation of existing evidence-based interventions may face challenges with standardisation. While service users and providers were broadly in support of tailored interventions, there were concerns about automated data-driven triage. We found that modern technologies (eg, apps) for health promotion were appealing for several reasons, such as requiring fewer clinic resources, but there were concerns with privacy and engagement. One-to-one sessions with health advisors were popular, being both familiar to service providers and offering personalised advice and privacy to service users.

In the UK, the National Institute for Health and Care Excellence (NICE) currently recommends that one-to-one interventions for high-risk individuals are provided in SHC to support sexual risk reduction and behaviour change.18 Despite this, we found that while many clinics offer one-to-one sessions, this was not universal and the methods used to target these to individuals with high-risk sexual behaviours were inconsistent. The capacity to deliver one-to-one sessions varied, compromising the ability to standardise the targeted delivery of interventions. Initiatives to move sexual health service provision online19–21 could provide an opportunity for standardisation and links to digital resources. Using self-reported data on recent sexual behaviours, service users could be directed to different interventions, including postal self-testing, or face-to-face appointments in a SHC. Service user self-triage has been shown to be feasible and reliable in other settings.22

Moves towards digitalisation of sexual health services need to recognise the tensions we observed between the convenience of digital innovations vs the familiarity and perceived privacy associated with one-to-one interventions conducted in person. In this study, providers expressed more enthusiasm for digital innovation than service users, who highlighted the importance of a more holistic approach to the individual (‘personal touch’). This was echoed in a discrete choice experiment where, on average, service users had a preference for one-to-one talking interventions with clinical staff, rather than digital and group interventions.15 Central to this is the need for interventions to be personal, private and trustworthy, which can be achieved but many digital interventions currently do not fulfil.4 23 Importantly, these factors seemed to outweigh convenience which previous studies have highlighted.24 25 Among young people in the 2010 NATSAL survey, the internet was only reported as a source of sexual health information by 29% of men and 14% of women;26 however, we found all service users reported accessing the internet for sexual health information. With the drive for technology-based solutions to improve healthcare service efficiency,27 careful evaluation will be needed to ensure that this does not impact negatively on engagement with services, especially among higher risk individuals.

Several tensions and contradictions were apparent between the priorities of service users and providers, in an era of limited resources. Service user concerns with automated triaging revolved around being denied services, while providers were concerned with the practicalities of implementation and accuracy of a data-driven approach. There has been a shift in policy towards harnessing ‘big data’ in health promotion;28 however, previous research found that use of algorithms may face resistance from service providers if they are not transparent.29 While in principle, service users understood the issues around limited resources and providers already routinely tailor patient pathways, data-driven approaches need to be transparent and accurate to be trusted. BASHH guidelines recommend key variables for triaging patients,30 which correspond to those reported in the web-survey, and may therefore be a sensible basis for generating algorithms. However, whether these can be implemented with existing EPR systems and perform with the same sensitivity and specificity across clinical settings is uncertain.31

A key strength of this study was the theoretical basis for our approach, following the MRC recommendation for developing and evaluating complex interventions.13 The qualitative interviews were based on evidence from a systematic literature review, to identify brief interventions that have shown effectiveness at either increasing STI testing, reducing risky sexual behaviours or reducing STI diagnoses.2 Using mixed methods with both service providers and users, allowed us to triangulate and explore tensions around desirability and acceptability; however, there are limitations. First, the low response rate for the provider web-survey. We encountered several issues in sending the web-survey to all SHCs in England in the absence of any current central register of contacts. This was particularly an issue for services tendered by local authorities to private providers. Additionally, Level-3 services were more likely to respond than Level-1 and Level-2 services; therefore, the data are biased towards clinics offering more comprehensive services. Second, service users were only recruited from two clinics, both large Level-3 services located in southern England and may therefore not reflect the full diversity of service users across England. Third, Level-2 providers were under-represented in interviews, and we were unable to recruit our initial target. The interviews were all conducted by three female researchers, which may have influenced responses, particularly among MSM or heterosexual men. We conducted pilot interviews to ensure our language and interview approach was acceptable to all respondents to mitigate this potential bias.

We saw variation in services offered, but similar preferences and concerns raised by providers and service users, focusing on privacy, accessibility, convenience and personalisation to individual needs, all of which need to be balanced with resource availability. Overall, one-to-one sessions were closest to meeting these needs. However, it is important to note that the quality and content of one-to-one sessions, including fidelity to motivational interviewing approaches, needs to be rigorously evaluated to determine effectiveness at scale. There was a lack of agreement between service users and providers on the role and scope of online and digital interventions and hesitation around the role of automated triage. As sexual health service cuts continue to restrict the scope of face to face services11 and incorporate digital pathways, resolving this contradiction is crucial to planning service implementation and ongoing monitoring. Using the MRC framework for complex interventions, the next step is to adapt the potentially acceptable targeted one-to-one and digital interventions and pilot this with routine care settings, to assess feasibility prior to conducting a large-scale trial.

Key messages

  • Behavioural interventions to reduce high risk sexual behaviours exist, but there is an evidence gap regarding their appropriateness for routine sexual health services in England.

  • Data-driven triage, while generally acceptable, raised concerns regarding restricting access to services, accuracy of the tool and practicalities of use within electronic patient record systems.

  • Behavioural interventions to reduce high risk sexual behaviours were seen favourably by both service providers and users, with key considerations including privacy, personalisation and convenience.

  • There is considerable heterogeneity in behavioural interventions offered, resources available and the way service users are triaged in sexual health services in England.

Acknowledgments

We would like to thank all the healthcare providers who contributed their time during the interviews and in responding to the web-survey. We would like to acknowledge Tom Nadarzynski (Brighton and Sussex Medical School) and Public Health England for providing lists of clinic contacts and Jack Brophy (University College London) for administrative support in managing the web-survey. We would like to thank all the service users who contributed their time and experiences for the interviews.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
View Abstract

Footnotes

  • Handling editor Claudia S Estcourt

  • Contributors The study was designed by RG, MS, CL, CK and AR, with input from all authors. Recruitment and interviews of service providers and users were conducted by AR, CK and SD and analysis of interviews was conducted by AR and CK. The web-survey was managed by CK and communications managed by RG and CK. The analysis of the web-survey was conducted by CK. The manuscript was written by AR and CK, with considerable input from MS and CL. All authors read and commented on the manuscript.

  • Funding This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme (12/191/05).

  • Competing interests None declared.

  • Patient consent for publication Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data availability statement All data relevant to the study are included in the article or uploaded as supplementary information.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.