Article Text

PDF

Measuring patient satisfaction in sexually transmitted infection clinics: a systematic review
  1. R Weston,
  2. R Dabis,
  3. J D C Ross
  1. 1
    Whittall Street Clinic, Birmingham, UK
  1. Correspondence to Professor J D C Ross, Whittall Street Clinic, Whittall Street, Birmingham B4 6DH, UK; jonathan.ross{at}hobtpct.nhs.uk

Abstract

Objectives: Measuring patient satisfaction is an important aspect of making services attractive to patients and improving service delivery, and outpatient-based clinics are increasingly assessing service quality using patient-based outcome measures. No systematic review of patient satisfaction in sexually transmitted infection clinics has previously been performed. The objectives of the review were: (1) to establish how patient satisfaction with sexual health services has been defined and measured; (2) to identify whether a “gold standard” method exists; and (3) to identify the themes regarded by patients as priorities for delivering a quality service within a sexually transmitted infection clinic setting.

Methods: A search of eight electronic journal databases and unpublished data sources was used to identify studies measuring patient satisfaction in a sexually transmitted infection clinic setting. Following initial review of each abstract, data from eligible studies were extracted by two independent reviewers and content analysis used to identify common themes.

Results: Eighteen questionnaire-based studies, nine semistructured interviews and four other studies, including three focus groups, fulfilled the selection criteria for inclusion. Three studies incorporated more than one method of analysis. No common validated method of assessing patient satisfaction was identified. Themes reported to be of greatest importance were the convenience of clinic location, availability of appointments, staff attitude to patients, effective provision of information and maintenance of confidentiality.

Conclusions: This review has identified the need for a validated and standardised approach to assess patient satisfaction in sexually transmitted infection clinics. Comparing studies which have measured satisfaction, clear themes for the provision of a high quality service, from a patient perspective, have emerged. These themes should be incorporated into assessment tools, such as questionnaires, when reviewing service delivery.

View Full Text

Statistics from Altmetric.com

Improving sexual health was one of the top six priorities for the UK National Health Service in 2006/2007,1 but on review of a pilot improvement scheme, fewer than half of those commissioning services regularly consulted with patients on the quality of sexual health services.1 Ensuring patients are satisfied with their experience of sexually transmitted infection clinics has the potential to increase appropriate use of services, improve compliance with treatment and benefit the relationship between the patient and the service provider. Satisfaction with a healthcare service is dependent on patient expectation and experience, and can be used as a patient-based outcome measure in evaluating the quality of clinical care.

Traditionally quantitative surveys, and specifically questionnaires, have been used to record patient experiences in sexually transmitted infection clinics. Focus groups and semistructured individual interviews are used less frequently but can gain a more in-depth view of patients’ experiences. Assessment is generally done within the clinic setting, and it remains a challenge to gain the views of people who have a clinical need but fail to access services.

No systematic review of patient satisfaction in sexually transmitted infection (STI) clinics has previously been published. The systematic analysis of relevant qualitative and quantitative studies can be used to identify best practice in measuring patient satisfaction and to develop new assessment tools based on the identified patient priorities.

The objectives of this review were:

  • to establish how patient satisfaction with sexual health services has previously been defined and measured;

  • to identify whether a “gold standard” method exists. A “gold standard” measure of patient satisfaction was defined as having appropriately assessed and reported:

    • reliability (are the results reproducible and consistent);

    • validity (has an assessment been made of what patients consider to be important measures of quality and are they accurately evaluated);

    • acceptability;

    • feasibility;

  • to identify the themes regarded by patients as priorities for delivering a high-quality service within a STI clinic setting.

Methods

Search strategy

A search strategy was developed with the inclusion of a methodology filter to identify all relevant literature (the full search strategy is provided in web appendix 1). Databases were searched as follows: AMED 1985 to date, BNID 1994 to date, CINAHL 1982 to date, DHData 1983 to date, EMBASE 1974 to date, Kings Fund 1979 to date, Medline 1950 to date, PsycINFO 1806 to date and the Cochrane library. Searches were performed between April and May 2008. The National Research Register was searched for unpublished and ongoing research, and further research was sought in conference paper indices and NHS health technology assessments. Authors identified were contacted for supporting information.

Study types

The studies identified included quantitative (questionnaires and surveys) and qualitative methodologies (focus groups and semistructured interviews). Editorials and opinions of single individuals were excluded.

Participant types

The populations included were patients seeking care from any clinical setting offering dedicated STI testing. Only healthcare services free at the point of delivery were included in the review. Any healthcare provision requiring payment or where a UK standard of care was not available (defined as healthcare provision in a lower than middle-income country as defined by the World Bank) were excluded as not being generalisable to a UK-based population. Studies looking at views of service providers, or predominantly based on the opinions of potential (rather than actual) service users, were also excluded. Eligibility criteria are described in more detail in web appendix 2.

Exposure types

Studies were included that assessed the views of users of STI testing services. Studies from clinics providing only contraception services were excluded, as were services delivered within an alternative specialist clinic, except where a dedicated STI testing service was also available. Evaluations of sex education programmes or interventions focused on medical education were excluded.

Outcome types

Any technique used to assess patient satisfaction was included. No language restriction was applied, and unpublished data were sought. Articles reporting satisfaction as a secondary outcome were excluded if they only evaluated a single aspect of service provision.

Quality of studies

Although the use of quality criteria in qualitative studies is difficult to interpret, quality assessments were used for both qualitative and questionnaire-based studies. For questionnaires, a critical appraisal checklist of 21 items was used,2 and for qualitative research, the Critical Appraisal Skills Programme criteria3 incorporating 27 items were adopted. A quality assessment checklist was created by the review team and applied to each study to record a numerical value (web appendix 3). To reflect the subjectivity of qualitative data, the numerical value was replaced by a rating score: “++” indicating greater than 10 points on the checklist, and “+” less than 10.

Data extraction

A data-extraction proforma was drafted, reviewed, piloted and refined by the review team (web appendix 4). Two reviewers independently extracted data from the articles, and any disagreements were resolved following discussion.

Data synthesis

Articles were subdivided according to study methodology and summarised using thematic headings, which emerged during content analysis.

Results

A total of 122 articles were selected by title. Sixty-eight articles were excluded after abstract review, and a further 26 articles were excluded after full text review. The 28 remaining articles were included for data extraction, and references from these were reviewed for further relevant studies, but no additional articles were identified. Of the 28 articles, 18 were questionnaire-based, nine utilised semistructured interviews, three were focus-group studies, and one study used professional patients (three studies used more than one methodology).

Questionnaire-based studies

Study design

Sixteen of the questionnaire studies were UK-based, one study surveyed the patients attending STI clinics in Bulawayo, Zimbabwe,4 and one study was based in Baltimore, USA,5 both supplying free access to healthcare (table 1). Surveys were predominantly performed in a dedicated STI clinic setting, although one study delivered the questionnaire to clients in a youth club clinic.6

Table 1

Comparison of questionnaire-based studies

The size and duration of the studies varied greatly, with the largest including 2636 patients from 12 different clinics.7 Kinn et al repeated their survey after 12 months,8 and Opaneye collated 200 responses each year over a period of 2 years.9

Three studies used a verbal format to deliver the questionnaire in an interview setting.4 5 10 Response rates were recorded in all but five studies9 11 12 13 14 and ranged from 8% to 100% (table 1).

Study quality

A validation process was described in five studies,5 8 11 14 15 with three of these adapting pre-existing questionnaires, but no study used a comprehensive approach to questionnaire design incorporating patient input, and an assessment of validity, acceptability, feasibility and reliability.

Outcomes

The predominant themes incorporated into the questionnaires were convenience of attending the clinic, staff attitudes, patient confidentiality and appropriate provision of information (table 2). Issues of convenience included location of the clinic, “no longer in a convenient location” being cited as a reason to leave the service.13 Melville reported that 39% of people questioned “felt that the service should be within 6–10 miles of their home.”

Table 2

Themes of questionnaire-based studies

High levels of satisfaction with staff were reported ranging from 80 to 99%. Specific issues raised included a preference for same-sex staff16 and dissatisfaction with a threatening or unfriendly atmosphere.4

Eleven studies included questions regarding confidentiality. Confidentiality and anonymity were “judged to be essential to the service.”13 Forty to 56% preferred to be called by number rather than by name.16 17 The clinic waiting area was identified as potentially problematic for maintaining confidentiality,10 but most patients were comfortable discussing sexual health topics during their consultation.6 11

All studies assessing overall satisfaction rated this as high. Potential recommendation to a friend was used as one measure of satisfaction.4 6 7

Semistructured interviews

Design

In nine studies, semistructured interviews were performed by a researcher on a one-to-one basis to identify emerging themes. Seven studies were UK-based, and two were administered in South African clinics.22 23

The populations studied using a semistructured interview technique were from STI clinics, a youth-club-based clinic,6 a city-centre pharmacy clinic24 and an Accident and Emergency-based clinic.25 The number of patients interviewed ranged from 1023 to 76.26

Quality

Seven of the nine interview studies scored highly on the quality-assessment measure.

Outcomes

Themes identified by patient interviews were similar to those explored in the questionnaire-based surveys (table 3).

Table 3

Interview analysis

Location was a major factor that motivated sex workers to use one clinic.23 Opening hours were raised as a significant issue, with clients expressing dissatisfaction with limited evening opening27 and finding it difficult to take time off work to attend the clinic.25 None of the studies concluded that waiting time within the clinic was a significant issue.

The interviewees reported high satisfaction with staff attitudes towards patients. Evans stated that the key to users’ experiences was their perception as to whether they had been treated with respect and in a non-judgemental manner.27 In the more informal settings that were evaluated, the patients suggested that the standard of care and professionalism of staff were not compromised by informality.24

Confidentiality was raised as an issue in five studies.6 21 24 26 27 All highlighted the need for a confidential service, and the reception area and waiting room were areas of potential concern.26

In the semistructured interviews, more clients raised stigma as a potential problem. Patients felt uncomfortable when attending a sexual health service, and some would have liked more emotional support.26 High levels of satisfaction were reported using a more informal approach in an outreach clinic.21

Overall high levels of satisfaction with services were reported from studies using a semistructured interview approach.27

Focus groups

Design

Three studies used focus groups to assess patient experiences within a service. The first was performed in the UK and included 93 service users of STI clinics and family planning clinics in 13 focus groups.29 The second was a small study including 15 participants in Alabama, USA30 with free healthcare at the point of access. A third focus-group study was performed in conjunction with one-to-one interviews specifically aimed at female sex workers in South Africa.23

Quality

Using the quality-assessment checklist, two of the focus-group studies scored highly, indicating a good understanding of the methodology and relevance of this approach.29 30

Outcomes

Staff attitudes remained an important issue from a user’s perspective.29 Criticisms identified in the Alabama study were men’s dislike of the front desk employees and the perceived gossipy nature of the clinic.30

The importance of efficient clinic infrastructure was noted in the Baraitser study, and providing entertainment within the clinic was suggested as a way of passing the time and also reducing anxiety.29 The focus groups held in the UK concluded that the issues identified as important to young people were similar to those for older users,29 namely confidentiality in the reception area, waiting times, staff attitude and provision of information.29

Other methodologies

One study used professional patients to assess patient satisfaction.31 Forty professional patients participated in 105 visits to STI clinics over a 9-month period.31 All staff within the clinics were aware that the study was taking place but were not aware of the patients’ identity. Each professional patient was paid a fee for their time. The issues raised generally mirrored those identified using other assessment methods. However, half had difficulty finding the clinic, and there was a generally poor perception of both the reception and waiting facilities. Also, overall satisfaction scoring was lower than that seen using questionnaires or interviews with “fewer than half” reporting satisfaction with the service.

Discussion

Predominantly, three methods were found to have been used to assess patient experiences at STI clinics. Questionnaires were the most common approach, with fewer researchers reporting results from qualitative studies in the form of focus groups or interviews. An additional option, used in a single study, was to evaluate services using “professional patients.”

Questionnaire-based studies

Questionnaires can be a useful way to measure satisfaction, allowing a large number of patients to be included, and potentially providing a widely representative view. Careful design is important to ensure clarity, relevance, feasibility and validity. The reliability of results is dependent on good response and completion rates, and the design process needs to include patient input and assessment to ensure that the questions are acceptable and appropriate.

The majority of questionnaire studies identified were self-completed by participants with verbal interviews as an alternative4 5 10 Although verbal delivery can improve participation and completion rates, participants may give less honest feedback if a researcher is present while completing a survey. Selection bias can also occur through the increased participation of either those who are particularly dissatisfied with a service or those who are highly satisfied.

Piloting of a questionnaire helps to refine its content and layout. Pilots were described in only four studies.8 11 14 15 The national NHS outpatient survey is widely used, but it has not been validated in a STI clinic population.32 Patients who attend sexual health services differ from the general outpatient population in age, morbidity, education, ethnicity and socio-economic status, and these factors may limit the validity of the existing national survey. The studies identified in this review did not generally include a specific and robust validation stage in their development. Specifically, the themes for the question topics seldom originated from patients, the questions were not validated to ensure that they actually assessed the target topic, acceptability to patients was not recorded, and the feasibility of administering the questionnaire was poorly reported.

Semistructured interviews

Interviews allow patients to be questioned more openly regarding their experiences, with the opportunity to raise issues of importance to them not previously identified. However, ensuring participants are representative of the whole clinic population may be difficult, and a limited number of individuals can be assessed using this potentially time-consuming and expensive approach. The value of semistructured interviews is also dependent on the specific interaction between the interviewer and patient.

A robust methodology needs to be applied to ensure interviews deliver clear outcomes. Background information to guide the format of the interview is essential and may take the form of previous work directed at establishing patient experience or literature reviews of published work. Seven of the included studies scored highly for quality using a prespecified scale.6 22 24 25 26 27 28 The information obtained from these interviews is therefore of particular value in identifying areas of concern to patients and can be used to help design future quantitative studies which are able to assess larger numbers of clinic attendees.

Focus groups

Focus groups explicitly use the interaction within a group to identify and develop relevant themes.33 Patients attending a sexual health service may be reluctant to be identified due to stigma which could limit participation and lead to selection bias. Focus groups need to reflect views from a representative sample of the population to provide generalisable conclusions. The focus-group studies included in the review did not systematically sample their study populations, but all did describe an appropriate design and analytical process.

Although focus groups follow a predesigned format, several dimensions of care can be studied including overall satisfaction with services delivered.34 Focus groups can also contribute to the development of quantitative measures of patient satisfaction by providing an understanding of what the research project means to patients.35

Professional patients

The use of individuals who attend a clinic without a clinical problem but specifically to evaluate the clinic’s performance (professional patients) has the advantage of allowing specific aspects of the service to be assessed and provides standardisation. However, issues of openness, relevance to actual patient experience and interpretation of findings may limit the usefulness of this approach. Concerns may be raised that, over time, the professional patients become less like normal users and less sensitive to the views and concerns of inexperienced service users.31 Also, as user involvement is thought to be central to service development,36 the evaluation by nonpatients raises concerns regarding the validity of results obtained in this way.

Strengths and weaknesses

This is the first systematic review of the measurement of patient satisfaction in STI clinics, and the resulting identification of key themes can help to inform future development of patient derived measures of service quality.

Patients’ assessment of what aspects of a STI service should be prioritised and included when measuring patient satisfaction will vary according to their presenting condition, their sexual-health needs and their cultural norms. Restricting the review to services which were focused on STI screening and testing provides a degree of homogeneity, but some variation will still exist within the study population which may have influenced the themes identified. The recurrent nature of the themes reported from different study methodologies provides some reassurance but cannot exclude subpopulations of patients who have different priorities. The inclusion criteria identified mostly UK-based studies, and any extrapolation of the findings to outside the UK should therefore be cautious. It is also likely that some data on patient satisfaction have not been formally published and therefore missed by our search strategy, especially from outside the UK—for example, needs assessments. Equally, the exclusion of sexual-health services where the focus was not on STI diagnosis and treatment means that the findings are not necessarily applicable in non-STI clinic settings. Two reviewers independently extracted data from the studies, but they were not blinded to the study author or publication type, which could have introduced bias. A quality assessment was made for each included study, but this process is less well defined and developed for observation data compared with randomised controlled trials.

Summary

A number of themes were identified which were of particular importance to service users: convenience of the clinic location, availability of appointments, staff attitude to patients, effective delivery of information and confidentiality within the clinic. These areas should provide a focus for future assessments of patient satisfaction at STI clinics.

Implications for practice and future research

Most of the studies identified in the review reported high levels of patient satisfaction with sexual health services, but further work is needed to ensure this positive reporting correlates with a positive experience. Further assessment of individuals who have not attended sexual-health services but may need to do so in the future could be useful to identify barriers to attendance, although the opinions of “non-patients” may be similar to that of STI clinic attendees.37 There is particularly a need for a standardised approach to measuring patient satisfaction—determining from patients what the central themes of satisfaction should be, designing questions around these themes, testing the questions for appropriateness, validity, acceptability and feasibility, and piloting the questionnaire with an appropriate patient group. None of the studies took this approach and nor was a common assessment method used which makes comparisons between providers, and of the same provider over time, difficult. The review has also highlighted the need for a standardised approach to identify strengths and weaknesses of individual STI clinics. Future work needs to include evaluation of the effect of patient satisfaction on clinical outcomes, assessment of how changes in service configuration affect patient satisfaction and direct comparisons between different sexual-health services.

Key messages

  • Patient satisfaction with sexual health clinics is an important measure of service quality.

  • No standardised measure of patient satisfaction within STI screening services is currently available.

  • Five key domains which are of particular importance to service users were identified.

  • Future assessments of patient satisfaction should incorporate these five domains.

Acknowledgments

C Beecroft Information Officer—School of Health and Related Research, University of Sheffield; C Meads—Lecturer in Health Technology Assessment, Director of MSc in Evidence Based Healthcare & Health Technology Assessment—University of Birmingham.

REFERENCES

View Abstract

Supplementary materials

Footnotes

  • Additional appendices are published online only at http://sti.bmj.com/content/vol85/issue6

  • Competing interests None.

  • Author contributions JR was responsible for study concept, management and governance; manuscript review and revision. RW was responsible for development of study protocol; data extraction; manuscript preparation and review. RD was responsible for data extraction; manuscript review.

  • Provenance and peer review Not commissioned; externally peer reviewed.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Linked Articles

  • Health services research
    R S French C H Mercer
  • Whistletop tour
    Jackie A Cassell