Objectives: To establish whether a simple risk scoring system, based on limited information, can reflect the variation in HSV-2 prevalence in a population, and whether a common system can be used across settings. To establish whether knowledge of a patient’s score can aid the interpretation of the result from one of the commercial type specific assays.
Methods: Four previous cross sectional studies are considered, with HSV-2 antibody results by western blot or type specific ELISA tests. The clinical settings were a blood donor centre (1359 participants) and STD clinic (808 participants), London, United Kingdom, an antenatal clinic, Sydney, Australia (2317 participants), and a family medical centre, Seattle, United States (478 participants). We determined the factors associated with HSV-2 prevalence, the similarity of associations across settings, and the variation in HSV-2 prevalence by risk score.
Results: A simple scoring captured much variation in HSV-2 prevalence in each population—for example, for London blood donors, scoring based on sex, age, and number of lifetime partners, prevalence varied from 0.7% (95% CI 0.1 to 2.0) to 47.3% (37.9 to 56.6) across five risk groups. For number of lifetime partners, and sex, the association with HSV-2 varied significantly across studies.
Conclusions: A scoring system can aid test interpretation—for example, in London blood donors the post-test probability of infection following a positive result varies from around 25% to 98% across risk groups for a typical type specific assay. Further work could address whether this theoretical benefit can be realised in practice. A common risk scoring probably could not be used across settings.
- herpes simplex virus type 2
- diagnostic test
Statistics from Altmetric.com
Herpes simplex virus type 2 (HSV-2) is the predominant cause of recurrent genital herpes. Seroepidemiological studies from the United States and elsewhere indicate that most people who are infected with HSV-2 are unaware of their infection.1 What is more, two thirds of people presenting with their first episode of genital herpes turn out to have been infected by a sexual partner with previously unrecognised genital herpes.2 Recently, assays which can reliably identify type specific antibody to HSV-2 have become commercially available. These assays can be used to diagnose HSV-2 infection among asymptomatic but, none the less, infected people who would otherwise be unaware of their infection. However, type specific assays for antibody to HSV-2 are imperfect, in that their specificity and sensitivity are not 100%.3 Use of these tests will result in some uninfected individuals being falsely diagnosed as being infected with HSV-2 (false positive result). Conversely, some infected individuals may have a negative HSV-2 antibody test result and be falsely reassured that they are uninfected (false negative result). As genital herpes is a lifelong sexually transmitted infection, which may be transmitted to sexual partners in the absence of symptoms, either a false negative or false positive diagnosis could have serious consequences for that individual and their current and future sexual partners.
The positive predictive value (or post-test probability of being infected) of an HSV-2 antibody test is the probability of an individual being truly positive given a positive result. The negative predictive value (or post-test probability of being uninfected) is the probability of being truly negative given a negative result. These predictive values of the test depend on the test characteristics and also the individual’s risk of infection (or pretest probability). The local population prevalence can be used to estimate an individual’s risk. However the prevalence of HSV-2 varies widely both within and between populations by age, sex, and past sexual behaviour,4–7 so it is important to include such factors in any measure of risk.
In this study we wanted to find out whether it is possible to estimate the pretest probability using a simple risk score, based on demographic, clinical, and behavioural information that is routinely collected when taking a sexual history. This could then be used by physicians to help interpret the HSV-2 antibody test result as advocated by Jaeschke et al8 and, in particular, to determine the likelihood that the test result is true or false. That is by combining the pretest probability with the likelihood ratio of the assay in order to establish the post-test probability of infection. The risk scoring system could even be used to develop an evidence based testing strategy. We also consider whether it is likely that it would be possible to use the same risk scoring system in four different populations.
We used data collected by self completion questionnaire from four populations, in three countries (United Kingdom, Australia, and United States) as part of seroepidemiological studies of HSV-2 (see table 1). Further details of these studies are given elsewhere.4,9,10
Developing a risk score for each study
We used standard univariate statistical tests to identify sociodemographic, behavioural, and clinical factors significantly associated with antibody to HSV-2. Forwards stepwise selection was then used to select the best of these factors to form a logistic regression model for HSV-2. The log odds ratios of the factors in the model are taken to indicate their importance, so that an additive scoring system results. The value of one unit of risk on the log odds scale was then selected so that as many factors as possible were close to a whole number of units and no factor represented more than five units. Each factor was then assigned a number of risk units, equal to the log odds ratio divided by the unit value, rounded to the nearest whole number. The overall risk score is then the sum of these terms.
For example, in study 4, one unit of risk was chosen to be 0.65 on the log odds scale. For number of lifetime sexual partners, relative to 0–2 the log odds ratios for 3–4, 5–9, and 10+ were 1.43, 2.10, and 2.80 respectively. Dividing by 0.65 and rounding, we see that 3–4, 5–9, or 10+ partners represent 2, 3, or 4 units of risk respectively.
The sample HSV prevalence is calculated for each value of the risk score. The score is then grouped to capture as much of the variation in prevalence as possible, subject to no more than five groups in total and each containing at least 8% of the sample to allow accurate estimation of the prevalence. However, for study 3, owing to similar prevalence across the middle risk scores, only four groups are created of which the highest risk group contains only 4% of the sample but has a substantially higher prevalence. For each risk group the sample prevalence and 95% confidence interval are determined.
Assessing similarity of associations with HSV-2 across settings
To consider whether a common scoring system could be used in different settings around the world, we assessed the similarity of associations with HSV-2 in the different studies. Age, sex, and number of lifetime partners were collected in each study and associated with HSV-2. Odds ratios for these factors, adjusting for the other two, were calculated using logistic regression. The similarity of the associations (that is, odds ratios) across studies can be formally assessed by testing for the main effects of study and interactions with the other factors.
All analysis was performed in spss 10 or stata 6.
Developing the risk scores
We include detailed results for study 1 in order to illustrate how the algorithm was constructed; results for other studies are available from the authors on request. Sex, age, genital blisters, lifetime number of partners, history of non-specific urethritis (NSU), gonococcus, warts, lice, Trichomonas vaginalis (TV), and thrush are all significantly associated with HSV-2. Country of birth, ethnicity, marital status, oral blisters/sores, cold sores, mouth ulcers, sexuality, age at first sex are not. Table 2 indicates the factors identified in the model selection process. The interactions between sex and the other three terms were each tested, and none found to significantly add to the model. The score to be added for each factor is specified in the final column of table 2. For example, if the patient is a 23 year old (0 points) man (0 points) with three lifetime partners (2 points) and no history of genital blisters (0 points) his score is 2, whereas if the patient is a 34 year old (2 points) woman (2 points) with seven lifetime partners (2 points) who has never had genital blisters (0 points) her score is 6.
The resulting scores, ranging from 0–10, were grouped according to the HSV-2 prevalence into five levels: 0–3, 4, 5, 6, and 7 or more. In table 3 the prevalence of antibody to HSV-2 is presented by risk group. In study 1, for example, the prevalence increases dramatically from 0.7% to 46.3% across the risk groups. The corresponding figures are also presented for the other studies.
Assessing similarity of associations with HSV-2 across settings
After controlling for the three risk factors, studies 2 and 4 have significantly higher HSV-2 prevalence than the other studies. Relative to study 1, the study odds ratios (95% CI) are 3.18 (2.38 to 4.26), 1.82 (1.39 to 2.37), and 3.20 (2.39 to 4.29) for studies 2, 3, and 4.
Furthermore we found the associations with sex (χ2 = 15.6, 2 df, p = 0.0004), and number of partners (χ2 =17.5, 6 df, p = 0.008), differed significantly across studies. Table 4 shows that, relative to study one, in study 2 the association between sex and HSV-2 is weaker, and in study 3 the association between number of partners and HSV-2 is weaker. The association with age did not vary significantly (χ2 =8.6, 6 df, p = 0.20) across studies.
CONCLUSIONS AND FURTHER WORK
We have seen that it is possible to develop a risk score, which helps to predict an individual’s risk of HSV-2 on the basis of only a few pieces of information in all four study settings. These data will usually be gathered routinely during sexual history taking. Each of the resulting risk groups contains an appreciable proportion of people tested, yet the prevalence of HSV-2 varies sufficiently across groups in each study to have a substantial impact on the post-test probabilities of infection (following either a positive or negative test), and hence test interpretation. This is illustrated in table 5, where three realistic tests are considered.3 For example, someone with a low risk score should be greatly reassured by a negative test result as their post-test probability of infection is also low. If they have a positive result, however, they should be aware that this has a significant likelihood of being false, as their post-test probability will be substantially less than 100%, even using a test with 98% sensitivity and specificity. The converse is true for individuals at high risk of infection. In addition to informing test interpretation, the patient’s pretest probability can be used in advance of testing. For example, where it is clear that a patient’s post-test probability will be inconclusive (for example, 20%–80%) whether the test result is positive or negative, then the clinician and patient can discuss whether the test is likely to be of benefit or not. At present many physicians are not offering testing for HSV-2 antibody on the basis that they may do more harm than good (for example, by erroneously telling someone that they have a lifelong, viral, sexually transmitted infection). By using a simple algorithm such as the ones that are outlined here, preferably in conjunction with the patient, it is less likely that false results will be given. Additionally it may help the patient understand the limitations of testing in certain circumstances.
Four patient databases of HSV-2 test results, demographic, clinical, and behavioural information from settings in London, Seattle, and Sydney were analysed
In each setting a simple risk scoring system, based on limited information, successfully reflected much of the variation in HSV-2 prevalence
Where commercial type specific assays are used, such a risk scoring system could be used in combination with the test result, to inform physician and patient of the likelihood of infection
Further work could address whether the use of such risk scoring is feasible and beneficial in practice.
Alternatively, in those few laboratories able to offer confirmatory HSV-2 antibody testing using a western blot assay, this approach could be used to decide which samples to retest using western blot. (The HSV-2 antibody western blot assay is expensive and labour intensive and unlikely to become widely or commercially available.3)
We have not evaluated this approach for HSV-1 testing as we feel this is a less controversial area. The overall prevalence of HSV-1 infection in the community is higher so there is less likelihood of false positive and negative diagnoses. Additionally, the implications of either a false positive or negative diagnosis are likely to be less important. HSV-1 is generally considered a minor, viral illness and even if genitally acquired is unlikely to lead to recurrent genital herpes.
Since the broad themes of sexual behaviour, age, sex, and clinical symptoms are associated with HSV-2 prevalence in every setting it is tempting to feel that a common risk scoring can be developed and applied identically at different sites. This would certainly be of greatest practical use. It is true that if the risk score from one setting is applied to another then it is likely to describe a substantial amount of the variation in the second setting. For example, we applied the risk scoring from study 1 to individuals in study 2 and found that the prevalence in the risk groups increased from 1.4% to 50.7%.
However, our findings that three key behavioural and demographic risk factors have significantly different associations across studies, reflecting the different make up of the populations concerned, and that study itself is a risk factor, suggest that a common scoring system based on such factors is not possible. In general some individuals will be assigned to inappropriate risk groups—for example, those with a major risk factor in one setting which is a mild risk factor in another. In addition, it is not possible to say exactly what the prevalence will be in the risk groups when a scoring based on one setting is applied to another. This finding is perhaps not surprising, firstly, because it is impossible to measure the exact behavioural risk experienced by an individual since it requires information unlikely to be available to the patient—for example, detailed risk information for each lifetime partner. Secondly, a related problem is that the association between sexual behaviour and HSV-2 prevalence is dependent on the prevalence in the population, which will vary across settings.
This work to assess whether a common risk scoring can be used across settings is limited by a lack of common patient information across studies, few clinical data collected, and the small number of studies included. In particular, a greater degree of commonality might be expected if the scoring includes a variety of clinical factors. Further projects might be designed without these limitations.
Further work might also address whether more complex approaches to selecting risk factors and combining this information into a scoring system would provide additional benefit. More complex approaches would be feasible, in particular, if the calculation of pretest and post-test probabilities is computerised.
Importantly, further work is also needed to establish whether using such an evidence based approach to HSV-2 testing such as the one described would actually benefit patients and clinicians in practice.
We thank Anna Wald, University of Washington for the Seattle study data and Dr Danielle Mercey and Dr Gilly Arthur for help with the manuscript.
The UK study was funded by the Wellcome Trust. The Australian study was funded by grants from the Ramaciotti Foundation and the Australian National Health and Medical Research Council.
Funding: This analysis of the four studies was funded by GlaxoSmithKline Research and Development.
Competing interests: AJC has received reimbursement for attending a conference from GlaxoWellcome. FC has received reimbursement for speaking and attending conferences from GlaxoWellcome and has acted as a consultant for them. AM and ALC have received reimbursement for speaking and attending conferences from GlaxoWellcome and SmithKline Beecham.
CONTRIBUTORS AJC selected the statistical methodology and performed the statistical analysis; FC had the original idea for the study and provided the data from London; AJC and FC wrote the paper together; AM and ALC provided the data from Sydney and commented on the paper; AJC will act as guarantor for this paper.
An evidence based approach to testing for antibody to herpes simplex virus type 2
A J Copas, F M Cowan, A L Cunningham and A Mindel
Questionnaire - London, UK
Questionnaire - Sydney, Australia
Questionnaire - Seattle, United States (Women)
Questionnaire - Seattle, United States (Men)
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.