Article Text

Download PDFPDF

Original article
Disclosure of HSV-2 serological test results in the context of an adolescent HIV prevention trial in Kenya
  1. Denise Dion Hallfors1,
  2. Hyunsan Cho1,
  3. Isabella I Mbai2,
  4. Benson W Millimo2,
  5. Carolyne Atieno2,
  6. David Okumu2,
  7. Winnie K Luseno1,
  8. Shane Hartman1,
  9. Carolyn T Halpern3,
  10. Marcia M Hobbs4
  1. 1The Pacific Institute for Research and Evaluation, Chapel Hill, North Carolina, USA
  2. 2School of Nursing, Moi University, Eldoret, Kenya
  3. 3Department of Maternal and Child Health, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
  4. 4Department of Medicine, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
  1. Correspondence to Dr Denise Hallfors, The Pacific Institute for Research and Evaluation, 1516 E. Franklin Street, Suite 200, Chapel Hill, NC 27514, USA; hallfors{at}pire.org

Abstract

Objectives Herpes simplex virus type 2 (HSV-2) biomarkers are often used in adolescent sub-Saharan HIV prevention studies, but evaluations of test performance and disclosure outcomes are rare in the published literature. Therefore, we investigated the proportion of ELISA-positive and indeterminate samples confirmed by western blot (WB), the psychosocial response to disclosure and whether reports of sexual behaviour and HSV-2 symptoms are consistent with WB confirmatory results among adolescent orphans in Kenya.

Methods In 2011, 837 Kenyan orphan youth in grades 7 and 8 enrolled in an HIV prevention clinical trial with HSV-2 biomarker outcomes. We used a modified algorithm for the Kalon HSV-2 ELISA to improve specificity; positive and indeterminate results were WB tested. We developed culturally sensitive protocols for disclosing positive results, and documented psychosocial responses, reports of sexual contact and HSV-2 symptoms.

Results 28 adolescents (3.3%) were identified as HSV-2 seropositive, six as indeterminate. Of these, 22 positive and all indeterminates were WB tested; 20 and 5, respectively, were confirmed positive. Most youth reported moderate brief stress after disclosure; 22% reported longer and more severe distress. Boys were more likely to be in the latter category. Self-reported virginity was highly inconsistent with WB-confirmed positives.

Conclusions The higher than manufacturer's cut-off for Kalon ELISA modestly reduced the rate of false-positive test results, but also increased false negatives. Investigators should consider the risk:benefit ratio in deciding whether or not to disclose HSV-2 results to adolescent participants under specific field conditions.

Trial registration number NCT01501864.

  • HERPES SIMPLEX (CLINICAL)
  • ADOLESCENT
  • AFRICA
  • SEROLOGY

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Introduction

Herpes simplex virus type 2 (HSV-2) is the primary cause of genital herpes,1 particularly in sub-Saharan Africa. Because nearly all HSV-2 infections are sexually acquired, type-specific HSV-2 antibodies in serum imply anal–genital infection.2 Infections are lifelong with intermittent clinical and subclinical viral reactivation and mucosal shedding.1 Only 10%–25% of people with HSV-2 antibodies are aware that they have genital herpes.1 Symptoms vary widely, and infected people may be asymptomatic. Although there is no cure, systemic antiviral drugs can partially control the signs and symptoms of herpes episodes, and can be used as daily suppressive therapy.2

Prevalence of genital herpes in the adult general population in sub-Saharan Africa is high, ranging from 30% to 80% in women and from 10% to 50% in men, as assessed by serological detection of HSV-2 antibodies.3–7 In Kenya, the population-based prevalence among those aged 15–64 years is 42% for females and 26% for males.8 In Nyanza Province, which has the highest HIV prevalence in the country, HSV-2 prevalence among those aged 13–14 years is estimated at 9% for females and 4% for males, and among those aged 15–19 years, at 28% and 17%, respectively.9

HSV-2 is an important risk factor for HIV.1 Meta-analyses of longitudinal studies have found a threefold increase in HIV infection with HSV-2.10 ,11 Among Kenyans, HIV prevalence is 16% among HSV-2 seropositive people compared with 2% among seronegatives.8

Besides its importance as an HIV risk factor, HSV-2 has become increasingly used as a biomarker to corroborate adolescent self-report of sexual behaviour, which is often inconsistent.12–14 HSV-2 is also considered as an important clue in determining the path of transmission for HIV-positive youth, whether vertical or through sexual contact.15 Because of its relatively high prevalence among sexually transmitted infections, the inclusion of HSV-2, along with HIV biomarkers, has become the scientific standard for evaluating youth prevention interventions in sub-Saharan Africa,16–20 although some have more recently questioned its utility for this purpose.21

Despite the potential importance of HSV-2 as a biomarker, studies to evaluate disclosure of results to sub-Saharan adolescents are lacking. Some US studies have raised concerns about disclosure after serological screening in the absence of pre-existing symptoms or diagnosis, given the low calculated positive predictive value (PPV) of existing ELISA tests22 and the possibility of psychosocial harm.23 Young adolescents are likely to have a low prevalence of HSV-2 infection,16 ,19 and PPV for all diagnostic tests drops greatly when prevalence is low, resulting in a potentially high rate of false positives.24 Nevertheless, a recent review of the extant literature concluded that HSV-2 diagnosis by type-specific serological testing did not result in long-term psychosocial harm in most people without an identified history of genital herpes.25 That review, however, was limited to studies with adults from developed countries. Moreover, conclusions were aimed at health professionals who were advised to offer HSV-2 testing selectively to ‘appropriate’ patients. Among published sub-Saharan adolescent prevention studies collecting biomarkers, most have not disclosed HSV-2 results to participants16 ,18 ,20 while others have.17 ,19 No research guidelines on the disclosure of HSV-2 biomarker test results in community studies of sub-Saharan African adolescents are available in the scientific or regulatory literature.

The study is unique in examining the performance of a commonly used serological HSV-2 test for Kenyan adolescents and the outcomes of a culturally sensitive protocol for disclosing results. Since the response of African youth to positive test results within the context of an HIV prevention trial was unknown, we also examined findings related to disclosure of positive HSV-2 results to Kenyan orphan adolescents. This paper addresses the following research questions:

  1. Following disclosure, what proportion of ELISA-positive samples was confirmed by WB?

  2. What was the psychosocial response reported by participants?

  3. Were participants’ report of sexual behaviour and HSV-2 symptoms consistent with WB confirmatory tests?

Study findings provide important guidance to scientists about the ethical disclosure of HSV-2 biomarkers in adolescent African HIV prevention research.

Methods

Sample and setting

This study was conducted in Siaya County in Nyanza Province, Kenya. Twenty-six primary schools were selected for a randomised controlled trial to determine whether providing orphans with school fees can prevent HIV and HIV-related risk behaviours.19 ,24 To be included, schools had to have at least 20 orphans (one or both parents deceased) in grades 7 and 8. All orphans in grades 7 and 8 at selected schools were eligible.

HSV-2 biomarker sample collection and testing

Whole blood was obtained aseptically by venipuncture at remote study sites, and transported on ice to a local laboratory where serum was prepared and stored at 4°C until weekly transport to the AMPATH Reference Laboratory in Eldoret, Kenya, for ELISA testing using a type-specific HSV-2 ELISA (Kalon Biological, Guildford, UK). Serum was stored at 4°C until testing. Kalon testing was performed by a single technician from October 2011 to January 2012. After testing, samples were frozen at −20°C until selected samples (described below) were shipped on dry ice to the Virology Laboratory at the University of Washington where confirmatory WB testing was performed in June 2014 by a single technician without knowledge of ELISA results.26

Kalon testing was performed according to the manufacturer's instructions with absorbance values obtained using a microtiter plate reader at 450 nm wavelength blanked on air. Index values were calculated from the absorbance value of the test sample compared with a manufacturer-supplied calibrator for the kit. The manufacturer's cut-off index value defining a positive result is 1.1.27 Numerous reports in the literature describe performance issues with HSV-2 ELISA tests in sub-Saharan African populations using manufacturers’ cut-offs, particularly in low-prevalence groups such as adolescents.27–30 In an effort to improve the specificity of the test, we employed a modified algorithm for test result interpretation in the study. Samples were initially tested in single wells; samples with initial index values <0.9 were considered negative, those with initial index values >2.5 were considered positive, and no further ELISA testing was performed on those sera. Samples with initial index values between 0.9 and 2.5 were retested in duplicate. Final results were considered negative if retest index results were <0.9; positive if retest results were ≥1.5 and indeterminate if retest results were between 0.9 and 1.5, or discordant.

Based on previously published evaluations of Kalon test performance in Sub-Saharan African populations using the higher index value cut-off of 1.5 to interpret results compared with the WB reference standard,27 we assumed ELISA sensitivity of 94% and specificity of 92% for the study-specific algorithm. PPV and negative predictive value (NPV) of the Kalon test were calculated using standard formulas:Embedded Image Embedded Image

Sub-study procedures

University-educated male and female registered nurse researchers were trained in the study protocol as follows: nurses met with same-gender participants for disclosure at a private place (eg, home or clinic room). If the participant was under 18 years, the nurses met first with the guardian to disclose the diagnostic findings, and reviewed a Centers for Disease Control and Prevention-adapted fact sheet on HSV-2. The participant then joined to receive the same information. The nurse answered questions, provided the fact sheet with his/her contact information for further questions, gave a referral form for treatment and requested permission to return for follow-up in a few months. The nurse then talked with the adolescent alone about transmission, symptoms or other questions. After disclosure, nurse researchers summarised their observations of guardian and participant behaviour and questions/comments during the meeting, including participant's self-report of sexual behaviour and symptoms.

 All participants were recontacted several months later for a follow-up interview at a private place of participant's choice. Nurses transcribed their notes and sent them in English to investigators in the USA who reviewed, coded and entered data.

Measures

Using content analysis of disclosure and follow-up interview notes, measures were coded by a senior research scientist, in consultation with the interviewers, as follows: (a) participants’ emotional response at follow-up (1=low or no emotional distress exhibited; 2=reported distress for a few days or weeks, but resolved; 3=distressed for a month or more, but resolved; 4=prolonged psychosocial effects with adverse emotional, social, academic effects); (b) guardian type (mother, sibling, stepmother, grandparent, aunt/uncle, spouse); (c) participants’ perception of guardian or family response and their relationship at follow-up (supportive or very supportive, no change in relationship, other reactions, missing) and (d) HSV-2 symptoms (0,1) and sexual activity (0,1). Other measures included baseline audio computer-assisted survey items: age, gender, ever had sexual intercourse (0,1). At follow-up, nurse researchers asked whether participants had tried to access HSV-2 treatment (most local clinics have acyclovir in stock, provided free of charge with a referral). From the laboratory analyses, we documented index values for Kalon and results of WB testing.

Data analysis

We analysed qualitative notes from nurse field researchers and coded responses for measures as described above. We compared the participants’ interview response on sexual behaviour with their baseline survey results, and noted discordant results, and we compared self-reported sexual behaviour and HSV-2 symptoms with WB results. PPV and NPV for the Kalon test were calculated from the estimated sensitivity (94%) and specificity (92%) of the test with the higher cut-off using standard formulas.

Human subjects protection

Institutional review boards at PIRE (USA) and the Moi University (Kenya) reviewed and approved study protocols, including consent procedures and disclosure procedures. Young adults aged 18 and older gave written consent, while guardians gave written permission and youth under age 18 years gave written assent for participation. To send samples out of the country for WB confirmatory testing, additional written consent was obtained.

Results

From October 2011 to January 2012, 837 youth completed baseline survey and biomarker testing. The average age of participants was 14.9 years (SD 1.5, range 11–21 years). Twenty-eight adolescents (3.3%) were identified as HSV-2 positive by Kalon ELISA at baseline, with an estimated prevalence of 4.4% for girls and 2.3% for boys. Another six were identified as indeterminate. Only participants with positive ELISA results were contacted for disclosure, which was conducted from February 2012 to March 2013. Follow-up interviews were conducted within 3–9 months later.

At the observed HSV-2 seroprevalence, the calculated NPV of the ELISA was 99.8%, providing high confidence in negative test results. However, the low calculated PPV of 26.4% prompted investigator and institutional review board concerns that false positives could result in needless social and psychological distress. Thus, we modified our protocol, and informed participants that serological results are not always accurate, and could result in false-positive values, and requested consent to send samples for WB confirmatory testing. All six of those with indeterminate results and 22 of those with positive results consented (five more were not found and one refused, figure 1).

Figure 1

Baseline HSV-2 testing and disclosure.

Despite the low calculated PPV of the Kalon test, >90% of positive samples and >80% of indeterminate samples were positive by WB (table 1). Among the samples tested by WB, 100% (9/9) with initial Kalon index values ≥2.5, 87.5% (14/16) with index values ≥1.5 and <2.5, and 83% (5/6) with index values ≥0.9 and <1.5 were confirmed positives. Using our study-specific algorithm, 2/22 positives (9%) were false positives. For samples with initial Kalon index values <2.5, there was no association between the index value and WB result (data not shown).

Table 1

HSV-2 antibody detection in Kenyan adolescent orphans

Because we did not submit all samples for reference testing by WB, we cannot calculate valid sensitivity and specificity estimates for Kalon performance using the study-specific algorithm. However, the observed high rates of WB positives among samples submitted for confirmatory testing suggest that the sensitivity was lower than estimated (most indeterminates were true positives), and the specificity was higher than estimated (most positives were true positives). Among samples tested by WB, 26 had initial index values ≥1.1, and would have been deemed positive according to the manufacturer's suggested cut-off; three of these (11.5%) were negative by WB, and would, thus, have been false positives.

Participant reaction as reported at follow-up

About 28% of participants who received HSV-2 serological test results (8/28) reported minimal stress and a positive attitude after disclosure. Another 50% said that they were worried or upset for a few days to a few weeks, but had eventually found ways to cope through support from their guardian, prayer or hope that the result could be a false positive. Another 11% said they had been worried for a month or more, but eventually came to acceptance. The final group (11%) reported being very stressed for many months with adverse emotional, physical, social and/or academic effects. As an example, one participant was very distressed at follow-up as the family was convinced that the youth was actually infected with HIV and not HSV-2, resulting in stigmatisation and isolation. The nurse researcher assured the participant that this was not the case, and talked with family members to correct the misperception.

Males made up 36% of the sample, but were represented disproportionately among those with the most severe and lingering stress (66%). Females were most likely to be among those with minimal stress (80%). Only two participants reported that they had sought treatment. In one case, the participant was told the clinic was out of the medication. The second went to a health centre with the referral form, and was given medicine. She reported, ‘the ulcers disappeared four days after taking the treatment’.

Guardian reaction

Among the guardians present at initial disclosure, seven were mothers; four brother, sister or sister-in-law; two stepmothers; seven grandparents and eight aunts or uncles. Guardians of participants under 18 years of age were contacted for permission to speak with the child at follow-up, but in no case did the guardian choose to be present for the follow-up visit. Most guardians were perceived as being supportive or very supportive (61%) or showing no change in the way they related to the youth (25%). As an example of perceived support, one participant said of her aunt, “were it not for her, I don't know how I would have made it.” Another boy said of his brother, “Nowadays he is more loving and concerned about my life. Before the disclosure we could not sit together to discuss anything but nowadays we discuss most things freely and kept on encouraging me to work hard in school.”

‘Other reactions’ included three guardians who were convinced that HSV-2 was actually a different disease (HIV or cancer). One guardian insisted the child take a medicine (likely a traditional medicine). Another mother told the researcher, “she likes men too much,” referring to the participant daughter. Among the three youth who reported the most severe and lingering stress, two reported negative attitudes from their guardian. No other pattern was found.

Sex, symptoms and WB

Of the 22 participants with positive samples and WB, only six (27%) reported ever having a sex partner (table 2). Of these, three reported symptoms, and of these, one had reported virginity on the survey. Of the rest (16), 10 consistently reported no sexual contact (both interview and survey) and no symptoms; of these, two were WB negative (both males) while eight were positive. Of the final six, three reported sexual intercourse by survey, but not interview, and three consistently denied sex, but reported HSV-2 symptoms.

Table 2

Report of sexual behaviour and symptoms by gender and western blot (WB) results among Kalon herpes simplex virus type 2 (HSV-2) positive participants

Discussion

Using a higher than manufacturer's cut-off (1.5 vs 1.1), we found a relatively low prevalence of HSV-2 among orphaned 7th and 8th grade Kenya students, as compared with a sample of those aged 13–14 years in the same region that was not limited to school-attending orphans.9 We used a higher than manufacturer's test cut-off, and with WB confirmatory testing, 91% of those who were positive by our algorithm and 83% of indeterminates were true positives. It is possible that estimates from studies using the manufacturer's cut-off may have had lower specificity, inflating prevalence. Our study, however, was not designed to formally evaluate the accuracy of the Kalon HSV-2 ELISA test; the goal was to optimise its performance for our specific study setting. Anticipating the potential trauma of informing adolescent subjects of a positive result, we opted to maximise specificity of the biomarker assay to minimise false positives by increasing the cut-off to define a positive test. A priori, we accepted the resulting decrease in sensitivity and any attendant false-negative results, recognising that NPV would be minimally affected.

We found that youth were generally resilient in the disclosure of results. Most reported that they felt stressed and upset initially, but, with support from their guardians, they soon accepted. Most orphaned participants described their guardians as supportive even though few had a living parent to come with them for disclosure. In a few cases, however, participants reported feeling very stressed over prolonged periods of time.

We also found that the majority of youth who were HSV-2 seropositive denied any sexual contact when interviewed. Since HSV-2 is almost always transmitted by direct sexual contact with an infected person,2 ,31 this suggested that either the participant's self-report (corroborated or not by audio computer assisted self interview (ACASI) survey and symptoms) or the Kalon result was false. When examining WB results, we found that the two false-positive samples corresponded to consistent verbal and survey reports, denying sexual contact or symptoms. Eight others, however, likewise, consistently denied sexual behaviour or symptoms, suggesting inaccurate reporting.

A limitation of the present study is the small sample size of participants with both WB and qualitative (disclosure) data. Findings can only be generalised to adolescent orphans attending grades 7 and 8 in Western Kenya, almost all of whom were members of the Luo tribe. Since over 80% of indeterminates in our study were found to be WB positive, adjustments to our protocol may be needed in order to maximise both sensitivity and specificity of the ELISA test. A standardised measure for distress was not used. For future studies, we recommend using such a measure at follow-up.

In summary, the Kalon ELISA used with a higher than manufacturer-recommended cut-off modestly reduced the rate of false-positive test results, but also increased false negatives. Investigators should carefully consider the relative benefits of increased confidence in positive test results versus the potential risk of missed positives in making such adjustments. They should also consider the risk:benefit ratio in deciding whether or not to disclose HSV-2 results to adolescent participants under specific field conditions. Including a parent/guardian or trusted adult at disclosure, and following up with the youth a month later, may help to minimise psychosocial harm, especially for boys who may be more vulnerable than girls.

Key messages

  • The study is unique in examining the specificity of a common serological herpes simplex virus type 2 (HSV-2) test along with adolescent outcomes of a culturally sensitive disclosure protocol.

  • Using a modified algorithm for interpreting results, 91% of tested ELISA-positive results were western blot (WB) confirmed; 83% of ELISA indeterminates were WB positive.

  • Boys in this study were more susceptible than girls to prolonged distress after HSV-2 disclosure.

  • Adolescent reports of sexual behavior and HSV-2 symptoms were highly inconsistent with positive WB confirmatory results.

Acknowledgments

We are grateful for the contributions of Janet Itindi who participated in the initial disclosure field work; Anne Cent and Rhoda Ashley Morrow at the University of Washington Virology Laboratory for WB testing; AMPATH Reference Laboratory for storing, analysing and preparing samples for WB; AMPATH's Fidelis Mambo and Linda Lumbasi who provided consultation and monitored quality control for data processing and analysis of the HSV-2 samples; Luke Opondo (DASCO), Bonita Iritani, Arlene Sena-Soberano and Judith Pokorni who laboured with us to establish ethical protocols under conditions of uncertainty; Susannah Allison who generously provided ongoing support and guidance and all of the Kenyan youth and guardians who courageously participated in this research.

References

Footnotes

  • Handling editor Jackie A Cassell

  • Contributors DDH developed the paper concept, participated in every stage of the research and drafted the manuscript. HC is the Principal Investigator of the study, participated in every stage of the research and critically reviewed and edited drafts. IM was the consortium Principal Investigator, oversaw all aspects of study protocol and implementation and participated in the draft manuscript. BM developed the protocol for disclosure and follow-up, supervised the nurse researchers, coordinated data collection and processing and analysis of specimens, and reviewed and edited the draft. CA and DO were nurse research assistants disclosing results to the participants and transcribing interview notes for the qualitative research; they reviewed and provided comments on the final draft. WL was the study coordinator and monitored data collection and analyses and critically edited the manuscript. SH processed transcripts for the qualitative study, assisted in the analysis of the qualitative data and reviewed and formatted the final draft of the manuscript. CTH reviewed and critically edited several drafts of the manuscript. MMH developed the algorithm for interpretation of the Kalon data, monitored and participated in all aspects of laboratory processing and analysis, assisted in protocols related to disclosure and participated in the writing and editing of the final draft of the paper.

  • Funding Research reported in this publication was supported by the National Institute of Mental Health of the National Institutes of Health under Award Number R01MH092215 (Hyunsan Cho, Principal Investigator). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Marcia M Hobbs was also supported by the UNC Center for AIDS Research grant (P30AI050410).

  • Competing interests None declared.

  • Ethics approval PIRE Institutional Review Board and Institutional Research and Ethics Committee, Moi University.

  • Provenance and peer review Not commissioned; externally peer reviewed.

Linked Articles