Article Text
Abstract
Objectives To compare the accuracy (ie, correlation, sensitivity, specificity) of self-performed point-of-care (POC) tests with clinician-performed tests for trichomoniasis in adolescent women.
Methods Sexually experienced women aged 14–22 years (n=209) collected a vaginal swab and performed a POC test for trichomoniasis. Using a speculum, the clinician obtained vaginal swabs that were tested for trichomoniasis using the POC test, wet mount, culture and transcription-mediated amplification (TMA) using standard and alternative primers. Self and clinician results were compared with true positives, defined as either culture-positive or TMA-positive with both sets of primers.
Results Participants' mean age was 17.8 years; 87% were African-American; 74% reported vaginal itching or discharge and 51 (24%) had trichomoniasis. Over 99% correctly performed and interpreted her self-test. Self and clinician POC tests were highly correlated (95.7% agreement, κ 0.87). Compared with true positives, the sensitivity of the self-POC test was 78% (CI 65% to 89%), similar to that of the clinician-POC test (84%, CI 71% to 93%) and culture (82%, CI 69% to 92%), and significantly better than wet mount (39%, CI 26% to 54%). The specificity of the self-POC test was 99% (CI 96% to 100%), similar to that of the clinician-POC test (100%, CI 98% to 100%). The sensitivity of the self-POC test was not affected by vaginal symptoms or other variables.
Conclusions Young women performing a self-POC test detected as many trichomoniasis infections as clinician-POC tests or culture, twice as many as wet mount and slightly fewer than an amplified test. Incorporating self-obtained or self-performed POC tests into routine practice could effectively increase the identification and treatment of trichomoniasis in this vulnerable population.
- Adolescent
- self-sampling
- STD control
- testing
- trichomonas
Statistics from Altmetric.com
Trichomoniasis, caused by the flagellated protozoa Trichomonas vaginalis, is one of the most common sexually transmitted infections (STI) found in adolescent women. According to estimations by Weinstock et al,1 approximately 7.4 million new trichomoniasis infections occurred in the USA in 2000, 25% of which were in 15–24-year-old women. In population-based surveys, the cross-sectional prevalence of trichomoniasis was 2–3% in adolescent women, similar to the prevalence of chlamydia and far higher than gonorrhoea in the same samples.2–5
Although trichomoniasis is highly prevalent, the current standard for evaluation (pelvic examination and wet mount) limits our ability to detect infections. Wet mount is estimated to be only approximately 50–60% sensitive compared with culture.6 7 Adolescent women find pelvic examinations uncomfortable and embarrassing. Providers often cite a lack of facilities to perform a pelvic examination as a barrier to offering STI testing.8–10
Improved diagnostic tests, self-obtained vaginal swabs and point-of-care (POC) testing are three strategies designed to remove barriers to testing and treatment for trichomoniasis and other STI. In addition to wet mount and culture, two promising new tests for trichomoniasis are a POC antigen test (a lateral flow test strip that detects T vaginalis membrane proteins) and transcription-mediated amplification (TMA), a nucleic acid amplification test (NAAT) that uses analyte-specific reagents (ASR) for T vaginalis RNA. Using latent class analysis, we have shown that the sensitivities of the POC test, culture and TMA–ASR (90%, 83%, and 98%, respectively) are each significantly higher than wet mount (56%), and only TMA has imperfect specificity.7 Therefore, using any test other than wet mount would increase the detection of trichomoniasis.
Self-obtained vaginal swabs have already been shown to perform well for the diagnosis of chlamydia and gonorrhoea using NAAT.11–13 Similarly, self-obtained vaginal swabs are equivalent to clinician-obtained swabs in detecting trichomoniasis by culture.14 Self-obtained vaginal swabs have been used to detect T vaginalis using TMA15 or PCR, another NAAT,16 17 but self-obtained swabs for NAAT have not been compared with clinician-obtained samples.
The POC test for trichomoniasis is simple and reliable, but has not yet been tested on self-obtained swabs or as a self-performed test. The aims of this study were: (1) to examine whether young women can reliably perform a POC test for trichomoniasis on self-obtained vaginal swabs; (2) to compare the accuracy (ie, correlation, sensitivity, specificity) of self-performed POC tests with clinician-performed tests for trichomoniasis; and (3) to examine whether clinical factors (eg, vaginal symptoms or the presence of other STI) affect the performance of self-POC tests in adolescent women.
Methods
Population
We recruited adolescent women aged 14–22 years who were sexually active and presented for a healthcare visit at an urban paediatric hospital's Teen Health Center (THC) or emergency department (ED) between July 2006 and August 2008. Women were ineligible for participation if they had taken antibiotics or had used any vaginal creams or medications in the past 2 weeks or could not collect a specimen at the study visit. This study was approved by the local institutional review board, with a waiver of the requirement for parental permission.
Study procedures
After informed consent, the participants completed a brief survey that included basic demographics, sexual history and gynaecological history questions. Survey questions were coded for race (African-American or other), type of health insurance (Medicaid, private, none/unknown), douching frequency (ever or never), and the number of lifetime male sexual partners (one or two or more (multiple)). Elicited vaginal symptoms were recorded as present if a woman answered ‘yes’ to either question: ‘Do you have a discharge from your vagina today?’ or ‘Do you have itching or pain in the vaginal area today?’ Hormonal contraception was recorded as ‘yes’ if the woman reported the current use of oral, transdermal or injectable contraceptives that contained oestrogens or progestins. After the survey, participants could perform self-testing either before or after clinician testing, depending on provider preference to minimise disruptions to clinical care.
Specimen collection
Using a speculum, an experienced clinician obtained several swabs from the participant's vagina and gave these to the trained research assistant (RA). The RA gave each woman standardised verbal instructions on how to obtain the vaginal swabs and perform the POC T vaginalis test. In addition, we provided a laminated single-page instruction sheet (adapted from the product insert, http://www.genzymediagnostics.com/pdf/OSOM_Trich_181_PI.pdf) that included both words and pictures on the testing procedures. This sheet was left in the room with the participant in case she needed additional guidance. Each woman inserted a rayon swab a few centimetres into the vagina and rotated it for approximately 10 s. Swab POC testing is described below.
Laboratory methods
Each participant performed the POC test (OSOM TV Trichomonas Rapid Test, Genzyme Diagnostics, Cambridge, Massachusetts, USA) as per the manufacturer's protocol. The lateral flow test strip device is similar in concept to a home pregnancy test and requires five steps and 10 min to complete. In short, the RA set up the sample phial containing buffer solution; the participant swirled her self-collected swab in the buffer, then squeezed the phial to remove the extra liquid from the swab while removing it from the solution. She discarded the swab, and added the test strip into the buffer solution. After 10 min, she read the test results. The test is determined to be negative if only the internal control line (red) is displayed and as positive when both the red control line and the test line (blue) are shown. After the woman performed the POC test and recorded her results on a standard form, the RA reviewed her test results and recorded whether the participant's interpretation (negative or positive) was correct. For analyses, we used the participant's interpretation of her self-POC test result.
The clinician-obtained vaginal swabs were tested for trichomoniasis in real time using wet mount, POC test and culture. Additional swabs were used to assess vaginal pH and the presence of amines. One swab was stored, frozen for NAAT testing by TMA for T vaginalis, Chlamydia trachomatis and Neisseria gonorrhoeae after the study was completed.
The wet mount (a microscopic examination of a saline preparation of vaginal secretions) was performed in a standard fashion: One vaginal swab was placed into a sterile tube containing 0.5 ml saline and transported to the laboratory. For women recruited from the THC, the clinician performed the wet mount in an on-site laboratory. On wet mount, the presence of motile trichomonads was considered positive for T vaginalis; the presence of buds or pseudohyphae was positive for yeast. Based on Amsel's criteria, clue cells were characterised as none, some (>20% of epithelial cells), or many (>50% of epithelial cells),18 and white blood cells were characterised as none, few (1–5 per high-powered field (hpf)), moderate (6–10/hpf), or many (>10/hpf).19 For participants recruited from the ED, the wet mount was performed in the clinical laboratory by trained laboratory technicians and only the presence of motile trichomonads was recorded. ED participants had an additional swab submitted for Gram stain, which was performed in the clinical laboratory by trained laboratory technicians. The Gram stain was examined for white blood cells, clue cells and yeast forms using the same criteria described for the wet mount above.
One clinician-obtained vaginal swab was used to inoculate the culture medium (InPouchTV, BioMed, White City, Oregon, USA). Culture was submitted to the microbiology laboratory where it was examined daily for motile trichomonads by trained laboratory personnel for up to 5 days or until a positive result was obtained.
Using swabs obtained by the clinician, the RA performed the POC test as described above as well as the pH and amine test. For the pH, a vaginal swab was rolled across pH paper (pHydrion, Mikro Essentials Laboratories, Brooklyn, New York, USA) and the colour change was compared immediately with the accompanying colour chart. The pH was recorded in increments of 0.5 (range 3.0–5.5). An abnormal pH was any result greater than 4.5.20 For the amine test, a drop of potassium hydroxide was added to the vaginal swab. The detection of a strong fishy odour was considered a positive result.
NAAT testing
One swab was frozen, dry, at −80°C until the close of the study. After thawing, swabs were eluted in phosphate-buffered saline. One aliquot was transferred to a vaginal specimen transport medium (APTIMA Vaginal Swab Specimen Collection Kit, Gen-Probe, Inc, San Diego, California, USA) for NAAT testing using TMA. Specimens were analysed following similar manufacturers' directions for the US Food and Drug Administration-cleared assay for chlamydia and gonorrhoea (APTIMA Combo-2, Gen-Probe, Inc). For T vaginalis detection, each specimen was tested first using ASR with primers directed to the 16S rRNA gene. Testing was also performed using an alternative primer set, specific for a different region of the trichomonas genome, which was available as research use only reagents from GenProbe. For both assays, the relative light units cut-off for a positive test was set at 60 000 relative light units, consistent with earlier studies.7 15 For this study, we defined a true positive case of trichomoniasis as either culture positive or TMA positive with both standard ASR and alternative research use only primers. Because we had multiple clinical providers performing the pelvic examination, we could not reliably ascertain the subjective ‘homogeneous vaginal discharge’ that is included in Amsel's original clinical criteria for bacterial vaginosis (BV). Therefore, we defined clinical BV based on modified Amsel's criteria, as the presence of three objective findings: more than 20% of clue cells, a positive amine test and abnormal vaginal pH (>4.5). Together, these three criteria have greater than 95% specificity for BV compared with Nugent's Gram stain criteria.18 20 21
Analysis
Data were entered into a spreadsheet and analysed with statistical software. We generated descriptive frequencies to characterise our sample and performed χ2 tests of association between POC test results and participant characteristics. We compared the correlation between self and clinician-POC tests using a κ statistic. We generated point estimates and 95% CI for sensitivity and specificity for each diagnostic test method. We stratified data by variables such as reported vaginal symptoms (present, absent), vaginal pH (normal, abnormal), and amine positive to assess for differences in test performance (sensitivity or specificity) by these characteristics.
Based on our hypothesis that self-performed POC tests would be at least 80% sensitive and 95% specific using clinician-obtained culture and TMA results as the combined reference standard, we determined that a sample size of 48 true positive and at least 150 true negative cases would have 80% power to detect this effect, at an α of 0.05. In addition, this sample size would have adequate power (80%) to detect an alternative hypothesis of a strong κ statistic of 0.75 versus null hypothesis of moderate κ statistics of 0.4 between self and clinician-POC tests.
Results
Two hundred and seventy-four women initially agreed to participate. Twenty-seven women withdrew without completing surveys or testing, and 247 completed both self and clinician-POC testing. Of these, eight were missing swabs for culture and 30 were missing swabs for TMA. Therefore, 209 women had complete data on all test methods and comprise the study sample (figure 1). The mean age of women was 17.8 years, 87% were African-American, and over half (58%) had Medicaid as their insurance carrier. Vaginal symptoms (ie, itching or discharge) were elicited from 74% of women, and 51 (24.4%) had trichomoniasis as defined by our reference standard (table 1). Of these 51 true positives, 41 (80%) were positive by both culture and TMA, nine (18%) were only TMA positive, and one (2%) was culture positive but TMA negative.
All 209 women performed the self-POC test correctly and 207 (99%) interpreted the self-test results correctly. Two women misinterpreted a positive test as negative (reported a false-negative result). Self-performed and clinician-performed POC tests were highly correlated, with 95.7% agreement and a κ of 0.87 (table 2). Of the five cases in which the clinician POC test was positive and the self-POC test was negative (including the two false negatives described above), four were culture positive and all five were TMA positive. Of the four cases in which the clinician-POC test was negative and the self-POC test was positive (and confirmed positive by the RA), one was culture and TMA positive and one was TMA positive (confirmed positives). The remaining two had no confirmatory T vaginalis test positive and are presumed false positives. The RA comment entered on the day of testing for these two presumed false-positive cases that ‘clinician swabs appeared dry’.
Correlation of POC test with participant characteristics
We examined which clinical, demographic and laboratory characteristics were related to having a positive POC test (either self or clinician test) (table 1). We found no significant relationship between a positive POC test and the order of testing, vaginal symptoms, age, race, a history of multiple partners, douching, health insurance status, clinical BV, or clue cells on wet mount. However, a positive POC test was significantly associated with several variables. Women recruited from the ED were more likely to have a positive POC test than those recruited from the THC (36.2% vs 17.2%, p=0.003). Those with a positive amine test had a higher prevalence of positive POC trichomoniasis test results than those with a negative amine test (28.9% vs 14.1%, p=0.01). Of those with an abnormal vaginal pH test, 28.1% had a positive POC test, compared with only 16.9% of those with a normal vaginal pH (p=0.06).
Sensitivity and specificity of POC test relative to true positives
Compared with true positives, the sensitivity of the self-POC test was 78.4%, similar to that of the clinician-POC test (84.3%) and culture (82.4%), and significantly better than wet mount (39.2%) (table 3). The specificity of the self-POC test was 99%, not significantly different from that of the clinician-POC test (100%), culture, or TMA. In stratified analyses, the sensitivity of the self-POC test was not affected by vaginal symptoms, recruitment from the ED, a positive amine test, or an abnormal pH (data not shown).
Discussion
Our study demonstrated that a POC test for T vaginalis (a rapid antigen test using lateral flow technology) performed on self-obtained or clinician-obtained vaginal swabs was more sensitive than wet mount and equal to culture. In addition, we showed that young women can accurately perform a simple POC STI test and interpret their own results. In our previous work we used latent class analysis to confirm the 100% specificity of the POC test.7 Therefore, the two apparent ‘false positive’ self-POC tests are most likely to represent a sampling error: the woman may have obtained a better sample than the clinician. However, there is also the possibility that the test is not truly 100% specific.
Our findings have two main implications for addressing the epidemic of STI that disproportionately affects young women. First, we have demonstrated that self-obtained vaginal specimens were feasible and reliable for the diagnosis of trichomoniasis using a POC test. Others have demonstrated that self-collected vaginal swabs perform well in detecting chlamydia and gonorrhoea using NAAT11–13 22 and trichomoniasis using culture and/or PCR.14 16 The use of self-obtained vaginal specimens for the diagnosis of STI using NAAT has been promoted by many researchers,23 as well as the CDC.24 We thus now have another diagnostic method that can reliably be used on self-obtained vaginal specimens.
Self-swabs remove the requirement for a speculum examination, a factor that deters both women from accepting and clinicians from offering STI testing. Adolescent women express a clear preference for non-invasive methods over a pelvic examination.25 Among adolescent women offered self-obtained vaginal swabs for STI testing in a school setting, the majority rated self-swabs as easy to perform and preferable to a pelvic examination, and half of those with a diagnosed STI said they would not have sought STI testing if self-collection was not offered.26 Therefore, for asymptomatic women for whom a speculum and full pelvic examination are not indicated, a self-obtained vaginal swab may be the specimen of choice to detect trichomoniasis, as has been recommended for chlamydia. In this study, we collected survey data assessing the acceptability of self-testing compared with clinician testing at baseline and after testing. However, this complex dataset is still being analysed.
Second, we have shown that women can accurately perform their own STI tests, especially a simple device based on familiar lateral flow technology. We could not find literature to assess whether women could perform a home human chorionic gonadotrophin test for pregnancy (also lateral flow technology) before it became available over the counter, but it is possible that this was considered market research and did not get published in the scientific literature. The only other over-the-counter self-test device available to women is a self-pH test (pHEM_ALERT, http://Gynex.com, Redmond, Washington, USA). Before its release, two studies evaluated the pH test. The first used a questionnaire to assess whether adult women could understand the package insert, and 97.1% gave correct answers to at least 75% of the questions. In another study, pH results obtained by adult women were highly correlated with healthcare professional's results (κ=0.9).27 28 Vaginal pH may be useful in distinguishing candidiasis from BV; however, while we and others have shown that abnormal pH is associated with trichomoniasis, pH is neither sensitive nor specific enough to use as a diagnostic tool for trichomoniasis or other STI.
If young women had access to a simple POC test for trichomoniasis, they could identify twice as many cases as a clinician could using the insensitive wet mount examination, and nearly as many as NAAT testing. In fact, many clinicians no longer perform the wet mount, as it requires a microscope and because of Clinical Laboratory Improvement Amendment regulations. POC testing also provides the patient with her results within minutes, allowing immediate counselling and treatment and reducing the risk of transmission and the proportion of women who are lost to follow-up. In addition, we have shown that women who are aware of their POC test results are more likely to report safer sexual behaviours in the weeks after diagnosis.29 These issues are especially important for adolescent women who may be concerned about confidentiality and have limited access to health care. Another potential use of this POC T vaginalis test would be in resource-limited settings such as less developed areas of the world, where both diagnostic tests for trichomoniasis and access to pelvic examinations are limited.
A self-performed STI test would be a novel strategy to address barriers to STI testing in adolescent women. Gaydos et al30 recently demonstrated that adults can reliably perform their own HIV POC test in an ED setting. We believe we are the first to show that adolescent women can accurately perform and interpret an STI test. Unfortunately, intellectual property licensing may prevent over-the-counter marketing of this simple and effective tool. As other simple STI tests become available, we expect that our findings can be used to inform future decisions about the use of these tests by adolescent women.
If women could accurately perform a POC test for trichomoniasis in a clinical setting, they would avoid a pelvic examination, improve the accuracy over wet mount and receive immediate feedback that would allow treatment. Furthermore, self-POC testing could be expanded for use in non-clinical settings and even home use. In these scenarios, the convenience and confidentiality of self-testing may encourage more women to seek testing, thus impacting the overall epidemic of trichomoniasis in the USA.
Key messages
Self-obtained vaginal swabs are reliable specimens for POC trichomoniasis testing.
Adolescent women can accurately collect and perform a POC test for trichomoniasis.
Self-performed POC trichomoniasis tests were highly correlated with clinician-performed tests.
Self-obtained and self-performed testing could eliminate barriers and increase STI testing in vulnerable populations.
Acknowledgments
The authors would like to thank the staff and clinicians at the Teen Health Center who allowed us to recruit their patients. The support and guidance provided by Frank Biro and Lorah Dorn were critical to their success. The authors gratefully acknowledge statistical support from Justin Bates and Bin Huang and technical support from Mary Jett-Goheen. Finally, they are also indebted to the women who participated for their valuable time.
References
Footnotes
Funding The study was supported by grant number 5K23AI063182-04 (JSH, PI) from the NIH/NIAID and by grant number 1U54EB007958-01 (CG, PI) from the NIH/NIBIB.
Competing interests JSH has received diagnostic kits, speaker's honoraria and unrestricted research funds from Genzyme Diagnostics, Inc. JSH and CG have received kits and reagents from Gen-Probe, Inc. JSH has received diagnostic kits from Gynex Corporation.
Patient consent Obtained.
Ethics approval This study was conducted with the approval of the Cincinnati Children's Hospital Medical Center's institutional review board.
Provenance and peer review Not commissioned; externally peer reviewed.