Article Text
PDF
Abstract
Objectives: To examine the “in use” test characteristics of the POCkit “near patient” HSV-2 rapid test for the detection of HSV-2 IgG antibodies for use in the clinic. This test relies on a visual interpretation of the result.
Methods: 2093 serum samples, 229 from UK and 919 from Italian genitourinary medicine clinic patients and 945 from obstetric and gynaecology clinic patients in Italy were tested. Tests were carried out according to manufacturers' protocol in the United Kingdom and Italy. Three readers independently recorded a score for each test carried out and the results were compared.
Results: In the UK study, the three readers disagreed on the result on 5.2% of tests. In the Italian study, there was disagreement in 10.2% of tests.
Conclusions: This study has demonstrated a problem in the subjective nature of the interpretation of the POCkit HSV-2 test. It highlights the need for adequate training of clinic staff and the need for clinics to adopt policies of quality assurance and ongoing monitoring which will ensure the validity and accuracy of this clinic based test.
- evaluation
- herpes simplex virus
- POCkit HSV-2 test
Statistics from Altmetric.com
Herpes simplex virus type 2 (HSV-2) is the principal cause of genital herpes. Traditionally, infection has been diagnosed by isolation of virus or viral antigen detection directly from genital lesions. However, this approach is impractical for diagnosing infection in the absence of a lesional recurrence or for diagnosing infection in people with asymptomatic infection.1 Recently, a number of commercial assays which can detect antibodies to HSV-2 have been developed for use in diagnostic serology laboratories. In addition, POCkit HSV-2 rapid test has been developed as a near patient test designed for use in the clinic. The POCkit test detects HSV-2 type specific IgG antibodies in either whole blood or serum. Interpretation of the test result relies on visualising a pink/red coloured spot in the test device. Early evaluation of this test compared with western blot analysis on 87 specimens found that the POCkit HSV-2 rapid test had a sensitivity of 96% and a specificity of 97%.2 In this report we present results of two separate evaluations of the POCkit test, one conducted in London and the other in Italy, which examine the “in use” test characteristics.
Subjects, methods, and results
UK
In all, 229 serum samples were collected from selected genitourinary medicine clinic patients through the MSSVD Advisory Panel on genital herpes.
ITALY
A total of 919 serum samples were collected in an STD clinic and 945 serum samples were collected in an obstetric and gynaecology clinic.
In both cases the tests were carried out according to the manufacturers' protocol. Owing to the subjective nature of the test, a scoring scheme already developed for evaluation of other near patient serology tests3 (table 1) was applied to the POCkit HSV rapid test. From this, three independent readers recorded a score for each of the tests.
Scoring system used to read the POCkit HSV 2 rapid test*
In the UK study, the three readers disagreed on the result in 12 out of 229 samples (5.2%). In two of these 12 samples, a positive/negative and ambiguous reading was given by each of the different readers of the same specimen, and in the remainder at least two different test results were given for each specimen. In the Italian study there was disagreement about 192 samples (10.2%). The majority, 182, were read as ambiguous (test score 1) by at least one of the readers.
Discussion
This study has demonstrated a problem in the subjective nature of the interpretation of the POCkit HSV-2 test. This caused difficulty with the interpretation of the result even in the hands of highly experienced laboratory staff. Of note, this test is designed to be used in clinics, pharmacies, and by the general public, when it will often be carried out by non-laboratory trained staff. It is clearly important that these staff receive adequate training in the interpretation of these tests, with ongoing evaluation to ensure consensus of interpretation. In this study some patients undergoing testing could have received either a false positive or false negative HSV-2 antibody result with likely unfortunate consequences.4 This assay is now sold for home testing directly to patients (wellbeing met), which may lead to further diagnostic confusion.
At the time of this evaluation, the POCkit HSV-2 rapid test did not include the option of an “ambiguous” result. However, the manufacturer of the test kit, Diagnology, have responded to this problem by clarifying the interpretation criteria particularly to cases where the test spot is very faint, as being an “indeterminate” result, cautioning users about the possibility of overinterpretation of these faint results. A further serological test 4–6 weeks later is recommended. This response is welcomed and must be publicised.
Importantly, extensive quality assurance schemes exist within laboratories to ensure that test results are reproducible. With the likely increase in near patient test kits, it is essential that large scale evaluations in laboratories are undertaken before clinic use and that clinics adopt policies of quality assurance and ongoing monitoring which will ensure the validity and accuracy of clinic based testing. In addition, it should be established that similar performance characteristics of the near patient test can be guaranteed in non-laboratory settings before they are widely introduced.
Footnotes
-
↵* On behalf of the MSSVD Special Interest Group on Genital Herpes.