Skip to main content
SpringerLink
Log in

Web-Based Sex Diaries and Young Adult Men Who Have Sex with Men: Assessing Feasibility, Reactivity, and Data Agreement

  • Original Paper
  • Published:
Archives of Sexual Behavior Aims and scope Submit manuscript

Abstract

We compared quantitative diary data with retrospective survey data collected from a cohort of young adult men who have sex with men (MSM) in Seattle, Washington. Ninety-five MSM, aged 16–30 years, completed web-based surveys every 3 months and were randomized to 4 diary submission schedules: every 2 weeks, once a week, twice a week, or never. We calculated diary completion rates and assessed agreement between daily diary data and aggregate retrospective survey data for sexual behavior measures. Over 6 months, 78 % of participants completed at least 80 % of their diary days, and the 2-week schedule had the highest and most consistent completion rate. The majority of sexual behavior and substance use measures had strong agreement between the diary and retrospective survey data (i.e., kappa >0.80 or concordance correlation coefficient ≥0.75), although we observed poorer agreement for some measures of numbers of anal sex acts. There were no significant differences in mean responses across diary schedules. We observed some evidence of reactivity (i.e., a difference in behavior associated with diary completion). Participants not assigned diaries reported significantly more unprotected anal sex acts and were more likely to be newly diagnosed with HIV or another sexually transmitted infection compared to those assigned active diary schedules. This study suggests that sexual behavior data collected from young adult MSM during 3-month retrospective survey—an interval commonly used in sexual behavior research—are likely valid. Diaries, however, may have greater utility in sexual behavioral research in which counts, timing, sequence, or within-person variation over time are of particular import.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Armstrong, B., White, E., & Saracci, R. (1992). Principles of exposure measurement in epidemiology. New York: Oxford University Press.

    Google Scholar 

  • Baer, A., Saroiu, S., & Koutsky, L. A. (2002). Obtaining sensitive data through the web: An example of design and methods. Epidemiology, 13, 640–645.

    Article  PubMed  Google Scholar 

  • Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579–616.

    Article  PubMed  Google Scholar 

  • Catania, J. A., Gibson, D. R., Chitwood, D. D., & Coates, T. J. (1990). Methodological problems in AIDS behavioral research: Influences on measurement error and participation bias in studies of sexual behavior. Psychological Bulletin, 108, 339–362.

    Article  PubMed  Google Scholar 

  • Centers for Disease Control and Prevention. (2009). Diagnoses of HIV infection and AIDS in the United States and dependent areas, 2009. Atlanta, GA: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention.

    Google Scholar 

  • Colfax, G., Vittinghoff, E., Husnik, M. J., McKirnan, D., Buchbinder, S., Koblin, B.,…Coates, T. J. (2004). Substance use and sexual risk: A participant- and episode-level analysis among a cohort of men who have sex with men. American Journal of Epidemiology, 159, 1002–1012.

    Article  PubMed  Google Scholar 

  • Coxon, A. P. (1999). Parallel accounts? Discrepancies between self-report (diary) and recall (questionnaire) measures of the same sexual behaviour. AIDS Care, 11, 221–234.

    Article  PubMed  Google Scholar 

  • Coxon, A. P., Coxon, N. H., Weatherburn, P., Hunt, A. J., Hickson, F., Davies, P. M., et al. (1993). Sex role separation in sexual diaries of homosexual men. AIDS, 7, 877–882.

    Article  PubMed  Google Scholar 

  • Downey, L., Ryan, R., Roffman, R., & Kulich, M. (1995). How could I forget? Inaccurate memories of sexually intimate moments. Journal of Sex Research, 32, 177–191.

    Article  Google Scholar 

  • Durant, L. E., & Carey, M. P. (2000). Self-administered questionnaires versus face-to-face interviews in assessing sexual behavior in young women. Archives of Sexual Behavior, 29, 309–322.

    Article  PubMed  Google Scholar 

  • Garry, M., Sharman, S. J., Feldman, J., Marlatt, G. A., & Loftus, E. F. (2002). Examining memory for heterosexual college students’ sexual experiences using an electronic mail diary. Health Psychology, 21, 629–634.

    Article  PubMed  Google Scholar 

  • Gillmore, M. R., Leigh, B. C., Hoppe, M. J., & Morrison, D. M. (2010). Comparison of daily and retrospective reports of vaginal sex in heterosexual men and women. Journal of Sex Research, 47, 279–284.

    Article  PubMed Central  PubMed  Google Scholar 

  • Graham, C. A., Catania, J. A., Brand, R., Duong, T., & Canchola, J. A. (2003). Recalling sexual behavior: A methodological analysis of memory recall bias via interview using the diary as the gold standard. Journal of Sex Research, 40, 325–332.

    Article  PubMed  Google Scholar 

  • Hoppe, M. J., Morrison, D. M., Gillmore, M. R., Beadnell, B., Higa, D. H., & Leigh, B. C. (2008). Agreement of daily diary and retrospective measures of condom use. AIDS and Behavior, 12, 113–117.

    Article  PubMed Central  PubMed  Google Scholar 

  • Horvath, K. J., Beadnell, B., & Bowen, A. M. (2007). A daily web diary of the sexual experiences of men who have sex with men: Comparisons with a retrospective recall survey. AIDS and Behavior, 11, 537–548.

    Article  PubMed  Google Scholar 

  • Irwin, T. W., Morgenstern, J., Parsons, J. T., Wainberg, M., & Labouvie, E. (2006). Alcohol and sexual HIV risk behavior among problem drinking men who have sex with men: An event level analysis of timeline followback data. AIDS and Behavior, 10, 299–307.

    Article  PubMed  Google Scholar 

  • Lambert, G., Cox, J., Hottes, T. S., Tremblay, C., Frigault, L. R., Alary, M.,…M-Track Study Group. (2011). Correlates of unprotected anal sex at last sexual episode: Analysis from a surveillance study of men who have sex with men in Montreal. AIDS and Behavior, 15, 584–595.

    Article  PubMed  Google Scholar 

  • Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.

    Article  PubMed  Google Scholar 

  • Leigh, B. C., Gillmore, M. R., & Morrison, D. M. (1998). Comparison of diary and retrospective measures for recording alcohol consumption and sexual activity. Journal of Clinical Epidemiology, 51, 119–127.

    Article  PubMed  Google Scholar 

  • Lenhart, A., Purcell, K., Smith, A., & Zickuhr, K. (2010). Social media and young adults. Washington, DC: Pew Internet and American Life Project: Pew Internet. Retrieved from Pew Internet website: http://www.pewinternet.org/Reports/2010/Social-Media-and-Young-Adults.aspx

  • Lin, L. I. (1989). A concordance correlation coefficient to evaluate reproducibility. Biometrics, 45, 255–268.

    Article  PubMed  Google Scholar 

  • Mansergh, G., Flores, S., Koblin, B., Hudson, S., McKirnan, D., & Colfax, G. N. (2008). Alcohol and drug use in the context of anal sex and other factors associated with sexually transmitted infections: Results from a multi-city study of high-risk men who have sex with men in the USA. Sexually Transmitted Infections, 84, 509–511.

    Article  PubMed  Google Scholar 

  • Mark, K. E., Wald, A., Drolette, L., & Golden, M. R. (2008). Internet and email use among STD clinic patients. Sexually Transmitted Diseases, 35, 960–965.

    Article  PubMed Central  PubMed  Google Scholar 

  • McAuliffe, T. L., DiFranceisco, W., & Reed, B. R. (2007). Effects of question format and collection mode on the accuracy of retrospective surveys of health risk behavior: A comparison with daily sexual activity diaries. Health Psychology, 26, 60–67.

    Article  PubMed  Google Scholar 

  • McLaws, M., Oldenburg, B., Ross, M. W., & Cooper, D. A. (1990). Sexual behavior in AIDS-related research: Reliability and validity of recall and diary measures. Journal of Sex Research, 27, 265–281.

    Article  Google Scholar 

  • Miller, E. T., Neal, D. J., Roberts, L. J., Baer, J. S., Cressler, S. O., Metrik, J., et al. (2002). Test-retest reliability of alcohol measures: Is there a difference between internet-based assessment and traditional methods? Psychology of Addictive Behaviors, 16, 56–63.

    Article  PubMed  Google Scholar 

  • Mustanski, B. S. (2007). Are sexual partners met online associated with HIV/STI risk behaviours? Retrospective and daily diary data in conflict. AIDS Care, 19, 822–827.

    Article  PubMed  Google Scholar 

  • Mustanski, B. (2008). Moderating effects of age on the alcohol and sexual risk taking association: An online daily diary study of men who have sex with men. AIDS and Behavior, 12, 118–126.

    Article  PubMed  Google Scholar 

  • Okami, P. (2002). Dear diary: A useful but imperfect method. In W. E. Wiederman & B. E. Whitley (Eds.), Handbook for conducting research on human sexuality (pp. 195–208). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Schroder, K. E., Carey, M. P., & Vanable, P. A. (2003). Methodological challenges in research on sexual risk behavior: II. Accuracy of self-reports. Annals of Behavioral Medicine, 26, 104–123.

    Article  PubMed Central  PubMed  Google Scholar 

  • Weinhardt, L. S., Forsyth, A. D., Carey, M. P., Jaworski, B. C., & Durant, L. E. (1998). Reliability and validity of self-report measures of HIV-related sexual behavior: Progress since 1990 and recommendations for research and practice. Archives of Sexual Behavior, 27, 155–180.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Acknowledgments

The study was funded by the National Institutes of Health (R03 AI074359) and the Royalty Research Fund at the University of Washington. S.N.G. was also supported by the University of Washington STD/AIDS Research Training Program (T32 AI007140) from the National Institutes of Health, U.S. Public Health Service.

Author information

Authors and Affiliations

  1. Department of Epidemiology and Biostatistics, The George Washington University, 2100-W Pennsylvania Ave. NW, 8th Floor, Washington, DC, 20037, USA

    Sara Nelson Glick

  2. Department of Epidemiology, University of Washington, Seattle, WA, USA

    Rachel L. Winer

  3. Department of Medicine, University of Washington, Seattle, WA, USA

    Matthew R. Golden

  4. HIV/STD Program, Public Health—Seattle & King County, Seattle, WA, USA

    Matthew R. Golden

Authors
  1. Sara Nelson Glick
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rachel L. Winer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Matthew R. Golden
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sara Nelson Glick.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Glick, S.N., Winer, R.L. & Golden, M.R. Web-Based Sex Diaries and Young Adult Men Who Have Sex with Men: Assessing Feasibility, Reactivity, and Data Agreement. Arch Sex Behav 42, 1327–1335 (2013). https://doi.org/10.1007/s10508-012-9984-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10508-012-9984-9

Keywords

Search

Navigation