A reliability generalization meta-analysis of the padua inventory of obsessions and compulsions

  1. Julio Sánchez-Meca 1
  2. María Rubio-Aparicio 1
  3. Rosa María Núñez-Núñez 2
  4. José López-Pina 1
  5. Fulgencio Marín-Martínez 1
  6. José Antonio López-López 3
  1. 1 Universidad de Murcia
    info

    Universidad de Murcia

    Murcia, España

    ROR https://ror.org/03p3aeb86

  2. 2 Universidad Miguel Hernández de Elche
    info

    Universidad Miguel Hernández de Elche

    Elche, España

    ROR https://ror.org/01azzms13

  3. 3 University of Bristol
    info

    University of Bristol

    Brístol, Reino Unido

    ROR https://ror.org/0524sp257

Mostrar afiliaciones +
Revista:
The Spanish Journal of Psychology

ISSN: 1138-7416

Año de publicación: 2017

Volumen: 20

Tipo: Artículo

DOI: 10.1017/SJP.2017.65 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: The Spanish Journal of Psychology

Resumen

The Padua Inventory (PI) of obsessions and compulsions is one of the most usually applied tests to assess obsessive-compulsive symptomatology in research contexts as well as for clinical and screening purposes. A reliability generalization meta-analysis was accomplished to estimate the average reliability of the PI scores and to search for characteristics of the samples and studies that can explain the variability among reliability estimates. An exhaustive literature search enabled us to select 39 studies (53 independent samples) that reported alpha and/or test-retest coefficients with the data at hand for the PI total score and subscales. An excellent average coefficient alpha was found for the PI total score (M = .935; 95%CI = .922–.949) and for Impaired Mental Control subscale (M = .911; 95%CI = .897–.924), being good for Contamination (M = .861; 95%CI = .841–.882) and Checking (M = .880; 95%CI = .856–.903), and fair for Urges and Worries (M = .783; 95%CI = .745–.822). The average test-retest reliability for PI total score was also satisfactory (M = .835; 95%CI = .782–.877). Moderator analyses showed larger coefficients alpha for larger standard deviation of the PI total scores (p = .0005; R 2 = .46), for adapted versions of the test (p = .002; R 2 = .32), and for samples composed of clinical participants (p = .066; R 2 = .10). The practical implications of these results are discussed as well as the need for researchers to report reliability estimates with the data at hand.

€ Ver financiación

Información de financiación

This research was supported by a grant from the Spanish Government and FEDER funds (Project No. PSI2016?77676?P)

Financiadores

Referencias bibliográficas

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.
  • Beşiroğlu L., Ağargün M. Y., Boysan M., Eryonucu B., Güleç M., & Selvi Y. (2005). The assessment of obsessive-compulsive symptoms: Reliability and validity of the Padua Inventory in a Turkish population. Turkish Journal of Psychiatry, 16, 179–189.
  • Bonett D. G. (2002). Sample size requirements for testing and estimating coefficient alpha. Journal of Educational and Behavioral Statistics, 27, 335–340. https://doi.org/10.3102/ 10769986027004335
  • Borenstein M., Hedges L. V., Higgins J. P. T., & Rothstein H. R. (2009). Introduction to meta-analysis. Chichester, UK: Wiley.
  • Borenstein M., Hedges L. V., Higgins J. P. T., & Rothstein H. R. (2014). Comprehensive Meta-analysis (Vers. 3.0) [Computer software]. Englewood, NJ: Biostat, Inc.
  • Bottesi G., Ghisi M., Ouimet A. J., Tira M. D., & Sanavio E. (2015). Compulsivity and impulsivity in pathological gambling: Does a dimensional-transdiagnostic approach add clinical utility to DSM–5 classification? Journal of Gambling Studies, 31, 825–847. https://doi.org/10.1007/ s10899-014-9470-5
  • Burns G. L., Keortge S. G., Formea G. M., & Sternberger L. G. (1996). Revision of the Padua Inventory of obsessive compulsive disorder symptoms: Distinctions between worry, obsessions, and compulsions. Behaviour Research and Therapy, 34, 163–173. https://doi.org/10.1016/0005-7967(95)00035-6
  • Chappa H. J. (1998). El Inventario de Obsesividad de Padua: Datos psicométricos y normativos de la versión en español [Padua’s Inventory of Obsession: Psychometric and normative data from the Spanish version]. Revista Argentina de Clínica Psicológica, 7, 117–129.
  • Charter R. A. (2003). A breakdown of reliability coefficients by test type and reliability methods, and the clinical implications of low reliability. Journal of General Psychology, 130, 290–304. https://doi.org/10.1080/00221300309601160
  • Craig (2014). Seeking the other side of the thought-action fusion: implications for risk-taking in young adultthood. Unpublished doctoral dissertation, University of Windsor, Canada.
  • Crocker L. M., & Algina J. (1986). Introduction to classical and modern test theory. New York, NY: Holt, Rinehart & Winston.
  • Cuttler C., & Graf P. (2009). Sub-clinical compulsive checkers show impaired performance on habitual, event-and time-cued episodic prospective memory tasks. Journal of Anxiety Disorders, 23, 813–823. https://doi. org/10.1016/j.janxdis.2009.03.006
  • Deditius-Island H. K., & Caruso J. C. (2002).An examination of the reliability of scores from Zuckerman’s sensation seeking scales, form V. Educational and Psychological Measurement, 64, 728–734. https://doi.org/10.1177/ 0013164402062004012
  • Goodarzi M. A., & Firoozabadi A. (2005). Reliability and validity of the Padua Inventory in an Iranian population. Behaviour Research and Therapy, 43, 43–54. https://doi. org/10.1016/j.brat.2003.11.004
  • Heldref Foundation (1997). Guidelines for contributors. Journal of Experimental Education, 65, 95–96.
  • Henson R. K., & Thompson B. (2002). Characterizing measurement error in scores across studies: Some recommendations for conducting “reliability generalization” studies. Measurement and Evaluation in Counseling and Development, 35, 113–127.
  • Higgins J. P. T., Thompson S. G., Deeks J. J., & Altman D. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327, 557–560. https://doi.org/10.1136/ bmj.327.7414.557
  • Ibáñez I., Olmedo E., Peñate W., & González M. (2002). Obsesiones y compulsiones: estructura del Inventario de Padua [Obsessions and compulsions: The structure of the Padua Inventory]. International Journal of Clinical and Health Psychology, 2, 263–288.
  • Kadak M. T., Balsak F., Besiroglu L., & Çelik C. (2014). Relationships between cognitive appraisals of adolescents with OCD and their mothers. Comprehensive Psychiatry, 55, 598–603. https://doi.org/10.1016/j.comppsych. 2013.11.013
  • Kessler R. C., Petukhova M., Sampson N. A., Zaslavsky A. M., & Wittchen H. U. (2012). Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. International Journal of Methods in Psychiatric Research, 21, 169–184. https://doi.org/10.1002/mpr.1359
  • Knapp G., & Hartung J. (2003). Improved tests for a random effects meta-regression with a single covariate. Statistics in Medicine, 22, 2693–2710. https://doi.org/ 10.1002/sim.1482
  • Kyrios M., Bhar S., & Wade D. (1996). The assessment of obsessive-compulsive phenomena: Psychometric and normative data on the Padua Inventory from an Australian non-clinical student sample. Behaviour Research and Therapy, 34, 85–95. https://doi.org/10.1016/00057967(95)00039-Z
  • Lavoie M. E., Sauvé G., Morand-Beaulieu S., Charron M. P., & O’Connor K. P (2014). Effects of obsessive-compulsive disorder symptom intensity on brain electro-cortical activity associated with emotional memory. In V. Kalinin (Ed.), Obsessive-compulsive disorder: The old and the new problems. Rijeka, Croacia: InTech.
  • López-López J. A., Botella J., Sánchez-Meca, & MarínMartínez F. (2013). Alternatives for mixed-effects meta-regression models in the reliability generalization approach: A simulation study. Journal of Educational and Behavioral Statistics, 38, 443–469. https://doi.org/ 10.3102/1076998612466142
  • Lord F. M., & Novick M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
  • Macdonald A. M., & de Silva P. (1999). The assessment of obsessionality using the Padua Inventory: Its validity in a British non-clinical sample. Personality and Individual Differences, 27, 1027–1046. https://doi.org/10.1016/ S0191-8869(99)00036-7
  • Mataix-Cols D., Sànchez-Turet M., & Vallejo J. (2002). A Spanish version of the Padua Inventory: Factor structure and psychometric properties. Behavioural and Cognitive Psychotherapy, 30, 25–36. https://doi.org/10.1017/ S1352465802001042
  • McDonald R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.
  • McLaren S., & Crowe S. F. (2003). The contribution of perceived control of stressful life events and thought suppression to the symptoms of obsessive–compulsive disorder in both non-clinical and clinical samples. Journal of Anxiety Disorders, 17, 389–403. https://doi.org/ 10.1177/1359105311433906
  • Norman R. M., Davies F., Malla A. K., Cortese L., & Nicholson I. R. (1996). Relationship of obsessivecompulsive symptomatology to anxiety, depression and schizotypy in a clinical population. British Journal of Clinical Psychology, 35, 553–566. https://doi.org/ 10.1111/j.2044-8260.1996.tb01211.x
  • Novy D. M., Stanley M. A., Averill P., & Daza P. (2001). Psychometric comparability of English-and Spanishlanguage measures of anxiety and related affective symptoms. Psychological Assessment, 13, 347–355. https:// doi.org/10.1037/1040-3590.13.3.347
  • Nunnally J. C., & Bernstein I. H. (1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.
  • Rodriguez M. C., & Maeda Y. (2006). Meta-analysis of coefficient alpha. Psychological Methods, 11, 306–322. https://doi.org/10.1037/1082-989X.11.3.306
  • Sanavio E. (1988). Obsessions and compulsions: The Padua Inventory. Behaviour Research and Therapy, 26, 169–177. https://doi.org/10.1016/0005-7967(88)90116-7
  • Sánchez-Meca J., López-López J. A., & López-Pina J. A. (2013). Some recommended statistical analytic practices when reliability generalization (RG) studies are conducted. British Journal of Mathematical and Statistical Psychology, 66, 402–425. https://doi. org/10.1111/j.2044-8317.2012.02057.x
  • Sánchez-Meca J., & Marín-Martínez F. (2008). Confidence intervals for the overall effect size in random-effects meta-analysis. Psychological Methods, 13, 31–48. https:// doi.org/10.1037/1082-989X.13.1.31
  • Sánchez-Meca J., Rubio-Aparicio M., Marín-Martínez F., & López-Pina J. A. (2015, July). The phenomenon of reliability induction in social and health sciences. Paper presented at the XIV Congress of Methodology of Behavioral Science. Palma de Mallora, Spain.
  • Sarısoy G., Terzi M., Gümüş K., & Pazvantoğlu O. (2013). Psychiatric symptoms in patients with multiple sclerosis. General Hospital Psychiatry, 35, 134–140. https://doi. org/10.1016/j.genhosppsych.2012.10.011
  • Scarrabelotti M. B., Duck J. M., & Dickerson M. M. (1995). Individual differences in obsessive-compulsive behaviour: The role of the Eysenckian dimensions and appraisals of responsibility. Personality and Individual Differences, 18, 413–421. https://doi.org/10.1016/0191-8869(94)00122-9
  • Shields A. L., & Caruso J. C. (2004). A reliability induction and reliability generalization study of the Cage Questionnaire. Educational and Psychological Measurement, 64, 254–270. https://doi.org/10.1177/0013164403261814
  • Somers J. M., Goldner E. M., Waraich P., & Hsu L. (2006). Prevalence and incidence studies of anxiety disorders: A systematic review of the literature. Canadian Journal of Psychiatry, 51, 100–113. https://doi.org/10.1177/ 070674370605100206
  • Stanley M. A., Beck J. G., & Zebb B. J. (1996). Psychometric properties of four anxiety measures in older adults. Behaviour Research and Therapy, 34, 827–838. https://doi. org/10.1016/0005-7967(96)00064-2
  • Sternberger L. G., & Burns G. L. (1990). Obsessions and compulsions: Psychometric properties of the Padua Inventory with an American college population. Behaviour Research and Therapy, 28, 341–345. https://doi.org/ 10.1016/0005-7967(90)90087-Y
  • Sterne J. A. C., Sutton A. J., Ioannidis J. P. A., Terrin N., Jones D. R., Lau J., ... Higgins J. P. T. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. British Medical Journal, 343, d4002. https://doi.org/10.1136/bmj.d4002
  • Streiner D. L., & Norman G. R. (2008). Health measurement scales: A practical guide to their development and use (4th ed.) New York, NY: Oxford University Press.
  • Sugiura Y., & Tanno Y. (2000). Self-report inventory of obsessive-compulsive symptoms: Reliability and validity of the Japanese version of the Padua Inventory. Archives of Psychiatric Diagnostics and Clinical Evaluation, 11, 175–189.
  • Suzuki T. (2005). Relationship between two aspect of perfectionism and obsessive-compulsive symptoms. Psychological Reports, 96, 299–305. https://doi.org/10.2466/ pr0.96.2.299-305
  • Thompson B. (1994). Guidelines for authors. Educational and Psychological Measurement, 54, 837–847.
  • Thompson B. (2003). Score reliability: Contemporary thinking on reliability issues. Thousand Oaks, CA: Sage.
  • Vaccaro L. D., Jones M. K., Menzies R. G., & Wootton B. M. (2014). The treatment of obsessive compulsive checking: A randomized trial comparing danger ideation reduction therapy with exposure and response prevention. Clinical Psychologist, 18, 74–95. https://doi.org/10.1111/ cp.12019
  • Vacha-Haase T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6–20. https://doi.org/10.1177/0013164498058001002
  • Vacha-Haase T., & Thompson B. (2011). Score reliability: A retrospective look back at 12 years of reliability generalization studies. Measurement and Evaluation in Counseling and Development, 44, 159–168. https://doi. org/10.1177/0748175611409845
  • Van Oppen P. (1992). Obsessions and compulsions: dimensional structure, reliability, convergent and divergent validity of the Padua Inventory. Behaviour Research and Therapy, 30, 631–637. https://doi. org/10.1016/0005-7967(92)90008-5
  • Van Oppen P., Hoekstra R. J., & Emmelkamp P. M. G. (1995). The structure of obsessive-compulsive symptoms. Behaviour Research and Therapy, 33, 15–23. https://doi. org/10.1016/0005-7967(94)E0010-G
  • Viechtbauer W. (2010). Conducting meta-analyses in R with the metaphor package. Journal of Statistical Software, 36, 1–48. https://doi.org/10.18637/jss.v036.i03
  • Viechtbauer W., López-López J. A., Sánchez-Meca J., & Marín-Martínez F. (2015). A comparison of procedures to test for moderators in mixed-effects meta-regression models. Psychological Methods, 20, 360–374. https://doi. org/10.1037/met0000023
  • Wakabayashi A., & Aobayashi T. (2007). Psychometric properties of the Padua Inventory in a sample of Japanese university students. Personality and Individual Differences, 43, 1113–1123. https://doi.org/10.1016/j.paid.2007.03.004
  • Wilkinson L., & APA Task Force on Statistical Inference. (1999). Statistical methods in psychology journal: Guidelines and explanations. American Psychologist, 54, 594–604. https://doi.org/10.1037/0003-066X.54.8.594
  • Williams M. T., & Turkheimer E. (2007). Identification and explanation of racial differences on contamination measures. Behaviour Research and Therapy, 45, 3041–3050. https://doi.org/10.1016/j.brat.2007.08.013
  • Williams M. T., Turkheimer E., Schmidt K. M., & Oltmanns T. F. (2005). Ethnic identification biases responses to the Padua Inventory for obsessivecompulsive disorder. Assessment, 12, 174–185. https:// doi.org/10.1177/1073191105275620
  • Zetsche U., Rief W., Westermann S., & Exner C. (2015). Cognitive deficits are a matter of emotional context: Inflexible strategy use mediates context-specific learning impairments in OCD. Cognition and Emotion, 29, 360–371. https://doi.org/10.1080/02699931.2014.911144
Fuente de los datos: Dialnet