Reliability of a Battery of cognitive tests in Young, healthy people

  1. María, Ramírez-de la Cruz 1
  2. Alfredo, Bravo-Sánchez 2
  3. Paula, Esteban-García 1
  4. Fernando Jiménez 1
  5. Javier Abián Vicen 1
  1. 1 Faculty of Sport Sciences, University of Castilla-La Mancha, Toledo, Spain.
  2. 2 Faculty of Health Sciences, Universidad Francisco de Vitoria, Ctra. Pozuelo-Majadahonda km 1,800, 28223 Pozuelo de Alarcón, Spain.
Journal:
Revista de psicología del deporte

ISSN: 1132-239X,  1988-5636

Year of publication: 2023

Volume: 32

Issue: 1

Pages: 148-160

Type: Article

DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Revista de psicología del deporte

Abstract

Cognitive performance is an essential aspect of sports. Still, few studies provide reliable cognitive tests for training and evaluating cognitive aspects related to sports, particularly in a healthy and/or youthful population. This study assessed the intraday and interday reliability of a cognitive test battery related to sports performance. In the research, seventeen healthy volunteers participated. DynavisionTMD2, Bassin Anticipation Timer, Go/No-Go, Eriksen Flanker, and the Trail Making Test (TMT) were analyzed. TMT-A and TMT-B (intraday), as well as the following variables in the interday analysis, exhibited significant differences: "Physical RT - Fastest" (Test 1), "Visual RT - Fastest" and "Physical RT - Fastest" (Test 2), "Visual RT - Fastest" (Test 4) and TMT-A. Thirteen of the thirty-one variables analyzed on the intraday exam had moderate Intraclass Correlation Coefficients (ICC), six were good, and one was exceptional. In the interday analysis, 15 variables with moderate ICC and 5 variables with excellent ICC were identified. Reliable tests include "Reaction Time" (Tests 5 and 6) and "Red and Green Lights" of the DynavisionTMD2, the 15 mph speed of the Bassin Anticipation Timer, and the Go/No-Go, Eriksen Flanker, and TMT tests.

Bibliographic References

  • Abernethy, B. (1989). Expert-novice differences in perception: How expert does the expert have to be? Canadian Journal of Sport Sciences, 14(1), 27-30. https://pubmed.ncbi.nlm.nih.gov/2924219
  • Allard, M., Husky, M., Catheline, G., Pelletier, A., Dilharreguy, B., Amieva, H., Peres, K., Foubert-Samier, A., Dartigues, J.-F., & Swendsen, J. (2014). Mobile Technologies in the Early Detection of Cognitive Decline. PLOS ONE, 9(12), e112197. https://doi.org/10.1371/journal.pone.0112197
  • Bernecke, V., Pukenas, K., & Brazaitis, M. (2016). Sex differences in reliability of tests to assess cognitive function. Baltic journal of sport and health sciences, 2(101), 17-25. http://dx.doi.org/10.33607/bjshs.v2i101.57
  • Bigsby, K., Mangine, R. E., Clark, J. F., Rauch, J. T., Bixenmann, B., Susaret, A. W., Hasselfeld, K. A., & Colosimo, A. J. (2014). Effects of postural control manipulation on visuomotor training performance: comparative data in healthy athletes. International Journal of Sports Physical Therapy, 9(4), 436-446. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4127506
  • Brady, F. (1996). Anticipation of Coincidence, Gender, and Sports Classification. Perceptual and Motor Skills, 82(1), 227-239. https://doi.org/10.2466/pms.1996.82.1.227
  • Cognitive fun. (2008). cognitivefun.net. https://new.cognitivefun.net/
  • Coker, C. A. (2004). Bilateral Symmetry in Coincident Timing: A Preliminary Investigation. Perceptual and Motor Skills, 98(1), 359-365. https://doi.org/10.2466/pms.98.1.359-365
  • Coker, C. A. (2005). Direction of an Approaching Stimulus on Coincident Timing Performance of a Ballistic Striking Task. Perceptual and Motor Skills, 100(3), 859-860. https://doi.org/10.2466/pms.100.3.859-860
  • Crocetta, T. B., Guarnieri, R., Massetti, T., Silva, T. D. d., de Almeida Barbosa, R. T., Ferreira de Lima Antao, J. Y., Abreu, L. C. d., & Monteiro, C. B. d. M. (2019). Concurrent Validity and Reliability of Alternative Computer Game for the Coincidence-Anticipation Timing Task. Measurement in Physical Education and Exercise Science, 23(2), 169-185. https://doi.org/10.1080/1091367X.2018.1560297
  • Dikmen, S. S., Heaton, R. K., Grant, I., & Temkin, N. R. (1999). Test-retest reliability and practice effects of Expanded Halstead-Reitan Neuropsychological Test Battery. Journal of the International Neuropsychological Society, 5(4), 346-356. https://doi.org/10.1017/S1355617799544056
  • Ducrocq, E., Wilson, M., Smith, T. J., & Derakshan, N. (2017). Adaptive working memory training reduces the negative impact of anxiety on competitive motor performance. Journal of Sport and Exercise Psychology, 39(6), 412-422. https://doi.org/10.1123/j sep.2017-0217
  • Furley, P., & Memmert, D. (2010). Differences in Spatial Working Memory as a Function of Team Sports Expertise: The Corsi Block-Tapping Task in Sport Psychological Assessment. Perceptual and Motor Skills, 110(3), 801-808. https://doi.org/10.2466/pms.110.3.801-808
  • Gaudino, E. A., Geisler, M. W., & Squires, N. K. (1995). Construct validity in the trail making test: What makes part B harder? Journal of Clinical and Experimental Neuropsychology, 17(4), 529-535. https://doi.org/10.1080/01688639508405143
  • Harris, D. J., Wilson, M. R., & Vine, S. J. (2018). A Systematic Review of Commercial Cognitive Training Devices: Implications for Use in Sport. Frontiers in Psychology, 9, 709. https://doi.org/10.3389/fpsyg.2018.00709
  • Helsen, W. F., & Starkes, J. L. (1999). A multidimensional approach to skilled perception and performance in sport. Applied Cognitive Psychology, 13(1), 1-27. https://doi.org/10.1002/(SICI)1099-0720(199902)13:1<kAID-ACP540>3.0.00;2-T
  • Hooper, B., Faria, L. 0., Fortes, L. d. S., Wanner, S. P., & Albuquerque, M. R. (2022). Development and reliability of a test for assessing executive functions during exercise. Applied Neuropsychology: Adult, 29(4), 750-760. https://doi.org/10.1080/23279095.2020.1807984
  • Hopkins, W. G. (2000). Measures of Reliability in Sports Medicine and Science. Sports Medicine, 30(1), 1-15. https://doi.org/10.2165/00007256-200030010-00001
  • Hunzinger, K. J., Sanders, E. W., Deal, H. E., Langdon, J. L., Evans, K. M., Clouse, B. A., Munkasy, B. A., & Buckley, T. A. (2020). The use of a visual motor test to identify lingering deficits in concussed collegiate athletes. Journal of Clinical and Translational Research, 5(4), 178-185. http://dx.doi.org/10.18053/jctres.05.202004.004
  • Klavora, P., Gaskovski, P., & Forsyth, R. D. (1995). Test-Retest Reliability of Three Dynavision Tasks. Perceptual and Motor Skills, 80(2), 607-610. https://doi.org/10.2466/pms.1995.80.2.607
  • Konishi, K., Kimura, T., Yuhaku, A., Kurihara, T., Fujimoto, M., Hamaoka, T., & Sanada, K. (2017). Mouth rinsing with a carbohydrate solution attenuates exercise-induced decline in executive function. Journal of the International Society of Sports Nutrition, 14(1), 45. https://doi.org/10.1186/s12970-017-0200-0
  • Koo, T. K., & Li, M. Y. (2016). A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of Chiropractic Medicine, 15(2), 155-163. https://doi.org/10.1016/j.jcm.2016.02.012
  • Kuan, Y. M., Zuhairi, N. A., Manan, F. A., Knight, V. F., & Omar, R. (2018). Visual reaction time and visual anticipation time between athletes and non-athletes. Malaysian Journal of Public Health Medicine, 1, 135¬141. https://www.researchgate.net/publication/324441797
  • Levine, A. J., Miller, E. N., Becker, J. T., Selnes, 0. A., & Cohen, B. A. (2004). Normative Data for Determining Significance of Test-Retest Differences on Eight Common Neuropsychological Instruments. The Clinical Neuropsychologist, 18(3), 373-384. https://doi.org/10.1080/1385404049052420
  • Lindenberger, U., Scherer, H., & Baltes, P. B. (2001). The strong connection between sensory and cognitive performance in old age: Not due to sensory acuity reductions operating during cognitive assessment. Psychology and Aging, 16(2), 196-205. https://doi.org/10.1037/0882-7974.16.2.196
  • Ludyga, S., Piihse, U., Lucchi, S., Marti, J., & Gerber, M. (2019). Immediate and sustained effects of intermittent exercise on inhibitory control and task-related heart rate variability in adolescents. Journal of Science and Medicine in Sport, 22(1), 96-100. https://doi.org/10.1016/j.jsams.2018.05.027
  • Mahncke, H. W., Connor, B. B., Appelman, J., Ahsanuddin, 0. N., Hardy, J. L., Wood, R. A., Joyce, N. M., Boniske, T., Atkins, S. M., & Merzenich, M. M. (2006). Memory enhancement in healthy older adults using a brain plasticity-based training program: A randomized, controlled study. Proceedings of the National Academy of Sciences, 103(33), 12523-12528. https://doi.org/10.1073/pnas.0605194103
  • Makizako, H., Shimada, H., Park, H., Doi, T., Yoshida, D., Uemura, K., Tsutsumimoto, K., & Suzuki, T. (2013). Evaluation of multidimensional neurocognitive function using a tablet personal computer: Test-retest reliability and validity in community-dwelling older adults. Geriatrics & Gerontology International, 13(4), 860-866. https://doi.org/10.1111/ggi.12014
  • Memmert, D. (2009). Pay attention! A review of visual attentional expertise in sport. International Review of Sport and Exercise Psychology, 2(2), 119-138. https://doi.org/10.1080/17509840802641372
  • Nagahara, A. H., Bernot, T., & Tuszynski, M. H. (2010). Age-related cognitive deficits in rhesus monkeys mirror human deficits on an automated test battery. Neurobiology of Aging, 31(6), 1020-1031. https://doi.org/10.1016/j.neurobiolaging.2008.07.007
  • O'Leary, K. C., Pontifex, M. B., Scudder, M. R., Brown, M. L., & Hillman, C. H. (2011). The effects of single bouts of aerobic exercise, exergaming, and videogame play on cognitive control. Clinical Neurophysiology, 122(8), 1518-1525. haps://doi.org/10.1016/j.clinph.2011.01.049
  • Reigal, R. E., Barrero, S., Martin, I., Morales-Sanchez, V., Juarez-Ruiz de Mier, R., & Hernandez-Mendo, A. (2019). Relationships Between Reaction Time, Selective Attention, Physical Activity, and Physical Fitness in Children. Frontiers in Psychology, 10, 2278. https://doi.org/10.3389/fpsyg.2019.02278
  • Schmidt, D., Germano, A. M. C., & Milani, T. L. (2015). Aspects of Dynamic Balance Responses: Inter- and Intra-Day Reliability. PLOS ONE, 10(9), e0136551. https://doi.org/10.1371/journal.pone.0136551
  • Simons, D. J., Boot, W. R., Charness, N., Gathercole, S. E., Chabris, C. F., Hambrick, D. Z., & Stine-Morrow, E. A. L. (2016). Do "Brain-Training" Programs Work? Psychological Science in the Public Interest, 17(3), 103¬186. https://doi.org/10.1177/1529100616661983
  • Sliwinski, M. J., Mogle, J. A., Hyun, J., Munoz, E., Smyth, J. M., & Lipton, R. B. (2018). Reliability and Validity of Ambulatory Cognitive Assessments. Assessment, 25(1), 14-30. https://doi.org/10.1177/1073191116643164
  • Smith, S. R., Servesco, A. M., Edwards, J. W., Rahban, R., Barazani, S., Nowinski, L. A., Little, J. A., Blazer, A. L., & Green, J. G. (2008). Exploring the Validity of the Comprehensive Trail Making Test. The Clinical Neuropsychologist, 22(3), 507-518. https://doi.org/10.1080/13854040701399269
  • Stewart, P. F., Turner, A. N., & Miller, S. C. (2014). Reliability, factorial validity, and interrelationships of five commonly used change of direction speed tests. Scandinavian Journal of Medicine & Science in Sports, 24(3), 500-506. https://doi.org/10.1111/sms.12019
  • Tallis, J., Duncan, M. J., Wright, S. L., Eyre, E. L. J., Bryant, E., Langdon, D., & James, R. S. (2013). Assessment of the ergogenic effect of caffeine supplementation on mood, anticipation timing, and muscular strength in older adults. Physiological Reports, 1(3), e00072. https://doi.org/10.1002/phy2.72
  • Thomas, C. J., Rothschild, J., Earnest, C. P., & Blaisdell, A. (2019). The Effects of Energy Drink Consumption on Cognitive and Physical Performance in Elite League of Legends Players. Sports, 7(9), 196. https://doi.org/10.3390/sports7090196
  • Timmers, C., Maeghs, A., Vestjens, M., Bonnemayer, C., Hamers, H., & Blokland, A. (2014). Ambulant Cognitive Assessment Using a Smartphone. Applied Neuropsychology: Adult, 21(2), 136-142. https://doi.org/10.1080/09084282.2013.778261
  • Van Campen, C. M. C., Rowe, P. C., Verheugt, F. W. A., & Visser, F. C. (2020). Cognitive Function Declines Following Orthostatic Stress in Adults With Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS). Frontiers in Neuroscience, 14, 688. https://doi.org/10.3389/fnins.2020.00688
  • Vesia, M., Esposito, J., Prime, S. L., & Klavora, P. (2008). Correlations of Selected Psychomotor and Visuomotor Tests with Initial Dynavision Performance. Perceptual and Motor Skills, 107(1), 14-20. https://doi.org/10.2466/pms.107.1.14-20
  • Votruba, K. L., & Langenecker, S. A. (2013). Factor structure, construct validity, and age- and education-based normative data for the Parametric Go/No-Go Test. Journal of Clinical and Experimental Neuropsychology, 35(2), 132-146. https://doi.org/10.1080/13803395.2012.758239
  • Wagner, S., Helmreich, I., Dahmen, N., Lieb, K., & Tadi6, A. (2011). Reliability of Three Alternate Forms of the Trail Making Tests A and B. Archives of Clinical Neuropsychology, 26(4), 314-321. https://doi.org/10.1093/arclin/acr024
  • Weir, J. P. (2005). Quantifying Test-Retest Reliability Using the Intraclass Correlation Coefficient and the SEM. The Journal of Strength & Conditioning Research, 19(1), 231-240. https://doi.org/10.1519/15184.1
  • Wells, A. J., Hoffman, J. R., Beyer, K. S., Jajtner, A. R., Gonzalez, A. M., Townsend, J. R., Mangine, G. T., Robinson, E. H. t., McCormack, W. P., Fragala, M. S., & Stout, J. R. (2014). Reliability of the dynavision- d2 for assessing reaction time performance. Journal of Sports Science and Medicine, 13(1), 145-150. http://www.jssm.org/researchjssm-13¬145.xml.xml
  • Wells, A. J., & Johnson, B.-a. D. I. (2022). Test-Retest Reliability, Training, and Detraining Effects Associated With the Dynavision D2'" Mode A Visuomotor Reaction Time Test. Journal of Sport Rehabilitation, 31(2), 253-261. https://doi.org/10.1123/jsr.2020-0550
  • Williams, B. J., & Kaufmann, L. M. (2012). Reliability of the Go/No Go Association Task. Journal of Experimental Social Psychology, 48(4), 879-891. https://doi.org/10.1016/j.jesp.2012.03.001
  • Williams, K. (1985). Age Differences on a Coincident Anticipation Task. Journal of Motor Behavior, 17(4), 389-410. https://doi.org/10.1080/00222895.1985.10735357
  • Williams, L. R. T. (2000). Coincidence Timing of a Soccer Pass: Effects of Stimulus Velocity and Movement Distance. Perceptual and Motor Skills, 91(1), 39-52. https://doi.org/10.2466/pms.2000.91.1.39
  • Williams, L. R. T., Katene, W. H., & Fleming, K. (2002). Coincidence Timing of a Tennis Stroke: Effects of Age, Skill Level, Gender, Stimulus Velocity, and Attention Demand. Research Quarterly for Exercise and Sport, 73(1), 28-37. https://doi.org/10.1080/02701367.2002.10608989
  • Wostmann, N. M., Aichert, D. S., Costa, A., Rubia, K., Moller, H.-J., & Ettinger, U. (2013). Reliability and plasticity of response inhibition and interference control. Brain and Cognition, 81(1), 82-94. https://doi.org/10.1016/j.bandc.2012.09.010
  • Wrisberg, C. A., Hardy, C. J., & Beitel, P. A. (1982). Stimulus Velocity and Movement Distance as Determiners of Movement Velocity and Coincident Timing Accuracy. Human Factors, 24(5), 599-608. https://doi.org/10.1177/001872088202400510
Data source: Dialnet