Volume 9, Issue 3 (Summer 2021)                   PCP 2021, 9(3): 179-188 | Back to browse issues page


XML Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Nasiry S, Nasiry N, Noori M. Psychometric Properties of COVID-19 Dot-probe Task in Iranian Adults. PCP 2021; 9 (3) :179-188
URL: http://jpcp.uswr.ac.ir/article-1-755-en.html
1- Department of Clinical Psychology, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran. , snasiry@sbmu.ac.ir
2- Department of Psychology, Faculty of Social Sciences, Imam Khomeini International University, Qazvin, Iran.
3- Department of Clinical Psychology, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
Full-Text [PDF 686 kb]   (1173 Downloads)     |   Abstract (HTML)  (3207 Views)
Full-Text:   (693 Views)
1. Introduction
Based on the World Health Organization statement in March 2020, the outbreak of coronavirus is a pandemic and it is not only endangering physical health, but also deteriorating personal, familial, and public mental health (Jakovljevic, Bjedov, Jaksic, & Jakovljevic, 2020). COVID-19 has changed how health care systems operate and how people behave in private and social situations, so the general population’s way of living and their priorities have altered (Fiorillo & Gorwood, 2020). The outbreak has decreased public mental health through the sudden rise of mortality rates, joblessness, stigmatization, seclusion, and lack of close contact with friends and loved ones (Marčinko, Jakovljević, Jakšić, Bjedov, & Mindoljević Drakulić, 2020). Recent studies suggest that people with a mental health condition are more vulnerable to the deteriorating psychological effects of the COVID-19 outbreak. These people are especially prone to tension and stress, and the current situation can exacerbate their already psychological problems (Yao, Chen, & Xu, 2020).
While the psychological issues caused by the coronavirus pandemic are wide-ranging, it has specifically affected the general population’s anxiety (Wang et al., 2020). Sorokowski et al. (2020) have shown that people’s anxiety levels can significantly increase just by being exposed to the information related to coronavirus pandemic. Also, the media’s way of handling this situation has made it virtually impossible to keep away from this information in daily life. Ojiaku, Iorfa, Mefoh, Ezeuzo and Odinko (2020) have also found that anxiety caused by coronavirus outbreak can negatively predict psychological health. As the deteriorating effects of the coronavirus pandemic on the general population’s mental wellbeing increase, the number of individuals requiring psychotherapeutic interventions also increases (Marčinko et al., 2020). Studies suggest that anxiety disorders are among the most common consequences of this circumstance (Huang & Zhao, 2020).
In response to these issues, researchers in psychology are trying to understand how corona anxiety occurs in people and how it can be treated. The theoretical background suggests that attentional bias (a cognitive deficiency in selective information processing) heightens attention towards signs of threat. So, it has a causal role in anxiety disorders, and extensive empirical evidence supports this notion (Bar-Haim, Lamy, Pergamin, Bakermans-Kranenburg, & Van Ijzendoorn, 2007; Van Bockstaele et al., 2014). Accordingly, attentional bias towards corona-related information is being investigated in recent studies as an essential factor in the increased anxiety during the outbreak of COVID-19. Also, the findings support the causal role of corona-related attentional bias in corona anxiety (Hagerty & Williams, 2020; Loreta et al., 2020; Nasiry & Ameli, 2021; Schudy et al., 2020).
However, the reliability of the results of such studies depends on the reliability of the instruments used in the assessment of study variables. The most commonly utilized tool for the measurement of threat-related attentional bias is the dot-probe task (Schmukle, 2005) which has also been used for the measurement of corona-related attentional bias (Loreta et al., 2020; Nasiry & Ameli, 2021). The dot-probe task consists of trials in which pairs of threatful and neutral pictures are displayed on a computer screen for a short amount of time. Then a single dot (or any other probe) is shown where one of the pictures was placed previously. The participant’s task is to use the computer’s keyboard to indicate on which side of the screen the probe has appeared. The time spent for each trial (i.e., reaction time [RT]) is recorded and used for the calculation of the measures of attentional bias. The lower RTs for probes that appear in place of threatful pictures and higher RTs for probes that appear in place of neutral pictures indicate higher attentional bias.
Other instruments similar to the dot-probe task with less common use have been developed and utilized to measure attentional bias. The emotional flanker task, which was designed by Nikolaou, Field, and Duka (2013), measures the participants’ attentional bias using their reaction times to specific trials. These trials consisted of one central arrow and multiple flanking arrows that are pointed either in the same direction as the central arrow (congruent trials) or in the opposite direction (incongruent trials). The participants are required to react to the direction of the central arrow while ignoring the emotional or neutral pictures displayed behind the arrows. Another instrument for measuring attentional bias is the relevant feature visual search task, developed by Ohman, Flykt, and Esteves (2001), with a variant called irrelevant feature visual search task proposed by Dodd, Vogt, Turkileri, and Notebaert (2017). These instruments comprised trials in which the participants were asked to search and locate a target picture amidst a series of distracting pictures. Variation in the emotionality or the neutrality of the target and distractor stimuli in different trials leads to different RTs which are recorded and utilized to calculate the measures of attentional bias.
Poor psychometric properties of the instruments measuring attentional bias have caused significant concerns among the researchers in this field (Evans, Walukevich, Seager, & Britton, 2018; McNally, 2019; Rodebaugh et al., 2016). Empirical evidence demonstrates that the emotional flanker task lacks reliability and validity in the context of anxiety research (Van Bockstaele et al., 2020). However, the relevant feature and the irrelevant feature variants of the visual search task show a medium level of reliability (Van Bockstaele, Salemink, Bögels, & Wiers, 2017) and lack any indications of validity (Van Bockstaele et al., 2020). Although the dot-probe task has been most commonly used in the studies investigating anxiety disorders, including corona anxiety (Loreta et al., 2020; Nasiry & Ameli, 2021), the standard version of this instrument shows poor psychometric properties and, therefore, might lead to inconsistent results across different studies (Cristea, Kok, & Cuijpers, 2015; Schmukle, 2005). To resolve this issue, a new version of this instrument with a response-based computational approach has been developed recently, which shows high levels of reliability and validity (Evans & Britton, 2018). But neither the standard version nor the response-based version of the dot-probe task has been psychometrically evaluated when used with stimuli related to COVID-19. This condition can challenge the reliability of the results of the studies which use this instrument to investigate attentional bias and anxiety related to COVID-19.
Because the studies investigating attentional bias related to COVID-19 are important and the psychometric properties of the dot-probe task with corona-related stimuli have not been examined, we aimed to determine the internal consistency, test-retest reliability, and criterion validity of the standard and response-based versions of COVID-19 dot-probe task. Considering the preliminary results of previous research, we expected the psychometric properties of the response-based dot-probe task to be superior to the standard version of this instrument.

2. Materials and Methods
Study participants

The study participants were recruited using online forums and social media platforms from the target population of all non-clinical adults in Iran. The inclusion criteria comprised 1) having at least 18 years of age, 2) being able to work efficiently with computers, and 3) delivering an informed willingness to contribute to the study. The exclusion criteria were 1) suffering from serious physical diseases that required immediate medical treatment, 2) having the diagnosis of psychological disorders, and 3) not completing the study. Overall, 362 Iranian adults (62% female) aged 18 to 42 years (28.3±4.9 years) were enrolled in the study. They did not report any history of receiving psychological diagnoses from an expert in clinical psychology or psychiatry and were not under medical treatment for any physical illnesses.

Study measures
Standard dot-probe task

The dot-probe task used in this study was developed based on the original work of MacLeod, Mathews, and Tata (1986). The task comprised several trials; each began with the appearance of a cross in the middle of the computer screen. The participants were asked to stare at this cross. The fixation cross would remain on the screen for 500 ms, and then a pair of pictures were displayed alongside each other. This part of the trial would also last for 500 ms, and then the images were replaced with a single probe (which was either < or >) that was shown in place of one of the pictures with a random order. The participant’s task was to use the arrow keys on their computer’s keyboard to quickly and accurately indicate the place of each probe. Each trial included either one corona-related stimulus (e.g., picture of a mask, glove, virus, etc.) and one neutral stimulus (e.g., image of a building, door, window, etc.), or two neutral stimuli. To select the stimuli used in the task, a sample of 73 unbiased individuals rated a pool of potential pictures (scores ranged from 0 to 100) based on their relatedness to coronavirus. The task included 120 trials divided into 40 congruent trials, 40 incongruent trials, and 40 neutral trials. In each congruent trial, a pair of threatful and neutral pictures were shown, and the probe replaced the threatful picture. Whereas, in the incongruent trials, the probes replaced the neutral pictures and not the threatful ones. In the neutral trials, both images were neutral, and the probe was placed in each direction equally.
In the older and more basic versions of the dot-probe task, only the Reaction Times (RTs) to congruent and incongruent trials were recorded and compared with each other to calculate the measure of attentional bias. If the total RTs of incongruent trials minus the total RTs of congruent trials was a positive score, it showed vigilant attentional bias towards threatful stimuli. In contrast, if the score was negative, it indicated avoidant attentional bias away from threatful stimuli. In cases where there was no attentional bias, the score would have been close to zero. Koster, Crombez, Verschuere, and De Houwer (2004) developed a method of calculating separate measures for the orientation and the disengagement of attention by comparing the mean RTs of congruent and incongruent trials with the mean RT of neutral trials. Subtracting the mean RT of congruent trials from the mean RT of neutral trials results in either a positive score indicating a faster orientation of attention to threatful stimuli or a negative score showing a slower orientation of attention. Similarly, subtracting the mean RT of neutral trials from the mean RT of incongruent trials produces either a positive score showing slower disengagement of attention from the threatful stimuli or a negative score indicating faster disengagement of attention.

Response-based dot-probe task
The procedure of the response-based version of the dot-probe task is the same as the standard version. Still, it has a different method of utilizing trial reaction times to compute the measures of attentional bias (Evans & Britton, 2018). In this version, the RT of each trial response (hence the name response-based) is individually compared with a mean RT that functions as a reference. The calculation of the measures of attentional bias is done by subtracting the RT of each congruent trial from the mean RT of incongruent trials and producing two sets of results. Positive results are produced from congruent trial responses with RTs lower than the reference RT and indicate attentional vigilance towards threatful stimuli. Therefore, the mean of this set of results can be used as a measure of vigilant attentional bias. Conversely, negative results are produced from congruent trial responses with RTs higher than the reference RT and indicate attentional avoidance from threatful stimuli. Thus the mean of this set of results can be used as a measure of avoidant attentional bias. By combining this computational method with the Koster et al. (2004) method, separate measures of orientation and disengagement of attention can be computed using the mean RT of neutral trials as the reference to be compared with individual RTs of congruent and incongruent trials. With this method, four different mean scores are produced for slow and fast orientation to and disengagement from threatful stimuli.

Corona Disease Anxiety Scale (CDAS)
Alipour, Ghadami, Alipour, and Abdollahzadeh (2020) have developed a self-report questionnaire called the Corona Disease Anxiety Scale (CDAS) to assess the anxiety about the coronavirus pandemic and have evaluated its psychometric properties in an Iranian sample. This questionnaire includes 18 items rated on a 4-point Likert scale, with the total score ranging from 0 to 54. Exploratory factor analysis has shown that CDAS comprised two subscales: one evaluating the psychological symptoms and the other assessing physical symptoms, and each containing 9 items. Confirmatory factor analysis has confirmed this factor structure and approved the questionnaire’s structural validity. Internal consistency of this questionnaire was also confirmed with the Cronbach α coefficients of 0.91, 0.87, and 0.86 for the whole measure and its subscales (subscale 1: psychological symptoms and subscale 2: physical symptoms), respectively. Also, the scores of CDAS are significantly correlated with the scores of the General Health Questionnaire-28 (GHQ-28), which confirms its criterion validity.

Study procedure
To observe the social distancing, the study procedures were all carried out online. The participant was asked to complete the dot-probe task in a private space with no distractions while keeping an ideal distance of 60 cm from their computer’s screen and then fill out the CDAS. After two weeks, 146 participants repeated this procedure to provide retest data. There were no significant differences in terms of age, gender, and corona anxiety scores between the participants who repeated the dot-probe task and those who did not (P>0.05). Utilizing SPSS v26, internal consistency was analyzed using split-half reliability and the Cronbach α; test-retest reliability was determined using Intraclass Correlation Coefficient (ICC), and criterion validity was evaluated using correlation coefficient between dot-probe task and CDAS questionnaire.
Before the study, all participants were informed about the objectives, procedure, and implications of the study, and written consent was obtained from them. During the investigation, all ethical standards, including the guidelines defined in the Declaration of Helsinki in 1975, were considered. The participants were aware that their information would remain confidential and that they could leave the study at any point. After completing the study, its results and their meanings were simply explained to the participants, and they were thanked for making this research possible.

3. Results
The results indicated that both split-half reliability and Cronbach α are unacceptable for measures of attentional bias, attentional orientation, and attentional disengagement in the standard version of the dot-probe task (Table 1).



For the response-based version of the dot-probe task, when mean RT of incongruent trials was used as a reference to divide attentional bias into vigilant and avoidant scores, split-half reliability ranged from acceptable to good, and Cronbach α ranged from good to excellent. When mean RT of neutral trials was used to divide orientation and disengagement of attention into fast and slow scores, split-half reliability ranged from acceptable to good, and the Cronbach α was good. Details of the internal consistency of the two versions of the dot-probe task are presented in Table 1.
No indication of test-retest reliability was evidenced for the standard version of dot probe task. Insignificant ICC between two measurements of attentional bias (r=0.11, P=0.21), orientation of attention (r=-0.13, P=0.39) and disengagement of attention (r=0.09, P=0.12), showed that these measures are not stable over time.
The response-based version of the dot-probe task showed varying degrees of stability over time, with some of its measures reaching acceptable levels of ICC between two measurements. Specifically, when mean RT of incongruent trials was used as a reference to attain separate measures of attentional bias, both vigilant (r=0.77, P<0.01) and avoidant (r=0.72, P<0.01) attentional biases showed acceptable levels of test-retest reliability. When mean RT of neutral trials were used as a reference, fast orientation of attention (r=0.71, P<0.01) showed acceptable level test-retest reliability, while the level of test-retest reliability for slow orientation of attention (r=0.49, P<0.01) was unacceptable. Moreover, fast disengagement (r=0.21, P=0.03) and slow disengagement (r=0.36, P<0.01) of attention, showed significant ICC between two measurements, but did not reach an acceptable level of test-retest reliability.
None of the measures of attentional bias in the standard version of the dot-probe task were significantly associated with corona anxiety (all P>0.05). In the response-based version of the task, vigilant attentional bias, fast orientation of attention, and slow disengagement of attention were significantly associated with corona anxiety. However, there were no significant correlations between corona anxiety and measures of avoidant attentional bias, slow orientation of attention, and fast disengagement of attention (Table 2).




4. Discussion
In this study, psychometric properties of the COVID-19 dot-probe task were investigated, using the standard and response-based methods of computation for measures of attentional bias related to COVID-19 stimuli. While standard measures did not show acceptable internal consistency, test-retest reliability, or criterion validity (which was consistent with previous studies) (Brown et al., 2014; Price et al., 2015; Schmukle, 2005), response-based measures showed acceptable to excellent internal consistency, variable test-retest reliability and partial associations with corona anxiety.
Based on these results, the standard version of dot-probe task in clinical studies of corona-related attentional bias and corona anxiety is questionable. Since this instrument has poor psychometric properties, it might not detect associations of corona-related attentional bias with associated variables or evaluate the effects of treatments targeting this type of attentional bias. But the response-based version of dot-probe task showed improvements in internal consistency and stability over time. However, some of its measures showed levels of test-retest reliability that are not regarded as acceptable levels for application in clinical research (Polit, 2014).
Nevertheless, since the internal consistency of response-based measures was very high, their limited test-retest reliability did not result from an overall deficiency of psychometric properties. Furthermore, the temporal instability of these measures cannot be attributed to changes in corona anxiety since it was stable (r=0.83, P<0.01) across multiple measurements. Therefore, low test-retest reliability of response-based measures may indicate that corona-related attentional bias has innate variability over time. Despite this variability, some of the response-based measures (i.e., vigilant and avoidant attentional biases and fast orientation of attention) had acceptable test-retest reliability. Also, studies show that attention measures that are reliable over time can detect changes in attentional bias after treatments like attentional bias modification (Heeren, Philippot, & Koster, 2015).
Criterion validity of the response-based version of dot-probe task was also limited, since only vigilant attentional bias, the fast orientation of attention, and slow disengagement of attention were significantly associated with corona anxiety. This specificity of associations demonstrates that in a non-clinical sample, different patterns of attentional bias towards corona-related stimuli go hand in hand with the severity of corona anxiety. In contrast, patterns of the attentional bias away from corona-related stimuli vary independent from the severity of corona anxiety, and this indicates that future research in this area should be focused more on the understanding and manipulation of attentional bias towards corona-related stimuli.
There were some limitations in this study that should be mentioned. First, the study participants were all non-clinical adults, which limits the generalizability of the results since previous research has shown that associations between attentional bias and anxiety might only be observable in a clinical sample (Briggs‐Gowan et al., 2015). Moreover, there are other methods of computation for the measures of attentional bias in dot-probe task, for example, the ones used by Zvielli, Bernstein, and Koster (2014). Although they have more limited usage than response-based method, they may have different psychometric properties, and therefore could be examined in future studies.

5. Conclusion
The COVID-19 dot-probe task is a psychometrically sound instrument for evaluating corona-related attentional bias if the response-based method of computation is used for calculating the measures of attentional bias. This method improves the internal consistency, test-retest reliability, and criterion validity of the instrument. This version of the dot-probe task can help researchers investigate the mechanisms of corona anxiety and its relationship with corona-related attentional bias and develop therapeutic methods for ameliorating corona anxiety through modification of this type of attentional bias.

Ethical Considerations
Compliance with ethical guidelines

All ethical standards, including the guidelines defined in the Declaration of Helsinki in 1975, were considered in conducting the present study. The participants were assured that their information would remain confidential and that they could leave the study at any time. All participants were informed about the objectives, procedure, and implications of the study, and written consent was obtained from all of them.

Funding
This research did not receive any grant from funding agencies in the public, commercial, or non-profit sectors. 

Authors' contributions
Conceptualization and methodology: Saeed Nasiry; Data collection and Data analysis: Nastaran Nasiry; Writing – original draft, and Writing – review & editing: all authors.

Conflict of interest
The authors declared no conflict of interest. 

Acknowledgments
The authors would like to thank the participants who made this study possible.


References
Alipour, A., Ghadami, A., Alipour, Z., & Abdollahzadeh, H. (2020). [Preliminary validation of the Corona Disease Anxiety Scale (CDAS) in the Iranian sample (Persian)]. Quarterly Journal of Health Psychology, 8(32), 163-75. http://hpj.journals.pnu.ac.ir/article_6571_en.html
Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & van Ijzendoorn, M. H. (2007). Threat-related attentional bias in anxious and nonanxious individuals: A meta-analytic study. Psychological Bulletin, 133(1), 1-24. [DOI:10.1037/0033-2909.133.1.1] [PMID]
Briggs‐Gowan, M. J., Pollak, S. D., Grasso, D., Voss, J., Mian, N. D., & Zobel, E., et al. (2015). Attention bias and anxiety in young children exposed to family violence. Journal of Child Psychology and Psychiatry, 56(11), 1194-201. [DOI:10.1111/jcpp.12397] [PMID]
Brown, H., Eley, T., Broeren, S., Macleod, C., Rinck, M., & Hadwin, J., et al. (2014). Psychometric properties of reaction time based experimental paradigms measuring anxiety-related information-processing biases in children. Journal of Anxiety Disorders, 28(1), 97-107. [DOI:10.1016/j.janxdis.2013.11.004] [PMID]
Cristea, I. A., Kok, R. N., & Cuijpers, P. (2015). Efficacy of cognitive bias modification interventions in anxiety and depression: Meta-analysis. The British Journal of Psychiatry, 206(1), 7-16. [DOI:10.1192/bjp.bp.114.146761] [PMID]
Dodd, H. F., Vogt, J., Turkileri, N., & Notebaert, L. (2017). Task relevance of emotional information affects anxiety-linked attention bias in visual search. Biological Psychology, 122, 13-20. [DOI:10.1016/j.biopsycho.2016.01.017] [PMID]
Evans, T. C., & Britton, J. C. (2018). Improving the psychometric properties of dot-probe attention measures using response-based computation. Journal of Behavior Therapy and Experimental Psychiatry, 60, 95-103. [DOI:10.1016/j.jbtep.2018.01.009] [PMID]
Evans, T. C., Walukevich, K. A., Seager, I., & Britton, J. C. (2018). A psychometric comparison of anxiety-relevant attention measures. Anxiety, Stress, & Coping, 31(5), 539-54. [DOI:10.1080/10615806.2018.1489536] [PMID]
Fiorillo, A., & Gorwood, P. (2020). The consequences of the COVID-19 pandemic on mental health and implications for clinical practice. European Psychiatry, 63(1), e32. [DOI:10.1192/j.eurpsy.2020.35] [PMID] [PMCID]
Hagerty, S. L., & Williams, L. M. (2020). The impact of COVID-19 on mental health: The interactive roles of brain biotypes and human connection. Brain, Behavior, & Immunity - Health, 5, 100078. [DOI:10.1016/j.bbih.2020.100078] [PMID] [PMCID]
Heeren, A., Philippot, P., & Koster, E. H. (2015). Impact of the temporal stability of preexistent attentional bias for threat on its alteration through attention bias modification. Journal of Behavior Therapy and Experimental Psychiatry, 49(Pt A), 69-75. [DOI:10.1016/j.jbtep.2014.10.012] [PMID]
Huang, Y., & Zhao, N. (2020). Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 outbreak in China: A web-based cross-sectional survey. Psychiatry Research, 288, 112954. [DOI:10.1016/j.psychres.2020.112954] [PMID] [PMCID]
Jakovljevic, M., Bjedov, S., Jaksic, N., & Jakovljevic, I. (2020). COVID-19 pandemia and public and global mental health from the perspective of global health security. Psychiatria Danubina, 32(1), 6-14. [DOI:10.24869/psyd.2020.6] [PMID]
Koster, E. H., Crombez, G., Verschuere, B., & De Houwer, J. (2004). Selective attention to threat in the dot probe paradigm: Differentiating vigilance and difficulty to disengage. Behaviour Research and Therapy, 42(10), 1183-92. [DOI:10.1016/j.brat.2003.08.001] [PMID]
Loreta, C., Rocco, P., Ceccato, I., Stefano, A., Riccardo, P., & Di, D. A. (2020). Health anxiety and attentional bias toward virus-related stimuli during the COVID-19 pandemic. Scientific Reports (Nature Publisher Group), 10(1), 16476. [DOI:10.1038/s41598-020-73599-8] [PMID] [PMCID]
MacLeod, C., Mathews, A., & Tata, P. (1986). Attentional bias in emotional disorders. Journal of Abnormal Psychology, 95(1), 15-20. [DOI:10.1037/0021-843X.95.1.15] [PMID]
Marčinko, D., Jakovljević, M., Jakšić, N., Bjedov, S., & Mindoljević Drakulić, A. (2020). The importance of psychodynamic approach during COVID-19 pandemic. Psychiatria Danubina, 32(1), 15-21. [DOI:10.24869/psyd.2020.15] [PMID]
McNally, R. J. (2019). Attentional bias for threat: Crisis or opportunity? Clinical Psychology Review, 69, 4-13. [DOI:10.1016/j.cpr.2018.05.005] [PMID]
Nasiry, S., & Ameli, Z. (2021). Effectiveness of online attentional bias modification on Corona disease anxiety. Practice in Clinical Psychology, 9(2), 143-52. [DOI:10.32598/jpcp.9.2.739.2]
Nikolaou, K., Field, M., & Duka, T. (2013). Alcohol-related cues reduce cognitive control in social drinkers. Behavioural Pharmacology, 24(1), 29-36. [DOI:10.1097/FBP.0b013e32835cf458] [PMID]
Ohman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology, 130(3), 466-78. [DOI:10.1037/0096-3445.130.3.466] [PMID]
Ojiaku, C. M., Iorfa, S., Mefoh, P. C., Ezeuzo, O., & Odinko, I. C. (2020). COVID-19-induced anxiety and Covid-19 precautionary measures as predictors of mental wellbeing of Nigerians. International Journal of Behavioral Sciences, 14(3), 149-54. [DOI:10.30491/IJBS.2020.239210.1342]
Polit, D. F. (2014). Getting serious about test-retest reliability: A critique of retest research and some recommendations. Quality of Life Research, 23(6), 1713-20. [DOI:10.1007/s11136-014-0632-9] [PMID]
Price, R. B., Kuckertz, J. M., Siegle, G. J., Ladouceur, C. D., Silk, J. S., & Ryan, N. D., et al. (2015). Empirical recommendations for improving the stability of the dot-probe task in clinical research. Psychological Assessment, 27(2), 365-76. [DOI:10.1037/pas0000036] [PMID] [PMCID]
Rodebaugh, T. L., Scullin, R. B., Langer, J. K., Dixon, D. J., Huppert, J. D., & Bernstein, A., et al. (2016). Unreliability as a threat to understanding psychopathology: The cautionary tale of attentional bias. Journal of Abnormal Psychology, 125(6), 840-51. [DOI:10.1037/abn0000184] [PMID] [PMCID]
Schmukle, S. C. (2005). Unreliability of the dot probe task. European Journal of Personality, 19(7), 595-605. [DOI:10.1002/per.554]
Schudy, A., Żurek, K., Wiśniewska, M., Piejka, A., Gawȩda, Ł., & Okruszek, Ł. (2020). Mental wellbeing during pandemic: The role of cognitive biases and emotion regulation strategies in risk perception and affective response to COVID-19. Frontiers in Psychiatry, 11, 589973. [DOI:10.3389/fpsyt.2020.589973] [PMID] [PMCID]
Sorokowski, P., Groyecka, A., Kowal, M., Sorokowska, A., Białek, M., & Lebuda, I., et al. (2020). Can information about pandemics increase negative attitudes toward foreign groups? A case of COVID-19 outbreak. Sustainability, 12(12), 4912. [DOI:10.3390/su12124912]
Van Bockstaele, B., Lamens, L., Salemink, E., Wiers, R. W., Bögels, S. M., & Nikolaou, K. (2020). Reliability and validity of measures of attentional bias towards threat in unselected student samples: Seek, but will you find? Cognition and Emotion, 34(2), 217-28. [DOI:10.1080/02699931.2019.1609423] [PMID]
Van Bockstaele, B., Salemink, E., Bögels, S. M., & Wiers, R. W. (2017). Limited generalisation of changes in attentional bias following attentional bias modification with the visual probe task. Cognition and Emotion, 31(2), 369-76. [DOI:10.1080/02699931.2015.1092418] [PMID]
Van Bockstaele, B., Verschuere, B., Tibboel, H., De Houwer, J., Crombez, G., & Koster, E. H. (2014). A review of current evidence for the causal impact of attentional bias on fear and anxiety. Psychological Bulletin, 140(3), 682-721. [DOI:10.1037/a0034834] [PMID]
Wang, C., Pan, R., Wan, X., Tan, Y., Xu, L., 7 Ho, C. S., et al. (2020). Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (COVID-19) epidemic among the general population in China. International Journal of Environmental Research and Public Health, 17(5), 1729. [DOI:10.3390/ijerph17051729] [PMID] [PMCID]
Yao, H., Chen, J. H., & Xu, Y. F. (2020). Patients with mental health disorders in the COVID-19 epidemic. The Lancet Psychiatry, 7(4), E21. [DOI:10.1016/S2215-0366(20)30090-0]
Zvielli, A., Bernstein, A., & Koster, E. H. (2014). Dynamics of attentional bias to threat in anxious adults: Bias towards and/or away? PloS One, 9(8), e104025. [DOI:10.1371/journal.pone.0104025] [PMID] [PMCID]
Type of Study: Research | Subject: Psychometric
Received: 2021/04/13 | Accepted: 2021/08/16 | Published: 2021/07/19

Add your comments about this article : Your username or Email:
CAPTCHA

Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Designed & Developed by : Yektaweb