Investigating stimulus-driven selective attention inside visual working memory

Harmelen, Anna van (August 2023): Investigating stimulus-driven selective attention inside visual working memory. Masterarbeit, Fakultät für Biologie, Ludwig-Maximilians-Universität München.

Abstract

Multiple objects can exist within (visual) working memory simultaneously, and internal selective attention is required to select amongst those objects. It is known this internal selection can occur in a goal-driven manner (Griffin & Nobre, 2003; van Ede et al., 2019), but the question remains whether this can also occur in a stimulus-driven manner. To answer this question, van Ede et al. (2020) developed a retrocue visual working memory task. They were able to induce attentional shifts with a completely uninformative retrocue, an effect that is best explained by the occurrence of stimulus-driven internal attention. Using eye-tracking, van Ede et al. showed that these attentional shifts were accompanied by a shift in gaze position towards the original location of the currently active memory item. Liu et al. (2022) showed that an internal attentional shift is often (also) accompanied by a bias in microsaccade direction.

However, the retrocue employed by van Ede et al. was only completely uninformative in one third of all trials, creating the possibility that the retrocue retained some implied informational value for participants. Our main research question therefore is: is a completely uninformative cue capable of and sufficient for creating an involuntary attentional-capture effect? If so, is this again reflected in an ocular signature consisting of a bias in gaze position and microsaccade direction? And is the behavioural effect that results from the attentional capture due to a benefit to the cued memory item, a cost to the uncued memory item, or a combination of both?

To answer these questions, the visual working memory task from van Ede et al. (2020) was employed after changing it in two critical ways. Based on the previous research we expected to find a behavioural attentional-capture effect, by observing less reproduction error and/or shorter decision times when the capture cue colour-matched the eventually probed item. We also expected that this behavioural effect would be accompanied by both a bias in gaze position and microsaccade direction towards the cued memory item.

Two separate experiments were performed for this research, which only differed in the shape of the capture cue. Experiment 1 produced no significant effect of capture cue congruency on decision times or accuracy, and this was accompanied by an extremely small, but significant, gaze bias. No significant microsaccade bias was found. Experiment 2 produced a significant effect of congruency on decision times, but not on accuracy: participants responded faster in congruent trials than in both neutral and incongruent trials. On group-level, this behavioural effect was again accompanied by a small, but significant, gaze bias, and no significant microsaccade bias was found.

The relationship between behavioural effect and ocular bias was further investigated by calculating a decision time effect size and a microsaccade bias effect size. A median-split of decision time effect size showed a significant microsaccade bias was present in the above-median decision time effect group. This microsaccade bias occurred within the expected timeframe, as based on previous research by Liu et al. (2022).

We concluded that a completely uninformative capture cue is capable of and sufficient for creating an involuntary attentional-capture effect within a visual working memory task. In a subset of participants this was also reflected in a significant bias in microsaccade direction, but this did not occur at a group-level. Finally, it seems the behavioural effect is due to a benefit for cued items, at no cost to uncued items. The current experiment complements earlier work by providing further proof that stimulus-driven internal attention does indeed exist and is sometimes accompanied by an ocular signature, consisting of at least a microsaccade direction bias. This research emphasises that the external world plays an important role in shaping the contents of our mind.

• Dokumententyp: LMU München: Studienabschlussarbeit
• Keywords: Attention, Eye-tracking, Gaze position, Gaze position bias, Internal selective attention, Microsaccade bias, Microsaccades, Selective attention, Visual working memory, Working memory, Stimulus-driven internal attention
• Fakultät: Biologie
• Fakultätsübergreifende Einrichtungen: Graduate School of Systemic Neurosciences (GSN)
• Institut oder Departement: Graduate School of Systemic Neurosciences
• Themengebiete: 100 Philosophie und Psychologie > 150 Psychologie ; 500 Naturwissenschaften und Mathematik > 570 Biowissenschaften; Biologie
• Sprache: Englisch

Literaturliste

Baddeley, A. (2003). Working memory: looking back and looking forward. Nature Reviews Neuroscience, 4(10), 829–839. https://doi.org/10.1038/nrn1201

Bays, P. M. (2016). Evaluating and excluding swap errors in analogue tests of working memory. Scientific Reports, 6(1), 1–14. https://doi.org/10.1038/srep19203

Bays, P. M., Catalao, R. F. G., & Husain, M. (2009). The precision of visual working memory is set by allocation of a shared resource. Journal of Vision, 9(10), 1–11. https://doi.org/10.1167/9.10.7

Chai, W. J., Abd Hamid, A. I., & Abdullah, J. M. (2018). Working memory from the psychological and neurosciences perspectives: A review. Frontiers in Psychology, 9. https://doi.org/10.3389/FPSYG.2018.00401/BIBTEX

Chun, M. M., Golomb, J. D., & Turk-Browne, N. B. (2011). A Taxonomy of External and Internal Attention. Annual Review of Psychology, 62, 73–101. https://doi.org/10.1146/annurev.psych.093008.100427

Corbetta, M., & Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nature Reviews Neuroscience, 3(3), 201–215. https://doi.org/10.1038/nrn755

Cragg, L., Richardson, S., Hubber, P. J., Keeble, S., & Gilmore, C. (2017). When is working memory important for arithmetic? The impact of strategy and age. PLoS ONE, 12(12). https://doi.org/10.1371/JOURNAL.PONE.0188693

D’esposito, M., Detre, J. A., Alsop, D. C., Shin, R. K., Scott, A., & Grossman, M. (1995). The neural basis of the central executive system of working memory. Nature, 378(6554), 279–281. https://doi.org/10.1038/378279a0

Griffin, I. C., & Nobre, A. C. (2003). Orienting Attention to Locations in Internal Representations. Journal of Cognitive Neuroscience, 15(8), 1176–1194. https://doi.org/10.1162/089892903322598139

James, W. (1890). The Principles of Psychology (Vol. 1). Henry Holt and Co.

Katsuki, F., & Constantinidis, C. (2014). Bottom-up and top-down attention: different processes and overlapping neural systems. The Neuroscientist, 20(5), 509–521. https://doi.org/10.1177/1073858413514136

Liu, B., Nobre, A. C., & van Ede, F. (2022). Functional but not obligatory link between microsaccades and neural modulation by covert spatial attention. Nature Communications, 13(1), 1–10. https://doi.org/10.1038/s41467-022-31217-3

Purves, D., Cabeza, R., Huettel, S. A., LaBar, K. S., Platt, M. L., & Woldorff, M. G. (2013). Principles of Cognitive Neuroscience (2nd ed.). Sinauer Associates, Inc. Publishers.

Shin, H., Zou, Q., & Ma, W. J. (2017). The effects of delay duration on visual working memory for orientation. Journal of Vision, 17(14), 10–10. https://doi.org/10.1167/17.14.10

Smith, E. E., & Jonides, J. (1999). Storage and Executive Processes in the Frontal Lobes. Science, 283(5408), 1657–1661. https://doi.org/10.1126/SCIENCE.283.5408.1657

Souza, A. S., Rerko, L., & Oberauer, K. (2015). Refreshing memory traces: thinking of an item improves retrieval from visual working memory. Annals of the New York Academy of Sciences, 1339(1), 20–31. https://doi.org/10.1111/NYAS.12603

SR Research Ltd. (2013). EyeLink ® 1000 Plus User Manual (version 1.0.12). http://www.sr-research.com

Taylor, R., & Bays, P. M. (2020). Theory of neural coding predicts an upper bound on estimates of memory variability. Psychological Review. https://doi.org/10.1037/REV0000189

van Ede, F., Board, A. G., & Nobre, A. C. (2020). Goal-directed and stimulus-driven selection of internal representations. Proceedings of the National Academy of Sciences of the United States of America, 117(39), 24590–24598. https://doi.org/10.1073/PNAS.2013432117/SUPPL_FILE/PNAS.2013432117.SAPP.PDF

van Ede, F., Chekroud, S. R., & Nobre, A. C. (2019). Human gaze tracks attentional focusing in memorized visual space. Nature Human Behaviour, 3(5), 462–470. https://doi.org/10.1038/s41562-019-0549-y

Which calibration model should I use? (2020, July 9). https://www.sr-research.com/support/thread-221.html

Wolfe, J. M. (2020). Visual Search: How Do We Find What We Are Looking For? Annual Review of Vision Science, 6, 539–562. https://doi.org/10.1146/annurev-vision-091718-015048

Yantis, S., & Jonides, J. (1990). Abrupt visual onsets and selective attention: voluntary versus automatic allocation. Journal of Experimental Psychology. Human Perception and Performance, 16(1), 121–134. https://doi.org/10.1037//0096-1523.16.1.121

Ye, S., Wang, J., Fan, H., & Zhang, Z. (2021). True mean value discovery over multiple data sources with unknown reliability degrees. Knowledge-Based Systems, 223, 107036. https://doi.org/10.1016/J.KNOSYS.2021.107036