Joseph B. Hopfinger - US grants

DESCRIPTION (provided by applicant): Accurate perception and action depend on the ability of brain attention systems to focus on the most relevant subset of stimuli in the environment. Attention can be directed in a voluntary (top-down) manner, or it may be captured reflexively either by salient sensory stimuli (sensory-driven reflexive attention) or by implicit memories (memory-driven reflexive attention). The experiments proposed here will test current theories and neural models of attentional control by investigating the brain mechanisms supporting each of these types of attention (voluntary, sensory-driven, and memory-driven). Since the momentary focus of attention is normally determined by the interplay between voluntary and reflexive systems, a further objective of these studies is to elucidate the interactions between these attention systems in the brain.In these experiments, event-related brain potentials (ERPs) will be recorded to provide a measure of the timing of neural activity relating to the control of attention and its subsequent effects on visual processing. Functional magnetic resonance imaging (fMRI) will be used to identify the brain regions involved in these attention mechanisms. In these studies: (1) We will investigate the neural mechanisms and temporal dynamics involved in voluntarily shifting the focus of attention. (2) We will directly contrast voluntary attention and sensory-driven reflexive attention, testing both the potential overlap in neural control systems as well as the differential effects of this control on subsequent visual processing. (3) We will investigate the combined versus competitive effects of voluntary and sensory-driven reflexive attention on visual cortical processing. (4) We will investigate the neural mechanisms of "attentional control settings" (ACS) -- task-dependent non-spatial strategic processes that have been shown to modulate the behavioral effects of reflexive attentional orienting. (5) We will test the hypothesis that these ACS share a common pool of mental resources with voluntary attention and working memory, and that under high levels of cognitive load, ACS will not modulate the effects of reflexive attention. (6) We will test whether reflexive orienting driven by implicitly learned predictive relationships modulates subsequent processing as early as does sensory-driven reflexive attention. (7) Finally, we will investigate the neural mechanisms by which memory, specifically item familiarity, reflexively captures attention. We will test the extent to which this type of attention relies upon brain mechanisms thought to underlie voluntary or sensory-driven reflexive attention. Voluntary and reflexive attention mechanisms support a variety of essential human behaviors that, when compromised by damage or disease, have significant impact on human health and the quality of life. Elucidating the brain mechanisms that support the control of attention holds promise for enhancing the understanding, diagnosis and treatment of attentional deficits that are key components of a variety of mental disorders.

psychological aspect of aging; age difference; memory; neural information processing; comprehension; model design /development; psychological models; behavioral /social science research tag; human subject; human old age (65+); young adult human (21-34); clinical research;

After a limb amputation, both motor and sensory functions associated with the limb are lost. Substantial effort has been devoted to restore lost motor functions. In contrast, there has been less advancement in restoring sensory function. Although earlier works have used sensory substitution or nerve stimulation techniques to elicit a single type of artificial sensation, there is limited understanding of how the human brain integrates different sources of artificial sensation, when multiple sensory stimulations are provided. This project will help understand the integration principles of different artificially evoked sensations of joint movements. By identifying key factors that determine the integration principle of multiple sources of artificial sensation, this project can generate potentially transformative outcomes for human-robot interactions, specifically developing brain-inspired sensory stimulation strategies that can enable intuitive interactions of assistive devices. The project will provide educational opportunities. Different project components will be integrated into existing undergraduate courses. Summer projects incorporating the sensory stimulation techniques will be offered to local school and community college students. Outreach programs associated with the research outcomes will be developed targeting underrepresented students.

The goal of this project is to understand the integration principles of different artificially evoked proprioceptive feedback. The research team will combine psychophysical testing, behavioral modeling, and brain signal recordings to understand the integration principle of artificial sensory signals. Proprioceptive feedback of the joint kinematics will be evoked using vibrotactile stimulation and peripheral nerve stimulation. Both upper and lower limbs will be investigated to evaluate whether the integration principle is task or end-effector dependent. The research team will use a Bayesian integration model and electroencephalogram (EEG) recordings to quantify how uncertainty and intuitiveness-associated attentional bias of artificial feedback impact sensory integration. The project outcomes will provide a theoretical basis for developing artificial sensory feedback for intuitive human-robot interactions, and will also provide a research platform for studying sensory perception.

This project is funded by Integrative Strategies for Understanding Neural and Cognitive Systems (NCS), a multidisciplinary program jointly supported by the Directorates for Biology (BIO), Computer and Information Science and Engineering (CISE), Education and Human Resources (EHR), Engineering (ENG), and Social, Behavioral, and Economic Sciences (SBE).

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.