PSYCHOLOGY COLLOQUIA
University of California, San Diego
                        

Homepage

Calendar

Directions

Past Events

Psych Homepage

UCSD Homepage


The Department of Psychology is Honored
to Present a Talk by

Michael Arbib
University of Southern California

"Describing Visual Scenes: Towards a Neurolinguistics Based on Construction Grammar"

Presented on May 8, 2008

Location: The Crick Conference Room
Mandler Hall, room 3545

Abstract:
The present work is part of a larger effort to locate the production and perception of language within the broader context of brain mechanisms for action and perception more generally. Here we model function in terms of the competition and cooperation of schemas. We use the task of describing visual scenes to explore the suitability of Construction Grammar as an appropriate framework for a schema-based linguistics. We recall the early VISIONS model of schema-based computer analysis of static visual scenes and then introduce SemRep as a graphical representation of dynamic visual scenes designed to support the generation of varied descriptions of episodes. We report preliminary results on implementing the production of sentences using Template Construction Grammar (TCG), a new form of construction grammar distinguished by its use of SemRep to express semantics. We summarize data on neural correlates relevant to future work on TCG within the context of neurolinguistics, and show how the relation between SemRep and TCG can serve as the basis for modeling language comprehension. (Work with JinYong Lee.)
About the Speaker:

    The thrust of Michael Arbib's work is expressed in the title of his first book, Brains, Machines and Mathematics (McGraw-Hill, 1964). The brain is not a computer in the current technological sense, but he has based his career on the argument that we can learn much about machines from studying brains, and much about brains from studying machines. He has thus always worked for an interdisciplinary environment in which computer scientists and engineers can talk to neuroscientists and cognitive scientists.

    His primary research focus is on the coordination of perception and action. This is tackled at two levels: via schema theory, which is applicable both in top-down analyses of brain function and human cognition as well as in studies of machine vision and robotics; and through the detailed analysis of neural networks, working closely with the experimental findings of neuroscientists on humans and monkeys. He is also engaged in research on the evolution of brain mechanisms for human language, pursuing the Mirror System Hypothesis that links language parity (the fact that what the speaker intends is roughly what the hearer understands) to the properties of the mirror system for grasping -- neurons active for both the execution and observation of actions -- to explain (amongst many other things) why human brains can acquire sign language as readily as speech.

    The author or editor of almost 40 books, Dr. Arbib has most recently edited "Who Needs Emotions? The Brain Meets the Robot" (with Jean-Marc Fellous, Oxford University Press, 2005) and "From Action to Language via the Mirror System" (Cambridge University Press, 2006).

For More Information About This Speaker:
Researchers and the general public are both welcome to attend the Psychology department's colloquia. Reservations are not required, and admission is free. If you have any questions regarding the department's colloquium series, then please write to colloquia@psy.ucsd.edu