2011 Graeme Clark Oration Questions

Professor Sejnowski kindly agreed to answer questions posted on the Graeme Clark Oration website for a week following the Oration. Below are some questions received and Professor Sejnowski’s responses.


Name: Andre Peterson

What is your neurophilosophy? your epistemology on consciousness? i.e. You wrote a book with P. Churchland, are you an eliminative materialist, reductionist, physicalist, dualist etc Thankyou
I am a neuroscientist and a pragmatist. As we learn more and more about the brain consciousness will become less and less mysterious. In the end we will be left with nothing but the grin of the Chesire cat.

Name: John Wells

I hoped to hear more about "brain behaviour in disorders such as autism and schizophrenia" which were advertised as being included in the oration. I guess this is more a comment than a question as I am not likely to be able to hear the topics which were apparently left out of the lecture.
I had to cut out the section of my talk on schizophrenia because of time limitations. There is increasing evidence that schizophrenia is an early developmental failure of neural circuits to mature properly, and especially the inhibitory interneurons that regulate activity in the cerebral cortex.

For a review paper look up "Sejnowski Behrens" in PubMed: http://www.ncbi.nlm.nih.gov/pubmed?term=sejnowski%20behrens

Name: Karen Johns

As I am in education, I was interested in hearing about how the brain behaves in such disorders as autism - as time got away from us at the Oration and you were unable to address this component. Could you please offer ‘some’ information on this area of brain function in this condition. Thank you Karen
Autism starts to develop during the first year of life and one of the earliest indicators is an enlarged head circumference, which reflects an overgrowth of neurons. For a review paper see:

Courchesne E, Pierce K, Schumann CM, Redcay E, Buckwalter JA, Kennedy DP, Morgan J., Mapping early brain development in autism, Neuron. 2007 Oct 25;56(2):399-413

Name: Kaye Mullins

What processes/courses would an undergraduate Psychology student need to go through in order to become involved in the development of technologies you spoke about? Is it possible?
A good way to take to get started is to take a course on Computational Neuroscience. Other courses to explore are on Neuromorphic Engineering and Social Robots. Social robots are being used by psychologists to study child development. For a review see:

Meltzoff, A. N., Kuhl, P. K., Movellan, J., Sejnowski, T. J., Foundations for a new science of learning, Science 325: 284-288 (2009).

Name: Tim Josling

My question is about the statement early on that the brain consists of many specialized components. Undoubtedly true overall, but... Looking at the neocortex which seems to be very central to what we think of as intelligence, however, it seems to be very uniform in structure and it seems to perform very similar algorithms in seemingly very different domains. One example of this is the success in getting the auditory part of a ferret’s brain to "see". Similar experiments with using the human tongue to "see: (placing a mat of pins onto the tongue as a way to get visual data into the brains of blind people). What are your thoughts on the idea of Jeff Hawkins that the neocortex employs a single algorithm? Do you think Hawkins is on the right track with his theory of Hierarchical Temporal memory as a model for the Neocortex?
At a superficial level the cerebral cortex does look uniform, but on closer inspection the neurons in each area are specialized for different functions. In the visual cortex of primates there are even extra layers, and in the rat somatosensory cortex there are "barrels" for each whisker. The neural circuits are also specialized, and in the prefrontal cortex they are specialized for working memory, in comparison with primary sensory areas that is continually updated with new information that streams in from the sensors. Despite these differences there also common algorithms that allow the cortex to process and store enormous amounts of information, but even here different areas have different time scales and different neural codes.

Name: Tom Hatcher

According to some extrapolations of Moore’s law, in the next 20 years the power of the biggest supercomputers will rival the human brain. Do you think that the first human brain simulations will be run on these machines, or a new class of massively parallel hardware? When it becomes possible to code artificial neurons that replicate the functionality of cortical neurons, and when a suitable interface between the two can be found, do you think it may be possible to upload your consciousness into the machine, initially just as an appendage to the original brain, but then eventually discarding the biological infrastructure altogether?
We don’t know for sure what the computational power of the brain is since we mainly look at the electrical signals and ignore the biochemical signals and genetic regulation. What we study may just be the tip of the iceberg. Nonetheless, if the exponential increase in computational power continues it will eventually reach a point at which it will be possible to simulate brain functions. But then we will have to program the computer, which requires that we know how the brain works. More likely there will be an iterative process, where we simulate what we know at any given time and use that to make predictions and help design new experiments to improve what we know about the brain. Regarding consciousness, we can already see the wide variety of conscious states in humans and in other species, so I have no doubt that machines can become conscious too but probably not in the same way that we are. You would not be the same if you uploaded your consciousness into such a machine.

Name: Paul Tune

Thank you for the fascinating talk! I am a researcher myself and am looking for a way to get into the study of artificial neural networks. In one of your slides, you mentioned something about a neural network with added noise and a sleep mode. This also apparently has some relation to sleep and human brain plasticity. I have two questions. What do you mean by "noise"? Is it just arbitrary input? Have you tried specially selected (possibly adversarial) input? Has there been work done to compare the competitiveness of neural networks in signal processing compared to recent advancements (for e.g. compressive sensing) of algorithms?
Noise is what is left in a measurement after you have accounted for all the signals you are interested in. This means that one man’s noise may be another man’s signal. There are sources of noise at the molecular level, such as the spontaneous release of neurotransmitter packets, but these are likely to have an important function. The so-called "spontaneous" activity that occurs during sleep is also likely to have an important function, which was what I alluded to in the talk with reference to the Boltzmann machine, which needs a "sleep" phase during which the internal correlations can be calibrated.

Artificial neural networks are most efficient when the inputs produce a pattern of neural activity that is sparse, that is, only a few of the many neurons are active. A new generation of artificial neural network models are being developed that take this one step further and uses random sparse projections of the inputs based on compressed sensing.

Name: Kaelasha Tyler

My image of neurons and dendrites tends to be a static one, based as it is on text book pictures of Golgi stains in vitro. However we know that living neurons and dendrites do physically move. I have heard the movement of a mass of neurons described as ’wriggling’. My question: do living neurons wriggle? I guess that amounts to the question of, how much and how fast is the physical movement of neurons and dendrites, for example, as they find and make new synaptic connections? Maybe you have had to include this sort of information in a computational model, and if so, I would love to know- do living neurons really wriggle? Cheers, Kaelasha.
Yes, real neurons "wriggle" and are dynamic on a wide range of time scales. The spines on dendrites use actin, the same protein in your muscle, to change their shape. Even dendritic branches come and go, along with new synapses, even in the adult brain. The proteins themselves that make up synapses turnover on a time scale of hours to days. The turnover of proteins and synapses may have an important function in maintaining homeostasis – keeping all of the parts of the neuron in a balanced state that is sensitive to inputs. And homeostatic synaptic plasticity has been shown to improve the flexibility of neural network models.

Name: John Zubevich

Why did you suggest that 2000–2050 would be the era of information when what is really necessary is analysis and comprehension of much of the information we have but which is only used if it is considered commercially expliotable because the information can be used as raw data to argue a particular point which would not be tentable if properly analysed? e.g. many scientific pieces of information like the cane toad in Queensland – truly a disaster that was not well thought out.
Information can be cryptic. Take the human genome, for example. Having the sequence of base pairs is not the same as knowing what it means. The sequences greatly help biologists do experiments, but interpreting the sequences and their variants in different people will take a lot more work, and mistakes will be made along the way, as you suggest. What has changed is that we can collect a lot more information a lot more quickly than we could in the past, but we are still slow on interpreting the information. We need to speed up this process.

Name: Rachel DeSumma

I would like to know more about findings of brain differences in individuals with Aspergers syndrome and autism and what this means for treatment approaches. Thank you.
A wide range of brain differences have been identified in the brains of patients with autism spectrum disorders (see above). Some of these changes compensate for the primary disorder, which we suspect occurs during the early development of neurons in the brain.

Here is a source of more information at NIH:
http://www.nichd.nih.gov/publications/pubs/sos_autism/sub6.cfm

Name: Andrew Hill

Prof Sejnowski, early in your oration you said, "The brain does not work without the body". Do you think that the brain also needs an environment beyond the body in order to function? If so, what kinds of research do you think would best reveal that relationship?
If you deprive the brain of sensory input, it goes into a free running state that is not normal. So the environment is necessary, and different environments can lead to profoundly different brain states. The environment and nutrition during the first few years of life are especially important in shaping a brain and preparing it for life. The recent earthquake and tsunami will leave its mark on the brains of the Japanese who lived through that experience, especially the children. Fortunately brains are resilient and can bounce back from even the worst environments.

Name: Andreas Hendarto

My question is on neuromorphic engineering. How long would you project it to be before a complete set of networks (which you presented) could be compiled to create a fully-functioning animal-like ’brain’? And do you believe such a brain, if advanced enough, would be able to eventually pass the Turing test and yet still retain the superior logical deductions of today’s conventional computers? Thank you so much for your thought-provoking oration!
It is easy to fool humans with words, so passing the Turing test is not a great achievement. Learning from experience is more difficult to program. An even more stringent test is to duplicate the sensorimotor capability of animals, which depend as much on the body as the brain. I don’t know how long it will take to achieve these capabilities in machines, but I am confident on the order of difficulty. Early researchers in AI thought that sensorimotor systems were the easiest to program, and the Turing test would be the most difficult.

Download flyer

Click here to download the Graeme Clark Oration 2012 flyer for friends/classmates


Oration highlights

The Oration informs the community about advances where biology, computing and engineering come together.

Click here to view information about previous Orations:


About Linda Partridge

The Royal Society Interview on The New Science of Ageing

The Partridge Lab

The Science of Ageing - Royal Society Publishing

The Royal Society 2009 Croonian Lecture, The New Biology of Ageing