Hints from Life to AI,  edited by Ugur HALICI, METU, 1994 ã

 

 

 

 


synapses not neurons as computational elements:

how to reconcile real and artificial computing

 


Karl H. Pribram

Center for Brain Research and Informational Sciences,

Radford University, Box 6977

Radford, Virginia 24142, USA

 


Neurons are ordinarily conceived to be the computational units of the brain. thus the majority of processing theories since the seminal contribution of Mc. Culloch and Pitts (1943) have taken the axonal discharge of the neuron, the nerve impulse, as the currency of  computation. However this framework for computational theory has led to considerable misunderstanding between neuroscientists and those interested in computational processing. Current computational processing emphasizes a minimum of constraints in the processing wetware or hardware, but in the current neuroscience framework wetware is highly constrained. Misunderstanding is alleviated when the computational framework is brodened to include the microprocessing that takes place within dendritic networks, and recognizing  importance of dendritic microprocessing  allows a coherent theory to be framed regarding the neural functions responsible for perception.

 


1. Neurons

         

Neurons are ordinarily conceived to be the computational units of the brain. Thus the majority of processing theories since the seminal contribution of McCulloch and Pitts (1943) have taken the axonal discharge of the neuron, the nerve impulse, as the currency of computation.

         

However, this framework for computational theory has led to considerable misunderstanding between neuroscientists and  those interested in computational processing. Succesful computational networks depend on highly-often randomly- interconnected elements. The more complex the computation, the more connections are needed: the law of requisite variety (Ashby, 1960). Neuroscientists know that neurons are connected  nonrandomly, often sparsely, and always in a specifically configured fashion for a neuroscience view of connectionist computational theory. In short; current computational processing  emphasizes a minimum of constraints in the processing wetware or hardware; in the current neuroscience framework wetware is highly constrained.

 

Misunderstanding is alleviated when the computational framework is broadened to include the  microprocessing  that takes place within dentritic networks. Not only are axonal dendritic synapses that connect  neurons subject to local influences in these networks, but innumerable dendro-dendritic synapses provide  the unconstrained high connectivity needed  in computational procedures. (Bishop 1956, Pribram  1960, 1971; Schmitt, Dev&Smith 1976) In fact, a large number of  neurons- in some systems, such as cortex, as high as 50%- do not have any axons at all. Their processing capability (primarily inhibitory) is purely dendro-dendritic.

 

Junctions (axodendritic and dendo-dendritic) between neurons in the form of chemical synapses, electrical ephapses, and tight junctions occur within overlapping dendritic arborizations. These junctions provide the possibility for processing as opposed to the mere transmission of signals. The term neurotransmitters applied to chemicals acting at junctions is, therefore, somewhat misleading. Term such as neuroregulator and neuromodulator convey more of meaning of what actually transpires at synapses.

 

Nerve impulse conduction leads everywhere in the central  nervous system to such junctional dendritic microprocessing. When nerve impulses arrive at synapses, presynaptic polarizations result. These are never solitary but constitute arrival patterns. The patterns are constituted of sinusoidally fluctuating  hyper- and depolarizations which are insufficiently  large to immediately incite nerve impulse discharge. The delay affords opportunity for computational complexity.

         

The dendritic microprocess thus provides the relatively unconstrained computational power of the brain, especially when arranged in layers as in the cortex. This computational powe can be described by linear dynamic processes, in terms of quantum field neurodynamics.

 

Neurons are thresholding devices that spatially and temporally segment the results of the dendritic microprocess into discrete packets for communication and control of other levels of processing. These packets are more resistant to degradation and interference than the graded microprocess. They constitute the channels of communication not the processing element.

         

Communication via neurons often consists of dividing a massage into chunks, labelling the chunks so that they are identifiable; transmitting the chunked message, resembling it at its destination. Neurons are labelled by their location in the network. This form of labelling is highly efficient because of the essentially parallel nature of neuronal connectivities.

         

Neuronal channels constrain the basic linear microprocess. These structural constraints can be topologically parallel, convergent and divergent. An instance of a combination of these forms of constraint is the  connectivity between retina and cerebral cortex, which is expressed as a logarithmic function of distance from the foveal center. Other constraints shape the time course of computations and lead to learning. Unveilling the manner in which constraints are imposed in the natural brain is the work of the neurophysiologist.

 

2. Dendritic Microprocessing

 

Recognizing the importance of dendritic microprocessing allows a coherent theory to be framed regarding the neural functions responsible for perception. As Bribram (1971) initially stated in Languages of the Brain:

   

 Any model we make of perceptual processes must thus take into account both the importence of Imaging, a process that contributes a portion of  man`s subjective experience, and the fact that there are influences on behavior of which we are not aware. Instrumental behavior and awareness are often opposed- the more efficient a performance, the less aware we become. Sherrington noted this antagonism in a succinct statement : "Between reflex action and mind there seems to be actual opposition. Reflex action and mind seem almost mutually exclusive-- the more reflex the reflex, the less does mind accompany it."          

 

 

Languages  then proceeds to detail the fact that nerve impulses in axons and junctional microprocessing in dentries function reciprocally. A hypothesis was formulated to the effect that when habbit and habituation characterize behavior that has become automatic, there is efficient processing of dentritic "arrival patterns into departure patterns."On the other hand, persisting designs of junctional patterns are assumed to be coordinated with awareness. The hypothesis is consonant with the view that we are cognizent of some, but not all of the events going in the brain.

 

Nerve impulses arriving at junctions generate dentritic microprocesses. The design of the microprocesses interacts with that which is already present by virtue of the spontaneous activity of the nervous system and its previous experience. The interaction is modulated by inhibitory processes and the whole procedure accounts for the computational power of the brain. The dentritic microprocesses act as a "cross-correlation device to produce new figures from which the patterns of axonic nerve impulses are initiated. The rapidly paced changes in awareness could well reflect the [pace of] duration of the correlation process."(Pribram,1971) .

 

Historically the issues were framed by Lashley, Kohler and Hebb. Donald Hebb (1949) summed up the problem by pointing out that one must decide whether perception is to depend on the excitation of specific cells, or on a pattern of excitation whose locus is unimportant. Hebb choose the former alternative: " A particular perception depends on the excitation of particular cells at some point in the central nervous system. "

 

As neurophysiological evidence accumulated (especially through the microelectrode experiments of Jung (1961); Mountcastle(1957); Maturana, Lettvin, McCulloch, and Pitts (1960); and Hubel and Wiesel (1962) this choice, for a time, appeared vindicated: Microelectrode studies identified neurol units responsive to one or another feature of a stimulating event such as directionality of movement, tilt of line, and so  forth. Today, text books in psychology, in neurophysiology; and even in perception, reflect this view that one percept corresponds to the excitation of one particular group of cells at at some point in the nervous system.

 

Profounly troubled by the problem, Lashley (1942) took the opposite stance:

 

Here is the dilemma. Nerve impulses are transmitted overdefinite, restricted paths in the sensory and motor nerves and in the central nervous system from cell to cell through the definite inter-cellular connections. Yet all behavior seems to be determined by masses of excitation, by the form or relations or proportions of excitation within general fields of activity, without regard to particular nerve cells. It is the pattern and not the element that counts. What sort of nervous organization might be capable of responding to a pattern of  excitation without limited, specialized paths of conduction ? The problem is almost universal in the activities of the nervous system and some hypothesis is needed to direct further research.

 

Wolfgang Kohler also based his Gestalt arguments on such "masses of excitation... within generalized fields of activity " and went on to prove their ubiquitous existence in the decade after the publication of Hebb` s and Leshley`s statements. A series of experiments established the existence of generalized fields but show that, although they were related to the speed with which learning took place, they were unrelated to the perception as tested by discrimination tasks.

 

Lashley was never satisfied with either Hebb`s or Kohler`s position. His alternative was an interface pattern model which he felt would account for perceptual phenomena more adequately than either a DC field or a cell assembly approach. He did not, however, have a clear idea of how the process might work. He never specified the fact that the interference patterns provide a computational scheme for perception. Thus he never developed an argument for the existence of a dentritic microprocess responsible for the computational power of the neuronal mechanism.

 

According to the views presented here and in keeping with Lashley`s intuitions, this computational power is not a function of the "particular cells" and the conducting aspects of the nervous system (the axonal nerve impulses), nor is it necessarily carried out within the province of single neurons. At the same the theory based on these views does not support the notion that the locus of processing is indeterminate. Rather the locus of processing is firmly rooted within regions of dentritic networks at the junctions between neurons.

 

 

As summarized by Szentagothai (1985) :

 

The simple laws of histodynamically polarized neurons ...indicating the direction of flow of excitation ... came to an end when unfamiliar types of synapses between dendrites, cell bodies and dendrites, serial synapses etc. were found in infinite variety ...  A whole new world of microcircuitry became known ... culminating in a new generalized concept of local neuron circuits(Rakic, 1976; Schmitt , 1976)    

 

The ubiquity of such axonless local circuit neurons indicates that  computation is strongly influenced by dentritic-dentritic interactions that modify the postaxonal dentritic processes. Perceptual processing depends therefore on network properties that extend beyond the purview of the dendrites of a single neuron. It is the synaptic event rather than the neuron perse, that serves as the computational element.

 

The sub - and superneuronal aspect of the dentritic microprocess, its potential to extend beyond the single neuron, provides explanatory power for both older and recently accumulating evidence that brain processes coordinate with perception are distributed.  In a distributed process, perceptual events are represented not by single neurons but by patterns of polarization across ensembles of neurons.

 

On the basis of his extensive studies E.R. John came to a similar conclusion:

 

The spatiotemporal patterning of these cooperative processes ... [involve] ionic shifts ... with extrusion of potassium ions and ionic binding on extracellular mucopolysaccharide filaments. If we focus our attention not on the membranes of  single neurons, but upon charge density distributions in the tissue matrix of  neurons, glial cells, and mucopolysaccharide processes, we can evisage a complex, three dimensional volume of isopotential contours, topologically comprised of portions of cellular membranes and extracellular binding sites and constantly changing over time. Let us call this volume of isopotential contours or convoluted surfaces a hyperneuron.

 

Basic to this new view of neurology of perception is the fact that propagated nerve impulses are but of one of the important electrical characteristics of neural tissue. The other characteristic is the microprocess that takes place at the junctions between neurons. Hyper and depolarizations of postsynaptic dentritic membranes occur at the junctions between neurons where they may even produce miniature electrical spikes. However, these minispikes and graded polarizations also differ from axonal nerve impulses in that they do not propagate. The influence of these minispikes and graded polarizations on further neuronal activity is by way of cooperativity among spatially seperated events. Cooperativity is mediated by the cable properties of dentrites and the surrounding glia. This type of interaction is called nonlocal because the effect is exerted at a distance witrhout any obvious intervening propagation. By analogy the effect is also called jumping or saltatory as in saltatory conduction by myelinated nerve fibers. It is this saltatory nature of the interactions ascaptured by perceptual experience that fascinated Frank Geldard, experiences so clearly described in his inaugural MacEachran Lecture ( 1975 ).   

 

3. Receptive Fields

           

The neurophysiologist can readily study the output --spike trains-- of neurons when they act as channels; but he has only limited access to the functions of the interactive dendritic junctional architecture because of the small scale at which the process proceed.A major breakthrough toward understanding was achieved, however, when Kuffler (1953) noted that he could map the functional dendritic field of a retinal ganglion cell  by recording impulses from the ganglion cell's axon located in the optic nerve. This was accomplished by moving a spot of light in front of a paralyzed eye and recording the locations of the spot that produce a response in the axon. The locations mapped the extent of  the responding dendritic field of that axon's parent neuron. The direction of response, inhibitory or excitatory, at each location indicated whether the dendrites at that location were hyperpolarizing or depolarizing.

         

The resulting maps of dendritic hyper and depolarization are called receptive fields.The receptive fields of retinal ganglion cells are configured concentrically: a circular inhibitory or excitatory center surrounded by a penumbra of  opposite sign. This center surround organization has been shown to be due to the operation of axonless horizontally arranged  dendritically endowed neurons that produce  lateral inhibition in the neighborhood of excitation and viceversa. The center surround organization thus reflects the formation of a spatial dipole of hyper and depolarization, an opponent process fundamental to the organization of the configural properties of vision.

Utilizing Kuffler's techniques of mapping, Hubel and Wiesel (1959) discovered that at the cerebral cortex the circular organization of the dendritic hyper and depolarization gives way to elongated  receptive fields with definite and various orientations.They noted that  oriented lines of light rather than spots produced the best response recorded from the axons of these cortical neurons. They therefore concluded that these cortical neurons were line dedectors. In keeping with the tenets of Euclidean geometry where lines are made up of points, planes by line and solids by planes.Hubel and Wiesel suggested that line dedectors were composed by convergence of inputs from neurons at earlier stages of visual processing (retinal and thalamic--which acted as spot dedectors due to the circular center-surround organization of the receptive fields.)        

 

The Euclidean interpretation of neural processing in perception became what Barlow (1972) has called the neurophysiological dogma. The interpretation led to a search for convergences of paths from feature dedectors such as those responding to lines, culminating in pontifical or grandfather cells that embodied the response to object forms such as faces and hands. The search was in some instances rewarded in that single neurons might respond best to a particular object form such as a hand or face. (Gross, 1973) However, response is never restricted to such object forms. Such best responses can also occur ýn parallel networks ýn which convergence is but one mode of organization.

 

About a decade after the discovery of elongated visual receptive fields of cortical neurons, new evidence accrued that called into question the view that figures were composed by convergence of Euclidean features. For instance, in the laboratories of Stanford University  the architecture of cortical dendritic fields examined by computer and cortical receptive fields that contained multiple bands of excitatory and inhibitory areas are found. (Spinelli & Barret,1969; Spinelli, Pribram& Bridgeman, 1973) In Leningrad similar observations were made by Glezer (Glezer, Ivanoff& Tscherbach, 1973) who remarked that these cortical neurons responded more like stripedness dedectors. The critical report, however, was that of Pollen, Lee, and Taylor (1971), who interpreted similar findings to indicate that the cortical neurons were behaving as Fourier analyzers rather than as line dedectors.

 

At the same time Campbell and Rabson (1968), initially on the basis of psycophysical, and subsequently, on the basis of neurophysiological experiments, developed the thesis that vision operates harmonically much as does audition except that the visual system responds to spatial frequencies. Here I want to introduce the critical difference between Euclidian-based and Fourier-based harmonic approaches.

 

When a harmonic analysis is taken as the approach, the elongated receptive field organization of cortical neurons suggest that neurons act as "strings" tuned to a limited bandwith frequencies. The ensemble of strings compose resonators or active filters as in musical instruments. A century ago, Helmoltz proposed that sensory receptors are akin to a piano keyboard; that a spatially isomorphic relation is maintained between receptor and cortex as in the relation between keys and strings of a piano, but that each cortical "unit" responds to a limited bandwidth of frequencies as do the strings attached to the piano's sounding board. From the operation of the total range of such units, magnificent sounds (in the case of the piano) and sights (by means of the visual system) can become configured (Figure 1).

 

The geometric and harmonic views differ significantly with respect to the composition of a percept. Irwin Rock (1983) described this difference as follows:

 

One confusion here may be with the meaning of "feature". A feature could refer to an identifiable part or unit that must first be extracted or detected, and then along with other features assembled into an overall pattern. Or "feature" could refer to an identifiable emergent characteristics of the form once it is achieved rather than as one of the parts that produces it.

 

The details of  the neurophysiological data show that features such as oriented lines, movement and color are best conceived as identifiable emergent charecteristicsof form because they are already conjoined in the receptive field.

 

Furthermore such features become activated either by sensory input or by central process to configure a percept. This evidence, makes the resonating string metaphor more reasonable than the feature detector approach.

 

There are four critical reasons for preferring tuned frequencies to detected features:

 

(a)   Neurons in the visual cortex respond to several  features of sensory input and there is no evidence that the different features are represented by seperate neurons, as would be required if it acted as a detector;

(b)  the receptive field properties of such neurons can be accounted for considering them as spatial and temporal differentiations of tuned frequency;

(c)   tuned frequencies provide a potentially richer panoply of configuration (e.g. texture, paralax ), and

(d)  perceptual research has clearly shown that lines ( and therefore line detectors ) composing contours are inadequate elements with which to account for the configural properties of vision.

 

Rock (1983) summarized the evidence and argument as follows:

 

The emphasis on contour detection is entirely misplaced because, as far as form is concerned, a contour simply marks or delineates a location. What matters for form  perception is the set of all such locations; and if these can be delineated without contours, contours are not necessary. That is why in addition to depth , we percieve regions of  particular shapes in two random dot patterns viewed binocularly despite the absence of any physical contours. Illusory contours also support this conclusion (pg.43).

 

Rock provided the results of innumerable experiments to document his insight that the configural properties of vision are due to a process of directional integration (p.47). The most critical is the demonstration that the percieved direction of a point which respect to ourselves... is a joint function of retinal locus and eye position (pg 46).

 

In summary, sensory cortical receptive fields are considered analogous to resonating strings in a piano. The functional relationship among strings (among the receptive fields of the sensory cortex) and with the keyboard (with the sensory receptors) is spatially organized and provides a macrolevel of perceptual processing. The functional relationship among resonant frequencies, characteristics of overlapping functions of the receptive fields of the cortical neurons, provides a microlevel of perceptual processing. It is this cooperative microprocess that allows one to assume that indeed a specific brain process is coordinate with the richness of experience that is perception. 


 

 

 

 contents                                     home