fbpx
Wikipedia

Biological neuron model

Biological neuron models, also known as spiking neuron models,[1] are mathematical descriptions of the conduction of electrical signals in neurons. Neurons (or nerve cells) are electrically excitable cells within the nervous system, able to fire electric signals, called action potentials, across a neural network. These mathematical models describe the role of the biophysical and geometrical characteristics of neurons on the conduction of electrical activity.

Fig. 1. Neuron and myelinated axon, with signal flow from inputs at dendrites to outputs at axon terminals. The signal is a short electrical pulse called action potential or 'spike'.
Fig 2. Time course of neuronal action potential ("spike"). Note that the amplitude and the exact shape of the action potential can vary according to the exact experimental technique used for acquiring the signal.

Central to these models is the description of how the membrane potential (that is, the difference in electric potential between the interior and the exterior of a biological cell) across the cell membrane changes over time. In an experimental setting, stimulating neurons with an electrical current generates an action potential (or spike), that propagates down the neuron's axon. This axon can branch out and connect to a large number of downstream neurons at sites called synapses. At these synapses, the spike can cause release of neurotransmitters, which in turn can change the voltage potential of downstream neurons. This change can potentially lead to even more spikes in those downstream neurons, thus passing down the signal. As many as 85% of neurons in the neocortex, the outermost layer of the mammalian brain, consist of excitatory pyramidal neurons,[2][3] and each pyramidal neuron receives tens of thousands of inputs from other neurons.[4] Thus, spiking neurons are a major information processing unit of the nervous system.

One such example of a spiking neuron model may be a highly detailed mathematical model that includes spatial morphology. Another may be a conductance-based neuron model that views neurons as points and describes the membrane voltage dynamics as a function of trans-membrane currents. A mathematically simpler "integrate-and-fire" model significantly simplifies the description of ion channel and membrane potential dynamics (initially studied by Lapique in 1907).[5][6]

Biological background, classification, and aims of neuron models edit

Non-spiking cells, spiking cells, and their measurement

Not all the cells of the nervous system produce the type of spike that define the scope of the spiking neuron models. For example, cochlear hair cells, retinal receptor cells, and retinal bipolar cells do not spike. Furthermore, many cells in the nervous system are not classified as neurons but instead are classified as glia.

Neuronal activity can be measured with different experimental techniques, such as the "Whole cell" measurement technique, which captures the spiking activity of a single neuron and produces full amplitude action potentials.

With extracellular measurement techniques, one or more electrodes are placed in the extracellular space. Spikes, often from several spiking sources, depending on the size of the electrode and its proximity to the sources, can be identified with signal processing techniques. Extracellular measurement has several advantages:

  • It is easier to obtain experimentally;
  • It is robust and lasts for a longer time;
  • It can reflect the dominant effect, especially when conducted in an anatomical region with many similar cells.

Overview of neuron models

Neuron models can be divided into two categories according to the physical units of the interface of the model. Each category could be further divided according to the abstraction/detail level:

  1. Electrical input–output membrane voltage models – These models produce a prediction for membrane output voltage as a function of electrical stimulation given as current or voltage input. The various models in this category differ in the exact functional relationship between the input current and the output voltage and in the level of detail. Some models in this category predict only the moment of occurrence of output spike (also known as "action potential"); other models are more detailed and account for sub-cellular processes. The models in this category can be either deterministic or probabilistic.
  2. Natural stimulus or pharmacological input neuron models – The models in this category connect the input stimulus which can be either pharmacological or natural, to the probability of a spike event. The input stage of these models is not electrical but rather has either pharmacological (chemical) concentration units, or physical units that characterize an external stimulus such as light, sound or other forms of physical pressure. Furthermore, the output stage represents the probability of a spike event and not an electrical voltage.

Although it is not unusual in science and engineering to have several descriptive models for different abstraction/detail levels, the number of different, sometimes contradicting, biological neuron models is exceptionally high. This situation is partly the result of the many different experimental settings, and the difficulty to separate the intrinsic properties of a single neuron from measurement effects and interactions of many cells (network effects).

Aims of neuron models

Ultimately, biological neuron models aim to explain the mechanisms underlying the operation of the nervous system. However, several approaches can be distinguished, from more realistic models (e.g., mechanistic models) to more pragmatic models (e.g., phenomenological models).[7][better source needed] Modeling helps to analyze experimental data and address questions. Models are also important in the context of restoring lost brain functionality through neuroprosthetic devices.

Electrical input–output membrane voltage models edit

The models in this category describe the relationship between neuronal membrane currents at the input stage and membrane voltage at the output stage. This category includes (generalized) integrate-and-fire models and biophysical models inspired by the work of Hodgkin–Huxley in the early 1950s using an experimental setup that punctured the cell membrane and allowed to force a specific membrane voltage/current.[8][9][10][11]

Most modern electrical neural interfaces apply extra-cellular electrical stimulation to avoid membrane puncturing, which can lead to cell death and tissue damage. Hence, it is not clear to what extent the electrical neuron models hold for extra-cellular stimulation (see e.g.[12]).

Hodgkin–Huxley edit

Experimental evidence supporting the model
Property of the H&H model References
The shape of an individual spike [8][9][10][11]
The identity of the ions involved [8][9][10][11]
Spike speed across the axon [8]

The Hodgkin–Huxley model (H&H model)[8][9][10][11] is a model of the relationship between the flow of ionic currents across the neuronal cell membrane and the membrane voltage of the cell.[8][9][10][11] It consists of a set of nonlinear[disambiguation needed] differential equations describing the behavior of ion channels that permeate the cell membrane of the squid giant axon. Hodgkin and Huxley were awarded the 1963 Nobel Prize in Physiology or Medicine for this work.

It is important to note the voltage-current relationship, with multiple voltage-dependent currents charging the cell membrane of capacity Cm

 

The above equation is the time derivative of the law of capacitance, Q = CV where the change of the total charge must be explained as the sum over the currents. Each current is given by

 

where g(t,V) is the conductance, or inverse resistance, which can be expanded in terms of its maximal conductance and the activation and inactivation fractions m and h, respectively, that determine how many ions can flow through available membrane channels. This expansion is given by

 

and our fractions follow the first-order kinetics

 

with similar dynamics for h, where we can use either τ and m or α and β to define our gate fractions.

The Hodgkin–Huxley model may be extended to include additional ionic currents. Typically, these include inward Ca2+ and Na+ input currents, as well as several varieties of K+ outward currents, including a "leak" current.

The result can be at the small end of 20 parameters which one must estimate or measure for an accurate model. In a model of a complex system of neurons, numerical integration of the equations are computationally expensive. Careful simplifications of the Hodgkin–Huxley model are therefore needed.

The model can be reduced to two dimensions thanks to the dynamic relations which can be established between the gating variables.[13] it is also possible to extend it to take into account the evolution of the concentrations (considered fixed in the original model).[14][15]

Perfect Integrate-and-fire edit

One of the earliest models of a neuron is the perfect integrate-and-fire model (also called non-leaky integrate-and-fire), first investigated in 1907 by Louis Lapicque.[16] A neuron is represented by its membrane voltage V which evolves in time during stimulation with an input current I(t) according

 

which is just the time derivative of the law of capacitance, Q = CV. When an input current is applied, the membrane voltage increases with time until it reaches a constant threshold Vth, at which point a delta function spike occurs and the voltage is reset to its resting potential, after which the model continues to run. The firing frequency of the model thus increases linearly without bound as input current increases.

The model can be made more accurate by introducing a refractory period tref that limits the firing frequency of a neuron by preventing it from firing during that period. For constant input I(t)=I the threshold voltage is reached after an integration time tint=CVthr/I after start from zero. After a reset, the refractory period introduces a dead time so that the total time until the next firing is tref+tint . The firing frequency is the inverse of the total inter-spike interval (including dead time). The firing frequency as a function of a constant input current is therefore

 

A shortcoming of this model is that it describes neither adaptation nor leakage. If the model receives a below-threshold short current pulse at some time, it will retain that voltage boost forever - until another input later makes it fire. This characteristic is not in line with observed neuronal behavior. The following extensions make the integrate-and-fire model more plausible from a biological point of view.

Leaky integrate-and-fire edit

The leaky integrate-and-fire model, which can be traced back to Louis Lapicque,[16] contains a "leak" term in the membrane potential equation that reflects the diffusion of ions through the membrane, unlike the non-leaky integrate-and-fire model. The model equation looks like[1]

 
 
A neuron is represented by an RC circuit with a threshold. Each input pulse (e.g. caused by a spike from a different neuron) causes a short current pulse. Voltage decays exponentially. If the threshold is reached an output spike is generated and the voltage is reset.

where Vm is the voltage across the cell membrane and Rm is the membrane resistance. (The non-leaky integrate-and-fire model is retrieved in the limit Rm to infinity, i.e. if the membrane is a perfect insulator). The model equation is valid for arbitrary time-dependent input until a threshold Vth is reached; thereafter the membrane potential is reset.

For constant input, the minimum input to reach the threshold is Ith = Vth / Rm. Assuming a reset to zero, the firing frequency thus looks like

 

which converges for large input currents to the previous leak-free model with the refractory period.[17] The model can also be used for inhibitory neurons.[18][19]

The most significant disadvantage of this model is that it does not contain neuronal adaptation, so that it cannot describe an experimentally measured spike train in response to constant input current.[20] This disadvantage is removed in generalized integrate-and-fire models that also contain one or several adaptation-variables and are able to predict spike times of cortical neurons under current injection to a high degree of accuracy.[21][22][23]

Adaptive integrate-and-fire edit

Experimental evidence supporting the model
Adaptive integrate-and-fire model model References
Sub-threshold voltage for time-dependent input current [22][23]
Firing times for time-dependent input current [22][23]
Firing Patterns in response to step current input [24][25][26]

Neuronal adaptation refers to the fact that even in the presence of a constant current injection into the soma, the intervals between output spikes increase. An adaptive integrate-and-fire neuron model combines the leaky integration of voltage V with one or several adaptation variables wk (see Chapter 6.1. in the textbook Neuronal Dynamics[27])

 
 

where   is the membrane time constant, wk is the adaptation current number, with index k,   is the time constant of adaptation current wk, Em is the resting potential and tf is the firing time of the neuron and the Greek delta denotes the Dirac delta function. Whenever the voltage reaches the firing threshold the voltage is reset to a value Vr below the firing threshold. The reset value is one of the important parameters of the model. The simplest model of adaptation has only a single adaptation variable w and the sum over k is removed.[28]

 
Spike times and subthreshold voltage of cortical neuron models can be predicted by generalized integrate-and-fire models such as the adaptive integrate-and-fire model, the adaptive exponential integrate-and-fire model, or the spike response model. In the example here, adaptation is implemented by a dynamic threshold which increases after each spike.[22][23]

Integrate-and-fire neurons with one or several adaptation variables can account for a variety of neuronal firing patterns in response to constant stimulation, including adaptation, bursting, and initial bursting.[24][25][26] Moreover, adaptive integrate-and-fire neurons with several adaptation variables are able to predict spike times of cortical neurons under time-dependent current injection into the soma.[22][23]

Fractional-order leaky integrate-and-fire edit

Recent advances in computational and theoretical fractional calculus lead to a new form of model called Fractional-order leaky integrate-and-fire.[29][30] An advantage of this model is that it can capture adaptation effects with a single variable. The model has the following form[30]

 

Once the voltage hits the threshold it is reset. Fractional integration has been used to account for neuronal adaptation in experimental data.[29]

'Exponential integrate-and-fire' and 'adaptive exponential integrate-and-fire' edit

Experimental evidence supporting the model
Adaptive exponential integrate-and-fire References
The sub-threshold current-voltage relation [31]
Firing patterns in response to step current input [26]
Refractoriness and adaptation [32]

In the exponential integrate-and-fire model,[33] spike generation is exponential, following the equation:

 

where   is the membrane potential,   is the intrinsic membrane potential threshold,   is the membrane time constant,  is the resting potential, and   is the sharpness of action potential initiation, usually around 1 mV for cortical pyramidal neurons.[31] Once the membrane potential crosses  , it diverges to infinity in finite time.[34] In numerical simulation the integration is stopped if the membrane potential hits an arbitrary threshold (much larger than  ) at which the membrane potential is reset to a value Vr . The voltage reset value Vr is one of the important parameters of the model. Importantly, the right-hand side of the above equation contains a nonlinearity that can be directly extracted from experimental data.[31] In this sense the exponential nonlinearity is strongly supported by experimental evidence.

In the adaptive exponential integrate-and-fire neuron [32] the above exponential nonlinearity of the voltage equation is combined with an adaptation variable w

 
 
 
Firing pattern of initial bursting in response to a step current input generated with the Adaptive exponential integrate-and-fire model. Other Firing patterns can also be generated.[26]

where w denotes the adaptation current with time scale  . Important model parameters are the voltage reset value Vr, the intrinsic threshold  , the time constants   and   as well as the coupling parameters a and b. The adaptive exponential integrate-and-fire model inherits the experimentally derived voltage nonlinearity [31] of the exponential integrate-and-fire model. But going beyond this model, it can also account for a variety of neuronal firing patterns in response to constant stimulation, including adaptation, bursting, and initial bursting.[26] However, since the adaptation is in the form of a current, aberrant hyperpolarization may appear. This problem was solved by expressing it as a conductance.[35]

Adaptive Threshold Neuron Model edit

In this model, a time-dependent function   is added to the fixed threshold,  , after every spike, causing an adaptation of the threshold. The threshold potential,  , gradually returns to its steady state value depending on the threshold adaptation time constant  .[36] This is one of the simpler techniques to achieve spike frequency adaptation.[37] The expression for the adaptive threshold is given by:

 

where   is defined by:  

When the membrane potential,  , reaches a threshold, it is reset to  :

 

A simpler version of this with a single time constant in threshold decay with an LIF neuron is realized in [38] to achieve LSTM like recurrent spiking neural networks to achieve accuracy nearer to ANNs on few spatio temporal tasks.

Double Exponential Adaptive Threshold (DEXAT) edit

The DEXAT neuron model is a flavor of adaptive neuron model in which the threshold voltage decays with a double exponential having two time constants. Double exponential decay is governed by a fast initial decay and then a slower decay over a longer period of time.[39][40] This neuron used in SNNs through surrogate gradient creates an adaptive learning rate yielding higher accuracy and faster convergence, and flexible long short-term memory compared to existing counterparts in the literature. The membrane potential dynamics are described through equations and the threshold adaptation rule is:

 

The dynamics of   and   are given by

 ,

 ,

where   and  .

Further, multi-time scale adaptive threshold neuron model showing more complex dynamics is shown in.[41]

Stochastic models of membrane voltage and spike timing edit

The models in this category are generalized integrate-and-fire models that include a certain level of stochasticity. Cortical neurons in experiments are found to respond reliably to time-dependent input, albeit with a small degree of variations between one trial and the next if the same stimulus is repeated.[42][43] Stochasticity in neurons has two important sources. First, even in a very controlled experiment where input current is injected directly into the soma, ion channels open and close stochastically[44] and this channel noise leads to a small amount of variability in the exact value of the membrane potential and the exact timing of output spikes. Second, for a neuron embedded in a cortical network, it is hard to control the exact input because most inputs come from unobserved neurons somewhere else in the brain.[27]

Stochasticity has been introduced into spiking neuron models in two fundamentally different forms: either (i) a noisy input current is added to the differential equation of the neuron model;[45] or (ii) the process of spike generation is noisy.[46] In both cases, the mathematical theory can be developed for continuous time, which is then, if desired for the use in computer simulations, transformed into a discrete-time model.

The relation of noise in neuron models to the variability of spike trains and neural codes is discussed in Neural Coding and in Chapter 7 of the textbook Neuronal Dynamics.[27]

Noisy input model (diffusive noise) edit

A neuron embedded in a network receives spike input from other neurons. Since the spike arrival times are not controlled by an experimentalist they can be considered as stochastic. Thus a (potentially nonlinear) integrate-and-fire model with nonlinearity f(v) receives two inputs: an input   controlled by the experimentalists and a noisy input current   that describes the uncontrolled background input.

 

Stein's model[45] is the special case of a leaky integrate-and-fire neuron and a stationary white noise current   with mean zero and unit variance. In the subthreshold regime, these assumptions yield the equation of the Ornstein–Uhlenbeck process

 

However, in contrast to the standard Ornstein–Uhlenbeck process, the membrane voltage is reset whenever V hits the firing threshold Vth .[45] Calculating the interval distribution of the Ornstein–Uhlenbeck model for constant input with threshold leads to a first-passage time problem.[45][47] Stein's neuron model and variants thereof have been used to fit interspike interval distributions of spike trains from real neurons under constant input current.[47]

In the mathematical literature, the above equation of the Ornstein–Uhlenbeck process is written in the form

 

where   is the amplitude of the noise input and dW are increments of a Wiener process. For discrete-time implementations with time step dt the voltage updates are[27]

 

where y is drawn from a Gaussian distribution with zero mean unit variance. The voltage is reset when it hits the firing threshold Vth .

The noisy input model can also be used in generalized integrate-and-fire models. For example, the exponential integrate-and-fire model with noisy input reads

 

For constant deterministic input   it is possible to calculate the mean firing rate as a function of  .[48] This is important because the frequency-current relation (f-I-curve) is often used by experimentalists to characterize a neuron.

The leaky integrate-and-fire with noisy input has been widely used in the analysis of networks of spiking neurons.[49] Noisy input is also called 'diffusive noise' because it leads to a diffusion of the subthreshold membrane potential around the noise-free trajectory (Johannesma,[50] The theory of spiking neurons with noisy input is reviewed in Chapter 8.2 of the textbook Neuronal Dynamics.[27]

Noisy output model (escape noise) edit

In deterministic integrate-and-fire models, a spike is generated if the membrane potential V(t) hits the threshold  . In noisy output models, the strict threshold is replaced by a noisy one as follows. At each moment in time t, a spike is generated stochastically with instantaneous stochastic intensity or 'escape rate' [27]

 

that depends on the momentary difference between the membrane voltage V(t) and the threshold  .[46] A common choice for the 'escape rate'   (that is consistent with biological data[22]) is

 
 
Stochastic spike generation (noisy output) depends on the momentary difference between the membrane potential V(t) and the threshold. The membrane potential V of the spike response model (SRM) has two contributions.[51][52] First, input current I is filtered by a first filter k. Second the sequence of output spikes S(t) is filtered by a second filter η and fed back. The resulting membrane V(t) potential is used to generate output spikes by a stochastic process ρ(t) with an intensity that depends on the distance between membrane potential and threshold. The spike response model (SRM) is closely related to the Generalized Linear Model (GLM).[53][54]

where  is a time constant that describes how quickly a spike is fired once the membrane potential reaches the threshold and   is a sharpness parameter. For   the threshold becomes sharp and spike firing occurs deterministically at the moment when the membrane potential hits the threshold from below. The sharpness value found in experiments[22] is   which means that neuronal firing becomes non-negligible as soon as the membrane potential is a few mV below the formal firing threshold.

The escape rate process via a soft threshold is reviewed in Chapter 9 of the textbook Neuronal Dynamics.[27]

For models in discrete time, a spike is generated with probability

 

that depends on the momentary difference between the membrane voltage V at time   and the threshold  .[55] The function F is often taken as a standard sigmoidal   with steepness parameter  ,[46] similar to the update dynamics in artificial neural networks. But the functional form of F can also be derived from the stochastic intensity   in continuous time introduced above as   where   is the threshold distance.[46]

Integrate-and-fire models with output noise can be used to predict the peristimulus time histogram (PSTH) of real neurons under arbitrary time-dependent input.[22] For non-adaptive integrate-and-fire neurons, the interval distribution under constant stimulation can be calculated from stationary renewal theory. [27]

Spike response model (SRM) edit

Experimental evidence supporting the model
Spike response model References
Sub-threshold voltage for time-dependent input current [23][22]
Firing times for time-dependent input current [23][22]
Firing Patterns in response to step current input [56][57]
Interspike interval distribution [56][46]
Spike-afterpotential [23]
refractoriness and dynamic firing threshold [23][22]

main article: Spike response model

The spike response model (SRM) is a generalized linear model for the subthreshold membrane voltage combined with a nonlinear output noise process for spike generation.[46][58][56] The membrane voltage V(t) at time t is

 

where tf is the firing time of spike number f of the neuron, Vrest is the resting voltage in the absence of input, I(t-s) is the input current at time t-s and   is a linear filter (also called kernel) that describes the contribution of an input current pulse at time t-s to the voltage at time t. The contributions to the voltage caused by a spike at time   are described by the refractory kernel  . In particular,   describes the reset after the spike and the time course of the spike-afterpotential following a spike. It therefore expresses the consequences of refractoriness and adaptation.[46][23] The voltage V(t) can be interpreted as the result of an integration of the differential equation of a leaky integrate-and-fire model coupled to an arbitrary number of spike-triggered adaptation variables.[24]

Spike firing is stochastic and happens with a time-dependent stochastic intensity (instantaneous rate)

 

with parameters   and   and a dynamic threshold   given by

 

Here   is the firing threshold of an inactive neuron and   describes the increase of the threshold after a spike at time  .[22][23] In case of a fixed threshold, one sets  . For   the threshold process is deterministic.[27]

The time course of the filters   that characterize the spike response model can be directly extracted from experimental data.[23] With optimized parameters the SRM describes the time course of the subthreshold membrane voltage for time-dependent input with a precision of 2mV and can predict the timing of most output spikes with a precision of 4ms.[22][23] The SRM is closely related to linear-nonlinear-Poisson cascade models (also called Generalized Linear Model).[54] The estimation of parameters of probabilistic neuron models such as the SRM using methods developed for Generalized Linear Models[59] is discussed in Chapter 10 of the textbook Neuronal Dynamics.[27]

 
Spike arrival causes postsynaptic potentials (red lines) which are summed. If the total voltage V reaches a threshold (dashed blue line) a spike is initiated (green) which also includes a spike-afterpotential. The threshold increases after each spike. Postsynaptic potentials are the response to incoming spikes while the spike-afterpotential is the response to outgoing spikes.

The name spike response model arises because, in a network, the input current for neuron i is generated by the spikes of other neurons so that in the case of a network the voltage equation becomes

 

where  is the firing times of neuron j (i.e., its spike train);   describes the time course of the spike and the spike after-potential for neuron i; and   and   describe the amplitude and time course of an excitatory or inhibitory postsynaptic potential (PSP) caused by the spike  of the presynaptic neuron j. The time course   of the PSP results from the convolution of the postsynaptic current   caused by the arrival of a presynaptic spike from neuron j with the membrane filter  .[27]

SRM0 edit

The SRM0[56][60][61] is a stochastic neuron model related to time-dependent nonlinear renewal theory and a simplification of the Spike Response Model (SRM). The main difference to the voltage equation of the SRM introduced above is that in the term containing the refractory kernel   there is no summation sign over past spikes: only the most recent spike (denoted as the time  ) matters. Another difference is that the threshold is constant. The model SRM0 can be formulated in discrete or continuous time. For example, in continuous time, the single-neuron equation is

 

and the network equations of the SRM0 are[56]

 

where   is the last firing time neuron i. Note that the time course of the postsynaptic potential   is also allowed to depend on the time since the last spike of neuron i to describe a change in membrane conductance during refractoriness.[60] The instantaneous firing rate (stochastic intensity) is

 

where   is a fixed firing threshold. Thus spike firing of neuron i depends only on its input and the time since neuron i has fired its last spike.

With the SRM0, the interspike-interval distribution for constant input can be mathematically linked to the shape of the refractory kernel   .[46][56] Moreover the stationary frequency-current relation can be calculated from the escape rate in combination with the refractory kernel  .[46][56] With an appropriate choice of the kernels, the SRM0 approximates the dynamics of the Hodgkin-Huxley model to a high degree of accuracy.[60] Moreover, the PSTH response to arbitrary time-dependent input can be predicted.[56]

Galves–Löcherbach model edit

 
3D visualization of the Galves–Löcherbach model for biological neural nets. This visualization is set for 4,000 neurons (4 layers with one population of inhibitory neurons and one population of excitatory neurons each) at 180 intervals of time.

The Galves–Löcherbach model[62] is a stochastic neuron model closely related to the spike response model SRM0 [61][56] and the leaky integrate-and-fire model. It is inherently stochastic and, just like the SRM0, it is linked to time-dependent nonlinear renewal theory. Given the model specifications, the probability that a given neuron   spikes in a period   may be described by

 

where   is a synaptic weight, describing the influence of neuron   on neuron  ,   expresses the leak, and   provides the spiking history of neuron   before  , according to

 

Importantly, the spike probability of neuron   depends only on its spike input (filtered with a kernel   and weighted with a factor  ) and the timing of its most recent output spike (summarized by  ).

Didactic toy models of membrane voltage edit

The models in this category are highly simplified toy models that qualitatively describe the membrane voltage as a function of input. They are mainly used for didactic reasons in teaching but are not considered valid neuron models for large-scale simulations or data fitting.

FitzHugh–Nagumo edit

Sweeping simplifications to Hodgkin–Huxley were introduced by FitzHugh and Nagumo in 1961 and 1962. Seeking to describe "regenerative self-excitation" by a nonlinear positive-feedback membrane voltage and recovery by a linear negative-feedback gate voltage, they developed the model described by[63]

 

where we again have a membrane-like voltage and input current with a slower general gate voltage w and experimentally-determined parameters a = -0.7, b = 0.8, τ = 1/0.08. Although not derivable from biology, the model allows for a simplified, immediately available dynamic, without being a trivial simplification.[64] The experimental support is weak, but the model is useful as a didactic tool to introduce dynamics of spike generation through phase plane analysis. See Chapter 7 in the textbook Methods of Neuronal Modeling.[65]

Morris–Lecar edit

In 1981, Morris and Lecar combined the Hodgkin–Huxley and FitzHugh–Nagumo models into a voltage-gated calcium channel model with a delayed-rectifier potassium channel represented by

 

where  .[17] The experimental support of the model is weak, but the model is useful as a didactic tool to introduce dynamics of spike generation through phase plane analysis. See Chapter 7[66] in the textbook Methods of Neuronal Modeling.[65]

A two-dimensional neuron model very similar to the Morris-Lecar model can be derived step-by-step starting from the Hodgkin-Huxley model. See Chapter 4.2 in the textbook Neuronal Dynamics.[27]

Hindmarsh–Rose edit

Building upon the FitzHugh–Nagumo model, Hindmarsh and Rose proposed in 1984[67] a model of neuronal activity described by three coupled first-order differential equations:

 

with r2 = x2 + y2 + z2, and r ≈ 10−2 so that the z variable only changes very slowly. This extra mathematical complexity allows a great variety of dynamic behaviors for the membrane potential, described by the x variable of the model, which includes chaotic dynamics. This makes the Hindmarsh–Rose neuron model very useful, because it is still simple, allows a good qualitative description of the many different firing patterns of the action potential, in particular bursting, observed in experiments. Nevertheless, it remains a toy model and has not been fitted to experimental data. It is widely used as a reference model for bursting dynamics.[67]

Theta model and quadratic integrate-and-fire edit

The theta model, or Ermentrout–Kopell canonical Type I model, is mathematically equivalent to the quadratic integrate-and-fire model which in turn is an approximation to the exponential integrate-and-fire model and the Hodgkin-Huxley model. It is called a canonical model because it is one of the generic models for constant input close to the bifurcation point, which means close to the transition from silent to repetitive firing.[68][69]

The standard formulation of the theta model is[27][68][69]

 

The equation for the quadratic integrate-and-fire model is (see Chapter 5.3 in the textbook Neuronal Dynamics [27])

 

The equivalence of theta model and quadratic integrate-and-fire is for example reviewed in Chapter 4.1.2.2 of spiking neuron models.[1]

For input   that changes over time or is far away from the bifurcation point, it is preferable to work with the exponential integrate-and-fire model (if one wants to stay in the class of one-dimensional neuron models), because real neurons exhibit the nonlinearity of the exponential integrate-and-fire model.[31]

Sensory input-stimulus encoding neuron models edit

The models in this category were derived following experiments involving natural stimulation such as light, sound, touch, or odor. In these experiments, the spike pattern resulting from each stimulus presentation varies from trial to trial, but the averaged response from several trials often converges to a clear pattern. Consequently, the models in this category generate a probabilistic relationship between the input stimulus to spike occurrences. Importantly, the recorded neurons are often located several processing steps after the sensory neurons, so that these models summarize the effects of the sequence of processing steps in a compact form

The non-homogeneous Poisson process model (Siebert) edit

Siebert[70][71] modeled the neuron spike firing pattern using a non-homogeneous Poisson process model, following experiments involving the auditory system.[70][71] According to Siebert, the probability of a spiking event at the time interval   is proportional to a non-negative function  , where   is the raw stimulus.:

 

Siebert considered several functions as  , including   for low stimulus intensities.

The main advantage of Siebert's model is its simplicity. The shortcomings of the model is its inability to reflect properly the following phenomena:

  • The transient enhancement of the neuronal firing activity in response to a step stimulus.
  • The saturation of the firing rate.
  • The values of inter-spike-interval-histogram at short intervals values (close to zero).

These shortcomings are addressed by the age-dependent point process model and the two-state Markov Model.[72][73][74]

Refractoriness and age-dependent point process model edit

Berry and Meister[75] studied neuronal refractoriness using a stochastic model that predicts spikes as a product of two terms, a function f(s(t)) that depends on the time-dependent stimulus s(t) and one a recovery function   that depends on the time since the last spike

 

The model is also called an inhomogeneous Markov interval (IMI) process.[76] Similar models have been used for many years in auditory neuroscience.[77][78][79] Since the model keeps memory of the last spike time it is non-Poisson and falls in the class of time-dependent renewal models.[27] It is closely related to the model SRM0 with exponential escape rate.[27] Importantly, it is possible to fit parameters of the age-dependent point process model so as to describe not just the PSTH response, but also the interspike-interval statistics.[76][77][79]

Linear-nonlinear Poisson cascade model and GLM edit

The linear-nonlinear-Poisson cascade model is a cascade of a linear filtering process followed by a nonlinear spike generation step.[80] In the case that output spikes feed back, via a linear filtering process, we arrive at a model that is known in the neurosciences as Generalized Linear Model (GLM).[54][59] The GLM is mathematically equivalent to the spike response model SRM) with escape noise; but whereas in the SRM the internal variables are interpreted as the membrane potential and the firing threshold, in the GLM the internal variables are abstract quantities that summarizes the net effect of input (and recent output spikes) before spikes are generated in the final step.[27][54]

The two-state Markov model (Nossenson & Messer) edit

The spiking neuron model by Nossenson & Messer[72][73][74] produces the probability of the neuron firing a spike as a function of either an external or pharmacological stimulus.[72][73][74] The model consists of a cascade of a receptor layer model and a spiking neuron model, as shown in Fig 4. The connection between the external stimulus to the spiking probability is made in two steps: First, a receptor cell model translates the raw external stimulus to neurotransmitter concentration, and then, a spiking neuron model connects neurotransmitter concentration to the firing rate (spiking probability). Thus, the spiking neuron model by itself depends on neurotransmitter concentration at the input stage.[72][73][74]

 
Fig 4: High level block diagram of the receptor layer and neuron model by Nossenson & Messer.[72][74]
 
Fig 5. The prediction for the firing rate in response to a pulse stimulus as given by the model by Nossenson & Messer.[72][74]

An important feature of this model is the prediction for neurons firing rate pattern which captures, using a low number of free parameters, the characteristic edge emphasized response of neurons to a stimulus pulse, as shown in Fig. 5. The firing rate is identified both as a normalized probability for neural spike firing, and as a quantity proportional to the current of neurotransmitters released by the cell. The expression for the firing rate takes the following form:

 

where,

  • P0 is the probability of the neuron being "armed" and ready to fire. It is given by the following differential equation:
 

P0 could be generally calculated recursively using the Euler method, but in the case of a pulse of stimulus, it yields a simple closed-form expression.[72][81]

  • y(t) is the input of the model and is interpreted as the neurotransmitter concentration on the cell surrounding (in most cases glutamate). For an external stimulus it can be estimated through the receptor layer model:
 

with   being a short temporal average of stimulus power (given in Watt or other energy per time unit).

  • R0 corresponds to the intrinsic spontaneous firing rate of the neuron.
  • R1 is the recovery rate of the neuron from the refractory state.

Other predictions by this model include:

1) The averaged evoked response potential (ERP) due to the population of many neurons in unfiltered measurements resembles the firing rate.[74]

2) The voltage variance of activity due to multiple neuron activity resembles the firing rate (also known as Multi-Unit-Activity power or MUA).[73][74]

3) The inter-spike-interval probability distribution takes the form a gamma-distribution like function.[72][81]

Experimental evidence supporting the model by Nossenson & Messer[72][73][74]
Property of the Model by Nossenson & Messer References Description of experimental evidence
The shape of the firing rate in response to an auditory stimulus pulse [82][83][84][85][86] The Firing Rate has the same shape of Fig 5.
The shape of the firing rate in response to a visual stimulus pulse [87][88][89][90] The Firing Rate has the same shape of Fig 5.
The shape of the firing rate in response to an olfactory stimulus pulse [91] The Firing Rate has the same shape as Fig 5.
The shape of the firing rate in response to a somatosensory stimulus [92] The Firing Rate has the same shape as Fig 5.
The change in firing rate in response to neurotransmitter application (mostly glutamate) [93][94] Firing Rate change in response to neurotransmitter application (Glutamate)
Square dependence between an auditory stimulus pressure and the firing rate [95] Square Dependence between Auditory Stimulus pressure and the Firing Rate (- Linear dependence in pressure square (power)).
Square dependence between visual stimulus electric field (volts) and the firing rate [88] Square dependence between visual stimulus electric field (volts) - Linear Dependence between Visual Stimulus Power and the Firing Rate.
The shape of the Inter-Spike-Interval Statistics (ISI) [96] ISI shape resembles the gamma-function-like
The ERP resembles the firing rate in unfiltered measurements [97] The shape of the averaged evoked response potential in response to stimulus resembles the firing rate (Fig. 5).
MUA power resembles the firing rate [74][98] The shape of the empirical variance of extra-cellular measurements in response to stimulus pulse resembles the firing rate (Fig. 5).

Pharmacological input stimulus neuron models edit

The models in this category produce predictions for experiments involving pharmacological stimulation.

Synaptic transmission (Koch & Segev) edit

According to the model by Koch and Segev,[17] the response of a neuron to individual neurotransmitters can be modeled as an extension of the classical Hodgkin–Huxley model with both standard and nonstandard kinetic currents. Four neurotransmitters primarily influence the CNS. AMPA/kainate receptors are fast excitatory mediators while NMDA receptors mediate considerably slower currents. Fast inhibitory currents go through GABAA receptors, while GABAB receptors mediate by secondary G-protein-activated potassium channels. This range of mediation produces the following current dynamics:

  •  
  •  
  •  
  •  

where is the maximal[8][17] conductance (around 1S) and E is the equilibrium potential of the given ion or transmitter (AMDA, NMDA, Cl, or K), while [O] describes the fraction of open receptors. For NMDA, there is a significant effect of magnesium block that depends sigmoidally on the concentration of intracellular magnesium by B(V). For GABAB, [G] is the concentration of the G-protein, and Kd describes the dissociation of G in binding to the potassium gates.

The dynamics of this more complicated model have been well-studied experimentally and produce important results in terms of very quick synaptic potentiation and depression, that is fast, short-term learning.

The stochastic model by Nossenson and Messer translates neurotransmitter concentration at the input stage to the probability of releasing neurotransmitter at the output stage.[72][73][74] For a more detailed description of this model, see the Two state Markov model section above.

HTM neuron model edit

The HTM neuron model was developed by Jeff Hawkins and researchers at Numenta and is based on a theory called Hierarchical Temporal Memory, originally described in the book On Intelligence. It is based on neuroscience and the physiology and interaction of pyramidal neurons in the neocortex of the human brain.

 
Comparing the artificial neural network (A), the biological neuron (B), and the HTM neuron (C).
Artificial Neural Network (ANN)
Neocortical Pyramidal Neuron (Biological Neuron)
HTM Model Neuron
- Few synapses

- No dendrites

- Sum input x weights

- Learns by modifying the weights of synapses

- Thousands of synapses on the dendrites

- Active dendrites: cell recognizes hundreds of unique patterns

- Co-activation of a set of synapses on a dendritic segment causes an NMDA spike and depolarization at the soma

- Sources of input to the cell:

  1. Feedforward inputs that form synapses proximal to the soma and directly lead to action potentials
  2. NMDA spikes generated in the more distal basal
  3. Apical dendrites that depolarize the soma (usually not sufficient enough to generate a somatic action potential)

- Learns by growing new synapses

- Inspired by the pyramidal cells in neocortex layers 2/3 and 5

- Thousands of synapses

- Active dendrites: cell recognizes hundreds of unique patterns

- Models dendrites and NMDA spikes with each array of coincident detectors having a set of synapses

- Learns by modeling the growth of new synapses

Applications edit

Spiking Neuron Models are used in a variety of applications that need encoding into or decoding from neuronal spike trains in the context of neuroprosthesis and brain-computer interfaces such as retinal prosthesis:[12][99][100][101] or artificial limb control and sensation.[102][103][104] Applications are not part of this article; for more information on this topic please refer to the main article.

Relation between artificial and biological neuron models edit

The most basic model of a neuron consists of an input with some synaptic weight vector and an activation function or transfer function inside the neuron determining output. This is the basic structure used for artificial neurons, which in a neural network often looks like

 

where yi is the output of the i th neuron, xj is the jth input neuron signal, wij is the synaptic weight (or strength of connection) between the neurons i and j, and φ is the activation function. While this model has seen success in machine-learning applications, it is a poor model for real (biological) neurons, because it lacks time-dependence in input and output.

When an input is switched on at a time t and kept constant thereafter, biological neurons emit a spike train. Importantly this spike train is not regular but exhibits a temporal structure characterized by adaptation, bursting, or initial bursting followed by regular spiking. Generalized integrate-and-fire models such as the Adaptive Exponential Integrate-and-Fire model, the spike response model, or the (linear) adaptive integrate-and-fire model can capture these neuronal firing patterns.[24][25][26]

Moreover, neuronal input in the brain is time-dependent. Time-dependent input is transformed by complex linear and nonlinear filters into a spike train in the output. Again, the spike response model or the adaptive integrate-and-fire model enables to prediction of the spike train in the output for arbitrary time-dependent input,[22][23] whereas an artificial neuron or a simple leaky integrate-and-fire does not.

If we take the Hodkgin-Huxley model as a starting point, generalized integrate-and-fire models can be derived systematically in a step-by-step simplification procedure. This has been shown explicitly for the exponential integrate-and-fire[33] model and the spike response model.[60]

In the case of modeling a biological neuron, physical analogs are used in place of abstractions such as "weight" and "transfer function". A neuron is filled and surrounded with water-containing ions, which carry electric charge. The neuron is bound by an insulating cell membrane and can maintain a concentration of charged ions on either side that determines a capacitance Cm. The firing of a neuron involves the movement of ions into the cell that occurs when neurotransmitters cause ion channels on the cell membrane to open. We describe this by a physical time-dependent current I(t). With this comes a change in voltage, or the electrical potential energy difference between the cell and its surroundings, which is observed to sometimes result in a voltage spike called an action potential which travels the length of the cell and triggers the release of further neurotransmitters. The voltage, then, is the quantity of interest and is given by Vm(t).[19]

If the input current is constant, most neurons emit after some time of adaptation or initial bursting a regular spike train. The frequency of regular firing in response to a constant current I is described by the frequency-current relation which corresponds to the transfer function   of artificial neural networks. Similarly, for all spiking neuron models the transfer function   can be calculated numerically (or analytically).

Cable theory and compartmental models edit

All of the above deterministic models are point-neuron models because they do not consider the spatial structure of a neuron. However, the dendrite contributes to transforming input into output.[105][65] Point neuron models are valid description in three cases. (i) If input current is directly injected into the soma. (ii) If synaptic input arrives predominantly at or close to the soma (closeness is defined by a length scale   introduced below. (iii) If synapse arrives anywhere on the dendrite, but the dendrite is completely linear. In the last case, the cable acts as a linear filter; these linear filter properties can be included in the formulation of generalized integrate-and-fire models such as the spike response model.

The filter properties can be calculated from a cable equation.

Let us consider a cell membrane in the form of a cylindrical cable. The position on the cable is denoted by x and the voltage across the cell membrane by V. The cable is characterized by a longitudinal resistance   per unit length and a membrane resistance   . If everything is linear, the voltage changes as a function of time

 

(19)

We introduce a length scale   on the left side and time constant   on the right side. The cable equation can now be written in its perhaps best-known form:

 

(20)

The above cable equation is valid for a single cylindrical cable.

Linear cable theory describes the dendritic arbor of a neuron as a cylindrical structure undergoing a regular pattern of bifurcation, like branches in a tree. For a single cylinder or an entire tree, the static input conductance at the base (where the tree meets the cell body or any such boundary) is defined as

 ,

where L is the electrotonic length of the cylinder which depends on its length, diameter, and resistance. A simple recursive algorithm scales linearly with the number of branches and can be used to calculate the effective conductance of the tree. This is given by

 

where AD = πld is the total surface area of the tree of total length l, and LD is its total electrotonic length. For an entire neuron in which the cell body conductance is GS and the membrane conductance per unit area is Gmd = Gm / A, we find the total neuron conductance GN for n dendrite trees by adding up all tree and soma conductances, given by

 

where we can find the general correction factor Fdga experimentally by noting GD = GmdADFdga.

The linear cable model makes several simplifications to give closed analytic results, namely that the dendritic arbor must branch in diminishing pairs in a fixed pattern and that dendrites are linear. A compartmental model[65] allows for any desired tree topology with arbitrary branches and lengths, as well as arbitrary nonlinearities. It is essentially a discretized computational implementation of nonlinear dendrites.

Each piece, or compartment, of a dendrite, is modeled by a straight cylinder of arbitrary length l and diameter d which connects with fixed resistance to any number of branching cylinders. We define the conductance ratio of the ith cylinder as Bi = Gi / G, where   and Ri is the resistance between the current compartment and the next. We obtain a series of equations for conductance ratios in and out of a compartment by making corrections to the normal dynamic Bout,i = Bin,i+1, as

  •  
  •  
  •  

where the last equation deals with parents and daughters at branches, and  . We can iterate these equations through the tree until we get the point where the dendrites connect to the cell body (soma), where the conductance ratio is Bin,stem. Then our total neuron conductance for static input is given by

 

Importantly, static input is a very special case. In biology, inputs are time-dependent. Moreover, dendrites are not always linear.

Compartmental models enable to include nonlinearities via ion channels positioned at arbitrary locations along the dendrites.[105][106] For static inputs, it is sometimes possible to reduce the number of compartments (increase the computational speed) and yet retain the salient electrical characteristics.[107]

Conjectures regarding the role of the neuron in the wider context of the brain principle of operation edit

The neurotransmitter-based energy detection scheme edit

The neurotransmitter-based energy detection scheme[74][81] suggests that the neural tissue chemically executes a Radar-like detection procedure.

 
Fig. 6 The biological neural detection scheme as suggested by Nossenson et al.[74][81]

As shown in Fig. 6, the key idea of the conjecture is to account for neurotransmitter concentration, neurotransmitter generation, and neurotransmitter removal rates as the important quantities in executing the detection task, while referring to the measured electrical potentials as a side effect that only in certain conditions coincide with the functional purpose of each step. The detection scheme is similar to a radar-like "energy detection" because it includes signal squaring, temporal summation, and a threshold switch mechanism, just like the energy detector, but it also includes a unit that emphasizes stimulus edges and a variable memory length (variable memory). According to this conjecture, the physiological equivalent of the energy test statistics is neurotransmitter concentration, and the firing rate corresponds to neurotransmitter current. The advantage of this interpretation is that it leads to a unit-consistent explanation which allows to bridge between electrophysiological measurements, biochemical measurements, and psychophysical results.

The evidence reviewed in[74][81] suggest the following association between functionality to histological classification:

  1. Stimulus squaring is likely to be performed by receptor cells.
  2. Stimulus edge emphasizing and signal transduction is performed by neurons.
  3. Temporal accumulation of neurotransmitters is performed by glial cells. Short-term neurotransmitter accumulation is likely to occur also in some types of neurons.
  4. Logical switching is executed by glial cells, and it results from exceeding a threshold level of neurotransmitter concentration. This threshold crossing is also accompanied by a change in neurotransmitter leak rate.
  5. Physical all-or-non movement switching is due to muscle cells and results from exceeding a certain neurotransmitter concentration threshold on muscle surroundings.

Note that although the electrophysiological signals in Fig.6 are often similar to the functional signal (signal power/neurotransmitter concentration / muscle force), there are some stages in which the electrical observation differs from the functional purpose of the corresponding step. In particular, Nossenson et al. suggested that glia threshold crossing has a completely different functional operation compared to the radiated electrophysiological signal and that the latter might only be a side effect of glia break.

General comments regarding the modern perspective of scientific and engineering models edit

  • The models above are still idealizations. Corrections must be made for the increased membrane surface area given by numerous dendritic spines, temperatures significantly hotter than room-temperature experimental data, and nonuniformity in the cell's internal structure.[17] Certain observed effects do not fit into some of these models. For instance, the temperature cycling (with minimal net temperature increase) of the cell membrane during action potential propagation is not compatible with models that rely on modeling the membrane as a resistance that must dissipate energy when current flows through it. The transient thickening of the cell membrane during action potential propagation is also not predicted by these models, nor is the changing capacitance and voltage spike that results from this thickening incorporated into these models. The action of some anesthetics such as inert gases is problematic for these models as well. New models, such as the soliton model attempt to explain these phenomena, but are less developed than older models and have yet to be widely applied.
  • Modern views regarding the role of the scientific model suggest that "All models are wrong but some are useful" (Box and Draper, 1987, Gribbin, 2009; Paninski et al., 2009).
  • Recent conjecture suggests that each neuron might function as a collection of independent threshold units. It is suggested that a neuron could be anisotropically activated following the origin of its arriving signals to the membrane, via its dendritic trees. The spike waveform was also proposed to be dependent on the origin of the stimulus.[108]

External links edit

  • Neuronal Dynamics: from single neurons to networks and models of cognition (W. Gerstner, W. Kistler, R. Naud, L. Paninski, Cambridge University Press, 2014).[27] In particular, Chapters 6 - 10, html online version.
  • Spiking Neuron Models[1] (W. Gerstner and W. Kistler, Cambridge University Press, 2002)

See also edit

References edit

  1. ^ a b c d Gerstner W, Kistler WM (2002). Spiking neuron models : single neurons, populations, plasticity. Cambridge, U.K.: Cambridge University Press. ISBN 0-511-07817-X. OCLC 57417395.
  2. ^ DeFelipe, Javier; Farinas, Isabel (1992). "The pyramidal neuron of the cerebral cortex: morphological and chemical characteristics of the synaptic inputs". Progress in Neurobiology. 39 (6): 563–607. doi:10.1016/0301-0082(92)90015-7. PMID 1410442. S2CID 34889543.
  3. ^ Markram, Henry; Muller, Eilif; Ramaswamy, Srikanth; Reimann, Michael; Abdellah, Marwan (2015). "Reconstruction and simulation of neocortical microcircuitry". Cell. 163 (2): 456–492. doi:10.1016/j.cell.2015.09.029. PMID 26451489. S2CID 14466831.
  4. ^ Wong, R. K. S.; Traub, R. D. (2009-01-01), "NETWORKS | Cellular Properties and Synaptic Connectivity of CA3 Pyramidal Cells: Mechanisms for Epileptic Synchronization and Epileptogenesis", in Schwartzkroin, Philip A. (ed.), Encyclopedia of Basic Epilepsy Research, Oxford: Academic Press, pp. 815–819, doi:10.1016/b978-012373961-2.00215-0, ISBN 978-0-12-373961-2, retrieved 2020-11-18
  5. ^ Lapicque, LM (1907). "Recherches quantitatives sur l'excitation electrique des nerfs". J Physiol Paris. 9: 620–635.
  6. ^ Abbott, Larry (1999). "Lapicque's introduction of the integrate-and-fire model neuron (1907)". Brain Research Bulletin. 50 (5): 303–304. doi:10.1016/S0361-9230(99)00161-6. PMID 10643408. S2CID 46170924.
  7. ^ Gauld, Christophe; Brun, Cédric; Boraud, Thomas; Carlu, Mallory; Depannemaecker, Damien (2022-01-14). "Computational Models in Neurosciences Between Mechanistic and Phenomenological Characterizations". doi:10.20944/preprints202201.0206.v1. S2CID 246059455.
  8. ^ a b c d e f g Hodgkin AL, Huxley AF (August 1952). "A quantitative description of membrane current and its application to conduction and excitation in nerve". The Journal of Physiology. 117 (4): 500–44. doi:10.1113/jphysiol.1952.sp004764. PMC 1392413. PMID 12991237.
  9. ^ a b c d e Hodgkin AL, Huxley AF, Katz B (April 1952). "Measurement of current-voltage relations in the membrane of the giant axon of Loligo". The Journal of Physiology. 116 (4): 424–48. doi:10.1113/jphysiol.1952.sp004716. PMC 1392219. PMID 14946712.
  10. ^ a b c d e Hodgkin AL, Huxley AF (April 1952). "Currents carried by sodium and potassium ions through the membrane of the giant axon of Loligo". The Journal of Physiology. 116 (4): 449–72. doi:10.1113/jphysiol.1952.sp004717. PMC 1392213. PMID 14946713.
  11. ^ a b c d e Hodgkin AL, Huxley AF (April 1952). "The components of membrane conductance in the giant axon of Loligo". The Journal of Physiology. 116 (4): 473–96. doi:10.1113/jphysiol.1952.sp004718. PMC 1392209. PMID 14946714.
  12. ^ a b Mathieson K, Loudin J, Goetz G, Huie P, Wang L, Kamins TI, et al. (June 2012). "Photovoltaic Retinal Prosthesis with High Pixel Density". Nature Photonics. 6 (6): 391–397. Bibcode:2012NaPho...6..391M. doi:10.1038/nphoton.2012.104. PMC 3462820. PMID 23049619.
  13. ^ Izhikevich EM (2010). Dynamical systems in neuroscience: the geometry of excitability and bursting. Cambridge, MA: MIT Press. ISBN 978-0-262-51420-0. OCLC 457159828.
  14. ^ Cressman JR, Ullah G, Ziburkus J, Schiff SJ, Barreto E (April 2009). "The influence of sodium and potassium dynamics on excitability, seizures, and the stability of persistent states: I. Single neuron dynamics". Journal of Computational Neuroscience. 26 (2): 159–70. doi:10.1007/s10827-008-0132-4. PMC 2704057. PMID 19169801.
  15. ^ Depannemaecker D, Ivanov A, Lillo D, Spek L, Bernard C, Jirsa V (2021-02-17). "A unified physiological framework of transitions between seizures, sustained ictal activity and depolarization block at the single neuron level". bioRxiv: 2020.10.23.352021. doi:10.1101/2020.10.23.352021. S2CID 225962412.
  16. ^ a b Abbott LF (1999). (PDF). Brain Research Bulletin. 50 (5–6): 303–4. doi:10.1016/S0361-9230(99)00161-6. PMID 10643408. S2CID 46170924. Archived from the original (PDF) on 2007-06-13.
  17. ^ a b c d e Koch C, Segev I (1999). (2nd ed.). Cambridge, Massachusetts: MIT Press. p. 687. ISBN 978-0-262-11231-4. Archived from the original on 2011-07-07. Retrieved 2013-01-10.
  18. ^ Brunel N (2000-05-01). "Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons". Journal of Computational Neuroscience. 8 (3): 183–208. doi:10.1023/A:1008925309027. PMID 10809012. S2CID 1849650.
  19. ^ a b Cejnar P, Vyšata O, Kukal J, Beránek M, Vališ M, Procházka A (April 2020). "Simple capacitor-switch model of excitatory and inhibitory neuron with all parts biologically explained allows input fire pattern dependent chaotic oscillations". Scientific Reports. 10 (1): 7353. Bibcode:2020NatSR..10.7353C. doi:10.1038/s41598-020-63834-7. PMC 7192907. PMID 32355185.
  20. ^ Fuortes MG, Mantegazzini F (July 1962). "Interpretation of the repetitive firing of nerve cells". The Journal of General Physiology. 45 (6): 1163–79. doi:10.1085/jgp.45.6.1163. PMC 2195242. PMID 13895926.
  21. ^ La Camera G, Rauch A, Lüscher HR, Senn W, Fusi S (October 2004). "Minimal models of adapted neuronal response to in vivo-like input currents". Neural Computation. 16 (10): 2101–24. doi:10.1162/0899766041732468. PMID 15333209. S2CID 1428381.
  22. ^ a b c d e f g h i j k l m n Jolivet R, Rauch A, Lüscher HR, Gerstner W (August 2006). "Predicting spike timing of neocortical pyramidal neurons by simple threshold models". Journal of Computational Neuroscience. 21 (1): 35–49. doi:10.1007/s10827-006-7074-5. PMID 16633938. S2CID 8911457.
  23. ^ a b c d e f g h i j k l m n Pozzorini C, Naud R, Mensi S, Gerstner W (July 2013). "Temporal whitening by power-law adaptation in neocortical neurons". Nature Neuroscience. 16 (7): 942–8. doi:10.1038/nn.3431. PMID 23749146. S2CID 1873019.
  24. ^ a b c d Gerstner W, van Hemmen JL, Cowan JD (November 1996). "What matters in neuronal locking?". Neural Computation. 8 (8): 1653–76. doi:10.1162/neco.1996.8.8.1653. PMID 8888612. S2CID 1301248.
  25. ^ a b c Izhikevich EM (November 2003). "Simple model of spiking neurons". IEEE Transactions on Neural Networks. 14 (6): 1569–72. doi:10.1109/TNN.2003.820440. PMID 18244602. S2CID 814743.
  26. ^ a b c d e f Naud R, Marcille N, Clopath C, Gerstner W (November 2008). "Firing patterns in the adaptive exponential integrate-and-fire model". Biological Cybernetics. 99 (4–5): 335–47. doi:10.1007/s00422-008-0264-7. PMC 2798047. PMID 19011922.
  27. ^ a b c d e f g h i j k l m n o p q r Wulfram Gerstner W, Kistler WM, Naud R, Paninski L (24 July 2014). Neuronal dynamics : from single neurons to networks and models of cognition. Cambridge, United Kingdom. ISBN 978-1-107-06083-8. OCLC 861774542.{{cite book}}: CS1 maint: location missing publisher (link)
  28. ^ Richardson MJ, Brunel N, Hakim V (May 2003). "From subthreshold to firing-rate resonance". Journal of Neurophysiology. 89 (5): 2538–54. doi:10.1152/jn.00955.2002. PMID 12611957.
  29. ^ a b Lundstrom BN, Higgs MH, Spain WJ, Fairhall AL (November 2008). "Fractional differentiation by neocortical pyramidal neurons". Nature Neuroscience. 11 (11): 1335–42. doi:10.1038/nn.2212. PMC 2596753. PMID 18931665.
  30. ^ a b Teka W, Marinov TM, Santamaria F (March 2014). "Neuronal spike timing adaptation described with a fractional leaky integrate-and-fire model". PLOS Computational Biology. 10 (3): e1003526. Bibcode:2014PLSCB..10E3526T. doi:10.1371/journal.pcbi.1003526. PMC 3967934. PMID 24675903.
  31. ^ a b c d e Badel L, Lefort S, Brette R, Petersen CC, Gerstner W, Richardson MJ (February 2008). "Dynamic I-V curves are reliable predictors of naturalistic pyramidal-neuron voltage traces". Journal of Neurophysiology. 99 (2): 656–66. CiteSeerX 10.1.1.129.504. doi:10.1152/jn.01107.2007. PMID 18057107.
  32. ^ a b Brette R, Gerstner W (November 2005). "Adaptive exponential integrate-and-fire model as an effective description of neuronal activity". Journal of Neurophysiology. 94 (5): 3637–42. doi:10.1152/jn.00686.2005. PMID 16014787.
  33. ^ a b Fourcaud-Trocmé N, Hansel D, van Vreeswijk C, Brunel N (December 2003). "How spike generation mechanisms determine the neuronal response to fluctuating inputs". The Journal of Neuroscience. 23 (37): 11628–40. doi:10.1523/JNEUROSCI.23-37-11628.2003. PMC 6740955. PMID 14684865.
  34. ^ Ostojic S, Brunel N, Hakim V (August 2009). "How connectivity, background activity, and synaptic properties shape the cross-correlation between spike trains". The Journal of Neuroscience. 29 (33): 10234–53. doi:10.1523/JNEUROSCI.1275-09.2009. PMC 6665800. PMID 19692598.
  35. ^ Górski T, Depannemaecker D, Destexhe A (January 2021). "Conductance-Based Adaptive Exponential Integrate-and-Fire Model". Neural Computation. 33 (1): 41–66. doi:10.1162/neco_a_01342. PMID 33253029.
  36. ^ "Neuronal Dynamics - a neuroscience textbook by Wulfram Gerstner, Werner M. Kistler, Richard Naud and Liam Paninski". neuronaldynamics.epfl.ch. Retrieved 2024-02-14.
  37. ^ Ganguly, Chittotosh; Bezugam, Sai Sukruth; Abs, Elisabeth; Payvand, Melika; Dey, Sounak; Suri, Manan (2024-02-01). "Spike frequency adaptation: bridging neural models and neuromorphic applications". Communications Engineering. 3 (1). doi:10.1038/s44172-024-00165-9. ISSN 2731-3395.
  38. ^ Bellec, Guillaume Emmanuel Fernand; Salaj, Darjan; Subramoney, Anand; Legenstein, Robert; Maass, Wolfgang (2018). "Long short-term memory and learning-to-learn in networks of spiking neurons". Advances in Neural Information Processing Systems. arXiv:1803.09574.
  39. ^ Shaban, Ahmed; Bezugam, Sai Sukruth; Suri, Manan (2021-07-09). "An adaptive threshold neuron for recurrent spiking neural networks with nanodevice hardware implementation". Nature Communications. 12 (1): 4234. Bibcode:2021NatCo..12.4234S. doi:10.1038/s41467-021-24427-8. ISSN 2041-1723. PMC 8270926. PMID 34244491.
  40. ^ Bezugam, Sai Sukruth; Shaban, Ahmed; Suri, Manan (2023-05-21). "Neuromorphic Recurrent Spiking Neural Networks for EMG Gesture Classification and Low Power Implementation on Loihi". 2023 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE. pp. 1–5. arXiv:2206.02061. doi:10.1109/ISCAS46773.2023.10181510. ISBN 978-1-6654-5109-3. S2CID 260004324.
  41. ^
biological, neuron, model, this, article, multiple, issues, please, help, improve, discuss, these, issues, talk, page, learn, when, remove, these, template, messages, this, article, tone, style, reflect, encyclopedic, tone, used, wikipedia, wikipedia, guide, w. This article has multiple issues Please help improve it or discuss these issues on the talk page Learn how and when to remove these template messages This article s tone or style may not reflect the encyclopedic tone used on Wikipedia See Wikipedia s guide to writing better articles for suggestions August 2023 Learn how and when to remove this message This article may be too technical for most readers to understand Please help improve it to make it understandable to non experts without removing the technical details August 2023 Learn how and when to remove this message Learn how and when to remove this message Biological neuron models also known as spiking neuron models 1 are mathematical descriptions of the conduction of electrical signals in neurons Neurons or nerve cells are electrically excitable cells within the nervous system able to fire electric signals called action potentials across a neural network These mathematical models describe the role of the biophysical and geometrical characteristics of neurons on the conduction of electrical activity Fig 1 Neuron and myelinated axon with signal flow from inputs at dendrites to outputs at axon terminals The signal is a short electrical pulse called action potential or spike Fig 2 Time course of neuronal action potential spike Note that the amplitude and the exact shape of the action potential can vary according to the exact experimental technique used for acquiring the signal Central to these models is the description of how the membrane potential that is the difference in electric potential between the interior and the exterior of a biological cell across the cell membrane changes over time In an experimental setting stimulating neurons with an electrical current generates an action potential or spike that propagates down the neuron s axon This axon can branch out and connect to a large number of downstream neurons at sites called synapses At these synapses the spike can cause release of neurotransmitters which in turn can change the voltage potential of downstream neurons This change can potentially lead to even more spikes in those downstream neurons thus passing down the signal As many as 85 of neurons in the neocortex the outermost layer of the mammalian brain consist of excitatory pyramidal neurons 2 3 and each pyramidal neuron receives tens of thousands of inputs from other neurons 4 Thus spiking neurons are a major information processing unit of the nervous system One such example of a spiking neuron model may be a highly detailed mathematical model that includes spatial morphology Another may be a conductance based neuron model that views neurons as points and describes the membrane voltage dynamics as a function of trans membrane currents A mathematically simpler integrate and fire model significantly simplifies the description of ion channel and membrane potential dynamics initially studied by Lapique in 1907 5 6 Contents 1 Biological background classification and aims of neuron models 2 Electrical input output membrane voltage models 2 1 Hodgkin Huxley 2 2 Perfect Integrate and fire 2 3 Leaky integrate and fire 2 4 Adaptive integrate and fire 2 5 Fractional order leaky integrate and fire 2 6 Exponential integrate and fire and adaptive exponential integrate and fire 2 7 Adaptive Threshold Neuron Model 2 8 Double Exponential Adaptive Threshold DEXAT 3 Stochastic models of membrane voltage and spike timing 3 1 Noisy input model diffusive noise 3 2 Noisy output model escape noise 3 3 Spike response model SRM 3 4 SRM0 3 5 Galves Locherbach model 4 Didactic toy models of membrane voltage 4 1 FitzHugh Nagumo 4 2 Morris Lecar 4 3 Hindmarsh Rose 4 4 Theta model and quadratic integrate and fire 5 Sensory input stimulus encoding neuron models 5 1 The non homogeneous Poisson process model Siebert 5 2 Refractoriness and age dependent point process model 5 3 Linear nonlinear Poisson cascade model and GLM 5 4 The two state Markov model Nossenson amp Messer 6 Pharmacological input stimulus neuron models 6 1 Synaptic transmission Koch amp Segev 7 HTM neuron model 8 Applications 9 Relation between artificial and biological neuron models 10 Cable theory and compartmental models 11 Conjectures regarding the role of the neuron in the wider context of the brain principle of operation 11 1 The neurotransmitter based energy detection scheme 12 General comments regarding the modern perspective of scientific and engineering models 13 External links 14 See also 15 ReferencesBiological background classification and aims of neuron models editNon spiking cells spiking cells and their measurementNot all the cells of the nervous system produce the type of spike that define the scope of the spiking neuron models For example cochlear hair cells retinal receptor cells and retinal bipolar cells do not spike Furthermore many cells in the nervous system are not classified as neurons but instead are classified as glia Neuronal activity can be measured with different experimental techniques such as the Whole cell measurement technique which captures the spiking activity of a single neuron and produces full amplitude action potentials With extracellular measurement techniques one or more electrodes are placed in the extracellular space Spikes often from several spiking sources depending on the size of the electrode and its proximity to the sources can be identified with signal processing techniques Extracellular measurement has several advantages It is easier to obtain experimentally It is robust and lasts for a longer time It can reflect the dominant effect especially when conducted in an anatomical region with many similar cells Overview of neuron modelsNeuron models can be divided into two categories according to the physical units of the interface of the model Each category could be further divided according to the abstraction detail level Electrical input output membrane voltage models These models produce a prediction for membrane output voltage as a function of electrical stimulation given as current or voltage input The various models in this category differ in the exact functional relationship between the input current and the output voltage and in the level of detail Some models in this category predict only the moment of occurrence of output spike also known as action potential other models are more detailed and account for sub cellular processes The models in this category can be either deterministic or probabilistic Natural stimulus or pharmacological input neuron models The models in this category connect the input stimulus which can be either pharmacological or natural to the probability of a spike event The input stage of these models is not electrical but rather has either pharmacological chemical concentration units or physical units that characterize an external stimulus such as light sound or other forms of physical pressure Furthermore the output stage represents the probability of a spike event and not an electrical voltage Although it is not unusual in science and engineering to have several descriptive models for different abstraction detail levels the number of different sometimes contradicting biological neuron models is exceptionally high This situation is partly the result of the many different experimental settings and the difficulty to separate the intrinsic properties of a single neuron from measurement effects and interactions of many cells network effects Aims of neuron modelsUltimately biological neuron models aim to explain the mechanisms underlying the operation of the nervous system However several approaches can be distinguished from more realistic models e g mechanistic models to more pragmatic models e g phenomenological models 7 better source needed Modeling helps to analyze experimental data and address questions Models are also important in the context of restoring lost brain functionality through neuroprosthetic devices Electrical input output membrane voltage models editThe models in this category describe the relationship between neuronal membrane currents at the input stage and membrane voltage at the output stage This category includes generalized integrate and fire models and biophysical models inspired by the work of Hodgkin Huxley in the early 1950s using an experimental setup that punctured the cell membrane and allowed to force a specific membrane voltage current 8 9 10 11 Most modern electrical neural interfaces apply extra cellular electrical stimulation to avoid membrane puncturing which can lead to cell death and tissue damage Hence it is not clear to what extent the electrical neuron models hold for extra cellular stimulation see e g 12 Hodgkin Huxley edit Experimental evidence supporting the model Property of the H amp H model References The shape of an individual spike 8 9 10 11 The identity of the ions involved 8 9 10 11 Spike speed across the axon 8 Main article Hodgkin Huxley model The Hodgkin Huxley model H amp H model 8 9 10 11 is a model of the relationship between the flow of ionic currents across the neuronal cell membrane and the membrane voltage of the cell 8 9 10 11 It consists of a set of nonlinear disambiguation needed differential equations describing the behavior of ion channels that permeate the cell membrane of the squid giant axon Hodgkin and Huxley were awarded the 1963 Nobel Prize in Physiology or Medicine for this work It is important to note the voltage current relationship with multiple voltage dependent currents charging the cell membrane of capacity Cm C m d V t d t i I i t V displaystyle C mathrm m frac dV t dt sum i I i t V nbsp The above equation is the time derivative of the law of capacitance Q CV where the change of the total charge must be explained as the sum over the currents Each current is given by I t V g t V V V e q displaystyle I t V g t V cdot V V mathrm eq nbsp where g t V is the conductance or inverse resistance which can be expanded in terms of its maximal conductance ḡ and the activation and inactivation fractions m and h respectively that determine how many ions can flow through available membrane channels This expansion is given by g t V g m t V p h t V q displaystyle g t V bar g cdot m t V p cdot h t V q nbsp and our fractions follow the first order kinetics d m t V d t m V m t V t m V a m V 1 m b m V m displaystyle frac dm t V dt frac m infty V m t V tau mathrm m V alpha mathrm m V cdot 1 m beta mathrm m V cdot m nbsp with similar dynamics for h where we can use either t and m or a and b to define our gate fractions The Hodgkin Huxley model may be extended to include additional ionic currents Typically these include inward Ca2 and Na input currents as well as several varieties of K outward currents including a leak current The result can be at the small end of 20 parameters which one must estimate or measure for an accurate model In a model of a complex system of neurons numerical integration of the equations are computationally expensive Careful simplifications of the Hodgkin Huxley model are therefore needed The model can be reduced to two dimensions thanks to the dynamic relations which can be established between the gating variables 13 it is also possible to extend it to take into account the evolution of the concentrations considered fixed in the original model 14 15 Perfect Integrate and fire edit One of the earliest models of a neuron is the perfect integrate and fire model also called non leaky integrate and fire first investigated in 1907 by Louis Lapicque 16 A neuron is represented by its membrane voltage V which evolves in time during stimulation with an input current I t according I t C d V t d t displaystyle I t C frac dV t dt nbsp which is just the time derivative of the law of capacitance Q CV When an input current is applied the membrane voltage increases with time until it reaches a constant threshold Vth at which point a delta function spike occurs and the voltage is reset to its resting potential after which the model continues to run The firing frequency of the model thus increases linearly without bound as input current increases The model can be made more accurate by introducing a refractory period tref that limits the firing frequency of a neuron by preventing it from firing during that period For constant input I t I the threshold voltage is reached after an integration time tint CVthr I after start from zero After a reset the refractory period introduces a dead time so that the total time until the next firing is tref tint The firing frequency is the inverse of the total inter spike interval including dead time The firing frequency as a function of a constant input current is therefore f I I C V t h t r e f I displaystyle f I frac I C mathrm V mathrm th t mathrm ref I nbsp A shortcoming of this model is that it describes neither adaptation nor leakage If the model receives a below threshold short current pulse at some time it will retain that voltage boost forever until another input later makes it fire This characteristic is not in line with observed neuronal behavior The following extensions make the integrate and fire model more plausible from a biological point of view Leaky integrate and fire edit The leaky integrate and fire model which can be traced back to Louis Lapicque 16 contains a leak term in the membrane potential equation that reflects the diffusion of ions through the membrane unlike the non leaky integrate and fire model The model equation looks like 1 C m d V m t d t I t V m t R m displaystyle C mathrm m frac dV mathrm m t dt I t frac V mathrm m t R mathrm m nbsp nbsp A neuron is represented by an RC circuit with a threshold Each input pulse e g caused by a spike from a different neuron causes a short current pulse Voltage decays exponentially If the threshold is reached an output spike is generated and the voltage is reset where Vm is the voltage across the cell membrane and Rm is the membrane resistance The non leaky integrate and fire model is retrieved in the limit Rm to infinity i e if the membrane is a perfect insulator The model equation is valid for arbitrary time dependent input until a threshold Vth is reached thereafter the membrane potential is reset For constant input the minimum input to reach the threshold is Ith Vth Rm Assuming a reset to zero the firing frequency thus looks like f I 0 I I t h t r e f R m C m log 1 V t h I R m 1 I gt I t h displaystyle f I begin cases 0 amp I leq I mathrm th left t mathrm ref R mathrm m C mathrm m log left 1 tfrac V mathrm th IR mathrm m right right 1 amp I gt I mathrm th end cases nbsp which converges for large input currents to the previous leak free model with the refractory period 17 The model can also be used for inhibitory neurons 18 19 The most significant disadvantage of this model is that it does not contain neuronal adaptation so that it cannot describe an experimentally measured spike train in response to constant input current 20 This disadvantage is removed in generalized integrate and fire models that also contain one or several adaptation variables and are able to predict spike times of cortical neurons under current injection to a high degree of accuracy 21 22 23 Adaptive integrate and fire edit Experimental evidence supporting the model Adaptive integrate and fire model model References Sub threshold voltage for time dependent input current 22 23 Firing times for time dependent input current 22 23 Firing Patterns in response to step current input 24 25 26 Neuronal adaptation refers to the fact that even in the presence of a constant current injection into the soma the intervals between output spikes increase An adaptive integrate and fire neuron model combines the leaky integration of voltage V with one or several adaptation variables wk see Chapter 6 1 in the textbook Neuronal Dynamics 27 t m d V m t d t R I t V m t E m R k w k displaystyle tau mathrm m frac dV mathrm m t dt RI t V mathrm m t E mathrm m R sum k w k nbsp t k d w k t d t a k V m t E m w k b k t k f d t t f displaystyle tau k frac dw k t dt a k V mathrm m t E mathrm m w k b k tau k sum f delta t t f nbsp where t m displaystyle tau m nbsp is the membrane time constant wk is the adaptation current number with index k t k displaystyle tau k nbsp is the time constant of adaptation current wk Em is the resting potential and tf is the firing time of the neuron and the Greek delta denotes the Dirac delta function Whenever the voltage reaches the firing threshold the voltage is reset to a value Vr below the firing threshold The reset value is one of the important parameters of the model The simplest model of adaptation has only a single adaptation variable w and the sum over k is removed 28 nbsp Spike times and subthreshold voltage of cortical neuron models can be predicted by generalized integrate and fire models such as the adaptive integrate and fire model the adaptive exponential integrate and fire model or the spike response model In the example here adaptation is implemented by a dynamic threshold which increases after each spike 22 23 Integrate and fire neurons with one or several adaptation variables can account for a variety of neuronal firing patterns in response to constant stimulation including adaptation bursting and initial bursting 24 25 26 Moreover adaptive integrate and fire neurons with several adaptation variables are able to predict spike times of cortical neurons under time dependent current injection into the soma 22 23 Fractional order leaky integrate and fire edit Recent advances in computational and theoretical fractional calculus lead to a new form of model called Fractional order leaky integrate and fire 29 30 An advantage of this model is that it can capture adaptation effects with a single variable The model has the following form 30 I t V m t R m C m d a V m t d a t displaystyle I t frac V mathrm m t R mathrm m C mathrm m frac d alpha V mathrm m t d alpha t nbsp Once the voltage hits the threshold it is reset Fractional integration has been used to account for neuronal adaptation in experimental data 29 Exponential integrate and fire and adaptive exponential integrate and fire edit Main article Exponential integrate and fire Experimental evidence supporting the model Adaptive exponential integrate and fire References The sub threshold current voltage relation 31 Firing patterns in response to step current input 26 Refractoriness and adaptation 32 In the exponential integrate and fire model 33 spike generation is exponential following the equation d V d t R t m I t 1 t m E m V D T exp V V T D T displaystyle frac dV dt frac R tau m I t frac 1 tau m left E m V Delta T exp left frac V V T Delta T right right nbsp where V displaystyle V nbsp is the membrane potential V T displaystyle V T nbsp is the intrinsic membrane potential threshold t m displaystyle tau m nbsp is the membrane time constant E m displaystyle E m nbsp is the resting potential and D T displaystyle Delta T nbsp is the sharpness of action potential initiation usually around 1 mV for cortical pyramidal neurons 31 Once the membrane potential crosses V T displaystyle V T nbsp it diverges to infinity in finite time 34 In numerical simulation the integration is stopped if the membrane potential hits an arbitrary threshold much larger than V T displaystyle V T nbsp at which the membrane potential is reset to a value Vr The voltage reset value Vr is one of the important parameters of the model Importantly the right hand side of the above equation contains a nonlinearity that can be directly extracted from experimental data 31 In this sense the exponential nonlinearity is strongly supported by experimental evidence In the adaptive exponential integrate and fire neuron 32 the above exponential nonlinearity of the voltage equation is combined with an adaptation variable w t m d V d t R I t E m V D T exp V V T D T R w displaystyle tau m frac dV dt RI t left E m V Delta T exp left frac V V T Delta T right right Rw nbsp t d w t d t a V m t E m w b t d t t f displaystyle tau frac dw t dt a V mathrm m t E mathrm m w b tau delta t t f nbsp nbsp Firing pattern of initial bursting in response to a step current input generated with the Adaptive exponential integrate and fire model Other Firing patterns can also be generated 26 where w denotes the adaptation current with time scale t displaystyle tau nbsp Important model parameters are the voltage reset value Vr the intrinsic threshold V T displaystyle V T nbsp the time constants t displaystyle tau nbsp and t m displaystyle tau m nbsp as well as the coupling parameters a and b The adaptive exponential integrate and fire model inherits the experimentally derived voltage nonlinearity 31 of the exponential integrate and fire model But going beyond this model it can also account for a variety of neuronal firing patterns in response to constant stimulation including adaptation bursting and initial bursting 26 However since the adaptation is in the form of a current aberrant hyperpolarization may appear This problem was solved by expressing it as a conductance 35 Adaptive Threshold Neuron Model edit In this model a time dependent function 8 t displaystyle theta t nbsp is added to the fixed threshold v t h 0 displaystyle v th0 nbsp after every spike causing an adaptation of the threshold The threshold potential v t h displaystyle v th nbsp gradually returns to its steady state value depending on the threshold adaptation time constant t 8 displaystyle tau theta nbsp 36 This is one of the simpler techniques to achieve spike frequency adaptation 37 The expression for the adaptive threshold is given by v t h t v t h 0 8 t t f f v t h 0 8 0 exp t t f t 8 f displaystyle v th t v th0 frac sum theta t t f f v th0 frac sum theta 0 exp left frac t t f tau theta right f nbsp where 8 t displaystyle theta t nbsp is defined by 8 t 8 0 exp t t 8 displaystyle theta t theta 0 exp left frac t tau theta right nbsp When the membrane potential u t displaystyle u t nbsp reaches a threshold it is reset to v r e s t displaystyle v rest nbsp u t v t h t v t v rest displaystyle u t geq v th t Rightarrow v t v text rest nbsp A simpler version of this with a single time constant in threshold decay with an LIF neuron is realized in 38 to achieve LSTM like recurrent spiking neural networks to achieve accuracy nearer to ANNs on few spatio temporal tasks Double Exponential Adaptive Threshold DEXAT edit The DEXAT neuron model is a flavor of adaptive neuron model in which the threshold voltage decays with a double exponential having two time constants Double exponential decay is governed by a fast initial decay and then a slower decay over a longer period of time 39 40 This neuron used in SNNs through surrogate gradient creates an adaptive learning rate yielding higher accuracy and faster convergence and flexible long short term memory compared to existing counterparts in the literature The membrane potential dynamics are described through equations and the threshold adaptation rule is v t h t b 0 b 1 b 1 t b 2 b 2 t displaystyle v th t b 0 beta 1 b 1 t beta 2 b 2 t nbsp The dynamics of b 1 t displaystyle b 1 t nbsp and b 2 t displaystyle b 2 t nbsp are given byb 1 t d t p j 1 b 1 t 1 p j 1 z t d t displaystyle b 1 t delta t p j1 b 1 t 1 p j1 z t delta t nbsp b 2 t d t p j 2 b 2 t 1 p j 2 z t d t displaystyle b 2 t delta t p j2 b 2 t 1 p j2 z t delta t nbsp where p j 1 exp d t t b 1 displaystyle p j1 exp left frac delta t tau b1 right nbsp and p j 2 exp d t t b 2 displaystyle p j2 exp left frac delta t tau b2 right nbsp Further multi time scale adaptive threshold neuron model showing more complex dynamics is shown in 41 Stochastic models of membrane voltage and spike timing editThe models in this category are generalized integrate and fire models that include a certain level of stochasticity Cortical neurons in experiments are found to respond reliably to time dependent input albeit with a small degree of variations between one trial and the next if the same stimulus is repeated 42 43 Stochasticity in neurons has two important sources First even in a very controlled experiment where input current is injected directly into the soma ion channels open and close stochastically 44 and this channel noise leads to a small amount of variability in the exact value of the membrane potential and the exact timing of output spikes Second for a neuron embedded in a cortical network it is hard to control the exact input because most inputs come from unobserved neurons somewhere else in the brain 27 Stochasticity has been introduced into spiking neuron models in two fundamentally different forms either i a noisy input current is added to the differential equation of the neuron model 45 or ii the process of spike generation is noisy 46 In both cases the mathematical theory can be developed for continuous time which is then if desired for the use in computer simulations transformed into a discrete time model The relation of noise in neuron models to the variability of spike trains and neural codes is discussed in Neural Coding and in Chapter 7 of the textbook Neuronal Dynamics 27 Noisy input model diffusive noise edit A neuron embedded in a network receives spike input from other neurons Since the spike arrival times are not controlled by an experimentalist they can be considered as stochastic Thus a potentially nonlinear integrate and fire model with nonlinearity f v receives two inputs an input I t displaystyle I t nbsp controlled by the experimentalists and a noisy input current I n o i s e t displaystyle I rm noise t nbsp that describes the uncontrolled background input t m d V d t f V R I t R I noise t displaystyle tau m frac dV dt f V RI t RI text noise t nbsp Stein s model 45 is the special case of a leaky integrate and fire neuron and a stationary white noise current I n o i s e t 3 t displaystyle I rm noise t xi t nbsp with mean zero and unit variance In the subthreshold regime these assumptions yield the equation of the Ornstein Uhlenbeck process t m d V d t E m V R I t R 3 t displaystyle tau m frac dV dt E m V RI t R xi t nbsp However in contrast to the standard Ornstein Uhlenbeck process the membrane voltage is reset whenever V hits the firing threshold Vth 45 Calculating the interval distribution of the Ornstein Uhlenbeck model for constant input with threshold leads to a first passage time problem 45 47 Stein s neuron model and variants thereof have been used to fit interspike interval distributions of spike trains from real neurons under constant input current 47 In the mathematical literature the above equation of the Ornstein Uhlenbeck process is written in the form d V E m V R I t d t t m s d W displaystyle dV E m V RI t frac dt tau m sigma dW nbsp where s displaystyle sigma nbsp is the amplitude of the noise input and dW are increments of a Wiener process For discrete time implementations with time step dt the voltage updates are 27 D V E m V R I t D t t m s t m y displaystyle Delta V E m V RI t frac Delta t tau m sigma sqrt tau m y nbsp where y is drawn from a Gaussian distribution with zero mean unit variance The voltage is reset when it hits the firing threshold Vth The noisy input model can also be used in generalized integrate and fire models For example the exponential integrate and fire model with noisy input reads t m d V d t E m V D T exp V V T D T R I t R 3 t displaystyle tau m frac dV dt E m V Delta T exp left frac V V T Delta T right RI t R xi t nbsp For constant deterministic input I t I 0 displaystyle I t I 0 nbsp it is possible to calculate the mean firing rate as a function of I 0 displaystyle I 0 nbsp 48 This is important because the frequency current relation f I curve is often used by experimentalists to characterize a neuron The leaky integrate and fire with noisy input has been widely used in the analysis of networks of spiking neurons 49 Noisy input is also called diffusive noise because it leads to a diffusion of the subthreshold membrane potential around the noise free trajectory Johannesma 50 The theory of spiking neurons with noisy input is reviewed in Chapter 8 2 of the textbook Neuronal Dynamics 27 Noisy output model escape noise edit In deterministic integrate and fire models a spike is generated if the membrane potential V t hits the threshold V t h displaystyle V th nbsp In noisy output models the strict threshold is replaced by a noisy one as follows At each moment in time t a spike is generated stochastically with instantaneous stochastic intensity or escape rate 27 r t f V t V t h displaystyle rho t f V t V th nbsp that depends on the momentary difference between the membrane voltage V t and the threshold V t h displaystyle V th nbsp 46 A common choice for the escape rate f displaystyle f nbsp that is consistent with biological data 22 is f V V t h 1 t 0 exp b V V t h displaystyle f V V th frac 1 tau 0 exp beta V V th nbsp nbsp Stochastic spike generation noisy output depends on the momentary difference between the membrane potential V t and the threshold The membrane potential V of the spike response model SRM has two contributions 51 52 First input current I is filtered by a first filter k Second the sequence of output spikes S t is filtered by a second filter h and fed back The resulting membrane V t potential is used to generate output spikes by a stochastic process r t with an intensity that depends on the distance between membrane potential and threshold The spike response model SRM is closely related to the Generalized Linear Model GLM 53 54 where t 0 displaystyle tau 0 nbsp is a time constant that describes how quickly a spike is fired once the membrane potential reaches the threshold and b displaystyle beta nbsp is a sharpness parameter For b displaystyle beta to infty nbsp the threshold becomes sharp and spike firing occurs deterministically at the moment when the membrane potential hits the threshold from below The sharpness value found in experiments 22 is 1 b 4 m V displaystyle 1 beta approx 4mV nbsp which means that neuronal firing becomes non negligible as soon as the membrane potential is a few mV below the formal firing threshold The escape rate process via a soft threshold is reviewed in Chapter 9 of the textbook Neuronal Dynamics 27 For models in discrete time a spike is generated with probability P F t n F V t n V t h displaystyle P F t n F V t n V th nbsp that depends on the momentary difference between the membrane voltage V at time t n displaystyle t n nbsp and the threshold V t h displaystyle V th nbsp 55 The function F is often taken as a standard sigmoidal F x 0 5 1 tanh g x displaystyle F x 0 5 1 tanh gamma x nbsp with steepness parameter g displaystyle gamma nbsp 46 similar to the update dynamics in artificial neural networks But the functional form of F can also be derived from the stochastic intensity f displaystyle f nbsp in continuous time introduced above as F y n 1 exp y n D t displaystyle F y n approx 1 exp y n Delta t nbsp where y n V t n V t h displaystyle y n V t n V th nbsp is the threshold distance 46 Integrate and fire models with output noise can be used to predict the peristimulus time histogram PSTH of real neurons under arbitrary time dependent input 22 For non adaptive integrate and fire neurons the interval distribution under constant stimulation can be calculated from stationary renewal theory 27 Spike response model SRM edit Experimental evidence supporting the model Spike response model References Sub threshold voltage for time dependent input current 23 22 Firing times for time dependent input current 23 22 Firing Patterns in response to step current input 56 57 Interspike interval distribution 56 46 Spike afterpotential 23 refractoriness and dynamic firing threshold 23 22 main article Spike response modelThe spike response model SRM is a generalized linear model for the subthreshold membrane voltage combined with a nonlinear output noise process for spike generation 46 58 56 The membrane voltage V t at time t isV t f h t t f 0 k s I t s d s V r e s t displaystyle V t sum f eta t t f int limits 0 infty kappa s I t s ds V mathrm rest nbsp where tf is the firing time of spike number f of the neuron Vrest is the resting voltage in the absence of input I t s is the input current at time t s and k s displaystyle kappa s nbsp is a linear filter also called kernel that describes the contribution of an input current pulse at time t s to the voltage at time t The contributions to the voltage caused by a spike at time t f displaystyle t f nbsp are described by the refractory kernel h t t f displaystyle eta t t f nbsp In particular h t t f displaystyle eta t t f nbsp describes the reset after the spike and the time course of the spike afterpotential following a spike It therefore expresses the consequences of refractoriness and adaptation 46 23 The voltage V t can be interpreted as the result of an integration of the differential equation of a leaky integrate and fire model coupled to an arbitrary number of spike triggered adaptation variables 24 Spike firing is stochastic and happens with a time dependent stochastic intensity instantaneous rate f V ϑ t 1 t 0 exp b V ϑ t displaystyle f V vartheta t frac 1 tau 0 exp beta V vartheta t nbsp with parameters t 0 displaystyle tau 0 nbsp and b displaystyle beta nbsp and a dynamic threshold ϑ t displaystyle vartheta t nbsp given by ϑ t ϑ 0 f 8 1 t t f displaystyle vartheta t vartheta 0 sum f theta 1 t t f nbsp Here ϑ 0 displaystyle vartheta 0 nbsp is the firing threshold of an inactive neuron and 8 1 t t f displaystyle theta 1 t t f nbsp describes the increase of the threshold after a spike at time t f displaystyle t f nbsp 22 23 In case of a fixed threshold one sets 8 1 t t f 0 displaystyle theta 1 t t f 0 nbsp For b displaystyle beta to infty nbsp the threshold process is deterministic 27 The time course of the filters h k 8 1 displaystyle eta kappa theta 1 nbsp that characterize the spike response model can be directly extracted from experimental data 23 With optimized parameters the SRM describes the time course of the subthreshold membrane voltage for time dependent input with a precision of 2mV and can predict the timing of most output spikes with a precision of 4ms 22 23 The SRM is closely related to linear nonlinear Poisson cascade models also called Generalized Linear Model 54 The estimation of parameters of probabilistic neuron models such as the SRM using methods developed for Generalized Linear Models 59 is discussed in Chapter 10 of the textbook Neuronal Dynamics 27 nbsp Spike arrival causes postsynaptic potentials red lines which are summed If the total voltage V reaches a threshold dashed blue line a spike is initiated green which also includes a spike afterpotential The threshold increases after each spike Postsynaptic potentials are the response to incoming spikes while the spike afterpotential is the response to outgoing spikes The name spike response model arises because in a network the input current for neuron i is generated by the spikes of other neurons so that in the case of a network the voltage equation becomes V i t f h i t t i f j 1 N w i j f e i j t t j f V r e s t displaystyle V i t sum f eta i t t i f sum j 1 N w ij sum f varepsilon ij t t j f V mathrm rest nbsp where t j f displaystyle t j f nbsp is the firing times of neuron j i e its spike train h i t t i f displaystyle eta i t t i f nbsp describes the time course of the spike and the spike after potential for neuron i and w i j displaystyle w ij nbsp and e i j t t j f displaystyle varepsilon ij t t j f nbsp describe the amplitude and time course of an excitatory or inhibitory postsynaptic potential PSP caused by the spike t j f displaystyle t j f nbsp of the presynaptic neuron j The time course e i j s displaystyle varepsilon ij s nbsp of the PSP results from the convolution of the postsynaptic current I t displaystyle I t nbsp caused by the arrival of a presynaptic spike from neuron j with the membrane filter k s displaystyle kappa s nbsp 27 SRM0 edit The SRM0 56 60 61 is a stochastic neuron model related to time dependent nonlinear renewal theory and a simplification of the Spike Response Model SRM The main difference to the voltage equation of the SRM introduced above is that in the term containing the refractory kernel h s displaystyle eta s nbsp there is no summation sign over past spikes only the most recent spike denoted as the time t displaystyle hat t nbsp matters Another difference is that the threshold is constant The model SRM0 can be formulated in discrete or continuous time For example in continuous time the single neuron equation is V t h t t 0 k s I t s d s V r e s t displaystyle V t eta t hat t int 0 infty kappa s I t s ds V mathrm rest nbsp and the network equations of the SRM0 are 56 V i t t i h i t t i j w i j f e i j t t i t t f V r e s t displaystyle V i t mid hat t i eta i t hat t i sum j w ij sum f varepsilon ij t hat t i t t f V mathrm rest nbsp where t i displaystyle hat t i nbsp is the last firing time neuron i Note that the time course of the postsynaptic potential e i j displaystyle varepsilon ij nbsp is also allowed to depend on the time since the last spike of neuron i to describe a change in membrane conductance during refractoriness 60 The instantaneous firing rate stochastic intensity is f V ϑ 1 t 0 exp b V V t h displaystyle f V vartheta frac 1 tau 0 exp beta V V th nbsp where V t h displaystyle V th nbsp is a fixed firing threshold Thus spike firing of neuron i depends only on its input and the time since neuron i has fired its last spike With the SRM0 the interspike interval distribution for constant input can be mathematically linked to the shape of the refractory kernel h displaystyle eta nbsp 46 56 Moreover the stationary frequency current relation can be calculated from the escape rate in combination with the refractory kernel h displaystyle eta nbsp 46 56 With an appropriate choice of the kernels the SRM0 approximates the dynamics of the Hodgkin Huxley model to a high degree of accuracy 60 Moreover the PSTH response to arbitrary time dependent input can be predicted 56 Galves Locherbach model edit nbsp 3D visualization of the Galves Locherbach model for biological neural nets This visualization is set for 4 000 neurons 4 layers with one population of inhibitory neurons and one population of excitatory neurons each at 180 intervals of time Main article Galves Locherbach model The Galves Locherbach model 62 is a stochastic neuron model closely related to the spike response model SRM0 61 56 and the leaky integrate and fire model It is inherently stochastic and just like the SRM0 it is linked to time dependent nonlinear renewal theory Given the model specifications the probability that a given neuron i displaystyle i nbsp spikes in a period t displaystyle t nbsp may be described by P r o b X t i 1 F t 1 f i j I W j i s L t i t 1 g j t s X s j t L t i displaystyle mathop mathrm Prob X t i 1 mid mathcal F t 1 varphi i Biggl sum j in I W j rightarrow i sum s L t i t 1 g j t s X s j t L t i Biggl nbsp where W j i displaystyle W j rightarrow i nbsp is a synaptic weight describing the influence of neuron j displaystyle j nbsp on neuron i displaystyle i nbsp g j displaystyle g j nbsp expresses the leak and L t i displaystyle L t i nbsp provides the spiking history of neuron i displaystyle i nbsp before t displaystyle t nbsp according to L t i sup s lt t X s i 1 displaystyle L t i sup s lt t X s i 1 nbsp Importantly the spike probability of neuron i displaystyle i nbsp depends only on its spike input filtered with a kernel g j displaystyle g j nbsp and weighted with a factor W j i displaystyle W j to i nbsp and the timing of its most recent output spike summarized by t L t i displaystyle t L t i nbsp Didactic toy models of membrane voltage editThe models in this category are highly simplified toy models that qualitatively describe the membrane voltage as a function of input They are mainly used for didactic reasons in teaching but are not considered valid neuron models for large scale simulations or data fitting FitzHugh Nagumo edit Main article FitzHugh Nagumo model Sweeping simplifications to Hodgkin Huxley were introduced by FitzHugh and Nagumo in 1961 and 1962 Seeking to describe regenerative self excitation by a nonlinear positive feedback membrane voltage and recovery by a linear negative feedback gate voltage they developed the model described by 63 r c l d V d t V V 3 3 w I e x t t d w d t V a b w displaystyle begin aligned rcl dfrac dV dt amp V V 3 3 w I mathrm ext tau dfrac dw dt amp V a bw end aligned nbsp where we again have a membrane like voltage and input current with a slower general gate voltage w and experimentally determined parameters a 0 7 b 0 8 t 1 0 08 Although not derivable from biology the model allows for a simplified immediately available dynamic without being a trivial simplification 64 The experimental support is weak but the model is useful as a didactic tool to introduce dynamics of spike generation through phase plane analysis See Chapter 7 in the textbook Methods of Neuronal Modeling 65 Morris Lecar edit Main article Morris Lecar model In 1981 Morris and Lecar combined the Hodgkin Huxley and FitzHugh Nagumo models into a voltage gated calcium channel model with a delayed rectifier potassium channel represented by C d V d t I i o n V w I d w d t f w w t w displaystyle begin aligned C frac dV dt amp I mathrm ion V w I frac dw dt amp varphi cdot frac w infty w tau w end aligned nbsp where I i o n V w g C a m V V C a g K w V V K g L V V L displaystyle I mathrm ion V w bar g mathrm Ca m infty cdot V V mathrm Ca bar g mathrm K w cdot V V mathrm K bar g mathrm L cdot V V mathrm L nbsp 17 The experimental support of the model is weak but the model is useful as a didactic tool to introduce dynamics of spike generation through phase plane analysis See Chapter 7 66 in the textbook Methods of Neuronal Modeling 65 A two dimensional neuron model very similar to the Morris Lecar model can be derived step by step starting from the Hodgkin Huxley model See Chapter 4 2 in the textbook Neuronal Dynamics 27 Hindmarsh Rose edit Main article Hindmarsh Rose model Building upon the FitzHugh Nagumo model Hindmarsh and Rose proposed in 1984 67 a model of neuronal activity described by three coupled first order differential equations d x d t y 3 x 2 x 3 z I d y d t 1 5 x 2 y d z d t r 4 x 8 5 z displaystyle begin aligned frac dx dt amp y 3x 2 x 3 z I frac dy dt amp 1 5x 2 y frac dz dt amp r cdot 4 x tfrac 8 5 z end aligned nbsp with r2 x2 y2 z2 and r 10 2 so that the z variable only changes very slowly This extra mathematical complexity allows a great variety of dynamic behaviors for the membrane potential described by the x variable of the model which includes chaotic dynamics This makes the Hindmarsh Rose neuron model very useful because it is still simple allows a good qualitative description of the many different firing patterns of the action potential in particular bursting observed in experiments Nevertheless it remains a toy model and has not been fitted to experimental data It is widely used as a reference model for bursting dynamics 67 Theta model and quadratic integrate and fire edit Main article Theta model The theta model or Ermentrout Kopell canonical Type I model is mathematically equivalent to the quadratic integrate and fire model which in turn is an approximation to the exponential integrate and fire model and the Hodgkin Huxley model It is called a canonical model because it is one of the generic models for constant input close to the bifurcation point which means close to the transition from silent to repetitive firing 68 69 The standard formulation of the theta model is 27 68 69 d 8 t d t I I 0 1 cos 8 1 cos 8 displaystyle frac d theta t dt I I 0 1 cos theta 1 cos theta nbsp The equation for the quadratic integrate and fire model is see Chapter 5 3 in the textbook Neuronal Dynamics 27 t m d V m t d t I I 0 R V m t E m V m t V T displaystyle tau mathrm m frac dV mathrm m t dt I I 0 R V mathrm m t E mathrm m V mathrm m t V mathrm T nbsp The equivalence of theta model and quadratic integrate and fire is for example reviewed in Chapter 4 1 2 2 of spiking neuron models 1 For input I t displaystyle I t nbsp that changes over time or is far away from the bifurcation point it is preferable to work with the exponential integrate and fire model if one wants to stay in the class of one dimensional neuron models because real neurons exhibit the nonlinearity of the exponential integrate and fire model 31 Sensory input stimulus encoding neuron models editThe models in this category were derived following experiments involving natural stimulation such as light sound touch or odor In these experiments the spike pattern resulting from each stimulus presentation varies from trial to trial but the averaged response from several trials often converges to a clear pattern Consequently the models in this category generate a probabilistic relationship between the input stimulus to spike occurrences Importantly the recorded neurons are often located several processing steps after the sensory neurons so that these models summarize the effects of the sequence of processing steps in a compact form The non homogeneous Poisson process model Siebert edit Siebert 70 71 modeled the neuron spike firing pattern using a non homogeneous Poisson process model following experiments involving the auditory system 70 71 According to Siebert the probability of a spiking event at the time interval t t D t displaystyle t t Delta t nbsp is proportional to a non negative function g s t displaystyle g s t nbsp where s t displaystyle s t nbsp is the raw stimulus P spike t t t D t D t g s t displaystyle P text spike t in t t Delta t Delta t cdot g s t nbsp Siebert considered several functions as g s t displaystyle g s t nbsp including g s t s 2 t displaystyle g s t propto s 2 t nbsp for low stimulus intensities The main advantage of Siebert s model is its simplicity The shortcomings of the model is its inability to reflect properly the following phenomena The transient enhancement of the neuronal firing activity in response to a step stimulus The saturation of the firing rate The values of inter spike interval histogram at short intervals values close to zero These shortcomings are addressed by the age dependent point process model and the two state Markov Model 72 73 74 Refractoriness and age dependent point process model edit Berry and Meister 75 studied neuronal refractoriness using a stochastic model that predicts spikes as a product of two terms a function f s t that depends on the time dependent stimulus s t and one a recovery function w t t displaystyle w t hat t nbsp that depends on the time since the last spike r t f s t w t t displaystyle rho t f s t w t hat t nbsp The model is also called an inhomogeneous Markov interval IMI process 76 Similar models have been used for many years in auditory neuroscience 77 78 79 Since the model keeps memory of the last spike time it is non Poisson and falls in the class of time dependent renewal models 27 It is closely related to the model SRM0 with exponential escape rate 27 Importantly it is possible to fit parameters of the age dependent point process model so as to describe not just the PSTH response but also the interspike interval statistics 76 77 79 Linear nonlinear Poisson cascade model and GLM edit Main article Linear nonlinear Poisson cascade model The linear nonlinear Poisson cascade model is a cascade of a linear filtering process followed by a nonlinear spike generation step 80 In the case that output spikes feed back via a linear filtering process we arrive at a model that is known in the neurosciences as Generalized Linear Model GLM 54 59 The GLM is mathematically equivalent to the spike response model SRM with escape noise but whereas in the SRM the internal variables are interpreted as the membrane potential and the firing threshold in the GLM the internal variables are abstract quantities that summarizes the net effect of input and recent output spikes before spikes are generated in the final step 27 54 The two state Markov model Nossenson amp Messer edit The spiking neuron model by Nossenson amp Messer 72 73 74 produces the probability of the neuron firing a spike as a function of either an external or pharmacological stimulus 72 73 74 The model consists of a cascade of a receptor layer model and a spiking neuron model as shown in Fig 4 The connection between the external stimulus to the spiking probability is made in two steps First a receptor cell model translates the raw external stimulus to neurotransmitter concentration and then a spiking neuron model connects neurotransmitter concentration to the firing rate spiking probability Thus the spiking neuron model by itself depends on neurotransmitter concentration at the input stage 72 73 74 nbsp Fig 4 High level block diagram of the receptor layer and neuron model by Nossenson amp Messer 72 74 nbsp Fig 5 The prediction for the firing rate in response to a pulse stimulus as given by the model by Nossenson amp Messer 72 74 An important feature of this model is the prediction for neurons firing rate pattern which captures using a low number of free parameters the characteristic edge emphasized response of neurons to a stimulus pulse as shown in Fig 5 The firing rate is identified both as a normalized probability for neural spike firing and as a quantity proportional to the current of neurotransmitters released by the cell The expression for the firing rate takes the following form R fire t P spike t D t D t y t R 0 P 0 t displaystyle R text fire t frac P text spike t Delta t Delta t y t R 0 cdot P 0 t nbsp where P0 is the probability of the neuron being armed and ready to fire It is given by the following differential equation P 0 y t R 0 R 1 P 0 t R 1 displaystyle dot P 0 y t R 0 R 1 cdot P 0 t R 1 nbsp P0 could be generally calculated recursively using the Euler method but in the case of a pulse of stimulus it yields a simple closed form expression 72 81 y t is the input of the model and is interpreted as the neurotransmitter concentration on the cell surrounding in most cases glutamate For an external stimulus it can be estimated through the receptor layer model y t g gain s 2 t displaystyle y t simeq g text gain cdot langle s 2 t rangle nbsp with s 2 t displaystyle langle s 2 t rangle nbsp being a short temporal average of stimulus power given in Watt or other energy per time unit R0 corresponds to the intrinsic spontaneous firing rate of the neuron R1 is the recovery rate of the neuron from the refractory state Other predictions by this model include 1 The averaged evoked response potential ERP due to the population of many neurons in unfiltered measurements resembles the firing rate 74 2 The voltage variance of activity due to multiple neuron activity resembles the firing rate also known as Multi Unit Activity power or MUA 73 74 3 The inter spike interval probability distribution takes the form a gamma distribution like function 72 81 Experimental evidence supporting the model by Nossenson amp Messer 72 73 74 Property of the Model by Nossenson amp Messer References Description of experimental evidence The shape of the firing rate in response to an auditory stimulus pulse 82 83 84 85 86 The Firing Rate has the same shape of Fig 5 The shape of the firing rate in response to a visual stimulus pulse 87 88 89 90 The Firing Rate has the same shape of Fig 5 The shape of the firing rate in response to an olfactory stimulus pulse 91 The Firing Rate has the same shape as Fig 5 The shape of the firing rate in response to a somatosensory stimulus 92 The Firing Rate has the same shape as Fig 5 The change in firing rate in response to neurotransmitter application mostly glutamate 93 94 Firing Rate change in response to neurotransmitter application Glutamate Square dependence between an auditory stimulus pressure and the firing rate 95 Square Dependence between Auditory Stimulus pressure and the Firing Rate Linear dependence in pressure square power Square dependence between visual stimulus electric field volts and the firing rate 88 Square dependence between visual stimulus electric field volts Linear Dependence between Visual Stimulus Power and the Firing Rate The shape of the Inter Spike Interval Statistics ISI 96 ISI shape resembles the gamma function like The ERP resembles the firing rate in unfiltered measurements 97 The shape of the averaged evoked response potential in response to stimulus resembles the firing rate Fig 5 MUA power resembles the firing rate 74 98 The shape of the empirical variance of extra cellular measurements in response to stimulus pulse resembles the firing rate Fig 5 Pharmacological input stimulus neuron models editThe models in this category produce predictions for experiments involving pharmacological stimulation Synaptic transmission Koch amp Segev edit See also Neurotransmission According to the model by Koch and Segev 17 the response of a neuron to individual neurotransmitters can be modeled as an extension of the classical Hodgkin Huxley model with both standard and nonstandard kinetic currents Four neurotransmitters primarily influence the CNS AMPA kainate receptors are fast excitatory mediators while NMDA receptors mediate considerably slower currents Fast inhibitory currents go through GABAA receptors while GABAB receptors mediate by secondary G protein activated potassium channels This range of mediation produces the following current dynamics I A M P A t V g A M P A O V t E A M P A displaystyle I mathrm AMPA t V bar g mathrm AMPA cdot O cdot V t E mathrm AMPA nbsp I N M D A t V g N M D A B V O V t E N M D A displaystyle I mathrm NMDA t V bar g mathrm NMDA cdot B V cdot O cdot V t E mathrm NMDA nbsp I G A B A A t V g G A B A A O 1 O 2 V t E C l displaystyle I mathrm GABA A t V bar g mathrm GABA A cdot O 1 O 2 cdot V t E mathrm Cl nbsp I G A B A B t V g G A B A B G n G n K d V t E K displaystyle I mathrm GABA B t V bar g mathrm GABA B cdot tfrac G n G n K mathrm d cdot V t E mathrm K nbsp where ḡ is the maximal 8 17 conductance around 1S and E is the equilibrium potential of the given ion or transmitter AMDA NMDA Cl or K while O describes the fraction of open receptors For NMDA there is a significant effect of magnesium block that depends sigmoidally on the concentration of intracellular magnesium by B V For GABAB G is the concentration of the G protein and Kd describes the dissociation of G in binding to the potassium gates The dynamics of this more complicated model have been well studied experimentally and produce important results in terms of very quick synaptic potentiation and depression that is fast short term learning The stochastic model by Nossenson and Messer translates neurotransmitter concentration at the input stage to the probability of releasing neurotransmitter at the output stage 72 73 74 For a more detailed description of this model see the Two state Markov model section above HTM neuron model editThe HTM neuron model was developed by Jeff Hawkins and researchers at Numenta and is based on a theory called Hierarchical Temporal Memory originally described in the book On Intelligence It is based on neuroscience and the physiology and interaction of pyramidal neurons in the neocortex of the human brain nbsp Comparing the artificial neural network A the biological neuron B and the HTM neuron C Artificial Neural Network ANN Neocortical Pyramidal Neuron Biological Neuron HTM Model Neuron Few synapses No dendrites Sum input x weights Learns by modifying the weights of synapses Thousands of synapses on the dendrites Active dendrites cell recognizes hundreds of unique patterns Co activation of a set of synapses on a dendritic segment causes an NMDA spike and depolarization at the soma Sources of input to the cell Feedforward inputs that form synapses proximal to the soma and directly lead to action potentials NMDA spikes generated in the more distal basal Apical dendrites that depolarize the soma usually not sufficient enough to generate a somatic action potential Learns by growing new synapses Inspired by the pyramidal cells in neocortex layers 2 3 and 5 Thousands of synapses Active dendrites cell recognizes hundreds of unique patterns Models dendrites and NMDA spikes with each array of coincident detectors having a set of synapses Learns by modeling the growth of new synapsesApplications editMain article Brain computer interface Spiking Neuron Models are used in a variety of applications that need encoding into or decoding from neuronal spike trains in the context of neuroprosthesis and brain computer interfaces such as retinal prosthesis 12 99 100 101 or artificial limb control and sensation 102 103 104 Applications are not part of this article for more information on this topic please refer to the main article Relation between artificial and biological neuron models editThe most basic model of a neuron consists of an input with some synaptic weight vector and an activation function or transfer function inside the neuron determining output This is the basic structure used for artificial neurons which in a neural network often looks like y i f j w i j x j displaystyle y i varphi left sum j w ij x j right nbsp where yi is the output of the i th neuron xj is the j th input neuron signal wij is the synaptic weight or strength of connection between the neurons i and j and f is the activation function While this model has seen success in machine learning applications it is a poor model for real biological neurons because it lacks time dependence in input and output When an input is switched on at a time t and kept constant thereafter biological neurons emit a spike train Importantly this spike train is not regular but exhibits a temporal structure characterized by adaptation bursting or initial bursting followed by regular spiking Generalized integrate and fire models such as the Adaptive Exponential Integrate and Fire model the spike response model or the linear adaptive integrate and fire model can capture these neuronal firing patterns 24 25 26 Moreover neuronal input in the brain is time dependent Time dependent input is transformed by complex linear and nonlinear filters into a spike train in the output Again the spike response model or the adaptive integrate and fire model enables to prediction of the spike train in the output for arbitrary time dependent input 22 23 whereas an artificial neuron or a simple leaky integrate and fire does not If we take the Hodkgin Huxley model as a starting point generalized integrate and fire models can be derived systematically in a step by step simplification procedure This has been shown explicitly for the exponential integrate and fire 33 model and the spike response model 60 In the case of modeling a biological neuron physical analogs are used in place of abstractions such as weight and transfer function A neuron is filled and surrounded with water containing ions which carry electric charge The neuron is bound by an insulating cell membrane and can maintain a concentration of charged ions on either side that determines a capacitance Cm The firing of a neuron involves the movement of ions into the cell that occurs when neurotransmitters cause ion channels on the cell membrane to open We describe this by a physical time dependent current I t With this comes a change in voltage or the electrical potential energy difference between the cell and its surroundings which is observed to sometimes result in a voltage spike called an action potential which travels the length of the cell and triggers the release of further neurotransmitters The voltage then is the quantity of interest and is given by Vm t 19 If the input current is constant most neurons emit after some time of adaptation or initial bursting a regular spike train The frequency of regular firing in response to a constant current I is described by the frequency current relation which corresponds to the transfer function f displaystyle varphi nbsp of artificial neural networks Similarly for all spiking neuron models the transfer function f displaystyle varphi nbsp can be calculated numerically or analytically Cable theory and compartmental models editSee also Cable theory All of the above deterministic models are point neuron models because they do not consider the spatial structure of a neuron However the dendrite contributes to transforming input into output 105 65 Point neuron models are valid description in three cases i If input current is directly injected into the soma ii If synaptic input arrives predominantly at or close to the soma closeness is defined by a length scale l displaystyle lambda nbsp introduced below iii If synapse arrives anywhere on the dendrite but the dendrite is completely linear In the last case the cable acts as a linear filter these linear filter properties can be included in the formulation of generalized integrate and fire models such as the spike response model The filter properties can be calculated from a cable equation Let us consider a cell membrane in the form of a cylindrical cable The position on the cable is denoted by x and the voltage across the cell membrane by V The cable is characterized by a longitudinal resistance r l displaystyle r l nbsp per unit length and a membrane resistance r m displaystyle r m nbsp If everything is linear the voltage changes as a function of timer m r l 2 V x 2 c m r m V t V displaystyle frac r m r l frac partial 2 V partial x 2 c m r m frac partial V partial t V nbsp 19 We introduce a length scale l 2 r m r l displaystyle lambda 2 r m r l nbsp on the left side and time constant t c m r m displaystyle tau c m r m nbsp on the right side The cable equation can now be written in its perhaps best known form l 2 2 V x 2 t V t V displaystyle lambda 2 frac partial 2 V partial x 2 tau frac partial V partial t V nbsp 20 The above cable equation is valid for a single cylindrical cable Linear cable theory describes the dendritic arbor of a neuron as a cylindrical structure undergoing a regular pattern of bifurcation like branches in a tree For a single cylinder or an entire tree the static input conductance at the base where the tree meets the cell body or any such boundary is defined as G i n G tanh L G L 1 G L G tanh L displaystyle G in frac G infty tanh L G L 1 G L G infty tanh L nbsp where L is the electrotonic length of the cylinder which depends on its length diameter and resistance A simple recursive algorithm scales linearly with the number of branches and can be used to calculate the effective conductance of the tree This is given by G D G m A D tanh L D L D displaystyle G D G m A D tanh L D L D nbsp where AD pld is the total surface area of the tree of total length l and LD is its total electrotonic length For an entire neuron in which the cell body conductance is GS and the membrane conductance per unit area is Gmd Gm A we find the total neuron conductance GN for n dendrite trees by adding up all tree and soma conductances given by G N G S j 1 n A D j F d g a j displaystyle G N G S sum j 1 n A D j F dga j nbsp where we can find the general correction factor Fdga experimentally by noting GD GmdADFdga The linear cable model makes several simplifications to give closed analytic results namely that the dendritic arbor must branch in diminishing pairs in a fixed pattern and that dendrites are linear A compartmental model 65 allows for any desired tree topology with arbitrary branches and lengths as well as arbitrary nonlinearities It is essentially a discretized computational implementation of nonlinear dendrites Each piece or compartment of a dendrite is modeled by a straight cylinder of arbitrary length l and diameter d which connects with fixed resistance to any number of branching cylinders We define the conductance ratio of the i th cylinder as Bi Gi G where G p d 3 2 2 R i R m displaystyle G infty tfrac pi d 3 2 2 sqrt R i R m nbsp and Ri is the resistance between the current compartment and the next We obtain a series of equations for conductance ratios in and out of a compartment by making corrections to the normal dynamic Bout i Bin i 1 as B o u t i B i n i 1 d i 1 d i 3 2 R m i 1 R m i displaystyle B mathrm out i frac B mathrm in i 1 d i 1 d i 3 2 sqrt R mathrm m i 1 R mathrm m i nbsp B i n i B o u t i tanh X i 1 B o u t i tanh X i displaystyle B mathrm in i frac B mathrm out i tanh X i 1 B mathrm out i tanh X i nbsp B o u t p a r B i n d a u 1 d d a u 1 d p a r 3 2 R m d a u 1 R m p a r B i n d a u 2 d d a u 2 d p a r 3 2 R m d a u 2 R m p a r displaystyle B mathrm out par frac B mathrm in dau1 d mathrm dau1 d mathrm par 3 2 sqrt R mathrm m dau1 R mathrm m par frac B mathrm in dau2 d mathrm dau2 d mathrm par 3 2 sqrt R mathrm m dau2 R mathrm m par ldots nbsp where the last equation deals with parents and daughters at branches and X i l i 4 R i d i R m displaystyle X i tfrac l i sqrt 4R i sqrt d i R m nbsp We can iterate these equations through the tree until we get the point where the dendrites connect to the cell body soma where the conductance ratio is Bin stem Then our total neuron conductance for static input is given by G N A s o m a R m s o m a j B i n s t e m j G j displaystyle G N frac A mathrm soma R mathrm m soma sum j B mathrm in stem j G infty j nbsp Importantly static input is a very special case In biology inputs are time dependent Moreover dendrites are not always linear Compartmental models enable to include nonlinearities via ion channels positioned at arbitrary locations along the dendrites 105 106 For static inputs it is sometimes possible to reduce the number of compartments increase the computational speed and yet retain the salient electrical characteristics 107 See also Multi compartment modelConjectures regarding the role of the neuron in the wider context of the brain principle of operation editThe neurotransmitter based energy detection scheme edit The neurotransmitter based energy detection scheme 74 81 suggests that the neural tissue chemically executes a Radar like detection procedure nbsp Fig 6 The biological neural detection scheme as suggested by Nossenson et al 74 81 As shown in Fig 6 the key idea of the conjecture is to account for neurotransmitter concentration neurotransmitter generation and neurotransmitter removal rates as the important quantities in executing the detection task while referring to the measured electrical potentials as a side effect that only in certain conditions coincide with the functional purpose of each step The detection scheme is similar to a radar like energy detection because it includes signal squaring temporal summation and a threshold switch mechanism just like the energy detector but it also includes a unit that emphasizes stimulus edges and a variable memory length variable memory According to this conjecture the physiological equivalent of the energy test statistics is neurotransmitter concentration and the firing rate corresponds to neurotransmitter current The advantage of this interpretation is that it leads to a unit consistent explanation which allows to bridge between electrophysiological measurements biochemical measurements and psychophysical results The evidence reviewed in 74 81 suggest the following association between functionality to histological classification Stimulus squaring is likely to be performed by receptor cells Stimulus edge emphasizing and signal transduction is performed by neurons Temporal accumulation of neurotransmitters is performed by glial cells Short term neurotransmitter accumulation is likely to occur also in some types of neurons Logical switching is executed by glial cells and it results from exceeding a threshold level of neurotransmitter concentration This threshold crossing is also accompanied by a change in neurotransmitter leak rate Physical all or non movement switching is due to muscle cells and results from exceeding a certain neurotransmitter concentration threshold on muscle surroundings Note that although the electrophysiological signals in Fig 6 are often similar to the functional signal signal power neurotransmitter concentration muscle force there are some stages in which the electrical observation differs from the functional purpose of the corresponding step In particular Nossenson et al suggested that glia threshold crossing has a completely different functional operation compared to the radiated electrophysiological signal and that the latter might only be a side effect of glia break General comments regarding the modern perspective of scientific and engineering models editThe models above are still idealizations Corrections must be made for the increased membrane surface area given by numerous dendritic spines temperatures significantly hotter than room temperature experimental data and nonuniformity in the cell s internal structure 17 Certain observed effects do not fit into some of these models For instance the temperature cycling with minimal net temperature increase of the cell membrane during action potential propagation is not compatible with models that rely on modeling the membrane as a resistance that must dissipate energy when current flows through it The transient thickening of the cell membrane during action potential propagation is also not predicted by these models nor is the changing capacitance and voltage spike that results from this thickening incorporated into these models The action of some anesthetics such as inert gases is problematic for these models as well New models such as the soliton model attempt to explain these phenomena but are less developed than older models and have yet to be widely applied Modern views regarding the role of the scientific model suggest that All models are wrong but some are useful Box and Draper 1987 Gribbin 2009 Paninski et al 2009 Recent conjecture suggests that each neuron might function as a collection of independent threshold units It is suggested that a neuron could be anisotropically activated following the origin of its arriving signals to the membrane via its dendritic trees The spike waveform was also proposed to be dependent on the origin of the stimulus 108 External links editNeuronal Dynamics from single neurons to networks and models of cognition W Gerstner W Kistler R Naud L Paninski Cambridge University Press 2014 27 In particular Chapters 6 10 html online version Spiking Neuron Models 1 W Gerstner and W Kistler Cambridge University Press 2002 See also editBinding neuron Bayesian approaches to brain function Brain computer interfaces Free energy principle Models of neural computation Neural coding Neural oscillation Quantitative models of the action potential Spiking Neural NetworkReferences edit a b c d Gerstner W Kistler WM 2002 Spiking neuron models single neurons populations plasticity Cambridge U K Cambridge University Press ISBN 0 511 07817 X OCLC 57417395 DeFelipe Javier Farinas Isabel 1992 The pyramidal neuron of the cerebral cortex morphological and chemical characteristics of the synaptic inputs Progress in Neurobiology 39 6 563 607 doi 10 1016 0301 0082 92 90015 7 PMID 1410442 S2CID 34889543 Markram Henry Muller Eilif Ramaswamy Srikanth Reimann Michael Abdellah Marwan 2015 Reconstruction and simulation of neocortical microcircuitry Cell 163 2 456 492 doi 10 1016 j cell 2015 09 029 PMID 26451489 S2CID 14466831 Wong R K S Traub R D 2009 01 01 NETWORKS Cellular Properties and Synaptic Connectivity of CA3 Pyramidal Cells Mechanisms for Epileptic Synchronization and Epileptogenesis in Schwartzkroin Philip A ed Encyclopedia of Basic Epilepsy Research Oxford Academic Press pp 815 819 doi 10 1016 b978 012373961 2 00215 0 ISBN 978 0 12 373961 2 retrieved 2020 11 18 Lapicque LM 1907 Recherches quantitatives sur l excitation electrique des nerfs J Physiol Paris 9 620 635 Abbott Larry 1999 Lapicque s introduction of the integrate and fire model neuron 1907 Brain Research Bulletin 50 5 303 304 doi 10 1016 S0361 9230 99 00161 6 PMID 10643408 S2CID 46170924 Gauld Christophe Brun Cedric Boraud Thomas Carlu Mallory Depannemaecker Damien 2022 01 14 Computational Models in Neurosciences Between Mechanistic and Phenomenological Characterizations doi 10 20944 preprints202201 0206 v1 S2CID 246059455 a b c d e f g Hodgkin AL Huxley AF August 1952 A quantitative description of membrane current and its application to conduction and excitation in nerve The Journal of Physiology 117 4 500 44 doi 10 1113 jphysiol 1952 sp004764 PMC 1392413 PMID 12991237 a b c d e Hodgkin AL Huxley AF Katz B April 1952 Measurement of current voltage relations in the membrane of the giant axon of Loligo The Journal of Physiology 116 4 424 48 doi 10 1113 jphysiol 1952 sp004716 PMC 1392219 PMID 14946712 a b c d e Hodgkin AL Huxley AF April 1952 Currents carried by sodium and potassium ions through the membrane of the giant axon of Loligo The Journal of Physiology 116 4 449 72 doi 10 1113 jphysiol 1952 sp004717 PMC 1392213 PMID 14946713 a b c d e Hodgkin AL Huxley AF April 1952 The components of membrane conductance in the giant axon of Loligo The Journal of Physiology 116 4 473 96 doi 10 1113 jphysiol 1952 sp004718 PMC 1392209 PMID 14946714 a b Mathieson K Loudin J Goetz G Huie P Wang L Kamins TI et al June 2012 Photovoltaic Retinal Prosthesis with High Pixel Density Nature Photonics 6 6 391 397 Bibcode 2012NaPho 6 391M doi 10 1038 nphoton 2012 104 PMC 3462820 PMID 23049619 Izhikevich EM 2010 Dynamical systems in neuroscience the geometry of excitability and bursting Cambridge MA MIT Press ISBN 978 0 262 51420 0 OCLC 457159828 Cressman JR Ullah G Ziburkus J Schiff SJ Barreto E April 2009 The influence of sodium and potassium dynamics on excitability seizures and the stability of persistent states I Single neuron dynamics Journal of Computational Neuroscience 26 2 159 70 doi 10 1007 s10827 008 0132 4 PMC 2704057 PMID 19169801 Depannemaecker D Ivanov A Lillo D Spek L Bernard C Jirsa V 2021 02 17 A unified physiological framework of transitions between seizures sustained ictal activity and depolarization block at the single neuron level bioRxiv 2020 10 23 352021 doi 10 1101 2020 10 23 352021 S2CID 225962412 a b Abbott LF 1999 Lapicque s introduction of the integrate and fire model neuron 1907 PDF Brain Research Bulletin 50 5 6 303 4 doi 10 1016 S0361 9230 99 00161 6 PMID 10643408 S2CID 46170924 Archived from the original PDF on 2007 06 13 a b c d e Koch C Segev I 1999 Methods in neuronal modeling from ions to networks 2nd ed Cambridge Massachusetts MIT Press p 687 ISBN 978 0 262 11231 4 Archived from the original on 2011 07 07 Retrieved 2013 01 10 Brunel N 2000 05 01 Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons Journal of Computational Neuroscience 8 3 183 208 doi 10 1023 A 1008925309027 PMID 10809012 S2CID 1849650 a b Cejnar P Vysata O Kukal J Beranek M Valis M Prochazka A April 2020 Simple capacitor switch model of excitatory and inhibitory neuron with all parts biologically explained allows input fire pattern dependent chaotic oscillations Scientific Reports 10 1 7353 Bibcode 2020NatSR 10 7353C doi 10 1038 s41598 020 63834 7 PMC 7192907 PMID 32355185 Fuortes MG Mantegazzini F July 1962 Interpretation of the repetitive firing of nerve cells The Journal of General Physiology 45 6 1163 79 doi 10 1085 jgp 45 6 1163 PMC 2195242 PMID 13895926 La Camera G Rauch A Luscher HR Senn W Fusi S October 2004 Minimal models of adapted neuronal response to in vivo like input currents Neural Computation 16 10 2101 24 doi 10 1162 0899766041732468 PMID 15333209 S2CID 1428381 a b c d e f g h i j k l m n Jolivet R Rauch A Luscher HR Gerstner W August 2006 Predicting spike timing of neocortical pyramidal neurons by simple threshold models Journal of Computational Neuroscience 21 1 35 49 doi 10 1007 s10827 006 7074 5 PMID 16633938 S2CID 8911457 a b c d e f g h i j k l m n Pozzorini C Naud R Mensi S Gerstner W July 2013 Temporal whitening by power law adaptation in neocortical neurons Nature Neuroscience 16 7 942 8 doi 10 1038 nn 3431 PMID 23749146 S2CID 1873019 a b c d Gerstner W van Hemmen JL Cowan JD November 1996 What matters in neuronal locking Neural Computation 8 8 1653 76 doi 10 1162 neco 1996 8 8 1653 PMID 8888612 S2CID 1301248 a b c Izhikevich EM November 2003 Simple model of spiking neurons IEEE Transactions on Neural Networks 14 6 1569 72 doi 10 1109 TNN 2003 820440 PMID 18244602 S2CID 814743 a b c d e f Naud R Marcille N Clopath C Gerstner W November 2008 Firing patterns in the adaptive exponential integrate and fire model Biological Cybernetics 99 4 5 335 47 doi 10 1007 s00422 008 0264 7 PMC 2798047 PMID 19011922 a b c d e f g h i j k l m n o p q r Wulfram Gerstner W Kistler WM Naud R Paninski L 24 July 2014 Neuronal dynamics from single neurons to networks and models of cognition Cambridge United Kingdom ISBN 978 1 107 06083 8 OCLC 861774542 a href Template Cite book html title Template Cite book cite book a CS1 maint location missing publisher link Richardson MJ Brunel N Hakim V May 2003 From subthreshold to firing rate resonance Journal of Neurophysiology 89 5 2538 54 doi 10 1152 jn 00955 2002 PMID 12611957 a b Lundstrom BN Higgs MH Spain WJ Fairhall AL November 2008 Fractional differentiation by neocortical pyramidal neurons Nature Neuroscience 11 11 1335 42 doi 10 1038 nn 2212 PMC 2596753 PMID 18931665 a b Teka W Marinov TM Santamaria F March 2014 Neuronal spike timing adaptation described with a fractional leaky integrate and fire model PLOS Computational Biology 10 3 e1003526 Bibcode 2014PLSCB 10E3526T doi 10 1371 journal pcbi 1003526 PMC 3967934 PMID 24675903 a b c d e Badel L Lefort S Brette R Petersen CC Gerstner W Richardson MJ February 2008 Dynamic I V curves are reliable predictors of naturalistic pyramidal neuron voltage traces Journal of Neurophysiology 99 2 656 66 CiteSeerX 10 1 1 129 504 doi 10 1152 jn 01107 2007 PMID 18057107 a b Brette R Gerstner W November 2005 Adaptive exponential integrate and fire model as an effective description of neuronal activity Journal of Neurophysiology 94 5 3637 42 doi 10 1152 jn 00686 2005 PMID 16014787 a b Fourcaud Trocme N Hansel D van Vreeswijk C Brunel N December 2003 How spike generation mechanisms determine the neuronal response to fluctuating inputs The Journal of Neuroscience 23 37 11628 40 doi 10 1523 JNEUROSCI 23 37 11628 2003 PMC 6740955 PMID 14684865 Ostojic S Brunel N Hakim V August 2009 How connectivity background activity and synaptic properties shape the cross correlation between spike trains The Journal of Neuroscience 29 33 10234 53 doi 10 1523 JNEUROSCI 1275 09 2009 PMC 6665800 PMID 19692598 Gorski T Depannemaecker D Destexhe A January 2021 Conductance Based Adaptive Exponential Integrate and Fire Model Neural Computation 33 1 41 66 doi 10 1162 neco a 01342 PMID 33253029 Neuronal Dynamics a neuroscience textbook by Wulfram Gerstner Werner M Kistler Richard Naud and Liam Paninski neuronaldynamics epfl ch Retrieved 2024 02 14 Ganguly Chittotosh Bezugam Sai Sukruth Abs Elisabeth Payvand Melika Dey Sounak Suri Manan 2024 02 01 Spike frequency adaptation bridging neural models and neuromorphic applications Communications Engineering 3 1 doi 10 1038 s44172 024 00165 9 ISSN 2731 3395 Bellec Guillaume Emmanuel Fernand Salaj Darjan Subramoney Anand Legenstein Robert Maass Wolfgang 2018 Long short term memory and learning to learn in networks of spiking neurons Advances in Neural Information Processing Systems arXiv 1803 09574 Shaban Ahmed Bezugam Sai Sukruth Suri Manan 2021 07 09 An adaptive threshold neuron for recurrent spiking neural networks with nanodevice hardware implementation Nature Communications 12 1 4234 Bibcode 2021NatCo 12 4234S doi 10 1038 s41467 021 24427 8 ISSN 2041 1723 PMC 8270926 PMID 34244491 Bezugam Sai Sukruth Shaban Ahmed Suri Manan 2023 05 21 Neuromorphic Recurrent Spiking Neural Networks for EMG Gesture Classification and Low Power Implementation on Loihi 2023 IEEE International Symposium on Circuits and Systems ISCAS IEEE pp 1 5 arXiv 2206 02061 doi 10 1109 ISCAS46773 2023 10181510 ISBN 978 1 6654 5109 3 S2CID 260004324 cite, wikipedia, wiki, book, books, library,

article

, read, download, free, free download, mp3, video, mp4, 3gp, jpg, jpeg, gif, png, picture, music, song, movie, book, game, games.