Self-organized criticality

Self-organized criticality (SOC) is a property of dynamical systems that have a critical point as an attractor. Their macroscopic behavior thus displays the spatial or temporal scale-invariance characteristic of the critical point of a phase transition, but without the need to tune control parameters to a precise value, because the system, effectively, tunes itself as it evolves towards criticality.

An image of the 2d Bak-Tang-Wiesenfeld sandpile, the original model of self-organized criticality.

The concept was put forward by Per Bak, Chao Tang and Kurt Wiesenfeld ("BTW") in a paper^[1] published in 1987 in Physical Review Letters, and is considered to be one of the mechanisms by which complexity^[2] arises in nature. Its concepts have been applied across fields as diverse as geophysics,^[3][4] physical cosmology, evolutionary biology and ecology, bio-inspired computing and optimization (mathematics), economics, quantum gravity, sociology, solar physics, plasma physics, neurobiology^[5][6][7][8] and others.

SOC is typically observed in slowly driven non-equilibrium systems with many degrees of freedom and strongly nonlinear dynamics. Many individual examples have been identified since BTW's original paper, but to date there is no known set of general characteristics that guarantee a system will display SOC.

Overview

Self-organized criticality is one of a number of important discoveries made in statistical physics and related fields over the latter half of the 20th century, discoveries which relate particularly to the study of complexity in nature. For example, the study of cellular automata, from the early discoveries of Stanislaw Ulam and John von Neumann through to John Conway's Game of Life and the extensive work of Stephen Wolfram, made it clear that complexity could be generated as an emergent feature of extended systems with simple local interactions. Over a similar period of time, Benoît Mandelbrot's large body of work on fractals showed that much complexity in nature could be described by certain ubiquitous mathematical laws, while the extensive study of phase transitions carried out in the 1960s and 1970s showed how scale invariant phenomena such as fractals and power laws emerged at the critical point between phases.

The term self-organized criticality was first introduced in Bak, Tang and Wiesenfeld's 1987 paper, which clearly linked together those factors: a simple cellular automaton was shown to produce several characteristic features observed in natural complexity (fractal geometry, pink (1/f) noise and power laws) in a way that could be linked to critical-point phenomena. Crucially, however, the paper emphasized that the complexity observed emerged in a robust manner that did not depend on finely tuned details of the system: variable parameters in the model could be changed widely without affecting the emergence of critical behavior: hence, self-organized criticality. Thus, the key result of BTW's paper was its discovery of a mechanism by which the emergence of complexity from simple local interactions could be spontaneous—and therefore plausible as a source of natural complexity—rather than something that was only possible in artificial situations in which control parameters are tuned to precise critical values. An alternative view is that SOC appears when the criticality is linked to a value of zero of the control parameters.^[9]

Despite the considerable interest and research output generated from the SOC hypothesis, there remains no general agreement with regards to its mechanisms in abstract mathematical form. Bak Tang and Wiesenfeld based their hypothesis on the behavior of their sandpile model.^[1]

Models of self-organized criticality

In chronological order of development:

• Stick-slip model of fault failure^[10][3]
• Bak–Tang–Wiesenfeld sandpile
• Forest-fire model
• Olami–Feder–Christensen model
• Bak–Sneppen model

Early theoretical work included the development of a variety of alternative SOC-generating dynamics distinct from the BTW model, attempts to prove model properties analytically (including calculating the critical exponents^[11][12]), and examination of the conditions necessary for SOC to emerge. One of the important issues for the latter investigation was whether conservation of energy was required in the local dynamical exchanges of models: the answer in general is no, but with (minor) reservations, as some exchange dynamics (such as those of BTW) do require local conservation at least on average^{[clarification needed]}.

It has been argued that the BTW "sandpile" model should actually generate 1/f² noise rather than 1/f noise.^[13] This claim was based on untested scaling assumptions, and a more rigorous analysis showed that sandpile models generally produce 1/f^a spectra, with a<2.^[14] Other simulation models were proposed later that could produce true 1/f noise.^[15]

In addition to the nonconservative theoretical model mentioned above^{[clarification needed]}, other theoretical models for SOC have been based upon information theory,^[16]mean field theory,^[17] the convergence of random variables,^[18] and cluster formation.^[19] A continuous model of self-organised criticality is proposed by using tropical geometry.^[20]

Key theoretical issues yet to be resolved include the calculation of the possible universality classes of SOC behavior and the question of whether it is possible to derive a general rule for determining if an arbitrary algorithm displays SOC.

Self-organized criticality in nature

 

The relevance of SOC to the dynamics of real sand has been questioned.

SOC has become established as a strong candidate for explaining a number of natural phenomena, including:

• The magnitude of earthquakes (Gutenberg–Richter law) and frequency of aftershocks (Omori law) ^[10][3]
• Fluctuations in economic systems such as financial markets (references to SOC are common in econophysics) ^[21][22]
• The evolution of proteins^[23][24]
• Forest fires ^[25]
• Neuronal avalanches in the cortex^{[7][26][27][28]}
• Acoustic emission from fracturing materials^[29]

Despite the numerous applications of SOC to understanding natural phenomena, the universality of SOC theory has been questioned. For example, experiments with real piles of rice revealed their dynamics to be far more sensitive to parameters than originally predicted.^[30][1] Furthermore, it has been argued that 1/f scaling in EEG recordings are inconsistent with critical states,^[31] and whether SOC is a fundamental property of neural systems remains an open and controversial topic.^[32]

Self-organized criticality and optimization

It has been found that the avalanches from an SOC process make effective patterns in a random search for optimal solutions on graphs.^[33] An example of such an optimization problem is graph coloring. The SOC process apparently helps the optimization from getting stuck in a local optimum without the use of any annealing scheme, as suggested by previous work on extremal optimization.

See also

• 1/f noise
• Complex systems
• Critical brain hypothesis
• Critical exponents
• Detrended fluctuation analysis, a method to detect power-law scaling in time series.
• Dual-phase evolution, another process that contributes to self-organization in complex systems.
• Fractals
• Ilya Prigogine, a systems scientist who helped formalize dissipative system behavior in general terms.
• Power laws
• Red Queen hypothesis
• Scale invariance
• Self-organization
• Self-organized criticality control

References

1. Bak P, Tang C, Wiesenfeld K (July 1987). "Self-organized criticality: An explanation of the 1/f noise". Physical Review Letters. 59 (4): 381–384. Bibcode:1987PhRvL..59..381B. doi:10.1103/PhysRevLett.59.381. PMID 10035754. Papercore summary: http://papercore.org/Bak1987.
2. Bak P, Paczuski M (July 1995). "Complexity, contingency, and criticality". Proceedings of the National Academy of Sciences of the United States of America. 92 (15): 6689–6696. Bibcode:1995PNAS...92.6689B. doi:10.1073/pnas.92.15.6689. PMC 41396. PMID 11607561.
3. Smalley Jr RF, Turcotte DL, Solla SA (1985). "A renormalization group approach to the stick-slip behavior of faults". Journal of Geophysical Research. 90 (B2): 1894. Bibcode:1985JGR....90.1894S. doi:10.1029/JB090iB02p01894. S2CID 28835238.
4. Smyth WD, Nash JD, Moum JN (March 2019). "Self-organized criticality in geophysical turbulence". Scientific Reports. 9 (1): 3747. Bibcode:2019NatSR...9.3747S. doi:10.1038/s41598-019-39869-w. PMC 6403305. PMID 30842462.
5. Dmitriev A, Dmitriev V (2021-01-20). "Identification of Self-Organized Critical State on Twitter Based on the Retweets' Time Series Analysis". Complexity. 2021: e6612785. doi:10.1155/2021/6612785. ISSN 1076-2787.
6. Linkenkaer-Hansen K, Nikouline VV, Palva JM, Ilmoniemi RJ (February 2001). "Long-range temporal correlations and scaling behavior in human brain oscillations". The Journal of Neuroscience. 21 (4): 1370–1377. doi:10.1523/JNEUROSCI.21-04-01370.2001. PMC 6762238. PMID 11160408.
7. Beggs JM, Plenz D (December 2003). "Neuronal avalanches in neocortical circuits". The Journal of Neuroscience. 23 (35): 11167–11177. doi:10.1523/JNEUROSCI.23-35-11167.2003. PMC 6741045. PMID 14657176.
8. Chialvo DR (2004). "Critical brain networks". Physica A. 340 (4): 756–765. arXiv:cond-mat/0402538. Bibcode:2004PhyA..340..756R. doi:10.1016/j.physa.2004.05.064. S2CID 15922916.
9. Gabrielli A, Caldarelli G, Pietronero L (December 2000). "Invasion percolation with temperature and the nature of self-organized criticality in real systems". Physical Review E. 62 (6 Pt A): 7638–7641. arXiv:cond-mat/9910425. Bibcode:2000PhRvE..62.7638G. doi:10.1103/PhysRevE.62.7638. PMID 11138032. S2CID 20510811.
10. Turcotte DL, Smalley Jr RF, Solla SA (1985). "Collapse of loaded fractal trees". Nature. 313 (6004): 671–672. Bibcode:1985Natur.313..671T. doi:10.1038/313671a0. S2CID 4317400.
11. Tang C, Bak P (June 1988). "Critical exponents and scaling relations for self-organized critical phenomena". Physical Review Letters. 60 (23): 2347–2350. Bibcode:1988PhRvL..60.2347T. doi:10.1103/PhysRevLett.60.2347. PMID 10038328.
12. Tang C, Bak P (1988). "Mean field theory of self-organized critical phenomena". Journal of Statistical Physics (Submitted manuscript). 51 (5–6): 797–802. Bibcode:1988JSP....51..797T. doi:10.1007/BF01014884. S2CID 67842194.
13. Jensen HJ, Christensen K, Fogedby HC (October 1989). "1/f noise, distribution of lifetimes, and a pile of sand". Physical Review B. 40 (10): 7425–7427. Bibcode:1989PhRvB..40.7425J. doi:10.1103/physrevb.40.7425. PMID 9991162.
14. Laurson L, Alava MJ, Zapperi S (15 September 2005). "Letter: Power spectra of self-organized critical sand piles". Journal of Statistical Mechanics: Theory and Experiment. 0511. L001.
15. Maslov S, Tang C, Zhang YC (1999). "1/f noise in Bak-Tang-Wiesenfeld models on narrow stripes". Phys. Rev. Lett. 83 (12): 2449–2452. arXiv:cond-mat/9902074. Bibcode:1999PhRvL..83.2449M. doi:10.1103/physrevlett.83.2449. S2CID 119392131.
16. Dewar R (2003). "Information theory explanation of the fluctuation theorem, maximum entropy production and self-organized criticality in non-equilibrium stationary states". Journal of Physics A: Mathematical and General. 36 (3): 631–641. arXiv:cond-mat/0005382. Bibcode:2003JPhA...36..631D. doi:10.1088/0305-4470/36/3/303. S2CID 44217479.
17. Vespignani A, Zapperi S (1998). "How self-organized criticality works: a unified mean-field picture". Physical Review E. 57 (6): 6345–6362. arXiv:cond-mat/9709192. Bibcode:1998PhRvE..57.6345V. doi:10.1103/physreve.57.6345. hdl:2047/d20002173. S2CID 29500701.
18. Kendal WS (2015). "Self-organized criticality attributed to a central limit-like convergence effect". Physica A. 421: 141–150. Bibcode:2015PhyA..421..141K. doi:10.1016/j.physa.2014.11.035.
19. Hoffmann H (February 2018). "Impact of network topology on self-organized criticality". Physical Review E. 97 (2–1): 022313. Bibcode:2018PhRvE..97b2313H. doi:10.1103/PhysRevE.97.022313. PMID 29548239.
20. Kalinin N, Guzmán-Sáenz A, Prieto Y, Shkolnikov M, Kalinina V, Lupercio E (August 2018). "Self-organized criticality and pattern emergence through the lens of tropical geometry". Proceedings of the National Academy of Sciences of the United States of America. 115 (35): E8135–E8142. arXiv:1806.09153. Bibcode:2018PNAS..115E8135K. doi:10.1073/pnas.1805847115. PMC 6126730. PMID 30111541.
21. Bak P, Paczuski M, Shubik M (1997-12-01). "Price variations in a stock market with many agents". Physica A: Statistical Mechanics and Its Applications. 246 (3): 430–453. arXiv:cond-mat/9609144. Bibcode:1997PhyA..246..430B. doi:10.1016/S0378-4371(97)00401-9. ISSN 0378-4371. S2CID 119480691.
22. Sornette D, Johansen A, Bouchaud JP (January 1996). "Stock Market Crashes, Precursors and Replicas". Journal de Physique I. 6 (1): 167–175. arXiv:cond-mat/9510036. Bibcode:1996JPhy1...6..167S. doi:10.1051/jp1:1996135. ISSN 1155-4304. S2CID 5492260.
23. Phillips JC (2014). "Fractals and self-organized criticality in proteins". Physica A. 415: 440–448. Bibcode:2014PhyA..415..440P. doi:10.1016/j.physa.2014.08.034.
24. Phillips JC (November 2021). "Synchronized attachment and the Darwinian evolution of coronaviruses CoV-1 and CoV-2". Physica A. 581: 126202. arXiv:2008.12168. Bibcode:2021PhyA..58126202P. doi:10.1016/j.physa.2021.126202. PMC 8216869. PMID 34177077.
25. Malamud BD, Morein G, Turcotte DL (September 1998). "Forest fires: An example of self-organized critical behavior". Science. 281 (5384): 1840–1842. Bibcode:1998Sci...281.1840M. doi:10.1126/science.281.5384.1840. PMID 9743494.
26. Poil SS, Hardstone R, Mansvelder HD, Linkenkaer-Hansen K (July 2012). "Critical-state dynamics of avalanches and oscillations jointly emerge from balanced excitation/inhibition in neuronal networks". The Journal of Neuroscience. 32 (29): 9817–9823. doi:10.1523/JNEUROSCI.5990-11.2012. PMC 3553543. PMID 22815496.
27. Chialvo DR (2010). "Emergent complex neural dynamics". Nature Physics. 6 (10): 744–750. arXiv:1010.2530. Bibcode:2010NatPh...6..744C. doi:10.1038/nphys1803. ISSN 1745-2481. S2CID 17584864.
28. Tagliazucchi E, Balenzuela P, Fraiman D, Chialvo DR (2012). "Criticality in large-scale brain FMRI dynamics unveiled by a novel point process analysis". Frontiers in Physiology. 3: 15. doi:10.3389/fphys.2012.00015. PMC 3274757. PMID 22347863.
29. Caldarelli G, Petri A (September 1996). "Self-Organization and Annealed Disorder in Fracturing Process" (PDF). Physical Review Letters. 77 (12): 2503–2506. Bibcode:1996PhRvL..77.2503C. doi:10.1103/PhysRevLett.77.2503. PMID 10061970. S2CID 5462487.
30. Frette V, Christensen K, Malthe-Sørenssen A, Feder J, Jøssang T, Meakin P (1996). "Avalanche dynamics in a pile of rice". Nature. 379 (6560): 49–52. Bibcode:1996Natur.379...49F. doi:10.1038/379049a0. S2CID 4344739.
31. Bédard C, Kröger H, Destexhe A (September 2006). "Does the 1/f frequency scaling of brain signals reflect self-organized critical states?". Physical Review Letters. 97 (11): 118102. arXiv:q-bio/0608026. Bibcode:2006PhRvL..97k8102B. doi:10.1103/PhysRevLett.97.118102. PMID 17025932. S2CID 1036124.
32. Hesse J, Gross T (2014). "Self-organized criticality as a fundamental property of neural systems". Frontiers in Systems Neuroscience. 8: 166. doi:10.3389/fnsys.2014.00166. PMC 4171833. PMID 25294989.
33. Hoffmann H, Payton DW (February 2018). "Optimization by Self-Organized Criticality". Scientific Reports. 8 (1): 2358. Bibcode:2018NatSR...8.2358H. doi:10.1038/s41598-018-20275-7. PMC 5799203. PMID 29402956.

Further reading

• Adami C (1995). "Self-organized criticality in living systems". Physics Letters A. 203 (1): 29–32. arXiv:adap-org/9401001. Bibcode:1995PhLA..203...29A. CiteSeerX 10.1.1.456.9543. doi:10.1016/0375-9601(95)00372-A. S2CID 2391809.
• Bak P (1996). How Nature Works: The Science of Self-Organized Criticality. New York: Copernicus. ISBN 978-0-387-94791-4.
• Bak P, Paczuski M (July 1995). "Complexity, contingency, and criticality". Proceedings of the National Academy of Sciences of the United States of America. 92 (15): 6689–6696. Bibcode:1995PNAS...92.6689B. doi:10.1073/pnas.92.15.6689. PMC 41396. PMID 11607561.
• Bak P, Sneppen K (December 1993). "Punctuated equilibrium and criticality in a simple model of evolution". Physical Review Letters. 71 (24): 4083–4086. Bibcode:1993PhRvL..71.4083B. doi:10.1103/PhysRevLett.71.4083. PMID 10055149.
• Bak P, Tang C, Wiesenfeld K (July 1987). "Self-organized criticality: An explanation of the 1/f noise". Physical Review Letters. 59 (4): 381–384. Bibcode:1987PhRvL..59..381B. doi:10.1103/PhysRevLett.59.381. PMID 10035754.
• Bak P, Tang C, Wiesenfeld K (July 1988). "Self-organized criticality". Physical Review A. 38 (1): 364–374. Bibcode:1988PhRvA..38..364B. doi:10.1103/PhysRevA.38.364. PMID 9900174. Papercore summary.
• Buchanan M (2000). Ubiquity. London: Weidenfeld & Nicolson. ISBN 978-0-7538-1297-6.
• Jensen HJ (1998). Self-Organized Criticality. Cambridge: Cambridge University Press. ISBN 978-0-521-48371-1.
• Katzm JI (1986). "A model of propagating brittle failure in heterogeneous media". Journal of Geophysical Research. 91 (B10): 10412. Bibcode:1986JGR....9110412K. doi:10.1029/JB091iB10p10412.
• Kron T, Grund T (2009). "Society as a Selforganized Critical System". Cybernetics and Human Knowing. 16: 65–82.
• Paczuski M (2005). "Networks as renormalized models for emergent behavior in physical systems". Complexity, Metastability and Nonextensivity. The Science and Culture Series – Physics. pp. 363–374. arXiv:physics/0502028. Bibcode:2005cmn..conf..363P. CiteSeerX 10.1.1.261.9886. doi:10.1142/9789812701558_0042. ISBN 978-981-256-525-9. S2CID 3082389. {{cite book}}: |journal= ignored (help)
• Turcotte DL (1997). Fractals and Chaos in Geology and Geophysics. Cambridge: Cambridge University Press. ISBN 978-0-521-56733-6.
• Turcotte DL (1999). "Self-organized criticality". Reports on Progress in Physics. 62 (10): 1377–1429. Bibcode:1999RPPh...62.1377T. doi:10.1088/0034-4885/62/10/201. S2CID 250910744.
• Nurujjaman M, Sekar Iyengar AN (2007). "Realization of {SOC} behavior in a dc glow discharge plasma". Physics Letters A. 360 (6): 717–721. arXiv:physics/0611069. Bibcode:2007PhLA..360..717N. doi:10.1016/j.physleta.2006.09.005. S2CID 119401088.
• Self-organized criticality on arxiv.org