The Machine Intelligence Research Institute (MIRI), formerly the Singularity Institute for Artificial Intelligence (SIAI), is a non-profitresearch institute focused since 2005 on identifying and managing potential existential risks from artificial general intelligence. MIRI's work has focused on a friendly AI approach to system design and on predicting the rate of technology development.
In 2000, Eliezer Yudkowsky founded the Singularity Institute for Artificial Intelligence with funding from Brian and Sabine Atkins, with the purpose of accelerating the development of artificial intelligence (AI).[1][2][3] However, Yudkowsky began to be concerned that AI systems developed in the future could become superintelligent and pose risks to humanity,[1] and in 2005 the institute moved to Silicon Valley and began to focus on ways to identify and manage those risks, which were at the time largely ignored by scientists in the field.[2]
Starting in 2006, the Institute organized the Singularity Summit to discuss the future of AI including its risks, initially in cooperation with Stanford University and with funding from Peter Thiel. The San Francisco Chronicle described the first conference as a "Bay Area coming-out party for the tech-inspired philosophy called transhumanism".[4][5] In 2011, its offices were four apartments in downtown Berkeley.[6] In December 2012, the institute sold its name, web domain, and the Singularity Summit to Singularity University,[7] and in the following month took the name "Machine Intelligence Research Institute".[8]
In 2014 and 2015, public and scientific interest in the risks of AI grew, increasing donations to fund research at MIRI and similar organizations.[3][9]: 327
In 2019, Open Philanthropy recommended a general-support grant of approximately $2.1 million over two years to MIRI.[10] In April 2020, Open Philanthropy supplemented this with a $7.7M grant over two years.[11][12]
Nate Soares presenting an overview of the AI alignment problem at Google in 2016
MIRI's approach to identifying and managing the risks of AI, led by Yudkowsky, primarily addresses how to design friendly AI, covering both the initial design of AI systems and the creation of mechanisms to ensure that evolving AI systems remain friendly.[3][14][15]
MIRI researchers advocate early safety work as a precautionary measure.[16] However, MIRI researchers have expressed skepticism about the views of singularity advocates like Ray Kurzweil that superintelligence is "just around the corner".[14] MIRI has funded forecasting work through an initiative called AI Impacts, which studies historical instances of discontinuous technological change, and has developed new measures of the relative computational power of humans and computer hardware.[17]
MIRI aligns itself with the principles and objectives of the effective altruism movement.[18]
Works by MIRI staffedit
Graves, Matthew (8 November 2017). "Why We Should Be Concerned About Artificial Superintelligence". Skeptic. The Skeptics Society. Retrieved 28 July 2018.
LaVictoire, Patrick; Fallenstein, Benja; Yudkowsky, Eliezer; Bárász, Mihály; Christiano, Paul; Herreshoff, Marcello (2014). "Program Equilibrium in the Prisoner's Dilemma via Löb's Theorem". Multiagent Interaction without Prior Coordination: Papers from the AAAI-14 Workshop. AAAI Publications.
Soares, Nate; Levinstein, Benjamin A. (2017). "Cheating Death in Damascus" (PDF). Formal Epistemology Workshop (FEW). Retrieved 28 July 2018.
Soares, Nate; Fallenstein, Benja; Yudkowsky, Eliezer; Armstrong, Stuart (2015). "Corrigibility". AAAI Workshops: Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, January 25–26, 2015. AAAI Publications.
Soares, Nate; Fallenstein, Benja (2015). "Aligning Superintelligence with Human Interests: A Technical Research Agenda" (PDF). In Miller, James; Yampolskiy, Roman; Armstrong, Stuart; et al. (eds.). The Technological Singularity: Managing the Journey. Springer.
Yudkowsky, Eliezer (2008). "Artificial Intelligence as a Positive and Negative Factor in Global Risk" (PDF). In Bostrom, Nick; Ćirković, Milan (eds.). Global Catastrophic Risks. Oxford University Press. ISBN978-0199606504.
Taylor, Jessica (2016). "Quantilizers: A Safer Alternative to Maximizers for Limited Optimization". Workshops at the Thirtieth AAAI Conference on Artificial Intelligence.
Yudkowsky, Eliezer (2011). "Complex Value Systems in Friendly AI" (PDF). Artificial General Intelligence: 4th International Conference, AGI 2011, Mountain View, CA, USA, August 3–6, 2011. Berlin: Springer.
^ ab"MIRI: Artificial Intelligence: The Danger of Good Intentions - Future of Life Institute". Future of Life Institute. 11 October 2015. from the original on 28 August 2018. Retrieved 28 August 2018.
^ abKhatchadourian, Raffi. "The Doomsday Invention". The New Yorker. from the original on 2019-04-29. Retrieved 2018-08-28.
^ abcWaters, Richard (31 October 2014). "Artificial intelligence: machine v man". Financial Times. from the original on 27 August 2018. Retrieved 27 August 2018.
^Abate, Tom (2006). "Smarter than thou?". San Francisco Chronicle. from the original on 11 February 2011. Retrieved 12 October 2015.
^Abate, Tom (2007). "Public meeting will re-examine future of artificial intelligence". San Francisco Chronicle. from the original on 14 January 2016. Retrieved 12 October 2015.
^Kaste, Martin (January 11, 2011). "The Singularity: Humanity's Last Invention?". All Things Considered, NPR. from the original on August 28, 2018. Retrieved August 28, 2018.
^"Press release: Singularity University Acquires the Singularity Summitt". Singularity University. 9 December 2012. from the original on 27 April 2019. Retrieved 28 August 2018.
^"Press release: We are now the "Machine Intelligence Research Institute" (MIRI) - Machine Intelligence Research Institute". Machine Intelligence Research Institute. 30 January 2013. from the original on 23 September 2018. Retrieved 28 August 2018.
^"Machine Intelligence Research Institute — General Support (2019)". Open Philanthropy Project. 2019-03-29. from the original on 2019-10-08. Retrieved 2019-10-08.
^"Machine Intelligence Research Institute — General Support (2020)". Open Philanthropy Project. 10 March 2020. from the original on April 13, 2020.
^Bensinger, Rob (April 27, 2020). "MIRI's largest grant to date!". MIRI. from the original on April 27, 2020. Retrieved April 27, 2020.
^Maheshwari, Suyash (2021-05-13). . MSN. Archived from the original on 2021-08-24. Retrieved 2023-01-23.
^ abLaFrance, Adrienne (2015). "Building Robots With Better Morals Than Humans". The Atlantic. from the original on 19 August 2015. Retrieved 12 October 2015.
^Sathian, Sanjena (4 January 2016). "The Most Important Philosophers of Our Time Reside in Silicon Valley". OZY. from the original on 29 July 2018. Retrieved 28 July 2018.
^Hsu, Jeremy (2015). "Making Sure AI's Rapid Rise Is No Surprise". Discover. from the original on 12 October 2015. Retrieved 12 October 2015.
^"AI and Effective Altruism". Machine Intelligence Research Institute. 2015-08-28. from the original on 2019-10-08. Retrieved 2019-10-08.
Further readingedit
Russell, Stuart; Dewey, Daniel; Tegmark, Max (Winter 2015). "Research Priorities for Robust and Beneficial Artificial Intelligence". AI Magazine. 36 (4): 6. arXiv:1602.03506. Bibcode:2016arXiv160203506R. doi:10.1609/aimag.v36i4.2577.
External linksedit
Official website
January 01, 1970
machine, intelligence, research, institute, singularity, institute, redirects, here, confused, with, singularity, university, miri, formerly, singularity, institute, artificial, intelligence, siai, profit, research, institute, focused, since, 2005, identifying. Singularity Institute redirects here Not to be confused with Singularity University The Machine Intelligence Research Institute MIRI formerly the Singularity Institute for Artificial Intelligence SIAI is a non profit research institute focused since 2005 on identifying and managing potential existential risks from artificial general intelligence MIRI s work has focused on a friendly AI approach to system design and on predicting the rate of technology development Machine Intelligence Research InstituteFormation2000 24 years ago 2000 TypeNonprofit research institutePurposeResearch into friendly artificial intelligence and the AI control problemLocationBerkeley California U S Key peopleEliezer YudkowskyWebsiteintelligence wbr org Contents 1 History 2 Research and approach 3 Works by MIRI staff 4 See also 5 References 6 Further reading 7 External linksHistory edit nbsp Yudkowsky at Stanford University in 2006 In 2000 Eliezer Yudkowsky founded the Singularity Institute for Artificial Intelligence with funding from Brian and Sabine Atkins with the purpose of accelerating the development of artificial intelligence AI 1 2 3 However Yudkowsky began to be concerned that AI systems developed in the future could become superintelligent and pose risks to humanity 1 and in 2005 the institute moved to Silicon Valley and began to focus on ways to identify and manage those risks which were at the time largely ignored by scientists in the field 2 Starting in 2006 the Institute organized the Singularity Summit to discuss the future of AI including its risks initially in cooperation with Stanford University and with funding from Peter Thiel The San Francisco Chronicle described the first conference as a Bay Area coming out party for the tech inspired philosophy called transhumanism 4 5 In 2011 its offices were four apartments in downtown Berkeley 6 In December 2012 the institute sold its name web domain and the Singularity Summit to Singularity University 7 and in the following month took the name Machine Intelligence Research Institute 8 In 2014 and 2015 public and scientific interest in the risks of AI grew increasing donations to fund research at MIRI and similar organizations 3 9 327 In 2019 Open Philanthropy recommended a general support grant of approximately 2 1 million over two years to MIRI 10 In April 2020 Open Philanthropy supplemented this with a 7 7M grant over two years 11 12 In 2021 Vitalik Buterin donated several million dollars worth of Ethereum to MIRI 13 Research and approach edit nbsp Nate Soares presenting an overview of the AI alignment problem at Google in 2016 MIRI s approach to identifying and managing the risks of AI led by Yudkowsky primarily addresses how to design friendly AI covering both the initial design of AI systems and the creation of mechanisms to ensure that evolving AI systems remain friendly 3 14 15 MIRI researchers advocate early safety work as a precautionary measure 16 However MIRI researchers have expressed skepticism about the views of singularity advocates like Ray Kurzweil that superintelligence is just around the corner 14 MIRI has funded forecasting work through an initiative called AI Impacts which studies historical instances of discontinuous technological change and has developed new measures of the relative computational power of humans and computer hardware 17 MIRI aligns itself with the principles and objectives of the effective altruism movement 18 Works by MIRI staff editGraves Matthew 8 November 2017 Why We Should Be Concerned About Artificial Superintelligence Skeptic The Skeptics Society Retrieved 28 July 2018 LaVictoire Patrick Fallenstein Benja Yudkowsky Eliezer Barasz Mihaly Christiano Paul Herreshoff Marcello 2014 Program Equilibrium in the Prisoner s Dilemma via Lob s Theorem Multiagent Interaction without Prior Coordination Papers from the AAAI 14 Workshop AAAI Publications Soares Nate Levinstein Benjamin A 2017 Cheating Death in Damascus PDF Formal Epistemology Workshop FEW Retrieved 28 July 2018 Soares Nate Fallenstein Benja Yudkowsky Eliezer Armstrong Stuart 2015 Corrigibility AAAI Workshops Workshops at the Twenty Ninth AAAI Conference on Artificial Intelligence Austin TX January 25 26 2015 AAAI Publications Soares Nate Fallenstein Benja 2015 Aligning Superintelligence with Human Interests A Technical Research Agenda PDF In Miller James Yampolskiy Roman Armstrong Stuart et al eds The Technological Singularity Managing the Journey Springer Yudkowsky Eliezer 2008 Artificial Intelligence as a Positive and Negative Factor in Global Risk PDF In Bostrom Nick Cirkovic Milan eds Global Catastrophic Risks Oxford University Press ISBN 978 0199606504 Taylor Jessica 2016 Quantilizers A Safer Alternative to Maximizers for Limited Optimization Workshops at the Thirtieth AAAI Conference on Artificial Intelligence Yudkowsky Eliezer 2011 Complex Value Systems in Friendly AI PDF Artificial General Intelligence 4th International Conference AGI 2011 Mountain View CA USA August 3 6 2011 Berlin Springer See also editAllen Institute for Artificial Intelligence Future of Humanity Institute Institute for Ethics and Emerging TechnologiesReferences edit a b MIRI Artificial Intelligence The Danger of Good Intentions Future of Life Institute Future of Life Institute 11 October 2015 Archived from the original on 28 August 2018 Retrieved 28 August 2018 a b Khatchadourian Raffi The Doomsday Invention The New Yorker Archived from the original on 2019 04 29 Retrieved 2018 08 28 a b c Waters Richard 31 October 2014 Artificial intelligence machine v man Financial Times Archived from the original on 27 August 2018 Retrieved 27 August 2018 Abate Tom 2006 Smarter than thou San Francisco Chronicle Archived from the original on 11 February 2011 Retrieved 12 October 2015 Abate Tom 2007 Public meeting will re examine future of artificial intelligence San Francisco Chronicle Archived from the original on 14 January 2016 Retrieved 12 October 2015 Kaste Martin January 11 2011 The Singularity Humanity s Last Invention All Things Considered NPR Archived from the original on August 28 2018 Retrieved August 28 2018 Press release Singularity University Acquires the Singularity Summitt Singularity University 9 December 2012 Archived from the original on 27 April 2019 Retrieved 28 August 2018 Press release We are now the Machine Intelligence Research Institute MIRI Machine Intelligence Research Institute Machine Intelligence Research Institute 30 January 2013 Archived from the original on 23 September 2018 Retrieved 28 August 2018 Tegmark Max 2017 Life 3 0 Being Human in the Age of Artificial Intelligence United States Knopf ISBN 978 1 101 94659 6 Machine Intelligence Research Institute General Support 2019 Open Philanthropy Project 2019 03 29 Archived from the original on 2019 10 08 Retrieved 2019 10 08 Machine Intelligence Research Institute General Support 2020 Open Philanthropy Project 10 March 2020 Archived from the original on April 13 2020 Bensinger Rob April 27 2020 MIRI s largest grant to date MIRI Archived from the original on April 27 2020 Retrieved April 27 2020 Maheshwari Suyash 2021 05 13 Ethereum creator Vitalik Buterin donates 1 5 billion in cryptocurrency to India COVID Relief Fund amp other charities MSN Archived from the original on 2021 08 24 Retrieved 2023 01 23 a b LaFrance Adrienne 2015 Building Robots With Better Morals Than Humans The Atlantic Archived from the original on 19 August 2015 Retrieved 12 October 2015 Russell Stuart Norvig Peter 2009 Artificial Intelligence A Modern Approach Prentice Hall ISBN 978 0 13 604259 4 Sathian Sanjena 4 January 2016 The Most Important Philosophers of Our Time Reside in Silicon Valley OZY Archived from the original on 29 July 2018 Retrieved 28 July 2018 Hsu Jeremy 2015 Making Sure AI s Rapid Rise Is No Surprise Discover Archived from the original on 12 October 2015 Retrieved 12 October 2015 AI and Effective Altruism Machine Intelligence Research Institute 2015 08 28 Archived from the original on 2019 10 08 Retrieved 2019 10 08 Further reading editRussell Stuart Dewey Daniel Tegmark Max Winter 2015 Research Priorities for Robust and Beneficial Artificial Intelligence AI Magazine 36 4 6 arXiv 1602 03506 Bibcode 2016arXiv160203506R doi 10 1609 aimag v36i4 2577 External links editOfficial website Retrieved from https en wikipedia org w index php title Machine Intelligence Research Institute amp oldid 1191056962, wikipedia, wiki, book, books, library,
