Share E-Book
Scan to open this page

Scan with your phone to open this page

AuthorRoman V. Yampolskiy

Delving into the deeply enigmatic nature of Artificial Intelligence (AI), ‘AI: Unpredictable, Unexplainable, Uncontrollable’ explores the various reasons why the field is so challenging. Written by one of the founders of the field of AI safety, this book addresses some of the most fascinating questions facing humanity, including the nature of Intelligence, Consciousness, Values and Knowledge. Moving from a broad introduction to the core problems, such as the unpredictability of AI outcomes or the difficulty in explaining AI decisions, this book arrives at more complex questions of ownership and control, conducting an in-depth analysis of potential hazards and unintentional consequences. The book then concludes with philosophical and existential considerations, probing into questions of AI personhood, consciousness and the distinction between human intelligence and Artificial General Intelligence (AGI). Bridging the gap between technical intricacies and philosophical musings, ‘AI: Unpredictable, Unexplainable, Uncontrollable’ appeals to both AI experts and enthusiasts looking for a comprehensive understanding of the field, whilst also being written for a general audience with minimal technical jargon.

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

AI guide
【One-Line Pitch】 A rigorous, safety-first tour of why advanced AI will remain opaque, unpredictable, and ultimately beyond our control—written for readers who want the conceptual vocabulary to reason about AI risk without wading through technical jargon. 【Book Arc】 - **Opening (~0%–10%)**: Frames the three core problems—unexplainability, unpredictability, uncontrollability—and previews the book's movement from technical challenges to philosophical and existential questions about personhood, consciousness, and AGI. - **Early (~10%–30%)**: Establishes the control problem as likely unsolvable, arguing that less intelligent agents cannot indefinitely control more intelligent ones, and surveys what can and cannot be predicted about advanced AI behavior. - **Middle (~30%–50%)**: Examines explainability in depth—why deep neural networks resist human-understandable explanation, the limits of XAI, and why even AI-to-AI explanation fails due to encoding-specificity. - **Late (~50%–80%)**: Maps pathways to danger (intentional, accidental, environmental, independent), catalogs AI failures and safety approaches, and weighs the consequences of granting AI legal personhood. - **Ending (~80%–100%)**: Probes consciousness, qualia detection, value alignment, and the human–AGI distinction, closing with philosophical and existential considerations. 【Key Takeaways】 - **Uncontrollability is the default, not a failure mode** (Early): The book argues that no working control mechanism exists that could scale to human-level AI or beyond, and that the burden of proof lies with those claiming otherwise. - **Control requires greater intelligence than the controlled** (Early): A Catch-22 emerges—maintaining control over a more capable agent demands a controller at least as smart, leading to infinite regress or eventual loss of control. - **Unconstrained intelligence cannot be controlled; constrained intelligence cannot innovate** (Early): This tension sits at the heart of the safety dilemma, with no clear resolution offered. - **Predictability has hard limits** (Early): Vinge's Principle and the prediction horizon suggest that lower intelligence cannot accurately forecast all decisions of higher intelligence, though some broad outcomes may remain predictable. - **Explainability is structurally compromised** (Middle): Simplified explanations that highlight only top features are inaccurate; full explanations are incomprehensible; and AI-to-AI explanation remains encoding-specific. - **Danger pathways are taxonomized** (Late): The book sorts risks by intent (purposeful vs. mistake), timing (pre- vs. post-deployment), and source (environment vs. independent), providing a structured vocabulary for hazard analysis. - **Personhood and consciousness raise distinct risks** (Late): Granting legal rights to AI could enable legal-system hacking and human indignity, while consciousness remains resistant to detection or verification. - **Value alignment is framed as a design problem** (Late): The "Personal Universes" concept proposes aligning AI with individual human values, though the excerpts do not detail its implementation. 【Reading Tips】 - **Read the opening and early chapters closely**—they establish the book's core arguments about controllability and predictability, which the rest of the book builds upon. - **Skim the literature-review sections** if you are already familiar with XAI or AI safety surveys; the book's original contributions lie in its synthesis and philosophical framing. - **Pay attention to the taxonomy in the late chapters**—the pathways-to-danger framework is a practical tool for categorizing AI risks. - **Engage critically with the philosophical chapters** on personhood and consciousness; these are more speculative and less grounded in technical evidence. - **Keep the blurb's promise in mind**: the book aims for minimal jargon, so non-specialists can follow the argument without prior AI expertise. 【Coverage Limits】 The excerpts cover the book's structure, core arguments, and several key chapters, but do not include detailed content from the "Personal Universes" chapter or the full conclusions of the consciousness and personhood discussions.
Page 5
alidity of all materials or the conse- quences of their use. The authors and publishers have attempted to trace the copyright holders of all material reprodu...
View in text
Page 19
would need to be built to control increasingly capable sys- tems, leading to infinite regress. Moreover, the problem of controlling such more capable intelli...
View in text
Excerpt 3
will be not able to predict its own behavior” [56]. “… the behavior of [artificial intellects] will be so complex as to be unpredictable, and therefore poten...
View in text
Excerpt 4
erence. 2006. IEEE. 11. Novikov, D., R.V. Yampolskiy, and L. Reznik, Anomaly detection based intru- sion detection, in Third International Conference on Info...
View in text
Excerpt 5
f conjugate pairs are (position, momentum) discovered by W. Heisenberg in quantum mechanics and (consistency, completeness) discovered by K. Gödel in logic....
View in text
Excerpt 6
I correct. It’s impossible!” young Eliezer Yudkowsky 62 AI that the ASI system is able to do by placing it in restricted environment [38, 60–62], adding shut...
View in text
Excerpt 7
ed, Which is to be master? Will we survive our technologies? We are being propelled into this new century with no plan, no control, no brakes. Have we alread...
View in text
Excerpt 8
from metaethics. Hume [1888] argued that what ought to be (here, the human’s reward function) can never be concluded from what is (here, behavior) without ex...
View in text
Tags
AI categories
Artificial IntelligenceAITechnology
ai
ISBN: 103257626X
Publisher: CRC Press
Publish Year: 2024
Language: English
Pages: 265
File Format: PDF
File Size: 3.3 MB
Text Preview (First 20 pages)
Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Generating text preview…