people

The Last Contrarian: Gary Marcus and the Unsolved Problems of AI

Yong Xu

— 14 min read

Prologue: The Hype and the Skeptic's Voice

In a time of unprecedented technological fervor, where the promise of artificial intelligence dominates headlines and fuels a speculative frenzy, a singular voice of skepticism cuts through the noise. This is the era of "exponential progress" and "transformative potential," a moment defined by breathless predictions of a new technological epoch.1 Yet, amidst this chorus of techno-optimism, Gary Marcus has emerged as a persistent and influential "contrarian".2 His career, spanning decades at the intersection of psychology, neuroscience, and computer science, can be framed as an ongoing challenge to the linear narrative of AI's relentless march toward human-level intelligence.

This report will explore Marcus's work not as a simple critique of current AI systems, but as a fundamental philosophical objection to the paradigm that underpins them. The central argument is that Marcus's long-standing advocacy for a hybrid, neuro-symbolic approach to AI is a direct result of his lifelong study of human cognition and language.7 His position, which once felt isolated, now appears prescient, anticipating the very limitations that are becoming impossible to ignore. His critique goes beyond the technical, encompassing a profound concern about what he terms the "weaponization of hype" by big tech companies 1, which he believes has created a societal "gullibility gap" where people are prone to overestimate AI's abilities.11 This creates a compelling narrative conflict between an intellectual voice of caution and the immense financial and media power of an entire industry. The core of his public identity is that of a voice of reason in a field driven by marketing and speculation, and this report will trace how that identity has made him both a respected public intellectual and a lightning rod for criticism. The juxtaposition of his technical arguments with his warnings about societal harm demonstrates that his concerns are not abstract; they are deeply practical and ethical. This is the essential story of a man who believes that to build machines we can trust, we must first confront the hard, unsolved problems of intelligence.

Part 1: The Foundations of a Different Mind

Chapter 1: An Algebraic Origin Story

The seeds of Marcus's unique perspective were planted early. As a ten-year-old, he developed an early fascination with artificial intelligence, learning to program on a paper-based simulation of a computer. He explained its workings to the media, an early indication of his dual role as a researcher and a public commentator.12 This early passion guided his academic career. He majored in cognitive science at Hampshire College before pursuing graduate studies at the Massachusetts Institute of Technology (MIT).12 At MIT, he was mentored by the renowned psychologist and linguist Steven Pinker, under whose guidance he conducted formative research on the nature of mental rules.12

Marcus's doctoral work focused on a seemingly simple but profoundly telling phenomenon in child language acquisition: "over-regularizations".12 This is the tendency for children to incorrectly apply grammatical rules to irregular words, producing phrases like "breaked" and "goed" instead of "broke" and "went." This behavior reveals something fundamental about the developing mind: it is not merely memorizing patterns, but actively inducing and applying abstract, algebraic rules. This work laid the foundation for his first book,

The Algebraic Mind: Integrating Connectionism and Cognitive Science, published in 2001.5 In it, he challenged the idea that the mind consists of largely undifferentiated neural networks, arguing instead that understanding intelligence requires combining the data-driven approach of connectionism with the classical, rule-based ideas of symbol-manipulation.12 The essence of his AI critique is thus not new; it is a direct extension of his decades-old work in cognitive science. His focus on "over-regularizations" serves as a microcosm of his broader argument about artificial intelligence: that true intelligence requires both data-driven pattern recognition and rule-based, symbolic manipulation.

This intellectual consistency is further demonstrated in his later work. His book The Birth of the Mind positions him as a psychological nativist, a school of thought that holds that the brain relies on a great deal of innate, domain-specific machinery.12 The book describes how a tiny number of genes can influence cognitive development, aiming to reconcile the nativist perspective with arguments from other academics. The long-held belief in the importance of structured, innate knowledge has remained a constant thread throughout his career, from his early studies of human language to his later critiques of AI.

Part 2: The Battle of Paradigms

Chapter 2: The Contrarian Entrepreneur

Marcus’s career trajectory is unique in that he has consistently sought to validate his academic theories in the high-stakes world of business and entrepreneurship. Transitioning from his role as a psychology and neural science professor at New York University, Marcus founded his first machine learning startup, Geometric Intelligence, in 2014.5 The company was acquired by Uber in 2016, and Marcus went on to launch Uber's AI lab as its director, demonstrating his influence within the tech industry.18

A point of factual clarification is necessary here. The company Marcus founded was named Geometric Intelligence, not Geometric AI.5 Separate companies and research labs, such as Geometric AI, LLC and the Geometric Intelligence Lab at UC Santa Barbara, now use a similar name to describe the subfield of geometric deep learning.21 While distinct, the technical focus of this subfield—on understanding relationships in non-Euclidean data rather than just pixels or tokens 24—is thematically aligned with Marcus’s call for systems that can handle symbolic relationships and reasoning. The decision to launch his own companies was a direct consequence of his dissatisfaction with the dominant deep-learning approach; he did not simply write and debate his ideas, but actively attempted to prove them commercially and scientifically.26

In 2019, Marcus continued this entrepreneurial path by co-founding his second startup, Robust.AI, with Rodney Brooks, the co-founder of iRobot.5 The company's mission is to build an "off-the-shelf" machine learning platform for autonomous robots, aiming to create the reliable, trustworthy AI that he believes is still lacking in the field.12

Chapter 3: The Deep Learning Dilemma

At the core of Marcus's public profile lies his systematic and unflinching critique of contemporary AI, particularly large language models (LLMs) and deep learning. His central argument is that these systems, while impressive in their ability to recognize patterns and generate plausible text, lack genuine understanding.7 He contends that because they operate on a statistical level, they are prone to "boneheaded mistakes" that expose a fundamental lack of a "world model"—a persistent, stable, and updatable internal representation of how the world works.3

To illustrate these points, Marcus frequently cites concrete and vivid examples of AI failures. He recalls a Tesla in "Full Self Driving Mode" that failed to recognize a person holding a stop sign in the middle of a road because the object was out of its usual context.30 He also points to a system that mislabeled an apple as an iPod simply because a piece of paper with the word "iPod" was placed in front of it.30 These failures are not isolated bugs, but are carefully selected case studies that expose a critical flaw in current systems: they are adept at interpolation (working on data similar to their training set) but fail catastrophically at extrapolation (handling outliers and novel contexts).3

A central pillar of his critique is the problem of "hallucinations"—the tendency of generative models to confidently fabricate false information.12 For Marcus, this is not a minor bug to be "ironed out" with more data, but a feature of the underlying architecture. He has famously stated that "the only way you can kill hallucinations is to not run the system".27 This is because the same mechanism that generates a correct statement also generates a false one; there is no separate module for truth.

To highlight what he believes is a critical unsolved problem, Marcus has proposed the "comprehension challenge".3 In this benchmark, an AI system would be tasked with watching a movie, building a cognitive model of what is happening, and answering questions about character motivations, plot themes, or even why a certain line is funny.3 He argues that while LLMs might get a few things "sort of right," they are nowhere near as reliable as an average person, who can easily understand the subtle, structured changes that occur in a narrative. The technical limitations he identifies—the inability to build a reliable world model and the lack of abstract reasoning—are directly linked to the societal and ethical risks he warns about, such as misinformation, bias, and discrimination.12 The following table summarizes some of Marcus's core critiques with specific examples.

Critique

Problematic Behavior/Failure

Concrete Example

Lack of Abstract Meaning & World Models

Models cannot truly grasp abstract principles and concepts.

Mislabeling an apple as an iPod; failures in logical river-crossing problems.3

Inability to Follow Instructions Reliably

Models fail to follow instructions that require abstract principles, such as "don't lie" or "don't use copyrighted materials."

Generating text that uses copyrighted content or produces factual errors despite being instructed not to.3

Hallucinations

Models confidently generate factually incorrect or nonsensical information.

Producing "bullshit" or fabricating details that do not exist in the real world.17

Perpetuating Stereotypes

When trained on real-world data, models amplify existing biases instead of following ethical principles.

Perpetuating past stereotypes, unable to follow the principle, "Don't discriminate on the basis of race or sex".3

Failure to Extrapolate

Models fail when exposed to situations far from their training data, or to "outliers."

A Tesla failing to recognize a person holding a stop sign in the middle of a road.30

Chapter 4: The Neuro-Symbolic Synthesis

Marcus's narrative is not one of mere criticism, but of a proposed path forward. His solution to the fundamental flaws of deep learning is a return to what he calls "neuro-symbolic AI".7 This hybrid approach combines the pattern recognition power of neural networks—the intuitive, statistical "System 1" thinking described by Daniel Kahneman—with the structured, rule-based reasoning of symbolic systems, or "System 2" thinking.3 He argues that a truly robust AI cannot exist without this synthesis.

He has long argued that this integration is necessary to build rich cognitive models, stating that to build a robust, knowledge-driven approach to AI, we must have the machinery of symbol manipulation.9 A significant development in the field is the growing consensus that this is indeed the path forward. Major players like OpenAI, with its use of plugins for factual reasoning, and Google DeepMind, with its use of symbolic proof solvers, are now adopting hybrid strategies.33 This shift in the AI community represents a powerful vindication of Marcus's long-held beliefs, as he himself has noted.26 The debate has largely evolved from a fundamental disagreement about whether we need hybrid systems to a discussion about how to best integrate them.9 This indicates that the core ideological divide in the field is slowly closing, a powerful indicator of Marcus's long-term influence on the direction of AI research.

The following table provides a taxonomy of neuro-symbolic architectures, illustrating the different ways this hybrid approach is being implemented.

Type of Architecture

Explanation

Concrete Example

Symbolic[Neural]

A symbolic technique invokes neural techniques.

AlphaGo, where Monte Carlo tree search (symbolic) invokes a neural network to evaluate game positions.9

Neural | Symbolic

A neural network interprets perceptual data into symbols, which are then reasoned about symbolically.

The Neural-Concept Learner.9

Neural

A neural model directly calls a symbolic reasoning engine.

ChatGPT using a plugin to query a system like Wolfram Alpha.9

Neural: Symbolic → Neural

Symbolic reasoning is used to generate or label training data for a deep learning model.

Training a neural model for symbolic computation by using a symbolic mathematics system to create labeled examples.9

NeuralSymbolic

A neural net is generated directly from symbolic rules.

The Neural Theorem Prover, which constructs a neural network from a proof tree generated from a knowledge base.9

Part 3: The Public Square and the Stakes

Chapter 5: The Great Debates and the Price of Skepticism

Gary Marcus has consistently used the public sphere as a forum for his ideas, engaging in high-profile debates that have defined key ideological divides in the field. His most notable public confrontation has been with Yann LeCun, the chief AI scientist at Meta and a pioneer of deep learning.23 The core of their disagreement echoes a long-standing "nature-nurture" debate in cognitive science. LeCun, an empiricist, argues that advanced AI will emerge primarily from general learning mechanisms, while Marcus, a nativist, insists that these systems will be limited without more innate, domain-specific machinery.23

Beyond academic forums, Marcus has also become known for his famous public wagers, which serve as real-world benchmarks for his predictions. In 2022, he challenged Elon Musk to a bet that a truly general AI would not exist by the end of 2029.37 He proposed five specific challenges, from an AI being able to watch a movie and accurately describe character motivations to working as a competent cook in an arbitrary kitchen.37 This public act highlights a deeper truth about the field: the very definition of "intelligence" is highly contested. His challenges are not just technical benchmarks; they are philosophical statements about what it means for a machine to truly "understand" and "reason."

However, his public role has not been without controversy. Marcus has faced criticism, often on social media, for what his detractors call "goalpost shifting".33 This argument suggests that as AI capabilities improve, Marcus simply moves the goalposts for what constitutes AGI. His supporters counter that this is not a retreat, but a "Bayesian update" 38—an intellectual and public recalibration in the face of rapid, undeniable progress in the field.38 This conflict in the public narrative surrounding him reveals that the personal and intellectual battles in AI are deeply intertwined.

The following table provides a clear comparison of his bets, which are central to the public perception of Marcus.

Bet Feature

2022 Bet (on AGI)

New Bet (on ASI)

End Date

2029 38

2027 38

Bet Amount

$100,000 38

$2,000 38

Number of Tasks

5 38

10 38

Passing Threshold

3 of 5 tasks (60%) 38

8 of 10 tasks (80%) 38

Stated Odds

1:1 (50% confidence) 38

10:1 (9% confidence) 38

Part 4: The Legacy and the Future

Chapter 6: The Unsolved Problems and the Path Forward

Gary Marcus's enduring impact on the field of artificial intelligence is multifaceted. He has served as a consistent voice of caution and intellectual rigor, forcing the AI community to confront the limitations of its dominant, purely data-driven approach.13 His influence is not solely in his own academic or entrepreneurial work, but in the way he has framed the problems for others to solve. The growing momentum behind neuro-symbolic AI suggests that the field is, in some ways, catching up to his long-held worldview.

His role as a technical critic is inextricably linked to his position as a moral and ethical one. Marcus argues that the current "unreliable" systems, which struggle with abstraction and common sense, pose a clear and present danger in areas like cybercrime, misinformation, and discrimination.12 Consequently, his technical critiques form the basis for his strong advocacy for AI regulation.1 He believes that the current model, where corporations privatize the profits of AI while socializing the costs and risks, is untenable and dangerous for society.31

Despite his influence, Marcus is not immune to criticism. Some have argued that he is overly pessimistic about the pace of AI progress and that his views can be one-sided.33 Critics have also pointed out that he may lack direct experience with the most cutting-edge "frontier models".33 However, even his detractors often acknowledge the importance of his voice. As one commentator noted, it is essential to hear his arguments to understand the level of sophistication of leading critiques against the AI hype.33 His work provides a necessary counterpoint to the prevailing techno-optimism, creating a more balanced and critical discourse.4

In the final analysis, Gary Marcus's story is that of a scientist who, guided by his foundational research in cognitive psychology, has consistently stood against a powerful technological tide. His enduring message is that the path to true intelligence requires a more patient, robust, and interdisciplinary approach—one that prioritizes understanding, reasoning, and trust over raw statistical power.

Works cited

  1. Debating AI's Future: Gary Marcus Challenges the Hype | TWiT.TV, accessed September 8, 2025, https://twit.tv/posts/tech/debating-ais-future-gary-marcus-challenges-hype
  2. Gary Marcus | Speaker - TED Talks, accessed September 8, 2025, https://www.ted.com/speakers/gary_marcus
  3. 'Not on the Best Path' – Communications of the ACM, accessed September 8, 2025, https://cacm.acm.org/opinion/not-on-the-best-path/
  4. Is AI just all hype? w/ Gary Marcus - YouTube, accessed September 8, 2025, https://www.youtube.com/watch?v=8Sh3og8p-u4
  5. Dr. Gary Marcus, accessed September 8, 2025, http://garymarcus.com/index.html
  6. Gary Marcus - ITU, accessed September 8, 2025, https://www.itu.int/en/ITU-T/AI/Pages/marcus.aspx
  7. Gary Marcus on AI and ChatGPT - Lux Capital, accessed September 8, 2025, https://www.luxcapital.com/content/gary-marcus-ai-and-chatgpt
  8. In defense of skepticism about deep learning | by Gary Marcus - Medium, accessed September 8, 2025, https://medium.com/@GaryMarcus/in-defense-of-skepticism-about-deep-learning-6e8bfd5ae0f1
  9. Neuro-symbolic AI - Wikipedia, accessed September 8, 2025, https://en.wikipedia.org/wiki/Neuro-symbolic_AI
  10. The Rise of Neuro-Symbolic AI for Smarter Systems - CloudThat, accessed September 8, 2025, https://www.cloudthat.com/resources/blog/the-rise-of-neuro-symbolic-ai-for-smarter-systems
  11. 487. Challenging AI's Capabilities with Gary Marcus - YouTube, accessed September 8, 2025, https://www.youtube.com/watch?v=QjCvL0KFWWY
  12. Gary Marcus - Wikipedia, accessed September 8, 2025, https://en.wikipedia.org/wiki/Gary_Marcus
  13. Interview: Cognitive Scientist Gary Marcus' Lifelong Disillusionment with A.I. - Observer, accessed September 8, 2025, https://observer.com/2025/05/gary-marcus-disillusionment-ai/
  14. en.wikipedia.org, accessed September 8, 2025, https://en.wikipedia.org/wiki/Gary_Marcus#:~:text=Marcus%20majored%20in%20cognitive%20science,children's%20acquisition%20of%20grammatical%20morphology.
  15. Gary Marcus 86F | Hampshire College, accessed September 8, 2025, https://www.hampshire.edu/notable-alumni/gary-marcus-86f
  16. garymarcus.com, accessed September 8, 2025, http://garymarcus.com/bio/bio.html
  17. Rebooting AI Summary, PDF, EPUD, Audio - BeFreed, accessed September 8, 2025, https://www.befreed.ai/book/rebooting-ai-by-gary-marcus
  18. Gary Marcus - AI Elections Initiative, accessed September 8, 2025, https://aielections.aspendigital.org/person/gary-marcus/
  19. Hire Gary Marcus | AI Speaker Agent, accessed September 8, 2025, https://ai-speakers-agency.com/speaker/gary-marcus
  20. NYU's Gary Marcus is an Artificial Intelligence Contrarian, accessed September 8, 2025, https://engineering.nyu.edu/news/nyus-gary-marcus-artificial-intelligence-contrarian
  21. Geometric AI | deep learning for remote sensing | Fairfax, VA, USA, accessed September 8, 2025, https://www.geometric-ai.com/
  22. The Geometric Intelligence Lab @ UC Santa Barbara | Geometric Intelligence Lab, accessed September 8, 2025, https://gi.ece.ucsb.edu/
  23. What does Yann LeCun think of Gary Marcus's critical appraisal of deep learning? - Quora, accessed September 8, 2025, https://www.quora.com/What-does-Yann-LeCun-think-of-Gary-Marcuss-critical-appraisal-of-deep-learning
  24. Geometric Deep Learning: AI Beyond Text & Images | Exxact Blog, accessed September 8, 2025, https://www.exxactcorp.com/blog/deep-learning/geometric-deep-learning-ai-beyond-text-images
  25. Geometric Deep Learning: Benefits, Future & Use Cases - Northwest Executive Education, accessed September 8, 2025, https://northwest.education/insights/machine-learning/geometric-deep-learning-introduction-benefits-and-the-future/
  26. What if Gary Marcus is Right? - Medium, accessed September 8, 2025, https://medium.com/@aliborji/what-if-gary-marcus-is-right-06bb6b389377
  27. Episode 487: Gary Marcus - unSILOed Podcast with Greg LaBlanc, accessed September 8, 2025, https://www.unsiloedpodcast.com/episodes/gary-marcus
  28. What Kind of AI World Do We Want? - YouTube, accessed September 8, 2025, https://www.youtube.com/watch?v=lZ_plAZuVvo
  29. Generative AI's crippling and widespread failure to induce robust models of the world, accessed September 8, 2025, https://garymarcus.substack.com/p/generative-ais-crippling-and-widespread
  30. Deep Learning Is Hitting a Wall - Nautilus, accessed September 8, 2025, https://nautil.us/deep-learning-is-hitting-a-wall-238440/
  31. Taming Silicon Valley - Gary Marcus, accessed September 8, 2025, https://www.victorhg.com/en/post/taming-silicon-valley-gary-marcus
  32. Unlocking the Potential of Generative AI through Neuro-Symbolic Architectures – Benefits and Limitations - arXiv, accessed September 8, 2025, https://arxiv.org/html/2502.11269v1
  33. What do you all think of Gary Marcus?: He's been calling BS on LLMs from the start but thinks other systems will reach AGI : r/BetterOffline - Reddit, accessed September 8, 2025, https://www.reddit.com/r/BetterOffline/comments/1mg1y4m/what_do_you_all_think_of_gary_marcus_hes_been/
  34. Open letter responding to Yann LeCun - Marcus on AI - Substack, accessed September 8, 2025, https://garymarcus.substack.com/p/open-letter-responding-to-yann-lecun/comments
  35. Articles by Gary Marcus's Profile | Freelance Journalist - Muck Rack, accessed September 8, 2025, https://muckrack.com/gary-marcus/articles
  36. Debate: Does Artificial Intelligence Need More Innate Machinery?, accessed September 8, 2025, https://as.nyu.edu/departments/philosophy/events/fall-2017/debate--does-artificial-intelligence-need-more-innate-machinery-.html
  37. Will AI Prove Gary Marcus Wrong by 2030? - Metaculus, accessed September 8, 2025, https://www.metaculus.com/questions/11199/gary-marcus-agi-bet-2030/
  38. In 2022 Gary Marcus was 50% sure that AGI wouldn't happen by ..., accessed September 8, 2025, https://www.reddit.com/r/LocalLLaMA/comments/1hprsyv/in_2022_gary_marcus_was_50_sure_that_agi_wouldnt/
  39. Sama calls out Gary Marcus, "Can't tell if he's a troll or extremely intellectually dishonest" : r/singularity - Reddit, accessed September 8, 2025, https://www.reddit.com/r/singularity/comments/1l8ercu/sama_calls_out_gary_marcus_cant_tell_if_hes_a/
  40. Gary Marcus: Taming Big Tech and AI - Commonwealth Club, accessed September 8, 2025, https://www.commonwealthclub.org/events/2024-09-23/gary-marcus-taming-big-tech-and-ai
  41. AI's Leading Critic: Gary Marcus on the Risks, Myths, and Failures of AI - YouTube, accessed September 8, 2025, https://www.youtube.com/watch?v=znC-pzRTy1M

Read more