Instructor: Prof. Edward Y. Chang
Course Assistant: TBA
Lectures: Mondays & Wednesdays, 4:30 โ 5:50 PM (January 4 โ March 10, 2027)
Location: TBA
Join us for an audacious aim: elevating LLMs from pattern matching to validated reasoning, grounded planning, and accountable decision making.
Contrary to the hype, AGI is not around the corner. Today's large language models are a remarkable System 1: a reflexive, associative substrate that predicts the most likely next token and, in doing so, honors the popular over the accurate. A single maximum-likelihood model cannot validate its own output, because its errors are correlated with the premises it reasons from. It cannot tell association from cause. It carries no persistent memory or transactional discipline across a long task, so a plan that fails at step forty cannot be audited, undone, or repaired. And it does not know when the world has exceeded what its context describes. Scaling makes such a model more fluent; it does not make it reason, validate, plan, or ground.
The three volumes of The Path to AGI, this course's textbooks, explain what is missing and how to build it. Volume 1 (Multi-LLM Collaborative Intelligence) shows that validated reasoning, checks and balances, and long-horizon planning with persistent transactional memory are fostered through collaboration among models rather than extracted from one. Volume 2 (System-2 Reasoning) replaces association with causal reasoning and adds the meta-cognitive questions a what-only, reward-trained model never asks: why, how, and when. Volume 3 (Beyond Intelligence) binds that intelligence to the physical and social world through active memory, grounding obligations, and the four Quadrivium disciplines of Reason, Elicit, Contract, and Bridge, and it states what has been proved, what has been demonstrated, and what remains open on the road from operational AGI toward wisdom.
Why you should take this course. Nearly every AI system built in the coming decade will sit on top of an LLM, and the engineers and researchers who matter will be those who understand exactly where the architecture fails and how to build around it. In this course you will learn to diagnose those failures at their source rather than patch them with prompts; to design multi-agent systems with validation, persistent memory, and transaction guarantees that go beyond today's agent frameworks; to ground an agent's decisions in causal structure and in the world it acts on; and to measure, rather than assume, whether a system meets a safety goal. The course is project-driven. Teams build and evaluate on the open-source MACI runtime and the MACI-Bench suite across domains such as medical diagnosis, causal discovery, physical-world grounding, planning, and disaster response, and the strongest projects are expected to become conference submissions.
Download the three textbooks and read the Preface of each volume:
Then write a short essay (two pages) answering three questions:
Your answers will be discussed in Lecture 3 on January 11 and will help shape the project topics.
Through lectures, discussions, and a quarter-long team project, students will build and evaluate multi-agent systems on the open-source MACI runtime that advance beyond current frameworks (e.g., LangGraph) to address reasoning and planning problems across domains including medical diagnosis, causal discovery, project planning, supply chain management, and natural disaster response.
Prerequisites: Completion of Machine Learning and Deep Learning courses, along with substantial experience with LLMs.
Volume 1: Multi-LLM Collaborative Intelligence (MACI) by Edward Y. Chang, ACM Books, 2024-2025. Free download with a Stanford or ACM account (through the institution's ACM Digital Library access or your ACM membership).
Volume 2: System-2 Reasoning: From Semantic Anchoring to Causal Intelligence by Edward Y. Chang, ACM Books, 2026. Free download with a Stanford or ACM account, as for Volume 1.
Volume 3: Beyond Intelligence: From Operational AGI toward Wisdom by Edward Y. Chang, Author's Archival Edition, September 2026. Publicly available on Zenodo at no cost (also in print on Amazon, ISBN 9798174093409); ACM Books edition expected February 2027.
Projects are built on the open-source MACI runtime (bring your own LLM keys) and evaluated on the MACI-Bench suite. Project ideas and benchmark domains will be presented in Lecture 2; teams form by January 13 and proposals are presented on January 20.
Additional reading materials and supplementary content can be found on SocraSynth.com.
To be announced in the first week.
Winter 2027, Mondays and Wednesdays. Chapter references are to the ACM editions of Volumes 1 and 2 and the ACM edition numbering of Volume 3; readings should be completed before the lecture.
| # | Date | Topic | Readings | Instructor | Deadlines |
|---|---|---|---|---|---|
| 1 | 1/4/2027 | Course Aims and Syllabus. Why AGI Is Far: the LLM as System 1; what the Trilogy adds (collaboration, causality, grounding); what is proved, demonstrated, and open | Vol 1, Preface; Vol 2, Preface; Vol 3, Preface and Chapter 1 | E. Chang | Assignment #1 due 1/10, 23:59 PM |
| 2 | 1/6 | Reasoning #1 From QA to Validated Reasoning: the Socratic Method, CRIT, and Why a Model Cannot Grade Itself (the correlated-error argument). Project Ideas, the MACI Runtime, and MACI-Bench | Vol 1, Chapter 5; Vol 3, Section 1.6 | E. Chang | |
| 3 | 1/11 | Reasoning #2 Pearl's Causal Hierarchy; From Association to Intervention and Counterfactuals; Causal Reasoning with LLMs. Discussion of Assignment #1 Essays | Vol 2, causal reasoning chapters (Part I) | CA | |
| 4 | 1/13 | Reasoning #3 Meta-Cognitive Judgment: Sycophancy and Skepticism (PID architecture, RAudit), Epistemic Regret Minimization (why), and Learning Before Failure (when) | Vol 2, Chapters 6, 7, and 10; ERM chapter | E. Chang | Project teams formed Assignment #2 out |
| 5 | 1/18 | Martin Luther King, Jr., Day (holiday, no class) | Project proposal due 1/18, 23:59 PM | ||
| 6 | 1/20 | Project Student Project Proposal Presentations | All | Course drop deadline 1/20 | |
| 7 | 1/25 | Collaboration #1 Multi-LLM Agent Collaborative Intelligence: SocraSynth, EVINCE and Entropy-Guided Exchange, DIKE-ERIS Checks and Balances | Vol 1, Chapter 6 and Chapter 7; Vol 3, Chapter 8 | E. Chang | |
| 8 | 1/27 | Collaboration #2 When Debate Helps and When It Hurts: Survey and Pathologies of Multi-Agent Systems; Contentiousness Scheduling; One Executive plus a Judge for Closed Questions, Debate for Open-Ended Ones | Vol 2, Chapter 8; Vol 3, Chapter 8 (Convergence section) | E. Chang | Assignment #2 due |
| 9 | 2/1 | Planning #1 Long-Horizon Planning with Transaction Guarantees: SagaLLM and ALAS (context management, validation, compensation) and Transactional Swarm Orchestration (TSO) | Vol 1, Chapter 11 and Chapter 12; Vol 2, Chapter 9 | E. Chang | |
| 10 | 2/3 | Planning #2 From Passive to Active Memory: Mnemosyne, TRACE, and the Runtime Invariants (authority separation, evidence preservation); Validating and Repairing AI-Generated Workflows | Vol 3, Part I (Chapters 2 to 7) | E. Chang | |
| 11 | 2/8 | Grounding #1 Grounded Intelligence: What Predictive World Models Leave Out; the Intelligence Sphere; Grounding Obligations and Profiles (OGP); World Under Audit, Anchoring, and Effects | Vol 3, Chapters 8 to 12 | E. Chang | |
| 12 | 2/10 | Grounding #2 Semantic Anchoring and Authority over Interpretation: Unified Contextual Control Theory (reservoir, anchors, density), Self-Anchoring Attacks and Re-Anchoring; Social and Epistemic Grounding; LEAP; Closing the Loop Safely: Risk Bounds for Physical AI | Vol 2, semantic anchoring chapters; Vol 3, Chapters 13 to 19 | CA | |
| 13 | 2/15 | Presidents' Day (holiday, no class) | |||
| 14 | 2/17 | Quadrivium #1 Reason and Elicit: Discovering Missing Causes, Confounders, and Evidence; Active Inquiry (the nurse, doctor, patient loop) and Entropy-Driven Questioning | Vol 3, Chapters 20 and 21 | E. Chang | |
| 15 | 2/22 | Project Midterm Project Presentations, Session 1 | All | Midterm report due 2/22 | |
| 16 | 2/24 | Project Midterm Project Presentations, Session 2 | All | ||
| 17 | 3/1 | Quadrivium #2 Contract and Bridge: Grounded Execution in Flood Search and Rescue; From Debate to Discovery; the Maximum Likelihood Trap and the Remaining Distance to ASI | Vol 3, Chapters 22 and 23 | E. Chang | |
| 18 | 3/3 | Wisdom Consciousness, Free Will, and Ethics in Machines; What the Trilogy Proves, Demonstrates, and Holds Open; Course Summary | Vol 1, Chapter 13; Vol 3, Chapter 24 and Epilogue | E. Chang | |
| 19 | 3/8 | Project Final Project Presentations, Session 1 | All | ||
| 20 | 3/10 | Project Final Project Presentations, Session 2 | All | Final report due 3/15 |