Connecting It All Together

Unit 8: Machine Learning Foundations (Capstone) — Section 8.4

You have now studied two fundamentally different philosophies of artificial intelligence. The first — symbolic AI — encodes intelligence as explicit rules, logic, and search procedures that humans write. The second — machine learning — extracts patterns directly from data. This section draws the map that connects them and shows you when to reach for each tool.

Your Journey Through AI

Over eight weeks you built a complete toolkit for artificial intelligence.

Unit Topic Core Idea

1

Foundations of AI

Four definitional lenses; history; ethics

2

Intelligent Agents

Agents perceive environments and act rationally to achieve goals

3

Search Techniques

Frame problems as state spaces; explore systematically

4

Optimization & CSPs

Search complex landscapes; enforce constraints

5

Logic & Reasoning

Represent knowledge formally; derive conclusions through inference

6

Knowledge-Based Agents

Build expert systems; forward and backward chaining

7

Probability & Bayesian Networks

Quantify uncertainty; update beliefs from evidence

8

Machine Learning

Discover patterns from labeled data rather than encoding rules

ML Uses Everything You Learned:

  • Search & Optimization (Units 3-4) → Training ML Models: Training is an optimization problem. We search the space of possible model parameters to minimize prediction error. Gradient descent — the algorithm that trains neural networks — is a form of hill climbing. Neural network backpropagation is a search through parameter space.

  • Logic & Knowledge (Units 5-6) → Decision Trees: A decision tree IS a knowledge base, automatically extracted from examples. Each leaf represents an if-then rule: "IF outlook=sunny AND humidity=high THEN don’t play." Decision trees bridge symbolic AI and machine learning.

  • Probability (Unit 7) → Most ML Algorithms: Naive Bayes (Unit 7) is a machine learning algorithm. Nearly every classifier outputs a probability: P(class | features). The Bayesian network (Unit 7) can learn its structure from data. ML is fundamentally probabilistic.

Symbolic AI vs. Machine Learning

Neither approach is universally superior. Each has genuine strengths that make it the right choice for certain problems.

Aspect Symbolic AI (Units 3-7) Machine Learning (Unit 8)

Knowledge Source

Expert-provided rules and logic

Learned from labeled data

Development Process

Program explicit rules; encode domain knowledge

Provide examples; system discovers patterns

Reasoning Style

Logical inference; search algorithms

Pattern matching; statistical methods

Interpretability

Very high — trace every decision step-by-step

Often low — "black box" neural networks

Handles Ambiguity

Struggles with noisy or uncertain data

Naturally handles noise and uncertainty

Adapts to Change

Requires manual rule updates

Retrain on new data

Data Needs

Little data; lots of domain knowledge

Lots of data; less explicit domain knowledge

Best For

Well-defined problems with known rules

Complex patterns; large training datasets
Symbolic AI

An approach to artificial intelligence that represents knowledge as explicit symbols, rules, and logical relationships. Examples include expert systems, logic-based inference, and search algorithms. Symbolic AI is interpretable and precise but struggles with noisy or ambiguous real-world data.

Connectionist AI

An approach to artificial intelligence that learns patterns through statistical models trained on data — most notably neural networks. Often called "machine learning" or "deep learning" in modern usage. Connectionist systems handle noise and complexity well but are harder to interpret.

When to Use Each Approach

Use Symbolic AI When:

  • Rules are well-defined and can be specified by experts

  • Explanations are critical — legal liability, medical consent, audit requirements

  • Little training data is available

  • Precision matters more than coverage (no ambiguous inputs)

  • Domain experts can specify the logic reliably

Examples: Chess engines, GPS route planning, tax calculation systems, theorem provers, legal document parsing.

Use Machine Learning When:

  • Patterns are too complex or too numerous for humans to write explicitly

  • Large amounts of labeled training data are available

  • Rules are unknown, unstable, or hard to specify (image recognition, speech)

  • The system needs to adapt as new data arrives

  • A "black box" is acceptable given the stakes and oversight mechanisms

Examples: Image recognition, spam filtering, speech-to-text, fraud detection, recommendation engines.

Medical Diagnosis: Which Approach?

A hospital is building two AI tools:

  1. Drug interaction checker: Should it flag dangerous combinations of medications? Pharma databases list known interactions precisely. Rules can be encoded explicitly. Every pharmacist must be able to explain why a flag was raised. → Symbolic AI is the right choice.

  2. Radiology assistant: Should it flag suspicious patterns in CT scans? Radiologists cannot fully articulate what makes a mass suspicious — they know it when they see it. Millions of labeled scans are available. → Machine Learning is the right choice.

Modern hospitals use both, sometimes in the same pipeline.

Hybrid AI: The Best of Both Worlds

The most capable AI systems today do not choose between symbolic and learning approaches — they combine them.

System How It Combines Both Approaches

AlphaGo (2016)

Deep learning for board-position evaluation (ML); Monte Carlo tree search for move planning (symbolic). Together they defeated the world Go champion.

Self-driving cars

ML for perception — detecting pedestrians, reading signs, estimating distances. Symbolic AI for planning — path finding, traffic rule compliance, safety constraints.

IBM Watson

ML for natural language understanding and evidence retrieval. Logical inference for confidence scoring and reasoning over retrieved facts.

Modern LLMs + Tools

Large language models (ML) for language understanding. Symbolic tools — calculators, code interpreters, databases — for precise reasoning tasks.

The question in modern AI is not "symbolic or learning?" but rather "how do we best combine both for this problem?" Research areas like neuro-symbolic AI, explainable AI (XAI), and knowledge-guided learning are actively exploring how to get the interpretability of symbolic methods and the flexibility of learning methods in the same system.

Key Takeaways

Symbolic AI and machine learning are complementary, not competing, paradigms. Symbolic systems are transparent and precise but brittle on messy real-world data. Machine learning handles complexity and noise but often cannot explain its decisions. The course topics connect directly: decision trees ARE symbolic rules learned from data; Naive Bayes IS ML; training IS optimization; and probability IS the language of most learning algorithms. Modern AI systems increasingly combine both approaches to capture the strengths of each.

Think about a hiring algorithm that screens job applications.

  • What would a purely symbolic hiring system look like? (What rules might it use? Who would write them?)

  • What would a purely ML-based system look like? (What would it train on? What would it optimize for?)

  • What are the fairness implications of each approach?

  • Which would you trust more, and why?

This is not a hypothetical — both types of hiring systems are in use today.

Test your ability to choose between symbolic AI and machine learning.

Next: 8.5 The Current AI Landscape →

Based on the UC Berkeley CS 188 Online Textbook by Nikhil Sharma, Josh Hug, Jacky Liang, and Henry Zhu, licensed under CC BY-SA 4.0.

This work is licensed under CC BY-SA 4.0.