Overview
Syllabus
Intro
Outline
Origins of the cognitive map
What exactly is the cognitive map?
Path integration (dead reckoning)
Problems with the classical definition
From navigation to reinforcement learning
Sequential decision problems
Evidence for two learning systems
Cognitive map = model-based RL?
Cognitive map = predictive code?
Representing the environment
Encode Euclidean distance
Encode predictive statistics
Successor Representation
Asymmetric direction selectivity
Constraint by barriers
Context preexposure facilitation
Entorhinal grid cells
Grid cells via eigendecomposition
Dorsal-ventral axis
Eigenvector Grid Fields
Compartmentalization
Relationship between grid cells and place cells
Grid cells as a regularization network
Supporting evidence
Spatial structure is useful
Hierarchical reinforcement learning
Task design
Model predictions
How is the SR learned?
Evidence for population coding
Taught by
MITCBMM