The efficient coding principle

To understand by first principles the brain's first stages of visual signal processing as manifested neurally and psychologically, based largely on chapter 3 of the textbook "Understanding vision: theory, models, and data"

Enroll for free

Course curriculum

1. Lesson 1: motivation and overview (4:11 minutes)
2. quiz for Lesson 1: motivation and overview
1. Lesson 2: Information theory: bits and entropy (3:12)
2. quiz for Lesson 2: Information theory: bits and entropy
3. Lesson 3: Information theory: entropy, uncertainty, and surprise (6:19)
4. quiz for Lesson 3: Information theory: entropy, uncertainty, and surprise
5. Lesson 4: information theory: information channel and transmission (4:29)
6. quiz for Lesson 4: information theory: information channel and transmission
7. Lesson 5: Information theory: mutual information (4:32)
8. quiz for Lesson 5: Information theory: mutual information
9. Lesson 6: entropy and mutual information in gaussian random variables (6:58)
10. quiz for Lesson 6: entropy and mutual information in gaussian random variables
11. Lesson 7: information theory: information redundancy (7:39)
12. quiz for Lesson 7: information theory: information redundancy
13. Lesson 8: information theory: redundancy, efficiency, and error correction (2:48)
14. survey at the end of chapter "Information theory: a very brief introduction"
1. Lesson 9: formulation of the efficient coding principle (7:03)
2. quiz for Lesson 9: formulation of the efficient coding principle
3. Lesson 10: zero noise limit --- maximum entropy code, decorrelation, and redundancy redunction (7:10)
4. quiz for Lesson 10: zero noise limit --- maximum entropy code, decorrelation, and redundancy redunction
5. Lesson 11: high noise limit --- preserve input redundancy while smoothing out noise (4:13)
6. quiz for Lesson 11: high noise limit --- preserve input redundancy while smoothing out noise
7. Lesson 12: comparing efficient coding strategies in low versus high noise conditions, and neural cost (2:20)
8. quiz for Lesson 12: comparing efficient coding strategies in low versus high noise conditions, and neural cost
1. Lesson 13: contrast sampling in fly's compound eye (6:13)
2. quiz for Lesson 13: contrast sampling in fly's compound eye
3. Lesson 14: retinal cone density across eccentricities (5:42)
4. quiz for Lesson 14: retinal cone density across eccentricities
5. Lesson 15: spectrum sensitivity functions of the cones (3:21)
6. quiz for Lesson 15: spectrum sensitivity functions of the cones
1. Lession 16: understanding receptive fields, formulation and notations (4:05)
2. quiz for Lession 16: understanding receptive fields, formulation and notations
3. Lesson 17: understanding receptive fields: gaussian approximations (3:21)
4. quiz for Lesson 17: understanding receptive fields: gaussian approximations
5. Lesson 18: understanding receptive fields: neural cost and object function (5:50)
6. quiz for Lesson 18: understanding receptive fields: neural cost and object function
7. Lesson 19: understanding receptive fields: three conceptual parts in the solution (4:58)
8. Lesson 19b: a more complex version of Lesson 19, --- understanding receptive fields: three conceptual parts in the solution (5:38)
9. quiz for Lesson 19: understanding receptive fields: three conceptual parts in the solution
10. Lesson 20: principal components and gain control (6:37)
11. quiz for Lesson 20: principal components and gain control
12. Lesson 21: Conceptual versus implementation steps in the efficient receptive field transform (2:06)
13. quiz for Lesson 21: Conceptual versus implementation steps in the efficient receptive field transform
1. ocularity coding: a gist (5:52)
2. quiz for ocularity coding: a gist
3. ocularity coding: (1) decorrelation (4:46)
4. quiz for ocularity coding: (1) decorrelation
5. ocularity coding: (1) decorrelation, continued (5:08)
6. quiz for ocularity coding: (1) decorrelation, continued
7. ocularity coding: (2) gain control (4:18)
8. quiz for ocularity coding: (2) gain control
9. ocularity coding: (2) gain control, continued (8:34)
10. quiz for ocularity coding: (2) gain control, continued
11. ocularity coding: (3) Multiplexing (10:50)
12. quiz for ocular coding (3), Multiplexing
13. ocularity coding: adaptation (13:23)
14. quiz for ocularity coding: adaptation
15. ocularity coding: experimental tests (10:33 minutes)
16. quiz for ocularity coding: experimental tests
1. Efficient coding: retinal (space, time, color) coding, a gist (7:47 minutes)
2. quiz for Efficient coding: retinal (space, time, color) coding, a gist
3. Efficient coding: retinal spatial coding -1: introduction and decorrelation -1. (7:25 minutes)
4. quiz for Efficient coding: retinal spatial coding -1: introduction and decorrelation -1
5. Efficient coding: retinal spatial coding -1: decorrelation -2 (7:05 minutes).
6. quiz for Efficient coding: retinal spatial coding -1: decorrelation -2
7. Efficient coding: retinal spatial coding-2, gain control (4:55 minutes).
8. quiz for Efficient coding: retinal spatial coding-2, gain control
9. Efficient coding: retinal spatial coding-3, multiplexing (7 minutes).
10. quiz for Efficient coding: retinal spatial coding-3, multiplexing
11. Efficient coding: retinal spatial coding: output correlation and adaptation (7:38 minutes).
12. quiz for Efficient coding: retinal spatial coding: output correlation and adaptation
13. Efficient coding: temporal coding, part 1 (7:47 minutes).
14. quiz for Efficient coding: temporal coding, part 1
15. Efficient coding: temporal coding, part 2 (6:46 minutes).
16. quiz for Efficient coding: temporal coding, part 2
17. Efficient coding: color coding, part 1, decorrelation (11:19 minutes)
18. quiz for Efficient coding: color coding, part 1, decorrelation
19. Efficient coding: color coding, part 2, gain control and adaptation (5:40 minutes)
20. quiz for Efficient coding: color coding, part 2, gain control and adaptation
21. Efficient coding: coupling color coding and spatial coding on retina (8:03 minutes)
22. quiz for Efficient coding: coupling color coding and spatial coding on retina
23. Efficient coding: coupling color coding and spatial coding on retina --- mathematical details (2:13 minutes)
1. Efficient coding: Spatial coding in V1, part 1 (10:13 minutes)
2. quiz for Efficient coding: Spatial coding in V1, part 1
3. Efficient coding: Spatial coding in V1, part 2 (14:09 minutes)
4. quiz for Efficient coding: Spatial coding in V1, part 2
5. Efficient coding, 28: V1 neurons tuned simultaneously to multiple feature dimensions (13:37 minutes)
6. quiz for Efficient coding, 28: V1 neurons tuned simultaneously to multiple feature dimensions
7. Guide to supplementary/advanced materials for understanding V1 coding
1. Efficient coding: other formulations, e.g., sparse coding, maximum entropy coding, etc . (8:33 minutes)
2. quiz for Efficient coding: other formulations, e.g., sparse coding, maximum entropy coding, etc
3. Efficient coding: unsupervised learning for efficient coding (12:23 minutes)
4. Problems with understanding V1 by efficient coding principles (15:20 minutes)
5. survey for "Problems with understanding V1 by efficient coding principles"
1. Efficient coding: coupling space and color in V1, part 1 (15:36 minutes).
2. quiz for Efficient coding: coupling space and color in V1, part 1
3. Efficient coding: coupling space and color in V1, part 2, adaptation and a diversity of preferred colors in neurons (14:59 minutes).
4. quiz for Efficient coding: coupling space and color in V1, part 2
5. Efficient coding: coupling space and ocular dimensions (stereo coding) in V1, part 1 (12:38 minutes).
6. quiz for Efficient coding: coupling space and ocular dimensions (stereo coding) in V1, part 1
7. Efficient coding: coupling space and ocular dimensions (stereo coding) in V1, part 2 (7:36 minutes).
8. quiz for Efficient coding: coupling space and ocular dimensions (stereo coding) in V1, part 2
9. Efficient coding: coupling space and ocular dimensions (stereo coding) in V1, part 3 (14:17 minutes).
10. quiz for Efficient coding: coupling space and ocular dimensions (stereo coding) in V1, part 3
11. Efficient coding: coupling spatial and temporal coding in retina and V1, part 1 (6:30 miniutes).
12. quiz for Efficient coding: coupling spatial and temporal coding in retina and V1, part 1
13. Efficient coding: coupling spatial and temporal coding in retina and V1, part 2 (12:53 miniutes).
14. quiz for Efficient coding: coupling spatial and temporal coding in retina and V1, part 2
1. Information bits, correlations, redundancy, principal components, and efficient stereo coding. This is a copy of another lesson in course "A very brief introduction to simple mathematical methods for computational vision"
2. Exercise for efficient spatial coding

About this course

Free
110 lessons
7 hours of video content

Discover your potential, starting today

Enroll today

Zhaoping Courses

The efficient coding principle

Course curriculum

Motivation and overview (4:08 minutes video)

Information theory: a very brief introduction (about 37 minutes of video)

Formulation of the efficient coding principle (about 21 minutes of video)

Application on input sampling in contrast, color, and space (about 15 minutes of video)

Formulation and solution of efficient coding by linear neural receptive fields (about 27 minutes of video)

Case study: efficient coding for stereo vision (about 64 minutes of video)

Efficient coding by the receptive fields of the retinal ganglion cells (about 1.5 hours of video)

Coding in V1, the primary visual cortex (about 38 minutes of video)

Other formulations, limitations, and unsupervised learning of the efficient codes (about 33 minutes of video)

Supplementary/Advanced : understanding V1 encoding of color, motion, and binocular disparity, assuming gabor spatial filters (about 1.5 hours of video)

Exercises for consolidate learning

About this course

Discover your potential, starting today