ECE 271C

Dynamic Programming

4credits
About this course

This graduate course provides a comprehensive treatment of dynamic programm ing (DP) as the fundamental framework for staged optimization problems unde r uncertainty. Core topics include the principle of optimality, Bellman equ ations, value and policy iteration, deterministic and stochastic dynamic pr ogramming, and Markov decision processes. Applications span linear-quadrati c optimal control, inventory control, asset management, hypothesis testing, the Viterbi algorithm, among others. The course concludes with modern rein forcement learning topics including Q-learning, temporal difference learnin g, and value function approximation, demonstrating how classical DP princip les form the theoretical foundation for contemporary AI algorithms.

All available terms

9 terms

Avg. GPA
3.64
Grades
94
More course details

University of California, Santa Barbara

ECE 271C at UCSB: average GPA 3.64 across 94 students. Grade distribution by term. This graduate course provides a comprehensive treatment of dynamic programm…

Average GPA: 3.64

Grade distribution records: 94 students across 9 terms.

Grade distribution

GradeStudentsPercent
A5659.6%
A-1718.1%
B+99.6%
B77.4%
B-11.1%
C11.1%
F33.2%

Based on 94 student grade records across 9 terms and 1 professor.

Instructors

Related courses

The course page is taking longer to load. This summary is still available.

We could not load the full course details. This summary is still available.

Still loading. This can take a moment on a slow connection.

Loading My Class Grades