Machine Learning
March 8, 2023

2.2 When Gradient Is Small...

1 Optimization Fails because Critical Point

image-20230311185253212

image-20230310163246344

2 Warning of Math

2.1 Tayler Series Approximation

image-20230310164042772

2.2 Hessian

image-20230310164149132

image-20230310165016964

3 Don’t Afraid of Saddle Point

image-20230311184807393

Example:

image-20230311185110992

image-20230310165912748

image-20230311184948190

4 Saddle Point v.s Local Minima

image-20230311185226815

image-20230311185237511

# ML