Deep feedforward networks part 1 - University of Houston

Neural networks with many layers often have extremely steep regions resembling cliffs. These result from the multiplication of several large weights together. On the face of an extremely steep cliff structure, the gradient update step can move the parameters extremely...

Uploaded by: Murkka Svensdottir
Filesize: 7 MB