Prerequisite for Deep learning¶

1. Logistics Regression Algorithm
2. Perceptron
3. Nerual Network
4. Activation function
5. Gradient Descent
6. forward and backward propagation
7. Regularization:
   • Logistics Regression
   • L1 Regularization
   • L2 Regularization
   • Drop out Regularization
   • Data augmentation
   • Early stoping
   • Normalizing input
   • Batch Norm
8. Bais correction
9. Exponentially weighted average
10. momentum
11. RMSProp
12. Adam
13. Learing rate Decay
14. local optimal problem