Feed forward Neural networks, Gradient descent and the back propagation algorithm, Unit saturation, RelU Heuristics for avoiding bad local minima, Heuristics for faster training, Nesters accelerated gradient descent, Regularization, Dropout.
Feed forward Neural networks, Gradient descent and the back propagation algorithm, Unit saturation, RelU Heuristics for avoiding bad local minima, Heuristics for faster training, Nesters accelerated gradient descent, Regularization, Dropout.
Auto encoders (standard, sparse, denoising, contractive, etc), Variational Auto encoders, Adversarial Generative Networks, Auto encoder and DBM.
Word Vector Representations, Continuous Skip-Gram Model, Continuous Bag-of-Words model (CBOW), Glove, Evaluations and Applications in word similarity, analogy reasoning, Named Entity Recognition, Opinion Mining using Recurrent Neural Networks, Parsing and Sentiment Analysis using Recursive Neural Networks.