Sancheeta Kaushal

Musings of my world

Strong convictions precede great actions.


Notes for Neural Networks!

This is the course offered by Jeffery Hilton.

Week 1:

  • He starts with a dicussion about the need for machine learning models and talks about the situations where it is really hard to write programs and form rule based solutions since there is no single answer. Additionally, rules need to change and outsmart the ones who try to break the system.
  • Approach is to take examples and train the system using these inputs and outputs. Machine Learning algorithms take care of generalisation.
  • Learning algorithms are really good solutions for
    • Recognising Patterns - Recognising facial expressions and identities.
    • Recognising Anomalies - Unusual Sequence of Credit Card Transactions.
    • Prediction - Future Stock Prices.
  • Discussion about MNIST databased of Handwritten Digits, ImageNet competition and Speech Recognition Task.
  • For speech recognition task, we have pre-processing, the acoustic model and decoding as various steps.
  • Talked about real neurons and how they insipred the development of neural networks as a field of machine learning.