About Me
Madhu Babu Sanjeevi,
Software Engineer,
Languages C, Java, Python
Technologies Machine Learning, Deep Learning,
NLP, Big data, Mobile dev.
Developments Android, Web, Rest API
Databases SQL, Mongo DB
Madhu Sanjeevi Madhu009 Madhu.ai
Agenda
•1.Introduction of Machine learning & Deep
learning
•2.Various learning algorithms of ML & DL
•3.Applications of ML & DL
•4.Open Source tools and help
•5.Deep Learning Demo
Why Machine Learning????
1 + 1 =11
2 + 2 =22
3 + 3 =?
If 1 + 2 = 10
2 + 3 = 21
7 + 8 = ?
• No hard coded rules
• No Code change
How does it work??
Computer
Data
Program
Output
Computer
Data
Output
Program
Traditional Programming
Machine Learning
What is Machine Learning???
1.Learn from past experiences
2.Improve the performances of intelligent programs
Definitions (Mitchell 1997)
“A computer program is said to learn from experience E with
respect to some class of tasks T and performance measure P,
if its performance at the tasks improves with the experiences”
Supervised Learning
• 1. Training data includes both the input and the desired
results.
• 2. For some examples the correct results (targets) are
known and are given in input to the model during the
learning process.
• 3. These methods are usually fast and accurate.
Classification: for categorical response values, where the data can be
separated into specific “classes”.
Regression: for continuous-response values
Unsupervised Learning
• 1. The model is not provided with the correct results during
the training.
• 2. The model has to understand it by itself by extracting
patterns.
• 3. These methods are difficult to implement.
Clustering: grouping similar things together
MLAlgorithms
Introduction of Neural Networks?
• What are Neural Networks?
• Neural networks are a new method of programming computers.
• In the human brain, a typical neuron collects signals from others through a
host of fine structures called dendrites.
• The neuron sends out spikes of electrical activity through a long, thin stand
known as an axon, which splits into thousands of branches.
Diagram of an NN
Fig: A simple Neural Network
Network Layers
• Input Layer - The activity of the input units represents the
raw information that is fed into the network.
• Hidden Layer - The activity of each hidden unit is
determined by the activities of the input units and the
weights on the connections between the input and the
hidden units.
• Output Layer - The behavior of the output units depends
on the activity of the hidden units and the weights
between the hidden and output units.
Neural Networks-Types
1. Feed forward network:
SLP (Single Layer perceptron):
MLP (Multi Layer Perceptron):
2. RNN (Recurrent Neural Network):
3. CNN (Convolution neural Network):
4.TDNN (Time Delay Neural Network) or Shared Weights Neural
Networks:
5. Hopfield Networks
Applications of ML & DL
• Spam Filtering
• Recommendation Engines
• Advancement in Speech Recognition in the last 3 years
• Advancement in Computer Vision
• Advancement in Natural Language Processing
• Used in all Domains
(Banking, Insurance, Healthcare, etc…)
18
Open Source Tools for DL
DL4J: Torch:
JVM-based Lua based
Distrubted Contains pretrained model
Integrates with Hadoop and Spark
TensorFlow: Theano:
Google written successor to Theano Very popular in Academia
Interfaced with via Python and Numpy Fairly low level
Highly parallel Interfaced with via Python and
Numpy
Caffe:
Not general purpose. Focuses on machine-vision problems
Implemented in C++ and is very fast
Not easily extensible
Has a Python interface
Deep
Learning
Resources
Name Language Link Note
Pylearn2 Python
http://deeplearning.net/softwar
e/pylearn2/
A machine learning library built
on Theano
Theano Python
http://deeplearning.net/softwar
e/theano/
A python deep learning library
Caffe C++ http://caffe.berkeleyvision.org/
A deep learning framework by
Berkeley
Torch Lua http://torch.ch/
An open source machine learning
framework
Overfeat Lua
http://cilvr.nyu.edu/doku.php?i
d=code:start
A convolutional network image
processor
Deeplearning
4j
Java http://deeplearning4j.org/
A commercial grade deep
learning library
Word2vec C
https://code.google.com/p/w
ord2vec/
Word embedding framework
GloVe C
http://nlp.stanford.edu/projects
/glove/
Word embedding framework
Doc2vec C
https://radimrehurek.com/gens
im/models/doc2vec.html
Language model for paragraphs
and documents
StanfordNLP Java http://nlp.stanford.edu/
A deep learning-based NLP
package
TensorFlow Python http://www.tensorflow.org
A deep learning based python
library
20
Introduction of Machine learning and Deep Learning
Introduction of Machine learning and Deep Learning

Introduction of Machine learning and Deep Learning

  • 1.
    About Me Madhu BabuSanjeevi, Software Engineer, Languages C, Java, Python Technologies Machine Learning, Deep Learning, NLP, Big data, Mobile dev. Developments Android, Web, Rest API Databases SQL, Mongo DB Madhu Sanjeevi Madhu009 Madhu.ai
  • 2.
    Agenda •1.Introduction of Machinelearning & Deep learning •2.Various learning algorithms of ML & DL •3.Applications of ML & DL •4.Open Source tools and help •5.Deep Learning Demo
  • 4.
    Why Machine Learning???? 1+ 1 =11 2 + 2 =22 3 + 3 =? If 1 + 2 = 10 2 + 3 = 21 7 + 8 = ? • No hard coded rules • No Code change
  • 5.
    How does itwork?? Computer Data Program Output Computer Data Output Program Traditional Programming Machine Learning
  • 6.
    What is MachineLearning??? 1.Learn from past experiences 2.Improve the performances of intelligent programs Definitions (Mitchell 1997) “A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at the tasks improves with the experiences”
  • 8.
    Supervised Learning • 1.Training data includes both the input and the desired results. • 2. For some examples the correct results (targets) are known and are given in input to the model during the learning process. • 3. These methods are usually fast and accurate.
  • 9.
    Classification: for categoricalresponse values, where the data can be separated into specific “classes”. Regression: for continuous-response values
  • 10.
    Unsupervised Learning • 1.The model is not provided with the correct results during the training. • 2. The model has to understand it by itself by extracting patterns. • 3. These methods are difficult to implement.
  • 11.
  • 12.
  • 14.
    Introduction of NeuralNetworks? • What are Neural Networks? • Neural networks are a new method of programming computers. • In the human brain, a typical neuron collects signals from others through a host of fine structures called dendrites. • The neuron sends out spikes of electrical activity through a long, thin stand known as an axon, which splits into thousands of branches.
  • 15.
    Diagram of anNN Fig: A simple Neural Network
  • 16.
    Network Layers • InputLayer - The activity of the input units represents the raw information that is fed into the network. • Hidden Layer - The activity of each hidden unit is determined by the activities of the input units and the weights on the connections between the input and the hidden units. • Output Layer - The behavior of the output units depends on the activity of the hidden units and the weights between the hidden and output units.
  • 17.
    Neural Networks-Types 1. Feedforward network: SLP (Single Layer perceptron): MLP (Multi Layer Perceptron): 2. RNN (Recurrent Neural Network): 3. CNN (Convolution neural Network): 4.TDNN (Time Delay Neural Network) or Shared Weights Neural Networks: 5. Hopfield Networks
  • 18.
    Applications of ML& DL • Spam Filtering • Recommendation Engines • Advancement in Speech Recognition in the last 3 years • Advancement in Computer Vision • Advancement in Natural Language Processing • Used in all Domains (Banking, Insurance, Healthcare, etc…) 18
  • 19.
    Open Source Toolsfor DL DL4J: Torch: JVM-based Lua based Distrubted Contains pretrained model Integrates with Hadoop and Spark TensorFlow: Theano: Google written successor to Theano Very popular in Academia Interfaced with via Python and Numpy Fairly low level Highly parallel Interfaced with via Python and Numpy Caffe: Not general purpose. Focuses on machine-vision problems Implemented in C++ and is very fast Not easily extensible Has a Python interface
  • 20.
    Deep Learning Resources Name Language LinkNote Pylearn2 Python http://deeplearning.net/softwar e/pylearn2/ A machine learning library built on Theano Theano Python http://deeplearning.net/softwar e/theano/ A python deep learning library Caffe C++ http://caffe.berkeleyvision.org/ A deep learning framework by Berkeley Torch Lua http://torch.ch/ An open source machine learning framework Overfeat Lua http://cilvr.nyu.edu/doku.php?i d=code:start A convolutional network image processor Deeplearning 4j Java http://deeplearning4j.org/ A commercial grade deep learning library Word2vec C https://code.google.com/p/w ord2vec/ Word embedding framework GloVe C http://nlp.stanford.edu/projects /glove/ Word embedding framework Doc2vec C https://radimrehurek.com/gens im/models/doc2vec.html Language model for paragraphs and documents StanfordNLP Java http://nlp.stanford.edu/ A deep learning-based NLP package TensorFlow Python http://www.tensorflow.org A deep learning based python library 20