Deep Learning Techniques

Last Update September 10, 2026
0 already enrolled

About This Course

Deep Learning Techniques (MDS-301) is a core course for M.Sc. Data Science – III Semester that provides a comprehensive foundation in artificial neural networks and modern deep learning methods. The course covers neural network models, activation functions, ANN architectures, supervised and unsupervised learning, perceptron, gradient descent, backpropagation, Hebbian and competitive learning, Self-Organizing Maps, Radial Basis Function Networks, and reinforcement learning. It further introduces advanced architectures including Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), LSTMs, Generative Adversarial Networks (GANs), Deep Belief Networks, Markov Decision Processes, and Hidden Markov Models. The course emphasizes both theoretical foundations and practical applications, enabling students to understand, develop, and apply deep learning models to real-world data science problems.

REFERENCES

  1. Haykin, S. (1994). Neural Networks: A Comprehensive Foundation. New York: Macmillan Publishing. A comprehensive book and contains a great deal of background theory.
  2. Yagnanarayana, B. (1999): Artificial Neural Networks, PHI.
  3. Bart Kosko (1997): Neural Networks and Fuzzy Systems, PHI.
  4. Jacek M. Zurada (1992): Artificial Neural Systems, West Publishing Company.
  5. Carling, A. (1992). Introducing Neural Networks. Wilmslow, UK: Sigma Press.
  6. Fausett, L. (1994). Fundamentals of Neural Networks. New York: Prentice Hall.
  7. Box and Jenkins: Time Series Analysis, Springer.
  8. Brockwell, P.J., and Davis, R.A.: Time Series: Theory and Methods (Second Edition). Springer-Verlag.

Curriculum

UNIT – I: Artificial Neural Networks

Introduction, Biological Activations of Neuron; Artificial Neuron Models: McCulloch-Pitts, Perceptron, Adaline, Hebbian Models; Characteristics of ANN, Types of Neuron Activation Function, Signal functions and their properties, monotonicity, ANN Architecture, Classification Taxonomy of ANN, Supervised, Un-supervised and Reinforcement learning; Learning tasks, Memory, Adaptation, Statistical nature of the learning process. Statistical learning theory. Gathering and partitioning of data for ANN and its pre and post processing.

UNIT – II: Supervised learning algorithms

Perceptron Learning Algorithm, Derivation, Perceptron convergence theorem (statement); Multi-layer Perceptron Learning rule, limitations, Applications of the Perceptron learning, Gradient Descent Learning, Least Mean Square learning, Widrow-Hoff Learning. Feed-forward and Feed-back Back-Propagation Algorithms and derivation.

UNIT – III: Unsupervised learning Algorithms

Hebbian Learning, Competitive learning. Self-Organizing Maps, SOM algorithm, properties of feature map, computer simulations, Vector quantization, Learning vector quantization. Radial Basis Function Networks, Approximation properties of Radial Basis Function Networks. Boltzman Machine, Hopfield model.

UNIT – IV: Reinforcement learning

Reinforcement learning, Markov Decision Process, Hidden Markov Model, Convolutional Neural Networks, Recurrent Neural Networks, Long-Short Term Memory Networks, Generative Adversarial Networks, Deep belief Networks.

Your Instructors

Mallesham G

Professor

0/5
6 Courses
0 Reviews
179 Students

Dr. G. Mallesham is a Professor in the Department of Electrical Engineering, University College of Engineering, Osmania University. He possesses expertise in Control Engineering, Smart Grid Technologies, Renewable Energy Systems, and Artificial Intelligence Systems. Having undergone advanced academic exposure in both India and the USA, he has also served in several key leadership positions at Osmania University.

See more

Want to receive push notifications for all major on-site activities?

✕

Don't have an account yet? Sign up for free