Digital Library
Essentials of Deep Learning and AI (Soppin, ShashidharRamachandra etc.)(Z-Library)
, , , , , ,
Essentials of Deep Learning and AI (Soppin, ShashidharRamachandra etc.)(Z-Library)
, , , , , ,
AI
No Description
11
Views
0
Downloads
0.00
Total Donations
Registered users can read the full content for free
Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.
Page
1
(This page has no text content)
Page
2
(This page has no text content)
Page
3
Essentials of Deep Learning and AI Experience Unsupervised Learning, Autoencoders, Feature Engineering and Time Series Analysis with TensorFlow, Keras, and scikit-learn Shashidhar Soppin Dr. Manjunath Ramachandra B N Chandrashekar www.bpbonline.com
Page
4
FIRST EDITION 2022 Copyright © BPB Publications, India ISBN: 978-93-91030-353 All Rights Reserved. No part of this publication may be reproduced, distributed or transmitted in any form or by any means or stored in a database or retrieval system, without the prior written permission of the publisher with the exception to the program listings which may be entered, stored and executed in a computer system, but they can not be reproduced by the means of publication, photocopy, recording, or by any electronic and mechanical means. LIMITS OF LIABILITY AND DISCLAIMER OF WARRANTY The information contained in this book is true to correct and the best of author’s and publisher’s knowledge. The author has made every effort to ensure the accuracy of these publications, but publisher cannot be held responsible for any loss or damage arising from any information in this book. All trademarks referred to in the book are acknowledged as properties of their respective owners but BPB Publications cannot guarantee the accuracy of this information. www.bpbonline.com
Page
5
Foreword Machine learning (ML) and artificial intelligence (AI) are revolutionizing almost every aspect of the business. From self-driven cars to predicting inventory to diagnosing cancer, AI is set to impact nearly every domain and industry vertical. While it is evident that AI is the most important technology of our times, there is not enough talent in the market. It is partly due to the complexity involved in learning and mastering the concepts of ML and AI. Many budding professionals and existing software developers aspiring to become AI engineers are often overwhelmed by the breadth and depth of the available tools and technologies. This book, Essentials of Deep Learning and AI, by Shashidhar Soppin, Dr. Manjunath Ramachandra, and B N Chandrashekar, takes a unique approach in introducing the fundamental concepts of AI and ML. It will appeal to novices and experienced ML engineers due to the breadth and depth of the topics covered. It’s one of the most comprehensive books on AI available in the market. What I like about this book is the balance it strikes between the theoretical and practical aspects of AI. It doesn’t intimidate those whose background is not mathematics or statistics. It also has the right balance between classical machine learning and deep learning, current and emerging techniques of AI. It is relevant to developers, business managers, technology decision- makers, and IT leaders. The book has all the attributes to become an authoritative guide or textbook for teaching and learning ML and AI. Each chapter has a summary that acts as a quick reference. The multiple-choice questions at the end of each chapter enable the readers to assess themselves. If you want to learn everything from the evolution of AI to advanced concepts such as ensemble methods and model optimization, look no further. This book has it all. —Mr Janakiram MSV
Page
6
Dedicated to All the "Covid Warriors" who fought the war against the pandemic and A big thank you to all the corona warriors for all the selfless service offered.
Page
7
About the Authors Shashidhar Soppin has two decades of experience in IT industry. At present he is working as Enterprise Architect in Zeta. Earlier, he has worked as DMTS (Distinguished Member of Technical Staff) with progressive history of defining vision, strategy, and technical roadmap, architecting solutions, recommending new approaches via technology enablement and managing large-scale & complex IT projects as part of Wipro. He has worked on, Multi-Cloud (OpenStack, Azure/AWS), Cloud Native Technologies, AIX-OS, HCI (Hyper Converged Infra), Docker Containers and Kubernetes for microservices-based architectures and in Virtualization domains. His areas of interest include AI/ML, Deep Learning and IoT. He has several granted and filed patents on various technologies on his name. He is an avid Author for the OSFY Magazine, Written Articles on Micro-services and Kubernetes, Docker, OpenStack, Storage, Node Red, ML & DL to name few {https://opensourceforu.com/author/shashidharsoppin/}. He has also written articles for Medium.com and Research-gate and also a blogger for “Linux-techi”. He has presented papers in conferences and panel speaker in industry forums. He has worked for various organizations including IBM- ISL, Ness Technologies before joining Wipro. He got certified from Great Learning Institute on Deep Learning Technology, Deep Learning Specialization from Coursera and has various Cloud certifications. linkedin.com/in/shashidhar-soppin-8264282 https://www.linuxtechi.com/author/shashidhar/ Dr. Manjunath Ramachandra has a blend of experience over twenty five years in the verticals of Healthcare, Telecom and consumer electronics spanning the technologies such as signal & Image processing, Artificial intelligence, cloud computing, IoT, wireless communication and quantum computing. He worked for the companies such as Tata Consultancy Services, Royal Philips and was placed in Wipro Limited as principal consultant. He has filed about 90 patents, authored 210 Research papers in
Page
8
international conferences and journals and a book. He was a member of the embedded systems special interest group at NASSCOM. He represented the industry in international standardization bodies such as Wi-Fi Alliance, served as the editor for the regional profiles standard in Digital living network alliance (DLNA) and as the industry liaison officer for the CE- Linux Forum. He has delivered over 24 keynote speeches and conducted over 21 workshop and tutorial sessions. He figures in Marquis Who’s Who 2008 & “2000 outstanding intellectuals of the 21st century”, International Biographical Center, UK. His areas of interest include Deep Learning/ Artificial intelligence, Signal & Image processing and wireless communications. B N Chandrashekar, a principal consultant by designation is a veteran of Wipro Technologies Limited and has industry experience of around 20 years. He is a post graduate from Indian Institute of Science and has toned his credibility by owning and getting moulded in the roles of Researcher, Data Science Consultant, Technical Director and Full Stack AI Consultant. He has handled multiple cross-domain projects starting from infrastructure setup to scoping, development, delivery and with support and maintenance. He has work experience in cutting edge technologies and adapts to any new technology in a short time. He has experience in writing proposals, hands- on in multiple high-level programming and scripting languages. He has contributed to programs and tools to open source, co-authored journals and conference papers. He has co-authored publications to online portals like medium.com, researchgate.net, and OSFY.com. He has pioneered the webinars to university professors at Wipro Tech Bootcamp and seminars at engineering colleges on explainable AI framework. He has co-authored multiple patents and has got certified from Great Learning Institute on Deep Learning Technology and Quantum Learning from Coursera. https://www.linkedin.com/in/ https://github.com/chandru4ni/
Page
9
About the Reviewer Sethuraman U., is at present working as Technical lead in Panasonic Automotive, in Frankfurt, Main, Hesse, Germany. He has decades of experience in various areas like Computer Vision, Deep learning, Machine Learning, AR/VR, ADAS, Computer vision, Embedded Systems, Video Codecs, ADAS, Computer vision areas. He has done Master of Technology - MTech Software Systems (Specialisation in Data Analytics), from Birla Institute of Technology and Science, Pilani. He has done his Bachelor of Engineering (ECE)Electronics and Communications Engineering from Bharathidasan University. He has decades of IT industry experience in various areas and also he has many patents on his name and authored papers. He is working for Wipro R&D, Toshiba India Pvt. Ltd and GDA Technologies Inc (now an L&T InfoTech company) before Panasonic stint.
Page
10
Acknowledgement We are grateful to BPB Publications, who came forward to publish this book and their entire team of BPB Publications were always kind, cooperative and understanding. Mr Sethuraman and Raju (from Wipro CTO team) who reviewed this book with abundant patience and helped us say what we had wanted to, improvising each and every page of this book with care. Their patience and guidance were invaluable. The journey through learning conceptual technologies brought to next level by using modern methods and with the use of artificial intelligence and machine learning in the field, has been very rewarding, as it has given us the opportunity to work for some of the customers and solving their critical problems. A special thank you goes to BPB design, technical and manuscription team for their patience in coming with beautiful cover design and Mr Janakiram MSV who is a analyst, advisor and architect for writing foreword given a short notice. Chandrashekar B N: Also, I would like to call out my wife, parents and daughter, family and relatives, who they realized it or not supported me in all front to shape this book. I am thankful to my manager, friends and all sources of information media that helped me to build the knowledge of this book. Shashidhar Soppin: Special and Big thanks also go to my Wife, Daughter, Mom & Mother-in-law the "4 ladies" who constantly supported me with delicious food and constant support and my brother and late father for their motivation and guidance while writing this book. I am also thankful to my family, relatives, manager, friends and all sources that helped me to build the knowledge for this book. Manjunath Ramachandra Iyer: I am deeply indebted to the tech giants who made the AI/ML technologies popular and accessible. Also thankful for My wife, Mother, children, aunt, family, relatives and cats who were understanding and supportive throughout the project.
Page
11
We are thankful to our Wipro colleagues, CTO team, ER&D team and leaders, without the help of their understanding this book would have not come out. We are thankful to our Zeta colleagues, CTO and leaders, without the help of their understanding this book would have not come out.
Page
12
Preface Artificial intelligence has proliferated deep in to all verticals of the industry. It has enabled the business solutions for the existing problems apart from providing new opportunities and avenues. As a result, technical community with varied degree of expertise and exposure to the underlying technologies will be interested to learn the state of the art quickly and adopt the same solutions. While the content available in public domain provides them with the required information to an extent, it also gives a lot more information. The user loses the focus and finally may not get the precise information. There is no single stop solution for the problem today. This book is written to reduce the burden on the user to a great extent by directly providing the required information. Accordingly, all sections are organised to be self- contained as far as possible and provide the precise content the reader is looking for. Organisation of the book is divided into several self-contained modules to make it more readable. In each chapter, adequate examples and code snippets are provided for the reader to try out. The programs may be executed directly on the indicated platforms to observe the results. Source of the required data to develop the models, pre-trained models and the settings of the configurable parameters to get optimal output are detailed. The case studies provided in the chapters indicate the contemporary business problems and the solution approaches are also detailed in the book. The book contains overall 14 chapters. The details covered in each chapter are provided below. Who is this book for? This book is most relevant to readers working in various IT positions like developers, managers, business leaders, data scientists, machine learning engineers, and alike. Even the experienced AI/ML experts/users can make use of valuable material from this book. It also touches upon advanced topics in AI/ML and DL technologies. What questions does this book answer?
Page
13
In coming up with this book, we authors spoke to many academic and industry experts from all walks of life. Below are some of the questions we wanted to highlight, Basic understanding of neural network building, AI concepts explained as simple as possible. We would like to highlight why one should invest time in learning these technologies. Multiple ways of learning concepts and technologies are detailed out in simplified manner. Chapter 1, This chapter provides overview and historical evolution of AI technologies used in different industry verticals. It considers the user preferences as well as dynamic emotional state. It briefs about the broad classification of AI, ML and DL. This chapter covers AI usage in different industry domains and sectors. End to end tools and frameworks used in the lifecycle of AI are covered. The various datasets used to build ML and DL models have been described. Chapter 2, This chapter describes one of the most popular class of algorithms used in supervised machine learning. This chapter details the various methods for data extraction, data annotation and better prediction. Optical character recognition used widely in industry has been described. The libraries, and packages for supervised learning algorithms are detailed in this chapter. Depiction of performance metrics and computation techniques used for optimization and loss methods are covered. Chapter 3, This chapter describes most popular and challenging class of algorithms used when labelled data is not available. This chapter describes various clustering techniques and data pre-processing methods. Selection of significant input features and dimensionality reduction using various PCA techniques and Singular Value Decomposition (SVD) are explained. The libraries and packages for the various techniques explained are provided. Depiction of performance metrics and computation techniques used for optimization and loss methods are covered. Chapter 4, This chapter describes the process of transforming raw data into set of useful features. It gives details of feature extraction, feature selection
Page
14
and hardening features. It helps in building robust and flexible models by better feature selection. It describes various techniques on feature encoding, data preparation and feature engineering. Chapter 5, This chapter provides in-depth understanding of advanced classification techniques, data association, clustering and regression. This chapter explains techniques to handle any kind of data involving simple to complex characteristics and small to huge data size. Use case of recommendations in retail industry is provided. Chapter 6, This chapter explains the various methods for handling time series data. It deals with various time series models and related algorithms. It describes categories of time series algorithms along with examples. Usage of time series data for predictive models is described. Chapter 7, This chapter provides various techniques for data clean-up before it is consumed by models. The various pre-processing techniques such as data formatting and normalization are described. The effect of bias and variance on the models is analysed. Different techniques for handling overfitting and underfitting of models are provided. Use case and examples for data formatting and normalization are provided. Chapter 8, This chapter covers mechanism for combining weak models to develop strong models using ensemble of algorithms. It describes systematic approach, hyper parameter tuning and optimal parameter selection for industry grade models. Latest trends in ensemble methods like boosting and genetic algorithm are explained. Chapter 9, This chapter explains one of the most complex and difficult human like data handling using deep learning techniques. This technique helps to solve problems which cannot be handled by machine learning algorithms. The training mechanism and the architecture of CNN are detailed in this chapter. Chapter 10, This chapter focuses on multi-layer perceptron (MLP) starting from simple perceptron and activation functions. It explains the architecture of simple perceptron model. It provides the latest trends in MLP like knowledge distillation and with a programming example. Chapter 11, This chapter deals with long short-term memory models which are mainly used for handling sequential data. The architectures of RNN,
Page
15
GRU and LSTM are explained. The analytical details of the architecture of the gates are described. The variants of LSTM such as bidirectional LSTM, and attention-based LSTM are elaborated. Chapter 12, This chapter deal with automatic generation of features for the given input data. Autoencoders deal with encoders and decoders and are connected with feed-forward neural networks. The features generation example for MNIST dataset is provided and architecture of autoencoders and its variants are discussed. Usage of autoencoders for denoising, and sparse representation are detailed in this chapter. Chapter 13, This chapter covers the industrial applications of deep learning and machine learning algorithms. The different hardware and software approaches are detailed. The business use case belonging to telecom, IoT, healthcare and cloud are described. This chapter explains how multiple algorithms of AI/ML are incorporated in working systems. Chapter 14, The final chapter discusses potential usage of AI, ML and DL along with future and emerging technologies. These technologies enrich AI/ML algorithms providing faster and secure methods for their execution. The technologies include quantum computing, cloud computing, 5G and neuromorphic computing. The AI/ML enables widespread usage of these technologies.
Page
16
Downloading the code bundle and coloured images: Please follow the link to download the Code Bundle and the Coloured Images of the book: https://rebrand.ly/a49452 Errata We take immense pride in our work at BPB Publications and follow best practices to ensure the accuracy of our content to provide with an indulging reading experience to our subscribers. Our readers are our mirrors, and we use their inputs to reflect and improve upon human errors, if any, that may have occurred during the publishing processes involved. To let us maintain the quality and help us reach out to any readers who might be having difficulties due to any unforeseen errors, please write to us at : errata@bpbonline.com Your support, suggestions and feedbacks are highly appreciated by the BPB Publications’ Family. Did you know that BPB offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.bpbonline.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at business@bpbonline.com for more details. At www.bpbonline.com, you can also read a collection of free technical articles, sign up for a range of free newsletters, and receive exclusive discounts and offers on BPB books and eBooks.
Page
17
(This page has no text content)
Page
18
BPB is searching for authors like you If you're interested in becoming an author for BPB, please visit www.bpbonline.com and apply today. We have worked with thousands of developers and tech professionals, just like you, to help them share their insight with the global tech community. You can make a general application, apply for a specific hot topic that we are recruiting an author for, or submit your own idea. The code bundle for the book is also hosted on GitHub at https://github.com/bpbpublications/Essentials-of-Deep-Learning- and-AI. In case there's an update to the code, it will be updated on the existing GitHub repository. We also have other code bundles from our rich catalog of books and videos available at https://github.com/bpbpublications. Check them out! PIRACY If you come across any illegal copies of our works in any form on the internet, we would be grateful if you would provide us with the location address or website name. Please contact us at business@bpbonline.com with a link to the material. If you are interested in becoming an author If there is a topic that you have expertise in, and you are interested in either writing or contributing to a book, please visit www.bpbonline.com. REVIEWS Please leave a review. Once you have read and used this book, why not leave a review on the site that you purchased it from? Potential readers can then see and use your unbiased opinion to make purchase
Page
19
decisions, we at BPB can understand what you think about our products, and our authors can see your feedback on their book. Thank you! For more information about BPB, please visit www.bpbonline.com.
Page
20
Table of Contents 1. Introduction Structure Objectives 1.1 Artificial intelligence 1.1.1 What is Artificial Intelligence? 1.1.2 Definitions of Artificial Intelligence 1.1.3 Applications of Artificial Intelligence 1.1.4 Industry domains and sectors along with sample use cases 1.1.5 Broad classification of what is AI, ML, FL, and DL? 1.2 Machine learning 1.2.1 History and definition of ML 1.2.2 Machine learning and its applications 1.2.3 Classification of ML algorithms 1.3 Deep Learning 1.3.1 What are the prerequisites to understand deep learning? 1.3.2 Difference between machine learning and deep learning 1.3.3 Applications of deep learning 1.4 Tools and frameworks for AI, ML and DL 1.5 Languages used for AI, ML, and DL 1.6 Sample datasets for AI, ML, and DL development Conclusion Points to remember Questions Multiple choice questions Answers 2. Supervised Machine Learning Structure Objectives 2.1 Introduction to Supervised Machine Learning 2.2 Data Cleanup
The above is a preview of the first 20 pages. Register to read the complete e-book.
AI Reading Assistant
Whole-book reading guide from stratified index samples; jump to passages in the text
AI guide
【One-Line Pitch】
A structured, classroom-style introduction to deep learning and AI that walks from machine-learning fundamentals through neural architectures to practical tooling. Best suited to students, career-switchers, and working engineers who want a single guided path from data preparation to model building.
【Book Arc】
- **Opening (~0%–10%)**: Sets the stage with author credentials, book resources, and a high-level taxonomy of AI applications — distinguishing problems by data volume, feature availability, data nature (sequential vs. parallel), and whether continuous learning is needed.
- **Early (~10%–30%)**: Establishes core machine-learning vocabulary: supervised vs. unsupervised vs. reinforcement learning, labeled data, and the practical realities of dataset sourcing (Kaggle, UCI, Kdnuggets). Moves into supervised learning mechanics — data collection, labeling, prediction, and preprocessing.
- **Early–Middle (~30%–45%)**: Dives into supervised algorithm internals: decision trees (splitting, pruning, information gain, Gini index), classification and regression methods, and evaluation metrics such as MAE, MSE, log loss, confusion matrix, and AUC-ROC.
- **Middle (~45%–55%)**: Shifts to unsupervised learning — clustering architecture, K-Means in scikit-learn, and dimensionality reduction with t-SNE, including the practical tip of applying PCA before t-SNE.
- **Late (beyond ~55%)**: Excerpts do not cover this portion in detail; based on the book's stated scope, later material likely addresses neural networks, deep learning architectures, and applied AI use cases.
【Key Takeaways】
- **AI applications should be classified before modeling** (Opening): The book frames problem types by data availability, feature boundaries, sequential vs. parallel structure, and whether the model must learn continuously — a useful scoping habit before choosing an architecture.
- **Supervised learning rests on three pillars** (Early): Collecting data, labeling data, and predicting data. The book stresses that models must be rebuilt as input distributions change, not trained once and forgotten.
- **Data preparation is not optional overhead** (Early): Cleaning, encoding (label, ordinal, frequency, hash, dummy, binary), feature generation, and feature selection are treated as first-class steps that determine model quality.
- **Decision trees are explained through their vocabulary** (Early–Middle): Root nodes, splitting, pruning, parent/child nodes, and leaf nodes are defined precisely, with information gain and Gini index as the key attribute-selection measures.
- **Metric choice is a modeling decision** (Early–Middle): MAE weights errors equally and is outlier-sensitive; MSE penalizes small errors and is differentiable; log loss targets false classifications. The book ties each metric to when it is appropriate.
- **Unsupervised learning is framed around clustering** (Middle): A shopping-website example shows how customer purchase histories can be segmented into apparel, books, and stationery clusters without labels.
- **Optimization is treated as a family of adaptive methods** (Middle): AdaGrad auto-tunes learning rates by feature frequency; RMSProp improves on AdaGrad to counter diminishing learning rates — presented with pseudo-equations rather than heavy derivation.
- **Tooling is practical, not theoretical** (Middle): K-Means and t-SNE are shown through scikit-learn function signatures and parameter tables, emphasizing initialization choices and iteration ranges.
【Reading Tips】
- **Deep-read the early chapters on data preparation and metrics.** These are the foundation for everything later; skimming them makes the algorithm chapters harder than they need to be.
- **Skim the author biographies and publisher boilerplate** at the very start — they consume the opening pages but carry no technical content.
- **Use the end-of-chapter questions as a self-test.** The excerpts show review questions and MCQs after major chapters; they are a cheap way to check whether you actually absorbed the material.
- **Treat the pseudo-equations as intuition, not proofs.** The optimization section gives update rules for AdaGrad and RMSProp; focus on what each method adapts and why, rather than memorizing formulas.
- **Pair the scikit-learn snippets with hands-on practice.** The K-Means and t-SNE parameter tables are reference material — run them on a small dataset to make the parameters concrete.
【Coverage Limits】
This guide is based on stratified excerpts covering roughly the first half of the book (through unsupervised learning and dimensionality reduction). The later deep-learning architecture chapters, case studies, and any advanced topics are not represented in the source material and are therefore not summarized here.
Passage locations
Page 8
niversity professors at Wipro Tech Bootcamp and seminars at engineering colleges on explainable AI framework. He has co-authored multiple patents and has got...
View in text
Excerpt 2
shown in figure 1.9: Figure 1.9: Artificial Neural Network Multiple factors have led to this development, the following are the prime factors: Amount and lar...
View in text
Excerpt 3
very important since it judges the performance of the model. And it also provides the importance of various characteristics of the results which are being in...
View in text
Excerpt 4
each cluster for each purchase type. For example, there are several clusters based on purchases of apparel, books, stationery, and so on. Based on this, the...
View in text
Recommended for You
{{#thumbnailUrl}}
{{/thumbnailUrl}}
{{^thumbnailUrl}}
{{/thumbnailUrl}}
Loading recommended books...
Failed to load, please try again later
Tip the Site
Scan the WeChat Pay or Alipay code to tip. No login required.
WeChat Pay
Alipay