Share E-Book
Scan to open this page

Scan with your phone to open this page

Author克里希纳·肖佩拉 著, [美] 乌黛·卡马特 (Dr.Uday Kamath) 译, 陈瑶 译, 陈峰 译, 刘江一 译

No description

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

AI guide
# Java机器学习 (Java Machine Learning) ## 【One-Line Pitch】 A comprehensive, hands-on guide to applying machine learning within the Java ecosystem, covering everything from classical supervised and unsupervised methods to deep learning, NLP, and big-data pipelines — ideal for Java developers and data scientists who want a practical, code-and-tool-oriented path through the ML landscape. ## 【Book Arc】 - **Opening (~0%–10%)**: Foundations of machine learning — history, terminology, data types, the CRISP-style iterative process (business problem → ML mapping → data collection → modeling → evaluation → deployment → monitoring), and core challenges like the curse of dimensionality and overfitting. - **Early (~10%–24%)**: Supervised learning in practice — formal notation, data preprocessing (missing values, discretization, sampling), feature selection and dimensionality reduction, linear and nonlinear models, ensemble methods, and a full end-to-end case study (Horse Colic classification) using both Weka and RapidMiner. - **Early–Middle (~24%–41%)**: Unsupervised learning — clustering algorithms (k-means, DBSCAN, mean shift, EM/GMM, hierarchical, SOM), internal and external validation metrics, outlier detection, and a practical case study applying these techniques. - **Middle (~41%–52%)**: Semi-supervised and active learning — self-training, co-training, cluster-and-label, graph-based label propagation, transductive SVM, plus active learning scenarios (stream-based and pool-based) and uncertainty sampling. - **Late (~52%–75%)**: Real-time streaming ML — incremental supervised learning (online linear models, online Naive Bayes, Hoeffding trees), concept drift detection, streaming clustering and outlier detection, with a dedicated case study. - **Ending (~75%–100%)**: Advanced topics — probabilistic graphical models (Bayesian networks, Markov networks, CRFs), deep learning (multilayer feedforward networks and limitations), text mining and NLP (classification, topic modeling, NER, sentiment), and big-data ML with Spark MLlib, concluding with future directions and appendices on linear algebra and probability. ## 【Key Takeaways】 - **Machine learning is a structured, iterative process, not just algorithms** (Opening): The book extends the CRISP-DM framework into a full lifecycle — business problem identification, ML mapping, data collection, quality analysis, sampling, feature analysis, modeling, evaluation, deployment, and ongoing performance monitoring. This process orientation is the backbone of every case study in the book. - **Data quality and preprocessing determine model success** (Early): Handling missing values, outliers, discretization (equal-width, equal-frequency, entropy-based), and proper train/validation/test splits are treated as first-class steps. The book emphasizes that preprocessing steps applied to training data must be applied identically to test data — a critical practical detail. - **Feature selection combats the curse of dimensionality** (Early): With 2^k−1 possible feature subsets, exhaustive search is infeasible, so heuristic search and evaluation techniques (e.g., chi-square, Gini impurity) are essential. The Horse Colic case study demonstrates how visual analysis (quartile color matrices, scatter plots, bubble charts) and automated feature weighting together identify discriminative features. - **Model evaluation requires multiple datasets and statistical rigor** (Early): Training, validation, and test sets serve distinct purposes; k-fold cross-validation (typically 10-fold) is the standard approach when data is limited. The book shows paired t-tests over repeated experiments (e.g., 30 runs) to compare algorithms statistically, not just by point estimates. - **Unsupervised learning offers a rich toolkit with distinct trade-offs** (Early–Middle): DBSCAN finds arbitrary-shaped clusters without specifying k but is sensitive to density variations; mean shift is non-parametric and deterministic but computationally slow; EM/GMM is probabilistic but can converge to local optima; hierarchical clustering imposes structure even when none exists. Validation via internal metrics (R-squared, Dunn, Davies-Bouldin, Silhouette) and external metrics is essential. - **Semi-supervised learning leverages unlabeled data when labels are scarce** (Middle): Self-training is simple but can amplify errors; co-training requires orthogonal feature views; cluster-and-label works well when the cluster assumption holds; graph-based label propagation is powerful but O(n³); transductive SVM extends max-margin ideas to unlabeled data. Each method has clear input/output specifications and documented limitations. - **Streaming ML requires fundamentally different algorithms** (Late): Online linear models with loss functions (hinge, logistic, squared), online Naive Bayes, and Hoeffding trees (using Hoeffding bounds to decide splits) are designed for incremental learning. Concept drift detection and sliding windows are core concerns, and validation in online environments differs from batch settings. ## 【Reading Tips】 - **Skim Chapter 1 if you have ML background** — the terminology and CRISP-style process are useful reference material, but the real value starts in Chapter 2 with the supervised learning workflow and Horse Colic case study. - **Deep-read the case studies** — each chapter follows the same structure (business problem → ML mapping → data collection → sampling → feature analysis → modeling → evaluation), which makes it easy to compare approaches across supervised, unsupervised, semi-supervised, streaming, and deep learning contexts. - **Pay close attention to the "input/output, how it works, advantages/limitations" format** used for every algorithm — this consistent structure is the fastest way to build a mental model of when to use which technique. - **Use the Weka and RapidMiner examples as templates** — the book provides actual code and GUI workflows; replicating the Horse Colic experiment in both tools is an excellent way to understand the difference between code-driven and visual ML environments. - **The appendices on linear algebra and probability are worth reviewing** before tackling Chapter 6 (probabilistic graphical models) and Chapter 7 (deep learning), as those chapters assume mathematical fluency. ## 【Coverage Limits】 This guide is based on excerpts covering roughly the first half of the book (through streaming ML). Detailed content on probabilistic graphical models, deep learning, NLP/text mining, and big-data ML with Spark MLlib is not covered in depth here, though the table of contents indicates these topics are treated with the same case-study-driven approach. ##
Excerpt 1
7 案例研究 6.7.1 业务问题 6.7.2 机器学习映射 6.7.3 数据采样和转换 6.7.4 特征分析 6.7.5 模型、结果和评估 6.7.6 结果分析 6.8 小结 6.9 参考文献 第7章 深度学习 7.1 多层前馈神经网络 7.1.1 输入、神经元、激活函数和数学符号 7.1.2 多层神经网络 7...
View in text
Excerpt 2
作原理 该模型试图在输入空间中学习“超平面”,这个超平面最大限度地减少了每个类的数据点之间的误差(参考文献 [4] )。 在线性模型d维输入中学习到的超平面为: 权重矩阵可以利用各种方法,如普通最小二乘法或迭代法,推导出来。使用矩阵符号如下: X是输入矩阵,y是标签。如果矩阵X T X在最小二乘问题中不是满秩矩阵...
View in text
Excerpt 3
度的分割算法。它将空间中的密集区域与稀疏区域分开(参考文献 [14] )。 输入和输出 在DBSCAN中仅使用数值特征。用户定义的参数是MinPts和由ε给出的邻域因子。 工作原理 该算法首先找到每个点p的邻域ε,表示为N∈:{q|d(p,q)≤∈}。高密度区域被识别为邻域ε中的点数大于等于给定MinPts的区域...
View in text
Excerpt 4
一个聚类中的未标注实例。 4)一旦所有的未标注实例 通过前面的步骤都被打上了标签,则在整个数据集上运行一个监督分类模型。 图4-3 聚类和标记半监督学习——先聚类后分类 优势和局限性 优势和局限性如下: ·当聚类的假设满足,且聚类算法和参数选择正确时,此算法效果很好。 ·在解决实际问题时,大量的参数和选项使此算法...
View in text
Excerpt 5
,X 2 ,…,X k 是代表节点的随机变量,ε是节点之间的有向边X i →X j 或是无向边X i -X j 的集合。如果ε中的每条边都是有向的,则该图称为 有向图 ;类似地,如果节点间的每条边都是无向的,则该图称为 无向图 。如图6-1所示。同样,如果一个图既有有向边又有无向边,则符号 表示这条边可能是有向的...
View in text
Excerpt 6
在第2章中也曾介绍过,以经验风险最小化为目标,正则化被用于解决机器学习中的过拟合问题。接下来介绍几个常用的正则化函数。 L2正则化 L2正则化仅仅用于对权重进行正则化,而不能用于偏差,只用于层与层(i,j)相连的部分。 同时,正则项的梯度计算为▽ θ Ω(θ)=2W k ,这通常被认为是权重分布的“高斯先验”。...
View in text
Excerpt 7
有多种自然语言处理库,用于文档分类、序列标注和主题建模等,以及各种机器学习算法库。Mallet是CPL协议下的开源工具。Mallet开放了扩展的API(见图8-23、图8-24),可以创建和配置那些用于预处理、向量化、特征选择等管道式的步骤序列。还有一些分类和聚类算法的扩展实现,以及整合了一些其他的文本分析和机器...
View in text
Excerpt 8
以确定平均传播误差。用x i 表示N次测量,用s i 表示特征的不确定性,可以记为: 以及: 这些方程均假设协方差为0。 假如s i =s-,即所有的观察值都有相同的误差。 则 由于 。 因此, 。
View in text
Tags
AI categories
Javamachine learningdata science
Publish Year: 2017
Language: Chinese
File Format: EPUB
File Size: 651.4 KB