Trees notes (06) (Cây quyết định trong Máy học) - Sebastian Raschka
Generating preview...
Ghi chú bài giảng về cây quyết định (decision trees) trong khóa học Máy học, bao gồm thuật toán, độ đo (entropy, Gini), cắt tỉa và cây hồi quy.
Description
STAT 479: Machine Learning Lecture Notes Sebastian Raschka Department of Statistics University of Wisconsin–Madison http://stat.wisc.edu/∼sraschka/teaching/stat479-fs2018/ Fall 2018 Contents 6 Decision Trees 6.1 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 6.1.1 Terminology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 6.1.2 Machine Learning Categories . . . . . . . . . . . . . . . . . . . . . . . 2 6.1.3 Relationship Between Decision Trees and Rule-based Learning . . . . 2 6.2 Divide-and-Conquer and Recursion . . . . . . . . . . . . . . . . . . . . . . . . 3 6.3 General Decision Tree Algorithm . . . . . . . . . . . . . . . . . . . . . . . . . 4 6.4 Time Complexity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 6.5 ID3, C4.5, CART . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 6.5.1 General Differences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 6.5.2 ID3 – Iterative Dichotomizer 3 . . . . . . . . . . . . . . . . . . . . . . 6 6.5.3 C4.5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 6.5.4 CART . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 6.5.5 Others . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 6.6 Information Gain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 6.7 Information Theory and Entropy . . . . . . . . . . . . . . . . . . . . . . . . . 8 6.8 Why Growing Decision Trees via Entropy or Gini Impurity instead of Misclassification Error? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 6.9 Gini Impurity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 6.10 Improvements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 6.10.1 Grain Ratio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 6.1
AI summary
- Document name
- Trees notes (06) (Cây quyết định trong Máy học) - Sebastian Raschka
- School / Course
- University Wisconsin-Madison · Machine learning
- Content
- Tài liệu cung cấp kiến thức chi tiết về Cây quyết định, từ khái niệm cơ bản, thuật ngữ, các thuật toán chính (ID3, C4.5, CART), đến các phương pháp đo lường hiệu quả và xử lý overfitting, cùng ứng dụng trong bài toán hồi quy.
- Table of contents
- 6 Decision Trees
- 6.1 Introduction
- 6.1.1 Terminology
- 6.1.2 Machine Learning Categories
- 6.1.3 Relationship Between Decision Trees and Rule-based Learning
- 6.2 Divide-and-Conquer and Recursion
- 6.3 General Decision Tree Algorithm
- 6.4 Time Complexity
- 6.5 ID3, C4.5, CART
- 6.5.1 General Differences
- 6.5.2 ID3 – Iterative Dichotomizer 3
- 6.5.3 C4.5
- 6.5.4 CART
- 6.5.5 Others
- 6.6 Information Gain
- 6.7 Information Theory and Entropy
- 6.8 Why Growing Decision Trees via Entropy or Gini Impurity instead of Misclassification Error?
- 6.9 Gini Impurity
- 6.10 Improvements
- 6.10.1 Grain Ratio
- 6.11 Overfitting
- 6.11.1 Pre-Pruning
- 6.11.2 Post-Pruning
- 6.12 Decision Tree for Regression
- 6.13 Summary
- 6.13.1 Pros and Cons of Decision Trees
- Pages
- 18 pages
- Uploaded by
- Uni24h
Frequently asked questions
Is this document free?
Yes. “Trees notes (06) (Cây quyết định trong Máy học) - Sebastian Raschka” is free — just sign in and click Download to get the original file.
How many pages is this document?
The document has 18 pages, for the course Machine learning. You can preview it online before downloading.
Can I preview before downloading?
Yes. You can preview this document right on this page with the online reader, then decide whether to download.
Trees notes (06) (Cây quyết định trong Máy học) - Sebastian Raschka
Generating preview...
STAT 479: Machine Learning Lecture Notes Sebastian Raschka Department of Statistics University of Wisconsin–Madison http://stat.wisc.edu/∼sraschka/teaching/stat479-fs2018/ Fall 2018 Contents 6 Decision Trees 6.1 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 6.1.1 Terminology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 6.1.2 Machine Learning Categories . . . . . . . . . . . . . . . . . . . . . . . 2 6.1.3 Relationship Between Decision Trees and Rule-based Learning . . . . 2 6.2 Divide-and-Conquer and Recursion . . . . . . . . . . . . . . . . . . . . . . . . 3 6.3 General Decision Tree Algorithm . . . . . . . . . . . . . . . . . . . . . . . . . 4 6.4 Time Complexity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 6.5 ID3, C4.5, CART . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 6.5.1 General Differences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 6.5.2 ID3 – Iterative Dichotomizer 3 . . . . . . . . . . . . . . . . . . . . . . 6 6.5.3 C4.5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 6.5.4 CART . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 6.5.5 Others . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 6.6 Information Gain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 6.7 Information Theory and Entropy . . . . . . . . . . . . . . . . . . . . . . . . . 8 6.8 Why Growing Decision Trees via Entropy or Gini Impurity instead of Misclassification Error? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 6.9 Gini Impurity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 6.10 Improvements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 6.10.1 Grain Ratio . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 6.1
Read full document
- Document name
- Trees notes (06) (Cây quyết định trong Máy học) - Sebastian Raschka
- School / Course
- University Wisconsin-Madison · Machine learning
- Content
- Tài liệu cung cấp kiến thức chi tiết về Cây quyết định, từ khái niệm cơ bản, thuật ngữ, các thuật toán chính (ID3, C4.5, CART), đến các phương pháp đo lường hiệu quả và xử lý overfitting, cùng ứng dụng trong bài toán hồi quy.
- Table of contents
- 6 Decision Trees
- 6.1 Introduction
- 6.1.1 Terminology
- 6.1.2 Machine Learning Categories
- 6.1.3 Relationship Between Decision Trees and Rule-based Learning
- 6.2 Divide-and-Conquer and Recursion
- 6.3 General Decision Tree Algorithm
- 6.4 Time Complexity
- 6.5 ID3, C4.5, CART
- 6.5.1 General Differences
- 6.5.2 ID3 – Iterative Dichotomizer 3
- 6.5.3 C4.5
- 6.5.4 CART
- 6.5.5 Others
- 6.6 Information Gain
- 6.7 Information Theory and Entropy
- 6.8 Why Growing Decision Trees via Entropy or Gini Impurity instead of Misclassification Error?
- 6.9 Gini Impurity
- 6.10 Improvements
- 6.10.1 Grain Ratio
- 6.11 Overfitting
- 6.11.1 Pre-Pruning
- 6.11.2 Post-Pruning
- 6.12 Decision Tree for Regression
- 6.13 Summary
- 6.13.1 Pros and Cons of Decision Trees
- Pages
- 18 pages
- Uploaded by
- Uni24h
Comments (0)
No comments yet. Be the first!
Eval algo notes (11) (Các kiểm định thống kê và so sánh thuật toán) - Sebastian Raschka
Refresher probabilities statistics (Xác suất và thống kê cho Machine Learning) - Afshine Amidi and Shervine Amidi
Ensembles notes (07) (Các phương pháp học ensemble) - Sebastian Raschka
Super cheatsheet machine learning (Khái niệm và công thức chính trong học máy) - Afshine Amidi and Shervine Amidi
Cheatsheet Deep Learning (Khái niệm chính về học sâu) - Afshine Amidi and Shervine Amidi
Chương 7.Cơ học lượng tử - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Chương 6.Quang học lượng tử - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Chương 5.Thuyết tương đối - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Chương 4. Tán xạ ánh sáng - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Chương 3.Phân cực ánh sáng - Vật lý đại cương 3 - TS.Nguyễn Thị Trang
Comments (0)
No comments yet. Be the first!