SlideShare uma empresa Scribd logo
1 de 50
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Course Syllabus ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Course Syllabus ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Course Syllabus ,[object Object],[object Object],[object Object],[object Object],[object Object]
Motivation:   “Necessity is the Mother of Invention” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Why Mine Data? Commercial Viewpoint ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Why Mine Data? Scientific Viewpoint ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
What Is Data Mining? ,[object Object],[object Object],[object Object],[object Object],[object Object]
Examples: What is (not) Data Mining? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Mining: Classification Schemes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Decisions in Data Mining ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Mining Tasks ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Classification: Definition ,[object Object],[object Object],[object Object],[object Object],[object Object]
Classification Example categorical categorical continuous class Training  Set Learn  Classifier Test Set Model
Classification: Application 1 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Classification: Application 2 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Classification: Application 3 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Classification: Application 4 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Classifying Galaxies Early Intermediate Late ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Clustering Definition ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Illustrating Clustering ,[object Object],Intracluster distances are minimized Intercluster distances are maximized
Clustering: Application 1 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Clustering: Application 2 ,[object Object],[object Object],[object Object],[object Object]
Association Rule Discovery: Definition ,[object Object],[object Object],Rules Discovered: {Milk} --> {Coke} {Diaper, Milk} --> {Beer}
Association Rule Discovery: Application 1 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Association Rule Discovery: Application 2 ,[object Object],[object Object],[object Object],[object Object],[object Object]
The Sad Truth About Diapers and Beer ,[object Object]
Sequential Pattern Discovery: Definition ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Regression ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Deviation/Anomaly Detection ,[object Object],[object Object],[object Object],[object Object]
Data Mining and Induction Principle ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Problems with Induction ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Hypothesis-Based vs. Exploratory-Based ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Hypothesis-Based vs. Exploratory-Based ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Mining: A KDD Process ,[object Object],Data Cleaning Data Integration Databases Data Warehouse Knowledge Task-relevant Data Data Selection  Data Preprocessing Data Mining Pattern Evaluation
Steps of a KDD Process   ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Mining and Business Intelligence   Increasing potential to support business decisions End User Business Analyst Data Analyst DBA Making Decisions Data Presentation Visualization Techniques Data Mining Information Discovery Data Exploration OLAP, MDA Statistical Analysis, Querying and Reporting Data Warehouses / Data Marts Data Sources Paper, Files, Information Providers, Database Systems, OLTP
Data Mining: On What Kind of Data? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Mining: Confluence of Multiple Disciplines   Data Mining Database  Technology Statistics Other Disciplines Information Science Machine Learning Visualization
Data Mining vs. Statistical Analysis ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Mining vs. DBMS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data Mining and Data Warehousing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
An OLAM Architecture Data  Warehouse Meta Data MDDB OLAM Engine OLAP Engine User GUI API Data Cube API Database API Data cleaning Data integration Layer3 OLAP/OLAM Layer2 MDDB Layer1 Data Repository Layer4 User Interface Filtering&Integration Filtering Databases Mining query Mining result
DBMS, OLAP, and Data Mining   Who will buy a mutual fund in the next 6 months and why? What is the average income of mutual fund buyers by region by year? Who purchased mutual funds in the last 3 years? Example question Induction (Build the model, apply it to new data, get the result) Multidimensional data modeling, Aggregation, Statistics Deduction (Ask the question, verify with data) Method Insight and Prediction Analysis Information Type of result Knowledge discovery of hidden patterns and insights Summaries, trends and forecasts Extraction of detailed and summary data Task Data Mining OLAP DBMS
Example of DBMS, OLAP and Data Mining: Weather Data DBMS: no true 91 71 rainy 14 yes false 75 81 overcast 13 yes true 90 72 overcast 12 yes true 70 75 sunny 11 yes false 80 75 rainy 10 yes false 70 69 sunny 9 no false 95 72 sunny 8 yes true 65 64 overcast 7 no true 70 65 rainy 6 yes false 80 68 rainy 5 yes false 96 70 rainy 4 yes false 86 83 overcast 3 no true 90 80 sunny 2 no false 85 85 sunny 1 play windy humidity temperature outlook Day
Example of DBMS, OLAP and Data Mining: Weather Data ,[object Object],[object Object],[object Object],[object Object],[object Object]
Example of DBMS, OLAP and Data Mining: Weather Data ,[object Object],[object Object],[object Object],2 / 0 1 / 1 2 / 1 Week 2 2 / 0 2 / 1 0 / 2 Week 1 overcast rainy sunny 9 / 5
Example of DBMS, OLAP and Data Mining: Weather Data ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Major Issues in Data Warehousing and Mining ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Major Issues in Data Warehousing and Mining ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Mais conteúdo relacionado

Mais procurados

Knowledge discovery thru data mining
Knowledge discovery thru data miningKnowledge discovery thru data mining
Knowledge discovery thru data miningDevakumar Jain
 
Data mining , Knowledge Discovery Process, Classification
Data mining , Knowledge Discovery Process, ClassificationData mining , Knowledge Discovery Process, Classification
Data mining , Knowledge Discovery Process, ClassificationDr. Abdul Ahad Abro
 
1.2 steps and functionalities
1.2 steps and functionalities1.2 steps and functionalities
1.2 steps and functionalitiesRajendran
 
Data mining concepts and work
Data mining concepts and workData mining concepts and work
Data mining concepts and workAmr Abd El Latief
 
Data mining presentation.ppt
Data mining presentation.pptData mining presentation.ppt
Data mining presentation.pptneelamoberoi1030
 
Introduction To Data Mining
Introduction To Data Mining   Introduction To Data Mining
Introduction To Data Mining Phi Jack
 
Data mining an introduction
Data mining an introductionData mining an introduction
Data mining an introductionDr-Dipali Meher
 
Introduction to Datamining Concept and Techniques
Introduction to Datamining Concept and TechniquesIntroduction to Datamining Concept and Techniques
Introduction to Datamining Concept and TechniquesSơn Còm Nhom
 
Introduction to Data mining
Introduction to Data miningIntroduction to Data mining
Introduction to Data miningHadi Fadlallah
 
Lecture2 big data life cycle
Lecture2 big data life cycleLecture2 big data life cycle
Lecture2 big data life cyclehktripathy
 
01 Introduction to Data Mining
01 Introduction to Data Mining01 Introduction to Data Mining
01 Introduction to Data MiningValerii Klymchuk
 
Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introductionhktripathy
 

Mais procurados (20)

Knowledge discovery thru data mining
Knowledge discovery thru data miningKnowledge discovery thru data mining
Knowledge discovery thru data mining
 
Data mining
Data miningData mining
Data mining
 
Data mining , Knowledge Discovery Process, Classification
Data mining , Knowledge Discovery Process, ClassificationData mining , Knowledge Discovery Process, Classification
Data mining , Knowledge Discovery Process, Classification
 
Data mining
Data miningData mining
Data mining
 
Data mining
Data miningData mining
Data mining
 
2 Data-mining process
2   Data-mining process2   Data-mining process
2 Data-mining process
 
Data Mining
Data MiningData Mining
Data Mining
 
Ghhh
GhhhGhhh
Ghhh
 
1.2 steps and functionalities
1.2 steps and functionalities1.2 steps and functionalities
1.2 steps and functionalities
 
Data mining concepts and work
Data mining concepts and workData mining concepts and work
Data mining concepts and work
 
3 Data Mining Tasks
3  Data Mining Tasks3  Data Mining Tasks
3 Data Mining Tasks
 
Data mining presentation.ppt
Data mining presentation.pptData mining presentation.ppt
Data mining presentation.ppt
 
Introduction To Data Mining
Introduction To Data Mining   Introduction To Data Mining
Introduction To Data Mining
 
Data mining an introduction
Data mining an introductionData mining an introduction
Data mining an introduction
 
Introduction to Data Mining
Introduction to Data MiningIntroduction to Data Mining
Introduction to Data Mining
 
Introduction to Datamining Concept and Techniques
Introduction to Datamining Concept and TechniquesIntroduction to Datamining Concept and Techniques
Introduction to Datamining Concept and Techniques
 
Introduction to Data mining
Introduction to Data miningIntroduction to Data mining
Introduction to Data mining
 
Lecture2 big data life cycle
Lecture2 big data life cycleLecture2 big data life cycle
Lecture2 big data life cycle
 
01 Introduction to Data Mining
01 Introduction to Data Mining01 Introduction to Data Mining
01 Introduction to Data Mining
 
Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introduction
 

Destaque

Foraco International 2008 Annual Report
Foraco International 2008 Annual ReportForaco International 2008 Annual Report
Foraco International 2008 Annual ReportTMX Equicom
 
What Is DATA MINING(INTRODUCTION)
What Is DATA MINING(INTRODUCTION)What Is DATA MINING(INTRODUCTION)
What Is DATA MINING(INTRODUCTION)Pratik Tambekar
 
First Approach to Automatic Measurement of Frontal Plane Projection Angle Dur...
First Approach to Automatic Measurement of Frontal Plane Projection Angle Dur...First Approach to Automatic Measurement of Frontal Plane Projection Angle Dur...
First Approach to Automatic Measurement of Frontal Plane Projection Angle Dur...Oresti Banos
 
"STAGES IN THE LIFE OF MINE"
"STAGES IN THE LIFE OF MINE""STAGES IN THE LIFE OF MINE"
"STAGES IN THE LIFE OF MINE"Anus KK
 
Projection of planes
Projection of planesProjection of planes
Projection of planesSmit Parikh
 
Projection of Planes
Projection of PlanesProjection of Planes
Projection of PlanesNilesh Jakher
 

Destaque (20)

Introductory mining
Introductory miningIntroductory mining
Introductory mining
 
Lecture 4: Underground Mining
Lecture 4: Underground MiningLecture 4: Underground Mining
Lecture 4: Underground Mining
 
Data mining with big data
Data mining with big dataData mining with big data
Data mining with big data
 
Lect4
Lect4Lect4
Lect4
 
Foraco International 2008 Annual Report
Foraco International 2008 Annual ReportForaco International 2008 Annual Report
Foraco International 2008 Annual Report
 
Day 2 - Session 5: Global Hotspots (part 2)
Day 2 - Session 5: Global Hotspots (part 2)Day 2 - Session 5: Global Hotspots (part 2)
Day 2 - Session 5: Global Hotspots (part 2)
 
What Is DATA MINING(INTRODUCTION)
What Is DATA MINING(INTRODUCTION)What Is DATA MINING(INTRODUCTION)
What Is DATA MINING(INTRODUCTION)
 
Teamwork
TeamworkTeamwork
Teamwork
 
First Approach to Automatic Measurement of Frontal Plane Projection Angle Dur...
First Approach to Automatic Measurement of Frontal Plane Projection Angle Dur...First Approach to Automatic Measurement of Frontal Plane Projection Angle Dur...
First Approach to Automatic Measurement of Frontal Plane Projection Angle Dur...
 
"STAGES IN THE LIFE OF MINE"
"STAGES IN THE LIFE OF MINE""STAGES IN THE LIFE OF MINE"
"STAGES IN THE LIFE OF MINE"
 
Teamwork PPT
Teamwork PPTTeamwork PPT
Teamwork PPT
 
Unit operations of mining
Unit operations of miningUnit operations of mining
Unit operations of mining
 
Basics1variogram
Basics1variogramBasics1variogram
Basics1variogram
 
Projection of planes
Projection of planesProjection of planes
Projection of planes
 
Mining objective
Mining objectiveMining objective
Mining objective
 
Lecture 2: Prospecting to Proving
Lecture 2: Prospecting to ProvingLecture 2: Prospecting to Proving
Lecture 2: Prospecting to Proving
 
Projection of Planes
Projection of PlanesProjection of Planes
Projection of Planes
 
Topic 7-mining methods-part iii -surface mining- placer mining
Topic 7-mining methods-part iii -surface mining- placer miningTopic 7-mining methods-part iii -surface mining- placer mining
Topic 7-mining methods-part iii -surface mining- placer mining
 
Mining law
Mining lawMining law
Mining law
 
ISOMETRIC PPT
ISOMETRIC PPTISOMETRIC PPT
ISOMETRIC PPT
 

Semelhante a Lecture1

Introduction To Data Mining
Introduction To Data MiningIntroduction To Data Mining
Introduction To Data Miningdataminers.ir
 
Data Mining- Unit-I PPT (1).ppt
Data Mining- Unit-I PPT (1).pptData Mining- Unit-I PPT (1).ppt
Data Mining- Unit-I PPT (1).pptAravindReddy565690
 
Dwdm ppt for the btech student contain basis
Dwdm ppt for the btech student contain basisDwdm ppt for the btech student contain basis
Dwdm ppt for the btech student contain basisnivatripathy93
 
Data Mining Xuequn Shang NorthWestern Polytechnical University
Data Mining Xuequn Shang NorthWestern Polytechnical UniversityData Mining Xuequn Shang NorthWestern Polytechnical University
Data Mining Xuequn Shang NorthWestern Polytechnical Universitybutest
 
Week-1-Introduction to Data Mining.pptx
Week-1-Introduction to Data Mining.pptxWeek-1-Introduction to Data Mining.pptx
Week-1-Introduction to Data Mining.pptxTake1As
 
Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introductionhktripathy
 
6months industrial training in data mining, jalandhar
6months industrial training in data mining, jalandhar6months industrial training in data mining, jalandhar
6months industrial training in data mining, jalandhardeepikakaler1
 
6 weeks summer training in data mining,ludhiana
6 weeks summer training in data mining,ludhiana6 weeks summer training in data mining,ludhiana
6 weeks summer training in data mining,ludhianadeepikakaler1
 
6 weeks summer training in data mining,jalandhar
6 weeks summer training in data mining,jalandhar6 weeks summer training in data mining,jalandhar
6 weeks summer training in data mining,jalandhardeepikakaler1
 
6months industrial training in data mining,ludhiana
6months industrial training in data mining,ludhiana6months industrial training in data mining,ludhiana
6months industrial training in data mining,ludhianadeepikakaler1
 
Data mining Basics and complete description onword
Data mining Basics and complete description onwordData mining Basics and complete description onword
Data mining Basics and complete description onwordSulman Ahmed
 
Data Mining and Knowledge Discovery in Business Databases
Data Mining and Knowledge Discovery in Business DatabasesData Mining and Knowledge Discovery in Business Databases
Data Mining and Knowledge Discovery in Business Databasesbutest
 

Semelhante a Lecture1 (20)

Lecture - Data Mining
Lecture - Data MiningLecture - Data Mining
Lecture - Data Mining
 
Introduction To Data Mining
Introduction To Data MiningIntroduction To Data Mining
Introduction To Data Mining
 
Data Mining- Unit-I PPT (1).ppt
Data Mining- Unit-I PPT (1).pptData Mining- Unit-I PPT (1).ppt
Data Mining- Unit-I PPT (1).ppt
 
Data mining
Data miningData mining
Data mining
 
Dwdm ppt for the btech student contain basis
Dwdm ppt for the btech student contain basisDwdm ppt for the btech student contain basis
Dwdm ppt for the btech student contain basis
 
Data Mining Xuequn Shang NorthWestern Polytechnical University
Data Mining Xuequn Shang NorthWestern Polytechnical UniversityData Mining Xuequn Shang NorthWestern Polytechnical University
Data Mining Xuequn Shang NorthWestern Polytechnical University
 
Talk
TalkTalk
Talk
 
Week-1-Introduction to Data Mining.pptx
Week-1-Introduction to Data Mining.pptxWeek-1-Introduction to Data Mining.pptx
Week-1-Introduction to Data Mining.pptx
 
Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introduction
 
Introduction to Data Mining
Introduction to Data MiningIntroduction to Data Mining
Introduction to Data Mining
 
Chapter 1: Introduction to Data Mining
Chapter 1: Introduction to Data MiningChapter 1: Introduction to Data Mining
Chapter 1: Introduction to Data Mining
 
Introduction to data warehouse
Introduction to data warehouseIntroduction to data warehouse
Introduction to data warehouse
 
6months industrial training in data mining, jalandhar
6months industrial training in data mining, jalandhar6months industrial training in data mining, jalandhar
6months industrial training in data mining, jalandhar
 
6 weeks summer training in data mining,ludhiana
6 weeks summer training in data mining,ludhiana6 weeks summer training in data mining,ludhiana
6 weeks summer training in data mining,ludhiana
 
6 weeks summer training in data mining,jalandhar
6 weeks summer training in data mining,jalandhar6 weeks summer training in data mining,jalandhar
6 weeks summer training in data mining,jalandhar
 
6months industrial training in data mining,ludhiana
6months industrial training in data mining,ludhiana6months industrial training in data mining,ludhiana
6months industrial training in data mining,ludhiana
 
data mining
data miningdata mining
data mining
 
Data mining Basics and complete description onword
Data mining Basics and complete description onwordData mining Basics and complete description onword
Data mining Basics and complete description onword
 
Data Mining and Knowledge Discovery in Business Databases
Data Mining and Knowledge Discovery in Business DatabasesData Mining and Knowledge Discovery in Business Databases
Data Mining and Knowledge Discovery in Business Databases
 
17 cs002
17 cs00217 cs002
17 cs002
 

Lecture1

  • 1.
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14. Classification Example categorical categorical continuous class Training Set Learn Classifier Test Set Model
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37. Data Mining and Business Intelligence Increasing potential to support business decisions End User Business Analyst Data Analyst DBA Making Decisions Data Presentation Visualization Techniques Data Mining Information Discovery Data Exploration OLAP, MDA Statistical Analysis, Querying and Reporting Data Warehouses / Data Marts Data Sources Paper, Files, Information Providers, Database Systems, OLTP
  • 38.
  • 39. Data Mining: Confluence of Multiple Disciplines Data Mining Database Technology Statistics Other Disciplines Information Science Machine Learning Visualization
  • 40.
  • 41.
  • 42.
  • 43. An OLAM Architecture Data Warehouse Meta Data MDDB OLAM Engine OLAP Engine User GUI API Data Cube API Database API Data cleaning Data integration Layer3 OLAP/OLAM Layer2 MDDB Layer1 Data Repository Layer4 User Interface Filtering&Integration Filtering Databases Mining query Mining result
  • 44. DBMS, OLAP, and Data Mining Who will buy a mutual fund in the next 6 months and why? What is the average income of mutual fund buyers by region by year? Who purchased mutual funds in the last 3 years? Example question Induction (Build the model, apply it to new data, get the result) Multidimensional data modeling, Aggregation, Statistics Deduction (Ask the question, verify with data) Method Insight and Prediction Analysis Information Type of result Knowledge discovery of hidden patterns and insights Summaries, trends and forecasts Extraction of detailed and summary data Task Data Mining OLAP DBMS
  • 45. Example of DBMS, OLAP and Data Mining: Weather Data DBMS: no true 91 71 rainy 14 yes false 75 81 overcast 13 yes true 90 72 overcast 12 yes true 70 75 sunny 11 yes false 80 75 rainy 10 yes false 70 69 sunny 9 no false 95 72 sunny 8 yes true 65 64 overcast 7 no true 70 65 rainy 6 yes false 80 68 rainy 5 yes false 96 70 rainy 4 yes false 86 83 overcast 3 no true 90 80 sunny 2 no false 85 85 sunny 1 play windy humidity temperature outlook Day
  • 46.
  • 47.
  • 48.
  • 49.
  • 50.