CSE 5331/7331 Fall 2009
AN INTRODUCTION TO DATA MINING AND RELATED TOPICS

Course Syllabus (updated)

Book:

Data Mining Introductory and Advanced Topics by Margaret H. Dunham Prentice Hall, 2003 Book Web Page

Class Material

• Slides
• WEKA download
• WEKA slides
• R download
• R tutorial
• Quick-R
• Tutorial on E-Commerce and ClickStream Mining by Jonathan Becher and Ronny Kohavi
• Web Mining
• Suffix Trees and Suffix Arrays by Haim Kaplan

Homework

• HW 1
• HW 2
• Data for HW 2
• DM Articles:
  • "Tall Men Are Happier and Richer," Recommended by Pavani Akundi
  • "Google Economist Sees Good Signs in Searches," Recommended by Daniela Briceno
  • "Depression can affect cancer survival," Recommended by Don Burgio
  • "Application of Bayesian Partition Models in Warranty Data Analysis," Recommended by Sudheer Chelluboina
  • "Big week ahead on Wall Street," Recommended by Cory Cothrum
  • "How Did Economists Get it So Wrong?" Recommended by Jeff Farris
  • "Dallas-area home listings fall substantially," Recommended by Kar Liew
  • "Mining the Web for Feelings, Not Facts," Recommended by Elizabeth Morris
  • "Productivity gains in 2Q due mainly to cost cuts," Recommended by David Origer
  • "Data Analytics Software Helps Transit Authorities Meet Rider Demand," Recommended by Deborah Sparkman
• HW 3
• HW 4

Projects

• Project 1
• Parkinson's Disease
• Project II
• Cisco Data for Project II
• "Rare Event Detection in a spatiotemporal Environment" by Yu Meng, Margaret H. Dunham, F. Marco Marchetti and Jie Huange (Publication using Cisco Data)
• Project III
• Project III Data

Supplementary Class Material

• Introduction
  • CRISP-DM
  • The Chi-Square Test
  • Chi-Square Probabilitites
  • Privacy:
    • Privacy Cartoon
    • Government Wiretapping
  • Visualization:
    • Box Plot
    • Lift Chart
    • Data Modeling and Mining: Why Lift? by David S. Coppock
  • Dimentionality Reduction
    • A Tutorial on Principal Component Analysis by Jonathon Shlens
    • Reducing Data Dimension from CMU Machine Learning Class
    • Principal Components Analysis Tutorial by Lindsay Smith
• Techniques
  • Neuron
  • Neuron Firing Video
  • Genetic Algorithm Example
  • Support Vector Machines:
    • DTREG SVM
    • SVM - Support Vector Machines
• Classification
  • Nonlinear Regression
  • Decision Trees:
    • Example 4.9
    • Gain vs. Gain-Ratio
    • Excerpt from Classification and Regression Trees by leo Breiman, Jerome H. Friedman, Richard A. Olshen, and Charles J. Stone
    • (submitted by Nathan Banek and his brother) Twenty Questions Web Site
  • Neural Networks:
    • Neural Networks by Christos Stergiou and Dimitrios Siganos
    • Artificial Neural Networks Technology by Dave Anderson and George McNeil
    • Derivation of weight change calculation for gradient descent
    • How many hidden units should I use?
    • Kohonen Networks
    • SOM Demonstration
    • SOM of the Market
    • Momentum and Learning Rate Adaptation
• Clustering:
  • Original BIRCH paper
  • Original DBSCAN paper
  • Original CURE paper
  • COBWEB on Wikipedia
  • Original COBWEB paper
• Related Topics
  • QuickStudy: Extract, Transform and Load (ETL) by Marc L. Songini
  • Dimensional Modeling:
    • Decision Support by R. Ramakrishnan and J. Gehrke
    • OLAP Analysis
    Data Warehouse:
    • The Data Warehouse Institute
    • The Data Warehousing Information Center
    • The Kimball Group
    • DB2 Data Warehouse Edition
    • Data Warehousing and OLAP by Hector Garcia-Molina
• Advanced Topics:
  • Mining Association Rules: Anti-Skew Algorithms by Jun-Lin Lin and Margaret H. Dunham
  • Web Usage Mininge & Clickstream Data
    • "Efficient Mining of Traversal Patterns" by Yongqiao Xiao and Margaret H. Dunham
    • "FS-Miner: Efficient and Incremental mining of Frequent Sequence Patterns in Web Logs' by Maged El-Sayed, Carolina Ruiz, and elke A. Rundensteiner
    • "Scalability of OAT" by Jason Mizher, Margaret H. Dunham, Lin Lu, and Yongqiao Xiao
    • "Discovery of Significant Usage Patterns from Clusters of Clickstream Data" by Lin Lu, Margaret H. Dunham, and Yu Meng
    • "Cache Busting: Busted?" by Jeremy Lockhorn

Metrics:

• Comparing Attributes:
  • Covariance and Correlation
  • Chi Squared Independence Test
  • Chi Squared Independence Test
  • P Value
• Accuracy:
  • ROC Curve
  • ROC Curve
  • ROC Example profided by Dr. Monnie McGee
  • Area under ROC
  • Kappa Statistic
  • Kappa Statistic
  • F-Measure

Tools:

• Winplot (Peanut Software)
• Zoomit
• XLMiner
• WEKA
• WEKA documentation
• Stuttgart Neural Network Simulator
• Rulequest
• ODBCMine Decision Trees
• Salford Systems (CART)
• Hierarchical Clustering Explorer

Resources:

• Electronic Textbook
• Mathworld
• Statistics Primer (Revised)
• KDNuggets
• ACM SIGKDD
• The Data Mine
• SMU Library User Education, Citing Sources: APA Style
• IEEE Citation Style