CSE 8337 Spring 2009
Information Retrieval

• Introduction to Information Storage
  by Christopher D. Manning, Prabhakar Raghavan, and Hinrich Schutze
  Book resources

The objective of this course is to examine techniques used to store and retrieve unformatted/textual data. Examination of current research topics of data mining, data warehousing, digital libraries, hypertext and multimedia data are also included. Of course Web search engines will be examined.

CSE7330 or equivalent as well as CSE 3358 are prerequisites for this course.

• CSE8337 Course Outline

• Course Notes/Slides:
  • Slides Part A
  • Slides Part B
  • Slides Part C
  • Modeling HO
  • Introduction to Modern Information Retrieval by Gerard Salton and Michael J. McGill, McGraw-Hill
  • Modern Information Retrieval by Ricardo Baeza-Yates and Berthier Ribeiro-Neto, Addison-Wesley
  • Slides Part D
  • Slides Part E
  • Introduction to Text Mining, by Rene Witte
  • An Eye on Information Retrieval in Hypertext Systems
  • Multimedia Information Retrieval
  • The Semantic Web of Data by Tim Berners Lee)
  • Semantic Web (Wikipedia)
  • RDFa Basics
  • Web Spam Detection with Anti-Trust Rank
  • Cleaning Search Results using Term Distance Features
  • Grand Challenges for Information Retrieval in the Biomedical Domain by William Hersh

• PROJECTS
  • PROJ 1
  • URL Normalization
  • URL Canonicalization
  • PROJ 2
    Project 2 Presentation must be your own presentation that you have written yourself. You may not use a presentation created by someone else.
  • PROJ 3
  • PROJ 4

• HW
  • HW 1
  • Tries
  • NIST - Data Structures
  • HW 2
  • HW 3
  • A Formal Derivation of Heaps' Law by F.A. Grootjen, D.C. van Leijenhorst, and Th.P. van der Weide
  • HW 4
  • HW 5

• LINKS
  • General
    • DBLP
    • Research Index
    • Handbook of Algorithms and Data Structures
    • ACM SIGIR
    • TREC
    • "WordNet"
    • Zipf's Law
    • Heaps' Law
    • Information Retrieval Education Resources, University of Pittsburgh
    • P-norm
    • Bayes Theorem
    • Zotero: The Next-Generation Research Tool Theorem (Contributed by Tom Shadle)
  • Simple Text Processing
    • Perl Regular Expressions
    • Exact String Matching Algorithms
    • SnowBall
  • Boolean Queries
    • Mi lslita, The Extended Boolean Model
    • extended Boolean query
  • Tokenization/Stemming
    • Lexical Analysis (Wikipedia)
    • Tokenization
    • Porter Stemming Algorithm
    • Porter's Stemming Algorithm Online
    • Lovins Stemming Algorithm
    • Stop Words (wikipedia)
    • Stop Words
  • the Web
    • The Indexable Web is more than 11.5 billion pages, by Antonio Fulli and Alessio Signorini
    • Web Coverage
    • WIKINOMICS | HOME
    • Information Retrieval on the Web" by Mei Kobayashi and Koichi Takeda
    • "The Bubble of Web Visibility" by Marco Gori and Ian Witten
    • Deep (Invisible) Web by Manoj Ravuru
  • Search Engines
    • Google:
      • Google
      • Technology Overview
      • Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd, "The PageRank Citation Ranking: Bringing Order to the Web," 1998.
      • Google API
    • Firefox
      • Firefox - Rediscover the Web
      • Firefox Resources
    • Altavista
    • Hotbot
    • Northern Light
    • Harvest
    • Phil Bradley, "Major Search Engines'; a comparison"
  • Metasearch Engines
    • Metacrawler
    • Pandia Metasearch
    • Meta Search Guide
    • Search.com
    • KartOO visual meta search engine
    • "Multi-Search Engines - A Comparison" by Phil Bradley
    • "Meta-Search Engines" UC Berkeley - Teaching Library Internet Workshops
  • Retrieval Evaluation and Feedback:
    • "Text Retrieval Quality: A Primer"
    • Cystic Fibrosis Reference Collection
    • TREC 2009 Legal Track
    • The magnificent ROC
    • MUC-5 Evaluation Metrics, by Nanch Chinchor and Beth Sundheim
    • Common Evaluation Measures, TREC 15, 2006
    • "The truth of the F-Measure" by Yutaka Sasaki
  • Text Analysis and Mining:
    • What is Text Mining? by Marti Hearst
    • Tapping the Power of Text Mining, by Weiguo Fan, Linda Wallace, Stephanie Rich, and Zhongju Zhang
    • Literature-based discovery on the World Wide Web, by Michael Gordon, Robert K. LIndsay, and Weiguo Fan
    • Beyond Keywords: Automated Question Answering on the Web by Dmitri Roussinov, et.al.
    • NSIR QA System
    • Stanford Parser
    • Thread Detection in Dynamic Text Message Streams by Dou Shen, Qiang Yang, Jian-Tao Sun, and Zheng Chen
  • Hypertext
    • As We May Think by Vannevar Bush
    • Ted Nelson & Xanadu
    • Hypertext & Information Retrieval & Web Mining
    • Hypertext
  • Multimedia IR:
    • Comparing Images Using Color Coherence Vectors, by G. Pass, R. Zabih, and J. Miller
    • Shape Matching Examples, by Eamonn Keogh
    • ANSES: Summarization of news video, byt Marcus J. Pickering, Lawrence Wong, and Stefan M. Ruger
    • ImageCLEF - Image Retrieval in CLEF
    • Query by Humming with the Vocalsearch System, by Willaim Birmingham, Roger Dannenberg, and Bryan Pardo, Communications of hte ACM, August 2006, Vo 49, No 8, pp49-52
    • Approximate Matching Algoritms for Music Information Retrieval Using Vocal Input, by Richard L. Kline and Ephraim P. Glinert, Proceedings of the eleventh ACM Internation Conference on Multimdedia (MM'03), Noverber 2003, pp 130-139
    • Time Series Alignmnet for Music Information Retrieval, by Norman H. Adams, Mark A. Bartsch, Jonah B. Shifrin, and Gregory H. Wakefield, Proceedings of the fifth International Conference on Music Information Retrieval (ISMIR 2004), October 2004
    • Geographic Information Retrieval and Spatial Browsing
    • ACM Multimedia 2009
    • ICME 2009
    • MIR 2009
    • GIR Workshops
    • MMIR Group Imperial College
    • Center for Digital Video Processing, Dublin City University
    • Viper/Multimedia Evaluation
    • Image Database Retrieval of Rotated Objects by User Sketch
  • Semantic Web
    • The Semantic Web by Tim Berners-Lee, James Hendler and Ora Lassila
    • Toward the Semantic Deep Web by James Geller, Soon Ae Chun, and Yoo Jung An
    • URI vs URL vs URN
    • Introducing RDFa by Bob DuCharme
    • FOAF Vocabulary Specification 0.9
    • Understanding HTML, XML and XHTML
    • SWOOGLE
    • International Semantic Web Conference 2008
    • August 2009: How Google beat Amazon and Ebay to the Semantic Web
    • RDF Primer
    • W3 Tutorials: RDF, XML Tutorials
  • Adversarial Information Retrieval
    • Adversarial Information Retrieval on the Web (AIRWeb 2006) by Brian D. Davison, Marc Najork, and Tim Converse
    • WIRWeb Workshops
    • Combating Web Spam with TrustRank
  • Biomedical Information Retrieval
    • On Iterative Intelligent Medical Search by Gang Luo and Chunqiang Tang
    • GENIES: A natural-language Processing System for the Extraction of Molecular Path3ways from Journal Articles
    • PubMed
    • Gogle Health