Web Search Engines
Room WWH 102
Professor Ernest Davis
- phone: (212) 998-3123
- office: 329 Warren Weaver Hall
- office hours: Tuesday 10:00-12:00, Thursday 3:00-4:00
or by appointment.
Introduction to Information Retrieval by Christopher Manning,
Prabhakar Raghavan, and Hinrich Schutze, Cambridge U. Press, 2008.
Available online .
Mining the Web: Discovering Knowledge from Hypertext
Data by Soumen Chakrabarti
Tentative list of course topics:
We will discuss the design of a Web search engine and the extraction of
information off the Web. Topics include
- Web crawlers.
- Database design.
- Query language.
- Relevance ranking
- Document Similarity and Clustering
- The "invisible" Web
- Specialized search engines
- Natural Language Processing
- The structure of the web
- Web content mining
- Web usage mining
- Business model: Pricing advertizing
- Multi-media retrieval.
- Multilingual retrieval.
Note: These are not complete lecture notes. They have cross references and
material that I preferred to project than to write on the blackboard.
Lecture 1: Jan. 26
Lecture 2: Relevance and PageRank Feb. 2
Lecture 3: Index, Query answering, Hardware
Lecture 4: Near Duplicates; Evaluation Feb. 16
Lecture 5: Clustering Feb. 23
Lecture 6: Sponsored Links. Collaborative Filtering
Slides of Wei Xu's
talk on NLP tools. Mar. 9
Lecture 7: Specialized Search Engines Mar. 9
Lecture 8: Invisible
Web; Table Search; Sentiment Analysis. Mar. 23
Lecture 9: Result Diversity and Query Log Mining
Lecture 10: Images and Music April 6
Lecture 11: The Multi-Lingual Web April 13
Lecture 12: Information Extraction April
Lecture 13: Software Search April 27
Lecture 14: The Politics and Ethics of Search Engines
The instructional assistants for this course are
| Daniel Galron
|| 704 715 Bway
|| Monday 4-6
Students with last names A-P.
Wei Xu || firstname.lastname@example.org || x8-3365 || 713 719 Bway
|| Tuesday 5-7
||Students with last names Q-Z.
A course project. (60%)
Final exam (40%).
Class email list
the class email web page and follow the instructions there for
Information about hosting web pages on the CIMS server can be found at
The Web at Courant
The final exam will be given Wednesday, May 11, 5:00-7:00, WWH 102.
Format of the Final Exam
Sample Exam, Part I
Sample Exam, Part I: Solutions