Schedule

Notes:

• Unless otherwise noted, assignment submissions are due by 1pm on the Friday of the week indicated. (They will also be clearly indicated in each homework description.)
• The schedule is subject to change, as the semester progresses, however any changes will be made at least one week in advance of the dates affected.

---

Week 1. January 14

• Topics
  • NLP Overview
  • Scala Overview
• Readings (1/16)
  • The Scala REPL, expressions, variables, basic types, simple functions, saving and running programs, comments.
  • Tuples, Lists, methods on Lists and Strings
  • Conditional execution with if-else blocks and matching
  • Iterating, mapping, filtering and counting

Week 2. January 21

NOTE: No class on Monday, January 21 (Martin Luther King, Jr. Day)

• Topics

  • Regular expressions
  • Scala: functional programming

• Readings (1/23)

  • Regular expressions and matching with them
  • Regular expression matching and substitution with the Regex API
  • Maps, Sets, groupBy, Options, flatten, flatMap
  • Word counting, scala.io.Source, file access, flatMap, mutable Maps
  • Code blocks, coding style, closures, Scala documentation project.

• Due. Homework1: Scala

Week 3. January 28

• Topics

  • Authorship attribution
  • Spelling correction
  • Vector-space models and computing similarity
  • Scala: object-oriented programming
  • Build systems

• Readings (1/28)

  • Variations for computing results from sequences in Scala
  • Student questions about Scala, Part 1
  • Student questions about Scala, Part 2

• Readings (1/30)

  • Objects, classes, inheritance, traits, Lists with multiple related types, apply
  • Scripting, compiling, main methods, return values of functions
  • SBT, scalabha, packages, build systems
  • Manning et al, Chapter 6, Section 6.3.

• Due. Project Phase One

Week 4. February 4

• Topics
  • Clustering
  • Data formats (CSV, XML, JSON)
• Readings (2/4)
  • Basic XML processing with Scala
  • Manning et al, Chapter 16, Sections 16.1-16.4.
• Readings (2/6)
  • Processing JSON in Scala using Jerkson
  • Manning et al, Chapter 17, Sections 17.1-17.4.
• Due. Homework2: Regular expressions

Week 5. February 11

• Topics
  • Classification
• Readings (2/11)
  • Manning et al, Chapter 13, Sections 13.1,13.2,13.6
• Readings (2/13)
  • Manning et al, Chapter 14, Sections 14.0,14.1,14.3-14.5

Week 6. February 18

• Topics
  • Evaluation
  • Sentiment analysis
• Due (2/18). Project Phase Two

Week 7. February 25

• Topics
  • Topic models
• Due (2/25): Homework3: Clustering

Week 8. March 4

• Topics
  • In class exercise: Topic Modelling
• Due (3/8). Project Phase Three

Spring Break. March 11-16

Week 9. March 18

• Topics
  • Part-of-speech Tagging
  • Named entity recognition
  • Label propagation
  • In class exercise: Chalk tutorial for sentence detection, tagging and NER
• Due. Homework 4: Classification

Week 10. March 25

• Topics
  • Deduplication
  • PageRank
• Due. Project: step 4

Week 11. April 1

• Topics
  • Text analysis pipelines
  • Hadoop and Spark
  • Amazon Web Services
• Due. Homework 5: Sentiment analysis

Week 12. April 8

• Topics
  • Geolocation
  • Spark
• Due. Project: step 5

Week 13. April 15

• Topics
  • Streaming data
• Due. Homework 6: Scaling, visualization

Week 14. April 22

• Topics
  • Parsing
• Due. Project: step 6

Week 15. April 29

• Topics
  • Project demos
  • Wrap-up

Finals week

• Due. Project code and write-up