EE 8392 – Advanced Information Theory
Spring 2006

Course Information

  • Class Time : Saturday 10:00 am – 12:50 pm
  • Class Location : Caruth 214
  • Instructor : Dinesh Rajan
  • Prerequisite: Preliminary course on information theory.  A graduate course on stochastic process might be helpful, but is not required.
  • Textbooks: No single text. Material from the reference books given below will be used and papers will handed out as required.
  • Reference books:
    1. Elements of Information Theory, T. Cover and J. Thomas, 1991
    2. A First Course in Information Theory, Raymond W. Yeung
    3. Information Theory and Reliable Communication, R.G. Gallagher New York, NY: John Wiley and Sons, 1971
  • Office hours: TBD

Grading

  • Home works (30%)
  • Project (60% - break up shown below)
    1. Project proposal (15%)
    2. Final Project report (35%)
    3. Final project presentation (10%)
    4. For distance students, the final project presentation report will be 45%
    5. A list of suggested topics will be made available at beginning of the semester; you are welcome to choose a topic on your own outside the list.
  • Final Exam (10%)
    The exam will be open book. However, you are not allowed to look for solutions to problems on the Internet. On the home works, you are encouraged to work in teams; however, each one of you should turn in your solutions independently. There will be approximately 4 homework’s.

Topics

  • Review of basic information theory (1 lecture)
  • Multiuser information theory
    • Random Access Channels
    • Broadcast Channels
    • Slepian-Wolf Encoding
  • Network Coding
  • MIMO capacity and vector channels
  • Minimum description length principle
  • Kolmogorov complexity
  • Applications of information theory in bioinformatics, stock market, and other areas

* Disability Accommodations: Students needing academic accommodations for a disability must first contact Ms. Rebecca Marin, Coordinator, Services for Students with Disabilities (214-768-4557)* to verify the disability and establish eligibility for accommodations. They should then schedule an appointment with the professor to make appropriate arrangements. (See University Policy No. 2.4.)
* Religious Observance: Religiously observant students wishing to be absent on holidays that require missing class should notify their professors in writing at the beginning of the semester, and should discuss with them, in advance, acceptable ways of making up any work missed because of the absence. (See University Policy No. 1.9.)
* Excused Absences for University Extracurricular Activities: Students participating in an officially sanctioned, scheduled University extracurricular activity will be given the opportunity to make up class assignments or other graded assignments missed as a result of their participation. It is the responsibility of the student to make arrangements with the instructor prior to any missed scheduled examination or other missed assignment for making up the work. (University Undergraduate Catalogue)

back