IEG5154 Information Theory
Semester: Spring 2009
Course Title: IEG 5154 Information Theory
|
Description: The course aims to cover
- Fundamental definitions of information measure (entropy, conditional entropy, mutual information) and their properties.
- Lossless Source Coding/Data Compression -- theory and algorithms
- Channel Coding/Error-Correcting Codes/Coding theory
- Rate-distortion theory.
-
Miscellaneous advanced topics depending on time and interest (Kolmogorov Complexity, Universal Portfolio Theory, Network Coding, ...)
|
Content, highlighting fundamental concepts
Topic
|
Contents/fundamental concepts
|
|
|
Learning outcomes:
- Demonstrate ability to manipulate basic information-theoretic quantities.
- Demonstrate understanding of foundational topics in information theory, and an ability to use the theoretic tools required to prove corresponding theorems.
- Use the above to characterize and design information storage, manipulation and transmission systems.
|
Learning activities
Lecture
|
Problem Sets
|
Online Activities (Scribe Notes/Discussion)
|
Homeworks
|
(hr)
in class
|
(hr)
in class
|
(hr)
out of class
|
(hr)
out of class
|
36
|
0
|
36
|
0
|
12
|
0
|
15
|
00
|
M
|
O
|
M
|
O
|
M
|
O
|
M
|
O
|
M: Mandatory activity in the course
O: Optional activity
NA: Not applicable
Assessment scheme
Task nature
|
Description
|
Weight
|
|
|
|
Learning resources for students
Feedback for evaluation:
Students are welcome to express their comments and suggestions via the following formal and informal feedback channels:
- Two course evaluations. First one to be conducted in the middle of the term and the second one at the end of the term. Students are encouraged to provide specific comments and/or suggestions in addition to the numeric ratings. Additionally, at the end of each lecture there will be a single question feedback slip given to each student.
- Students are also encouraged to provide feedbacks using informal channels, such as email/discussion to instructor/tutor, and via the talk pages on the class wiki.
Preliminary Course Schedule
(Will change if needed)
Date
|
Topics
|
Assigned Readings
(Mandatory)
|
Supplementary Readings: these would be useful for someone to better understand the specific topics (Optional)
|
Problem Set
|
|
|
|
|
|
Teachers’ or TA’s contact details
Professor/Lecturer/Instructor:
|
|
Name:
|
Prof. Sidharth Jaggi
|
Office Location:
|
SHB Room 706
|
Telephone:
|
2609-4326
|
Email:
|
jaggi@ie.cuhk.edu.hk
|
Teaching Time and Venue:
|
Mon 4:30pm to 6:15pm, LSB 241,
Thu 5:30pm to 6:15pm, LSB 241.
|
Website:
|
http://ieg5154.pbwiki.com
|
Other information:
|
Office Hours: by appointment
|
A facility for posting course announcements
Academic honesty and plagiarism
Attention is drawn to University policy and regulations on honesty in academic work, and to the disciplinary guidelines and procedures applicable to breaches of such policy and regulations. Details may be found at http://www.cuhk.edu.hk/policy/academichonesty/ . With each assignment, students will be required to submit a statement that they are aware of these policies, regulations, guidelines and procedures.
|
Additional Resources:
Problem Sets
(Will update weekly)
Tutorial Notes
Comments (0)
You don't have permission to comment on this page.