Courses – Fakultet tehničkih nauka u Novom Sadu

Subject: Introduction to Information Theory (17.EK310)

Native organizations units: Department of Power, Electronic and Telecommunication Engineering

Type of studies	Title
Undergraduate Academic Studies	Biomedical Engineering (Godina: 3, Winter)

General information:

Category	Scientific-professional
Scientific or art field	Telecommunications and Signal Processing
Interdisciplinary	No
ECTS	6

Educational goal:

Introduction to the basics of the information theory and an overview of algorithms used in information processing.

Educational outcome:

The knowledge of basic postulates of the information theory.

Course content:

- Introduction to information theory; - Source coding (statistical coding), block code for data compression, optimal prefix code (Huffman code), Arithmetic coding, Universal codes, Lempel-Ziv algorithms; - Channel coding (Model of the communication channel, Transinformation, Equivocation, Irrelevance, Channel capacity and the methods of calculation, Optimal decoding. MAP criterion, The properties of binary symmetric channel, Convolutional codes and algorithms for their decoding)

Teaching methods:

The lectures are continuously followed by synchronized oral and computer exercises. Oral exercises contain practical problem solving sessions principally related to information theory. In the computer lab students obtain practical experience with algorithms used in information theory. Through the teaching process, students are constantly motivated to an intensive discussion, problem oriented reasoning, independent study work and active participation in the whole lecturing process. The prerequisite to enter the final exam is to complete the pre-exam assignments by earning at least 10 points.

Literature:

Authors	Title	Year	Publisher	Language
Šenk, V.	Uvod u teoriju informacija	2006	Fakultet tehničkih nauka, Novi Sad	Serbian language

Knowledge evaluation:

Course activity	Pre-examination	Obligations	Number of points
Exercise attendance	Yes	Yes	5.00
Homework	Yes	Yes	5.00
Practical part of the exam - tasks	No	Yes	20.00
Laboratory exercise attendance	Yes	Yes	5.00
Test	Yes	Yes	10.00
Lecture attendance	Yes	Yes	5.00
Oral part of the exam	No	Yes	50.00