Subject: Introduction to Information Theory (17 - EK310)

Basic Information

Scientific or art field:Telecommunications and Signal Processing
Course specification

Course is active from 10.10.2007..

Course which have preconditioned courses Introduction to Information Theory

Course idMandatoryMandatory
Channel coding techniquesYesYes
Introduction to the basics of the information theory and an overview of algorithms used in information processing.
The knowledge of basic postulates of the information theory.
- Introduction to information theory; - Source coding (statistical coding), block code for data compression, optimal prefix code (Huffman code), Arithmetic coding, Universal codes, Lempel-Ziv algorithms; - Channel coding (Model of the communication channel, Transinformation, Equivocation, Irrelevance, Channel capacity and the methods of calculation, Optimal decoding. MAP criterion, The properties of binary symmetric channel, Convolutional codes and algorithms for their decoding)
The lectures are continuously followed by synchronized oral and computer exercises. Oral exercises contain practical problem solving sessions principally related to information theory. In the computer lab students obtain practical experience with algorithms used in information theory. Through the teaching process, students are constantly motivated to an intensive discussion, problem oriented reasoning, independent study work and active participation in the whole lecturing process. The prerequisite to enter the final exam is to complete the pre-exam assignments by earning at least 10 points.
Šenk, V.Uvod u teoriju informacija2006Fakultet tehničkih nauka, Novi SadSerbian language
Course activity Pre-examination ObligationsNumber of points
Exercise attendanceYesYes5.00
Laboratory exercise attendanceYesYes5.00
Lecture attendanceYesYes5.00
Oral part of the examNoYes50.00
Practical part of the exam - tasksNoYes20.00
Name and surnameForm of classes
Missing picture!

Šenk Vojin
Full Professor

Missing picture!

Kovačević Mladen
Associate Professor

Missing picture!

Devaja Tijana
Assistant - Master

Practical classes
Missing picture!

Devaja Tijana
Assistant - Master

Laboratory classes
Missing picture!

Simić Nikola
Asistent sa doktoratom

Laboratory classes