×

Faculty of Technical Sciences

Subject: Introduction to Information Theory (17.EK310)

Native organizations units: Department of Power, Electronic and Telecommunication Engineering

General information:
 
Category Scientific-professional
Scientific or art field Telecommunications and Signal Processing
ECTS 6

Introduction to the basics of the information theory and an overview of algorithms used in information processing.

The knowledge of basic postulates of the information theory.

- Introduction to information theory; - Source coding (statistical coding), block code for data compression, optimal prefix code (Huffman code), Arithmetic coding, Universal codes, Lempel-Ziv algorithms; - Channel coding (Model of the communication channel, Transinformation, Equivocation, Irrelevance, Channel capacity and the methods of calculation, Optimal decoding. MAP criterion, The properties of binary symmetric channel, Convolutional codes and algorithms for their decoding)

The lectures are continuously followed by synchronized oral and computer exercises. Oral exercises contain practical problem solving sessions principally related to information theory. In the computer lab students obtain practical experience with algorithms used in information theory. Through the teaching process, students are constantly motivated to an intensive discussion, problem oriented reasoning, independent study work and active participation in the whole lecturing process. The prerequisite to enter the final exam is to complete the pre-exam assignments by earning at least 10 points.

Authors Title Year Publisher Language
Course activity Pre-examination Obligations Number of points
Exercise attendance Yes Yes 5.00
Practical part of the exam - tasks No Yes 20.00
Test Yes Yes 10.00
Homework Yes Yes 5.00
Lecture attendance Yes Yes 5.00
Oral part of the exam No Yes 50.00
Laboratory exercise attendance Yes Yes 5.00
API Image

Assoc. Prof. Aleksandar Minja

Associate Professor

Lectures

API Image

Assoc. Prof. Mladen Kovačević

Associate Professor

Lectures

Asistent sa doktoratom Tijana Devaja

Assistant with PhD

Practical classes

API Image

Asst. Prof. Nikola Simić

Assistant Professor

Laboratory classes

Asistent sa doktoratom Tijana Devaja

Assistant with PhD

Laboratory classes

Faculty of Technical Sciences

© 2024. Faculty of Technical Sciences.

Contact:

Address: Trg Dositeja Obradovića 6, 21102 Novi Sad

Phone:  (+381) 21 450 810
(+381) 21 6350 413

Fax : (+381) 21 458 133
Emejl: ftndean@uns.ac.rs

© 2024. Faculty of Technical Sciences.