(in Polish) Teoria informacji 0800-M-TINFOR

1. How to measure possesed information, decision systems and Huffman code, Shannon information.
2. Properties of Shannon information, joint information, relative information, mutual information
3. Sending an information through channel, channel capacity, Shannon theorem, error correcting codes.
4. Information about Markov process result, markovian approximation of processes, information per sign or time unit in natural languages.
5. Kolmogorov complexity
6. Data copmression algorithms
7. Physical aspects of informaion - Landauer principle and Gibbs distribution
8. Elements of Quantum Information Theory

Learning outcomes - knowledge

Physical meaning of information and its relaions with work and heat. Differences between classical and quantum information.

Learning outcomes - skills

Ability of construction of data compresion algorithms for a given source, ability of approximation of a given source of correlated output with a Markov process. Ability of construction of codes sending information through noisy channels. Ability of prooving properties of Shannon / von Neumann information Estimating from above the Kolmogorov complexity

Learning outcomes - social competencies

none

Teaching methods

lecture

Type of course

elective course

Prerequisites

Analysis I, Algebra I, elementary probability calculus

Course coordinators

Gniewomir Sarbicki

Assessment criteria

Oral exam

Bibliography

A. Dąbrowski "O Teorii Informacji"
T.M. Cover, J.A. Thomas "Elements of Information Theory"

Additional information

Additional information (registration calendar, class conductors, localization and schedules of classes), might be available in the USOSweb system:

Description of 0800-M-TINFOR in USOSweb