Introduction to the Theory of Computation

Teaching Staff: Oikonomou Konstantinos, Skiadopoulos Konstantinos
Code: ΗΥ030
Course Type: Elective Course
Course Level: Undergraduate
Course Language: Greek
Semester: 3rd
ECTS: 4
Teaching Units: 4
Lecture Hours: 2
Lab/Tutorial Hours: 2T
Total Hours: 4
E Class Page: https://e-class.ionio.gr/courses/DCS264/
Curricula: Curriculum in Informatics up to 2024-25

Short Description:

Entropy, relative entropy. The second law of thermodynamics. «Asymptotic equipartition» property. Entropy and stochastic processes. Data compression. Optimal codes, Huffman code, Shannon-Fano-Elias code. Kolmogorov algorithmic complexity. Channel capacity. Shannon’s fundamental theorem. Differential entropy. Gauss bus. Information theory and advanced statistical issues. Maximum Entropy. Source coding. Approximation by Markov process. Galois bodies. Rate-loss function. Signals and noise. Error Correction Codes. Hamming codes, Reed-Muller codes. Information Theory Applications in investment theory.

Back