Aller au menu Aller au contenu
Une voie, plusieurs choix
Informatique et Mathématiques appliquées
Une voie, plusieurs choix

> Formation > Cursus ingénieur

Information theory - 3MMTINF

A+Augmenter la taille du texteA-Réduire la taille du texteImprimer le documentEnvoyer cette page par mail cet article Facebook Twitter Linked In
  • Number of hours

    • Lectures : 16.5
    • Tutorials : 16.5
    • Laboratory works : -
    • Projects : -
    • Internship : -
    • Written tests : -
    ECTS : 3.0
  • Officials : Jean-Marc BROSSIER

Goals

Provide the theoretical fundamentals for the quantitative measurement of information (what is a bit of information?), Representation, storage, transmission, protection and information hiding. Application to lossless compression, error correcting codes, transmission security and content security (steganography).

Content

  • Uncertainty and information. Entropies . The Shannon entropy and its properties. Entropy and information transfer.
  • Structure of a communication chain. Information and compression. Channel capacity and channel coding.
  • Coding of discrete sources. Asymptotic equipartition. Theoretical optimal codes . Construction of optimal codes.
  • Transmit and store information. Discrete channel (binary symmetric channel). Channel coding and second Shannon theorem.
  • Error correcting codes. Repetition and second Shannon theorem. Error detection codes. Error correcting codes. Linear block codes. Hamming distance and Euclidean distance. Maximum likelihood decoding.
  • Some applications: steganography, information leakage and security.

Prerequisites

Probability

Tests

N1 = E1
N2= E2

Calendar

The course exists in the following branches:

  • Curriculum - Core curriculum - Semester 5
see the course schedule for 2022-2023

Additional Information

Course ID : 3MMTINF
Course language(s): FR

The course is attached to the following structures:

You can find this course among all other courses.

Bibliography

C. Shannon, W. Weaver, La théorie mathématique de la communication, Cassini, avril 2018.

Théorie de l'information et du codage. O. Rioul. Hermès, 2007.

Elements of Information Theory. T.M. Cover, Joy A. Thomas. John Wiley & Sons Inc, 2006.

David J.C. MacKay “Information Theory, Inference, and Learning Algorithm”, Cambridge Univ. Press, 2003. http://www.cs.toronto.edu/~mackay/itila/book.html

R.G. Gallager, « Information Theory and reliable communication », Wiley, 1968

A+Augmenter la taille du texteA-Réduire la taille du texteImprimer le documentEnvoyer cette page par mail cet article Facebook Twitter Linked In

Date of update January 15, 2017

French
Grenoble INP - Ensimag
École nationale supérieure d'informatique et de mathématiques appliquées
681, rue de la passerelle - Domaine universitaire - BP 72
38402 SAINT MARTIN D'HERES
 
 
République Française         Groupe INP
    Université Grenoble Alpes