Syllabus for Information Theory and Coding (KEC-075) Btech Aktu

Explore the concepts of data compression, error correction, and secure communication as they are covered in the AKTU B.Tech Information Theory and Coding syllabus. Explore the principles underlying effective data transport and storage.

```Dudes 🤔.. You want more useful details regarding this subject. Please keep in mind this as well.

Important Questions For Information Theory and Coding:
*Quantum                *B.tech-Syllabus
*Circulars                 *B.tech AKTU RESULT
* Btech 4th Year     * Aktu Solved Question Paper```

UNIT-1: ENTROPY

• Entropy
• Joint Entropy and Conditional Entropy
• Relative Entropy and Mutual Information
• Relationship Between Entropy and Mutual Information
• Chain Rules for Entropy
• Relative Entropy and Mutual Information
• Jensen’s Inequality and Its Consequences
• Log Sum Inequality and Its Applications
• Data-Processing Inequality
• Sufficient Statistics
• Fano’s Inequality.

UNIT-2: ASYMPTOTIC EQUIPARTITION PROPERTY

• Asymptotic Equipartition Property: Asymptotic Equipartition Property Theorem.
• Consequences of the AEP: Data Compression
• High-Probability Sets and the Typical Set Data Compression: Examples of Codes
• Kraft Inequality
• Optimal Codes
• Bounds on the Optimal Code Length
• Kraft Inequality for Uniquely Decodable Codes
• Huffman Codes
• Optimality of Huffman Codes
• Shannon-Fano-Elias Coding.

UNIT-3: CHANNEL CAPACITY

• Channel Capacity for Various Binary Channels
• Symmetric Channels
• Properties of Channel Capacity
• Preview of the Channel Coding Theorem
• Jointly Typical Sequences
• Channel Coding Theorem
• Channel Capacity Theorem.

UNIT-4: BLOCK CODES AND LINEAR CODES

• Block Codes : Introduction to block codes
• Single-parity-check codes
• Product codes
• Repetition codes
• Hamming codes
• Minimum distance of block codes
• Soft-decision decoding
• Automatic-repeat-request schemes.
• Linear codes: Definition of linear Block Codes
• Generator matrices
• Standard array
• Parity-check matrices
• Error detection and correction.

UNIT-5: CONVOLUTION CODES

• Encoding convolutional codes
• Generator matrices for convolutional codes
• Generator polynomials for convolutional codes
• Graphical representation of convolutional codes
• Viterbi Algorithm
• Binary Cycle Codes
• BCH codes
• RS codes
• Golay codes.