VTU
Electronics & Communication Engineering 5 Semester 2010 Scheme
Information Theory & Coding [10EC55]
Compiled by by studyeasy.in studyeasy.in Download Notes, Question Banks and other Study Material
www.studyeasy www. .in studyeasy.in
Compiled by www.studyeasy.in ITC
10EC55
Information Theory and Coding Subject Code : 06EC55 No. of Lecture Hrs/Week : 04 Total no. of Lecture Hrs. : 52
IA Marks Exam Hours Exam Marks
: 25 : 03 : 100
PART - A Unit – 1: Information Theory: Introduction, Measure of information, Average information content of symbols in long independent sequences, Average information content of symbols in long dependent sequences. Mark-off statistical model for information source, Entropy and 6 Hours information rate of mark-off source. Unit – 2: Source Coding : Encoding of the source output, Shannon’s encoding algorithm. Communication Channels, Discrete communication channels, Continuous channels. 6 Hours Unit – 3: Fundamental Limits on Performance : Source coding theorem, Huffman coding, Discrete memory less Channels, Mutual information, Channel Capacity. 6 Hours Unit – 4: Channel coding theorem, Differential entropy and mutual information for continuous 6 Hours ensembles, Channel capacity Theorem. PART - B Unit – 5: Introduction to Error Control Coding : Introduction, Types of errors, examples, Types of codes Linear Block Codes: Matrix description, Error detection and correction, Standard arrays and table look up for decoding. 7 Hours Unit – 6: Binary Cycle Codes, Algebraic structures of cyclic codes, Encoding using an (n-k) bit shift 7 Hours register, Syndrome calculation. BCH codes. Unit – 7: RS codes, Golay codes, Shortened cyclic codes, Burst error correcting codes. Burst and 7 Hours Random Error correcting codes. Unit – 8: Convolution Codes, Time domain approach. Transform domain approach. 7Hours Text Books: Digital and analog communication systems, K. Sam Shanmugam, John Wiley, 1996. Digital communication, Simon Haykin, John Wiley, 2003.
Reference Books: ITC and Cryptography, Ranjan Bose, TMH, II edition, 2007 Digital Communications - Glover and Grant; Pearson Ed. 2nd Ed 2008
Compiled by www.studyeasy.in ITC
10EC55
Information Theory and Coding Subject Code : 06EC55 No. of Lecture Hrs/Week : 04 Total no. of Lecture Hrs. : 52
IA Marks Exam Hours Exam Marks
: 25 : 03 : 100
PART - A Unit – 1: Information Theory: Introduction, Measure of information, Average information content of symbols in long independent sequences, Average information content of symbols in long dependent sequences. Mark-off statistical model for information source, Entropy and 6 Hours information rate of mark-off source. Unit – 2: Source Coding : Encoding of the source output, Shannon’s encoding algorithm. Communication Channels, Discrete communication channels, Continuous channels. 6 Hours Unit – 3: Fundamental Limits on Performance : Source coding theorem, Huffman coding, Discrete memory less Channels, Mutual information, Channel Capacity. 6 Hours Unit – 4: Channel coding theorem, Differential entropy and mutual information for continuous 6 Hours ensembles, Channel capacity Theorem. PART - B Unit – 5: Introduction to Error Control Coding : Introduction, Types of errors, examples, Types of codes Linear Block Codes: Matrix description, Error detection and correction, Standard arrays and table look up for decoding. 7 Hours Unit – 6: Binary Cycle Codes, Algebraic structures of cyclic codes, Encoding using an (n-k) bit shift 7 Hours register, Syndrome calculation. BCH codes. Unit – 7: RS codes, Golay codes, Shortened cyclic codes, Burst error correcting codes. Burst and 7 Hours Random Error correcting codes. Unit – 8: Convolution Codes, Time domain approach. Transform domain approach. 7Hours Text Books: Digital and analog communication systems, K. Sam Shanmugam, John Wiley, 1996. Digital communication, Simon Haykin, John Wiley, 2003.
Reference Books: ITC and Cryptography, Ranjan Bose, TMH, II edition, 2007 Digital Communications - Glover and Grant; Pearson Ed. 2nd Ed 2008
Compiled by www.studyeasy.in ITC
10EC55
INDEX SHEET SLNO.
Unit & Topic of Discussion
PAGE NO.
1
PART - A UNIT – 1: INFORMATION THEORY Introduction Measure of information Average information content of symbols in long independent sequences Average information content of symbols in long dependent sequences Mark-off statistical model for information source, Entropy and information rate of mark-off source. Review questions UNIT – 2 SOURCE CODING Encoding of the source output Shannon’s encoding algorithm Communication Channels Discrete communication channels Review questions UNIT – 3 FUNDAMENTAL LIMITS ON PERFORMANCE Source coding theorem Huffman coding Discrete memory less Channels Mutual information Channel Capacity Review questions UNIT - 4 Continuous Channel Differential entropy and mutual information for continuous ensembles Channel capacity Theorem Review questions PART - B UNIT - 5 INTRODUCTION TO ERROR CONTROL CODING Introduction Types of errors Types of codes Linear Block Codes: Matrix description. Error detection and correction Standard arrays and table look up for decoding
4
2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27
28 29 30 31 32 33
5
5 8 9 11 19 27 29
30 31 44 45 73 74 75 75 81 88 90 110 111 112 119 121 129 130
131 133 133 136 146 149
