Information Theory and Coding Notes eBook

Information Theory and Coding Notes eBook
60% Off

Information Theory and Coding Notes eBook

6945 Views
Publisher: VTU eLearning
Availability: In Stock
INR 10.00 INR 4.00 ( 60% Off )
Effective Price after using Coupon Code: SAVE20
Download & Read Books Offline (Desktop/Laptop/Android Device) :
  • Description

About this eBook

1. Average Information Content of Symbols in Long Independence Sequences Suppose that a source is emitting one of M possible symbols s0, s1 .. sM in a statically independent sequence Let p1, p2, .. pM be the problems of occurrence of the M-symbols resply. suppose further that during a long period of transmission a sequence of N symbols have been generated. On an average
s1 will occur NP1 times S2 will occur NP2 times
si will occur NPi times
1 The information content of the i th symbol is I si log p i
bits
PiN occurrences of si contributes an information content of
1 PiN . I si PiN . log p i
bits
Total information content of the message is Sum of the contribution due to each of
M symbols of the source alphabet M
i.e., Itotal
1 bits
i
NP log p
i 1