| 
  • If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

  • Buried in cloud files? We can help with Spring cleaning!

    Whether you use Dropbox, Drive, G-Suite, OneDrive, Gmail, Slack, Notion, or all of the above, Dokkio will organize your files for you. Try Dokkio (from the makers of PBworks) for free today.

  • Dokkio (from the makers of PBworks) was #2 on Product Hunt! Check out what people are saying by clicking here.

View
 

Scribe Notes 6-5

Page history last edited by Lingxiao XIA 13 years, 1 month ago

*Under Construction*

Water-filling Method

Recall that the capacity of a AWGN channel with noise Formulaand power constraint Formula:

Formula

Suppose now we have two channels with Formula and total power constraint Formula, how should we use our power?

 

Suppose, for example, Formula, we can get a capacity of Formula if we only use channel 1 and Formula if we only use channel 2. SinceFormula , we can acheive a larger capacity if we use channel 1 alone. But what if we divide the power half-half? The new capacity would be Formula, which is larger than either of the cases when we use only one channel.

 

Intuitively, when power is already large, we have to double the power to add an extra bit, so it is easier to use two channels with Formula, Formula.

 

It is obivious to see that the maximum capacity can only be acheived when we use all the power we get, i.e. Formula. Use Lagrange Multiplier Method to find the maximum capacity with the constraints above, there exists Formula such that the equation below equals 0 when we take partial differentiation with respect to Formula and Formula:

Formula

We get:

Formula

This leads to the water-filling strategy when we divide our power to different channels.

 

The image below shows the idea of water-filling strategy and how it works when the total power constraint shrink, with Formula as variables and Formula the total power constraints.

The same idea can also be applied to when there are multiple parallel channels.

 

Feedback for Binary Erasure Channel

For Binary Erasure Channels, feedback does not increase rate, but still helps.

Every time an error occurs, the symbol is erased and retransmitted till it is right.

The capacity does not change but the probability of error becomes much smaller.

 

 

 

Comments (2)

Lingxiao XIA said

at 9:35 pm on Apr 15, 2009

I moved something around on the frontpage and i think i messed it up... please correct the changes if you find that they are wrong, and i separated my scribe note because they are about two problem sets, so scribe notes 6-5 and scribe notes 7-1 are from one class. sorry for any confusion

Lingxiao XIA said

at 9:42 pm on Apr 15, 2009

ah by the way, i love my new profile picture~~~~~ iyummy! XDDDDD

You don't have permission to comment on this page.