• If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

  • You already know Dokkio is an AI-powered assistant to organize & manage your digital files & messages. Very soon, Dokkio will support Outlook as well as One Drive. Check it out today!


Scribe Notes 1

This version was saved 15 years, 5 months ago View current version     Page history
Saved by Lingxiao XIA
on January 9, 2009 at 3:19:26 pm






What will happen when one toss a coin many times?

Probability is a good way of talking about information.

There’re many ways of talking about information, but basically it’s more about new things that cannot be predicted. i.e. What I don’t know about the world?


It talks about statistic property & probability.


A biased coin: a. pictures of a dark room (b/w), more 1s than 0s.

            b. noise, more 0s than 1s

Data compression:

n         lossless source coding

n         rate-distortion theory. i.e. images(within some error, compress as much as one can)


Problem Set 1

Independence c.d.f. cumulative distribution function of x.

Pr(x <= x) = f(x)

Two random variables X and Y are independent if and only if

P(X <= x, Y <= y) = P(X <= x)P(Y <= y)

When there’re 3 variables. Each two of them can be independent with each other but the three of them are dependent.



i.i.d. identical & independently distributed.


How many different sequences there are for tossing a coin ten times? 2^10


Comments (0)

You don't have permission to comment on this page.