• If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

• You already know Dokkio is an AI-powered assistant to organize & manage your digital files & messages. Very soon, Dokkio will support Outlook as well as One Drive. Check it out today!

View

# Scribe Notes 1

View current version     Page history
Saved by
on January 9, 2009 at 3:19:44 pm

*UNFINISHED*

What will happen when one toss a coin many times?

Probability is a good way of talking about information.

There’re many ways of talking about information, but basically it’s more about new things that cannot be predicted. i.e. What I don’t know about the world?

It talks about statistic property & probability.

A biased coin: a. pictures of a dark room (b/w), more 1s than 0s.

b. noise, more 0s than 1s

Data compression:

n         lossless source coding

n         rate-distortion theory. i.e. images(within some error, compress as much as one can)

Problem Set 1

Independence c.d.f. cumulative distribution function of x.

Pr(x <= x) = f(x)

Two random variables X and Y are independent if and only if

P(X <= x, Y <= y) = P(X <= x)P(Y <= y)

When there’re 3 variables. Each two of them can be independent with each other but the three of them are dependent.

i.i.d. identical & independently distributed.

How many different sequences there are for tossing a coin ten times? 2^10