If X∼Bernoulli(p)X \sim Bernoulli(p)X∼Bernoulli(p), what is the entropy H(X)H(X)H(X)?
−plnp−(1−p)ln(1−p)-p \ln p - (1-p) \ln(1-p)−plnp−(1−p)ln(1−p)
plnp+(1−p)ln(1−p)p \ln p + (1-p) \ln(1-p)plnp+(1−p)ln(1−p)
lnp\ln plnp
111