We want to estimate

intractable p(x) with tractable q(x)

For approximation,

Expectation propagation KL(p || q)

Variational Bayesian minimize KL(q || p)

VB generally requiring more iterations, however sometimes each iteration is much cheaper than an EP iteration

(VB vs EP ~ simplex vs interior )