I am looking for a library that does advanced math, statistics, statistical distribution, etc..
Currently I am looking for something that does binomial and poisson distribution.
MathDotNet should have the functions you are looking for, although it may be a bit of overkill depending on how much functionality you need. It offers:
For a complete list see this page.