Whose baby has trouble with their pacifier?

My son TOTALLY loves his binkie (pacifier) but he can almost NEVER keep it in his mouth on his own! It always falls out while he sucks...and he gets soooo mad until I put it back....the only time it stays is when he is really calm...like ready to hit the sheets! What's up with this!