The blossoms on my pepper plant have fallen off?

I have planted sweet red peppers in a large pot and they seem to be growing very well. Blossoms fave sprouted and are begining to open, however, the ones that have already opened have wilted and fallen off - stem and all. Is this normal? If not, what can I do?