If religion is not a presidential pre-requisite, why has there never been an agnostic president?

Social issues. Many people say, according to some surveys, that they would never vote for an Atheist President. Which I, as an Atheist, find incredibly annoying.