What was the first movie to have a post-credits scene?

Night of the Living Dead, depending on what you mean. There are stills of the people killing zombies throughout the end credits and then after the credits roll we see film of a bonfire burning.

Airplane! seems to be the first in the way we think of a post-credit scene now.