It does point upward. The dipole always points in the direction of the more electronegative atom, and oxygen is more electronegative than hydrogen. Also, the lone pair of electrons on the oxygen contributes to the trigonal pyramidal structure and the overall dipole moment because lone pairs take up more space then bonded ones.