When you whimper, you make a soft crying sound.

The puppy started to whimper outside the door.