If you recieved your gun from a wall-buy, you can purchase the ammo at where you brought the gun, but if you recieved the gun from the box, you can ONLY refill it by killing zombies in hope for a max ammo power up (a yellow ammo box)

What about the guns you start a round with?

Which starting pistol? (M1911 colt or Mauser C96)