The oil on your hands is part of it. If you ever seen a baseball how its made, there are youtube videos. There is a glue substance inside the ball that will also leak through the leather cover causing glue spots.

Holding the ball on the seems is crucial. Also the lighting in the room will cause problems to baseballs. As well as temperature.