Im more of a weightlifter but recently i got a punch bag in my mini gym something like this in the picture.

Now ive been punching hell out of it mainly to work on my cardio, but after about 5 minutes i get sweaty hands so i like to take my gloves off and punch it without any gloves on.
My qustion is, will punching an hard punch bag without gloves on do more damage to my hands in the long run then good?