Yeah, but this is comics. That hammer can't possibly hit any harder than he does, or he'd end up smashing the Hulk's skull every time he hit him.

At best, Thor's hammer, as a bludgeoning weapon, relieves him from the burden of having to actually use his fist. Absent the use of any of the more exotic powers, it doesn't cause any more damage than he does with his bare fist.