Headshots are the only way to end a fight.

Zombies don't feel pain, and unless you blow their brains, they'll chase you until the land collapses and the sea dies. There is no practical point in hitting other parts, the head is the key.