Why is crime against society as a whole and not just a direct victim ?

its because murder is considered to be mala in se or inherently wrong in and of itself and society would agree to murder being wrong regardless of there being any regulation against it.