Soldiers being held legally responsible for atrocities committed during war?

Holocaust Rememberance Day is coming up on the eleventh of April. Do you believe that former soldiers should be held legally and morally responsible for participating in acts such as the atrocities committed during the holocaust because they were "following orders"? For example, there were several German soldiers placed in prisons after World War 2 for their involvement in activities doented in concentration camps. Do you personally believe these men should have been let off the hook, or are you glad that they were prosecuted? They were, after all, following orders from their superiors. Yet, these orders were morally unjust. What do you think?