Atheists have as much conscience, possibly more, than people with deep religious conviction, and they still have the same problem of how they reconcile themselves to a bad deed in the past. It's a little easier if you've got a god to forgive you.