I find that it, like everything else, gets a different response from different people.
Some people brood over it, but do nothing, others avoid things that cause them guilt or shame, others do those things anyway and ignore it, some people try to do something about it and make themselves only feel guilt or shame when it should be felt.
I tend to feel shame and guilt (especially guilt) much too often, which is quite frustrating at certain times, such as not being able to hold a grudge when I probably should.