Where does all the Guilt and Shame come from?

Guilt and Shame seem to be the common denominators to much of issues and reactions. Where is it coming from? What is the genesis? I suspect that those with ADHD (either inattentive, impulsive or combo) have had a life-long history of having "normal" folks commenting and correcting them. I think from a young age they have had to listen to people say, "why did you do that"? or "what were you thinking" or "you need to pay attention" or "you broke that because you weren't careful," and so forth and so forth. Is that where it all started?