I can be inherited without being owned, lost without being stolen, and defended without a weapon. I may follow someone long after they are gone, and sometimes a single action is enough to change me forever. People may build me for decades, yet destroy me in seconds.
I am the first letter of the answer. What letter am I?