I can be a place of comfort, but I can also become a place of confinement. People build me, leave me, return to me, and sometimes dream of owning one. I may be large enough for a family or small enough for a single person. Though I can be made of stone, wood, or steel, what makes me special is not my material, but what happens inside me.
I am the 2nd letter of the answer. What letter am I?