In all these discussions it's helpful to understand the definition of broad-sense heritability (the statistic almost always in play when we're discussing heritability) --- it's a correlation, not a demonstrated causation, and your environment (and gene/environment interactions) are inherited as well.