If instead your husband insists, then Grandpa's behavior is the obstacle. The latter locates the blame outside your marriage, while the former drops it right in the middle.