Both of you feeling guilty in this situation is definitely natural. As long as your husband and his wife are still good with this then there's nothing really to feel guilty about as things progress. If you've both been given permission, the guilt will slowly subside. You and the older guy both...