Talk to your husband, only the three of you will be able to figure out the path forward. It is easier to not address it, but maybe there is a happy path for all parties involved. If not, better to address it up front than let it drag out. Remember, bad news doesn't get better with age.