The way this has gone down, with him either backtracking or truly unaware of having shared his fantasy, the OP’s plan sounds very risky. The reality is most guys are very much ill prepared for the reality of their wife being with other men. Sure it may sound good to some when they are excited...