I dont think its odd or gay or whatever you want to call it.
I think this lifestyle or fantasy lends itself to "out of the norm". It is possible for a man not to find other men attractive at all, but because of the wife and another cock making her hot it makes the husband hot for it by proxy...