It’s definitely sexier without condoms, but you’re absolutely right to think about this question. It is very important to be sure that sex is completely safe.
I think everything should be in order only if you are sure that he does not have (and does not plan) other untested partners.