I was loyal to my wife when she attracted him