He visited her when her husband went to work