

As long as you don’t have symptoms, assume you are healthy, and stray separated. Obviously, if you already got Covid yesterday, then that ship has sailed, but what if you didn’t? What if your immune system is still fighting it off and will give out in two hours? Chances are slim, but not none.
As a general statement: worrying doesn’t help, only raises your stress levels and negatively impact your immune system.
There are here causes for concern, and your fear is justified. Other than isolation from your wife, there is not much to do.
As a side note: being in constant contact with other humans raises your immune responses, because you are constantly trained to fight off mild infections. Coming back from full isolation was really rough on my partner, they kept getting “the flu” (something or other) every time they went to a crowded place, even just the supermarket at rush hour. It took them a year to develop a normal immune response again.