I was wondering about that too. It was after Dr. Enys found the bottle, so I thought he must have told George what had happened.
But, I think you're right that he may have been blaming the feud between himself and Ross for contributing to her plight.
(Of course, as others have said above, it was his nasty behavior towards and withdrawal from Valentine that were causing the most stress on their marriage. Would a better man than George (pretty much anyone since he is among the worst of the worst) have been able to maintain a happy family in that era if his suspicians had been confirmed