I think that conferences, etc, build up on the human element and are important, but not for the reasons you mention.

My current belief is that a 95% remote team works, you do need in-person opportunities, the more the better, but at least once in a project can be enough.