Who needs Friends

Mr H doesn't have any friends, apart from an old workmate, a guy he's been mates with for 30 odd years, who also, in my humble opinion,  has undiagnosed aspergers. Mr H doesn't seem to have any need or desire to meet new people, and seems to think that it's "him and me against the world", and almost resents any intrusion into our life together. I'm probably not the most outgoing socialite either (only child, quite happy with my own company), but I do like people, and like to have some female friends. In our previous home I had good neighbours and a couple of close friends, and when we moved to this very rural area ( our village has about 25 houses and no social hub), I went out to meet people. I joined a local womens group and subsequently met and made friends with about 5 women in the village; we meet up for coffee, dog walk together, do crafts together and have a good laugh. I feel that I could call on them in a crisis, and hope they feel they could call on me.
A few weeks ago however, a guy who lives on the outskirts of the village called round to drum up support for a residents association, Mr H said we were interested and that we would go to the next meeting. The next meeting is tomorrow, and although Mr H is away for the week, he is twitching on the phone to me about it, wanting to know whether I am going. The upshot is, he doesn't want me to go to the meeting, he thinks this man is "too pushy", " he has been round twice unannounced".
What? I didn't realise people had to pre book in order to ring our doorbell. I'd better warn the postman! I said to him that I will decide tomorrow whether or not I go to the meeting, and that he cannot dictate to me who I do and don't see. He's not a happy bunny, his world may be breached by an intruder!
I worry for him in the future, if I were to die first he would have no supportive friends. He seems to be very happy living in isolation with me, I am not happy living in isolation with him.
Where next?
Hannah x