There are very few people who will walk alone. When men truly walk with God they walk alone, not as islands but as them who will do God's will without self. Any man walking with God understands that his Cross is his alone and his carrying of it marks him as a man consecrated (set apart). He is a peculiar person; one who's ways are not understood by the world. "If any man come to me, and hate not his father, and mother, and wife, and children, and brethren, and sisters, yea, and his own life also, he cannot be my disciple. And whosoever doth not bear his cross, and come after me, cannot be my disciple (Luke 14:26-27). Our faith and affections should solely be to God without conflict. They are not to be compared to or in competition with self or loved ones, so as to displace Christ. God first over everything and everyone. I'd rather walk alone in the light, than to walk in the darkness with my brother.
If you find that your walk is getting lonelier, don't be discouraged. It is because you are walking closer to and with God. "Therefore, my beloved brethren, be ye stedfast, unmoveable, always abounding in the work of the Lord, forasmuch as ye know that your labour is not in vain in the Lord (1 Corinthians 15:58). "For the wages of sin is death; but the gift of God is eternal life through Jesus Christ our Lord (Romans 6:23).