About 1846, after the death of his first wife Mary, Samuel and his brother William came to Tallapoosa County, Alabama. After moving to Alabama the name was spelled Neighbors and sometimes Neighbours. He bought a farm near Alexander City, then called Youngstown. This farm was later the site of the Alexander City Country Club. In 1965 the Country Club property was donated to the Sate for the purpose of a Junior College for this area.
Samuel married three times.
After marrying Milesa Jane, they moved the family from Alexander City to the Fishpond community in Coosa County.