Interestingly, Albert hopped around. In 1850 he was in Marshall County, MS along with his parents and siblings. But in 1860 he is in Morgan County, AL. Then in 1870 he is back in Mississippi. By 1880 until his death in 1899, he is again in Morgan County, AL. 
Albert was inducted into the Chulahoma Masonic Lodge #55 in 1849 (Nockton). By 1870 he was back in Marshall County, MS, living next door to his brother, William M. Harris, Jr.
1860 Alabama Slave Schedule, Morgan County (#10, p. 301): Albert H. Harris No. Slaves/Age/Sex/Color
1 65 f B
1 47 f B
1 45 f B
1 18 m B
1 14 m B
1 9 f B
1 7 m B
Tombstone shows birth year as 1820, not 1823. However, this date is likely in error, as his parents did not wed until December 1821.320