The 1870 census of Haywood Co TN, Brownsville:

Smith, J. H. 39 M W Miller $8,000 $1,000 TN
---, Martha 27 F W Keeping house TN
---, Jenny 9 F W at home TN
---, William 7 M W at home TN
---, Charles 4 M W at home TN
---, John 1 M W at home TN
Greg, W. 22 M W Boarder

The adjacent family appears to be former King slaves:

King, Cele 20 F B Cook TN cannot read or write
---, Roberta 1 F Mul at home TN
---, Mandy 10 F B at home TN cannot read or write

The 1880 census of Haywood Co TN, Brownsville:

Name Age
J H Smith 49 head
M J Smith 37 wife
M C Smith 16 dau
C G Smith 14 son
John H Smith 11 son
Ida M Smith 8 dau
W K Smith 5 son
J G H Smith 2 son