Joseph H. Miller was the fourth of eleven known children of Jacob Miller (1774-1866) and Mary Magdalena Krause Miller (1774-1874), who married 24 Dec 1800 at Stokes (now Forsyth) County, North Carolina. The parents (Jacob and Mary) and some of their children moved from North Carolina to Indiana in 1836.

The Rev. Joseph H. Miller married three times. He first married Sarah Sowers (1808-1873) on 23 Mar 1827 at Davidson County, North Carolina. Rev. Miller and Sarah were the parents of thirteen known children, namely:

1. Elizabeth Miller (1827-???)
2. Michael A. Miller (1829-1905)
3. Joseph Henry Miller (1831-1886)
4. Martin W. Miller (1832-???)
5. Mary Caroline Miller Nifong (1833-1893)
6. Sarah Eliza Miller Thomas (1835-1905)
7. Catherine Amanda Miller Nifong (1836-1905)
8. Jacob John W. Miller (c1839-???)
9. Susan Phoebe Miller Snyder (1840-1911)
10. Alexander Falze Miller (1842-1923)
11. Lewis "Webb" Webster Miller (1845-1915)
12. Jane Albertine Miller Woosley (1848-1905)
13. Barbara Augusta Miller Lambeth (1849-1911)

In 1850 the Rev. Miller (listed as a farmer), Sarah, and all 13 children were living at the Northern Division, Davidson County, North Carolina. After Sarah died, Rev. Miller remarried to the widow Mrs. Anna (went by Annie) Maria Rothrock Thomas (1829-1879) on 23 Apr 1874 at Forsyth County, North Carolina. Rev. Miller and Annie did not have any children together. After Annie died, Rev. Miller remarried to the widow Mrs. Sarah Susanna Ketner Crater (1836-1904) on 01 Feb 1880 at Forsyth County, North Carolina. Rev. Miller and Sarah Ketner Crater Miller did not have any children together.

Links to Rev. Miller's parents, his three known wives, eleven of his thirteen known children and two of his ten known siblings are included below.