His brother was Amos Riley, also of Montgomery Co., MD who had married Susan Phillips around 1809.

This Isaac Riley provided the model for Simon Legree in Harriet Beecher Stowe's classic, Uncle Tom's Cabin. She based her story in part, on the life of Josiah Henson, born as a slave in Maryland in 1789.

From Jim Davis (email 1 June 2007):

...I attend Wildwood Baptist Church in Bethesda, MD. In our cemetery, which is called the Mt. Zion Baptist Cemetery, is buried Isaac Riley and his wife Matilda Middleton. Isaac Riley was the slaveholder of Josiah Henson and was the inspiration for the book “Uncle Tom’s Cabin”. You might also be interested in this 1881 excerpt which tells about Isaac Riley’s son and grandson. ftp://ftp.rootsweb.com/pub/usgenweb/mo/buchanan/bios/r4000001.txt.