Frederick R. Spencer, son of General Ichabod Spencer of Massachusetts, began his artistic training by copying engravings. His enthusiasm was further inspired when he visited Ezra Ames' gallery of portraits in Albany. In 1822 he was sent to Middleboro Academy where he first attempted painting portraits. He subsequently showed these early efforts to William Dunlap who gave him advice and encouragement.
In 1825 he decided to abandon his studies at Middleboro and convinced his father to send him to New York City where he could pursue his artistic training. Upon arriving in New York he began studying the casts in the collection of the American Academy of Fine Arts. Through his dedication and enthusiasm, Spencer eventually became acquainted with John Trumbull (q.v.)* who proceeded to give the young artist formal instruction. Spencer developed rapidly as a portraitist and in 1833 began exhibiting his works at the American Academy. During the early 1830s he retained close ties with the American Academy and served on its board of directors from 1833 to 1835. When the dissolution of the American Academy became evident, Spencer quickly developed his association with the National Academy of Design and his portraits were frequently included in the Academy's annual exhibitions from 1837 to 1853. In 1849 he was elected to the Academy's council and served as its recording secretary. In 1853, after establishing a successful career as a portraitist and acquiring a sizeable fortune, he began to work increasingly in upstate New York. Although few records document Spencer's life and career after 1858, his eulogy in the Academy's council minutes suggest that the majority of his remaining years were spent on a farm in Wampsville.