Selma, also known as "Selma Plantation" or "Selma Farm" was once part of the Raspberry Plain tract owned by Thomson Mason (1733-1785). Between 1800 and 1810 his grandson Armistead Thomson Mason (1787-1819) constructed a home on a portion of the property, naming it "Selma". Active in politics, Mason was a leader of the Loudoun County Democratic-Republican Party. In 1815 he was elected to fill the United States Senate seat vacated by William B. Giles resignation but failed to retain the seat in an 1816 re-election bid. On 6 February 1819, Mason was killed in a duel over political differences with his cousin, John Mason McCarty (1795-1852). Mason's widow Charlotte Elizabeth Taylor (fl. 1800-1846) and son Stevens Thomson Mason (1819-1848) lived at Selma until financial difficulties led them to sell the property to William Beverly (1829-1879).

In 1896, Selma was damaged by a fire, which destroyed much of the original house. Following the fire, the property was purchased by Elijah B.White (1864-1926), son of Colonel Elijah Viers White (1832-1907) and Sarah Elizabeth Gott White (1836-1893). Elijah B. White was president of the People's National Bank and owner of White's Ferry. White began reconstruction of Selma, incorporating remains of the original structure into a new, more modern mansion. He commissioned Noland & Baskervill, a Richmond Architectural firm, to design the new house and Leesburg's Norris Brothers to build it. Work was completed in 1902. In October 1911 Hazelle Pancoast White (1888 - 1920), Elijah B. White's eldest daughter, married Joel Chandler Harris (1888-1964), son of the noted author at Selma. The White family continued to occupy the home and to farm the property until Elijah B.White's youngest daughter Jane Elizabeth White (1893-1970) passed away.

Ben and Ruth Epperson purchased Selma in the early 1970s and lived in the house, also renting it for weddings and special events. In 1996 they listed the property with Long & Foster Realty. The property was sold to Peter J. ter Maaten, CEO of HSO Business Systems in 1999 with the intention of transforming the house into the US headquarters of the Dutch software consulting firm. In 2002, 162 acres of the property was sold to Edgemoore Homes, which began construction of a neighborhood called Selma Estates. Selma Limited Liability Corp., owned by ter Maaten, continued to own Selma and a conservancy lot of 50 acres, although the property was unoccupied after 2000. In 2008, Edgemoore Homes declared bankruptcy and Stanley Martin Homes purchased and completed the development. In 2007, suffering from a lack of maintenance and upkeep, Selma was nominated as one of Virginia's most endangered historic properties, and a "Save Selma" group was formed by local preservationists. In March 2016, Loudoun County native Sharon D. Virts and Scott F. Miller purchased Selma and began extensive restoration and renovations of the property.