Modest Town, VirginiaModest Town is a census-designated place in Accomack County, Virginia, United States. Per the 2020 census, the population was 120.HistoryThe origin of the name "Modest Town" is obscure. In the mid-19th century, it was a point along the stagecoach route between Wilmington, Delaware and Eastville, Virginia.GeographyThe CDP lies at an elevation of 36 feet.DemographicsModest Town was first listed as a census designated place in the 2010 U.S. census.