He was the third of four children of Janet Woodrow and Joseph Ruggles Wilson, a Presbyterian minister. He spent his childhood in Augusta, Georgia, and Columbia, South Carolina; graduated from Princeton (then the College of New Jersey) in ; and attended the University of Virginia Law School.