Wild soybean (Glycine soja Sieb. et Zucc) is the most important germplasm resource for soybean breeding, and is currently subject to habitat loss, fragmentation and population decline. In order to develop successful conservation strategies, a total of 604 wild soybean accessions from 43 locations sampled across its range in China, Japan and Korea were analyzed using 20 nuclear (nSSRs) and five chloroplast microsatellite markers (cpSSRs) to reveal its genetic diversity and population structure. Relatively high nSSR diversity was found in wild soybean compared with other self-pollinated species, and the region of middle and lower reaches of Yangtze River (MDRY) was revealed to have the highest genetic diversity. However, cpSSRs suggested that Korea is a center of diversity. High genetic differentiation and low gene flow among populations were detected, which is consistent with the predominant self-pollination of wild soybean. Two main clusters were revealed by MCMC structure reconstruction and phylogenetic dendrogram, one formed by a group of populations from northwestern China (NWC) and north China (NC), and the other including northeastern China (NEC), Japan, Korea, MDRY, south China (SC) and southwestern China (SWC). Contrib analyses showed that southwestern China makes the greatest contribution to the total diversity and allelic richness, and is worthy of being given conservation priority.