The sequential layer by layer self-assembly of block copolymer (BCP) nanopatterns is an effective approach to construct 3D nanostructures. Here large-scale highly ordered metal nanoarrays prepared from solvent annealed thin films of polystyrene-block-poly(2-vinylpyridine) (PS-b-P2VP) diblock copolymer are used to direct the assembly of the same BCP. The influence of initial loading concentration of metal precursor, the type of metal nanoparticle (gold, platinum, and silver), and the nanoparticle-substrate interaction on the directed assembly behavior of the upper BCP layer have been focused. It is found that the upper BCP film can be completely directed by the gold nanoarray with P2VP domain exclusively located between two adjacent gold nanowires or nanodots, which behaves the same way as on the platinum nanoarray. While the silver nanoarray can be destroyed during the upper BCP self-assembly with the silver nanoparticles assembled into the P2VP domain. Based on the discussions of the surface energy of nanoparticles and the interplay between nanoparticle-substrate interaction and nanoparticle-polymer interaction, it is concluded that the effect of immobilization of nanoparticles on the substrate, together with entropy effect to minimize the energetically unfavorable chain stretching contributes to the most effective alignment between each layer.