V404 Cygni is a well-known candidate for the black hole binary thought to have relativistic jets. It showed extreme outbursts in 2015 June, characterized by a large amplitude and short time variation of flux in the radio, optical, and X-ray bands. Not only disk emission but also synchrotron radiation from the relativistic jets was suggested by radio observations. However, it is difficult to measure the accurate spectral shape in the optical/near-infrared band because there are uncertainties of interstellar extinction. To estimate the extinction value for V404 Cygni, we performed photopolarimetric and spectroscopic observations of V404 Cygni and nearby field stars. Here, we estimate the Galactic extinction using interstellar polarization based on the observation that the origin of the optical polarization is the interstellar medium, and investigate the properties of interstellar polarization around V404 Cygni. We found a good correlation between the color excess and polarization degree in the field stars. We also confirmed that the wavelength dependence of the polarization degree in the highly polarized field stars was similar to that of V404 Cygni. Using the highly polarized field stars, we estimated the color excess for the (B − V) color and the extinction in the V band to be E(B − V) = 1.2 ± 0.2 and 3.0 < A(V) < 3.6, respectively. A tendency for a bluer peak of polarization (λmax < 5500 Å) was commonly seen in the highly polarized field stars, suggesting that the dust grains toward this region are generally smaller than the Galactic average. The corrected spectral energy distribution of V404 Cygni in the near-infrared and optical bands in our results indicated a spectral break between 2.5 × 1014 Hz and 3.7 × 1014 Hz, which might originate in the synchrotron self-absorption.