Lists of Must-Read Papers Goodfellow, Ian, et al. “Generative adversarial nets” Advances in neural information processing systems. 2014. Conditional GAN pix2pix CycleGAN Salimans, Tim, et al. “Improved techniques for training gans” Advances in neural information processing systems. 2016. WassersteinGAN Non saturating GAN LSGAN DCGAN Semi-supervised GAN Spectral Normalization for Generative Adver..

How to Choose the Batch Size? 일반적으로 아래 세 가지 batch size를 결정할 수 있으며, 배치 사이즈의 크기에 따라 딥러닝의 성능에 많은 영향을 미친다. Batch(deterministic) Gradient Descent Mini-Batch Gradient Descent Stochastic(Online) Gradient Descent Large Batch Small Batch Accurate estimate of the gradient (low variance) Noisy estimate of the gradient (high variance) High Computation cost per iteration Low computation cost per iteration Hi..