[Pytorch] How to Control Randomization in Pytorch

# set random seed
random_seed = 999

# for pytorch
torch.manual_seed(random_seed)
torch.cuda.manual_seed(random_seed)
torch.cuda.manual_seed_all(random_seed) # for multi-GPU
torch.backends.cudnn.deterministic = True
torch.backends.cudnn.benchmark = False

# for numpy and random
np.random.seed(random_seed)
random.seed(random_seed)

Reference

• pytorch.org/docs/stable/notes/randomness.html
• https://hoya012.github.io/blog/reproducible_pytorch/