Recent Posts
-
What does .eval() do in PyTorch?Data/Machine learning 2021. 4. 14. 18:21
.eval() is known to be used during inference of models that usually contain BN and/or Dropout. When .eval() is used, the model with BN uses runinng_mean and running_var instead of mean and var obtained from each mini-batch. Fine-tuning When fine-tuning, it is important to use running_mean and running_var of the trained model and they should be fixed during fine-tuning. This is because usually th..
-
Git TipsData/Machine learning 2021. 4. 5. 09:54
.gitignore .gitignorefile is a plain text file where each line contains a pattern for files/directories to ignore. You may ignore them for the following reasons: 1) security, 2) size, 3) non-related to a project. .gitignore should be located in the root directory. Syntax [1] www.pluralsight.com/guides/how-to-use-gitignore-file [2] programming119.tistory.com/105 Examples 1-InitialExperiment/devel..
-
W&B TipsData/Machine learning 2021. 4. 4. 10:12
[1] QuickStart: docs.wandb.ai/quickstart [2] wandb.init(...): docs.wandb.ai/library/init [3] wandb.log(...): docs.wandb.ai/library/log [4] PyTorch Integration: docs.wandb.ai/integrations/pytorch Quick Start Set your config with argparse. wandb.init(project='project_name_you_want' , config=args) wandb.watch(model) // automatically log gradients and model parameters Set up a training pipeline and ..