Weight initialization in PyTorch Lightning

354 Views Asked by At

Since PyTorch Lightning does most things under the hood, how can I know which weight initialization methods it use for training the model? And how can I modify the initialization method?

1

There are 1 best solutions below

1
On BEST ANSWER

PyTorch Lightning doesn't interfere with weight initialization. It should be same as default PyTorch weights initialization. This is how Linear layers are initialized.