苏州集团网站制作设计企业营销策划公司

本文将介绍如何用PyTorch构建模型

torch.nn.Module和torch.nn.Parameter

除了Parameter之外，本视频中讨论的所有类都是torch.nn.Module的子类。这是PyTorch基类，用于封装PyTorch模型及其组件的特定行为。

torch.nn.Module的一个重要行为是注册参数。如果特定的Module子类具有学习权值，则这些权值表示为torch.nn.Parameter的实例。Parameter类是torch的子类。张量，具有特殊的行为，当它们被分配为模块的属性时，它们被添加到该模块的参数列表中。这些参数可以通过Module类的parameters（）方法访问。

作为一个简单的例子，这里有一个非常简单的模型，有两个线性层和一个激活函数。我们将创建它的一个实例，并要求它报告其参数：

import torchclass TinyModel(torch.nn.Module):def __init__(self):super(TinyModel, self).__init__()self.linear1 = torch.nn.Linear(100, 200)self.activation = torch.nn.ReLU()self.linear2 = torch.nn.Linear(200, 10)self.softmax = torch.nn.Softmax()def forward(self, x):x = self.linear1(x)x = self.activation(x)x = self.linear2(x)x = self.softmax(x)return xtinymodel = TinyModel()print('The model:')
print(tinymodel)print('\n\nJust one layer:')
print(tinymodel.linear2)print('\n\nModel params:')
for param in tinymodel.parameters():print(param)print('\n\nLayer params:')
for param in tinymodel.linear2.parameters():print(param)

输出为：

The model:
TinyModel((linear1): Linear(in_features=100, out_features=200, bias=True)(activation): ReLU()(linear2): Linear(in_features=200, out_features=10, bias=True)(softmax): Softmax(dim=None)
)Just one layer:
Linear(in_features=200, out_features=10, bias=True)Model params:
Parameter containing:
tensor([[-0.0451,  0.0361,  0.0902,  ..., -0.0564, -0.0323,  0.0335],[ 0.0668,  0.0843,  0.0506,  ...,  0.0162,  0.0668, -0.0089],[-0.0505, -0.0148,  0.0485,  ...,  0.0714, -0.0399,  0.0798],...,[-0.0639,  0.0345, -0.0766,  ...,  0.0711, -0.0354, -0.0719],[ 0.0827, -0.0614,  0.0078,  ...,  0.0531, -0.0672,  0.0158],[-0.0577, -0.0733, -0.0662,  ..., -0.0263, -0.0143, -0.0904]],requires_grad=True)
Parameter containing:
tensor([-1.8241e-02, -8.1554e-02,  3.1390e-02, -9.7299e-02, -3.9416e-02,-3.4526e-02,  6.9457e-02,  9.3126e-02,  8.3945e-02,  2.5128e-02,-1.9594e-02,  1.4253e-02,  7.5062e-02, -2.5254e-02,  2.5275e-02,3.6509e-02, -5.4355e-02,  5.2070e-02, -1.1055e-02,  6.3872e-02,-4.2867e-02, -6.9062e-02, -9.6398e-02,  6.0366e-02,  8.6856e-02,-4.3543e-02,  7.1326e-02,  3.6623e-03,  5.4014e-02, -1.3758e-02,4.6091e-02,  4.6796e-03, -2.9959e-02, -5.0925e-02,  1.9598e-02,5.6875e-03, -2.5505e-02,  9.8728e-02,  4.3602e-02,  3