Slicing operation don't seem to work on nn.ModuleList. from torch import nn list = nn.ModuleList([nn.Module(), nn.Module()]) print list[1:] produces the following error: KeyError: 'slice(1, None, None)'