Skip to content

Add torch.nn.GELU as the module for GELU activation #28947

@xiaomengy

Description

@xiaomengy

🚀 Feature

Add torch.nn.GELU as the module for GELU activation.

Motivation

Currently we have a torch.nn.functional.gelu op but no corresponding module like we do for the other activations (e.g. nn.ReLU()).

Pitch

Alternatives

Additional context

Metadata

Metadata

Assignees

Labels

featureA request for a proper, new feature.module: nnRelated to torch.nntriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions