Skip to content

Fix documentation for attention mask shape #20851

@jotsif

Description

@jotsif

📚 Documentation

The attention mask shape should be (L, S) since it is added to the attention weights which is of shape (N, L, S). This is only in master, and not on pytorch.org yet.

#20850

Metadata

Metadata

Assignees

No one assigned

    Labels

    module: docsRelated to our documentation, both in docs/ and docblockstriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions