Skip to content

Conversation

@mariosasko
Copy link
Contributor

Fixes #43389.

This PR replaces the old ELU formula from the docs that yields wrong results for negative alphas with the new one that fixes the issue and relies on the cases notation which makes the formula more straightforward.

@dr-ci
Copy link

dr-ci bot commented Aug 28, 2020

💊 CI failures summary and remediations

As of commit 8f5a468 (more details on the Dr. CI page):


  • 1/1 failures possibly* introduced in this PR
    • 1/1 non-CircleCI failure(s)

Extra GitHub checks: 1 failed


This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions on the GitHub issue tracker or post in the (internal) Dr. CI Users group.

See how this bot performed.

This comment has been revised 1 time.

@codecov
Copy link

codecov bot commented Aug 28, 2020

Codecov Report

Merging #43764 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master   #43764   +/-   ##
=======================================
  Coverage   69.34%   69.34%           
=======================================
  Files         378      378           
  Lines       46698    46698           
=======================================
  Hits        32381    32381           
  Misses      14317    14317           
Impacted Files Coverage Δ
torch/nn/modules/activation.py 96.62% <ø> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f06d390...8f5a468. Read the comment docs.

@mariosasko
Copy link
Contributor Author

@albanD Here is a PR with the fix. Seems like the flake8 fail is unrelated to my changes.

Copy link
Collaborator

@albanD albanD left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks great! Thanks!

Copy link
Contributor

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@albanD has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@albanD
Copy link
Collaborator

albanD commented Aug 31, 2020

@pytorchbot rebase this please

@mariosasko
Copy link
Contributor Author

@albanD Do you know the reason why this is still not merged?

@albanD
Copy link
Collaborator

albanD commented Sep 14, 2020

Hey,

This is my bad. It took so long to get the internal tests to pass that it ended up dropping from my queue.
Doing it now!

@facebook-github-bot
Copy link
Contributor

@albanD merged this pull request in cfba33b.

xuzhao9 pushed a commit that referenced this pull request Sep 18, 2020
Summary:
Fixes #43389.

This PR replaces the old ELU formula from the docs that yields wrong results for negative alphas with the new one that fixes the issue and relies on the cases notation which makes the formula more straightforward.

Pull Request resolved: #43764

Reviewed By: ailzhang

Differential Revision: D23425532

Pulled By: albanD

fbshipit-source-id: d0931996e5667897d926ba4fc7a8cc66e8a66837
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

a problem about ELU

5 participants