R1.13: RAdam for optimizer #31740
Closed
R1.13: RAdam for optimizer #31740
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
… are in different graphs. This is in preparation for the next TF release where this warning would become an error. PiperOrigin-RevId: 225875718
r1.13-rc0 cherrypick request: Raise warning for dataset pipeline in different graphs
PiperOrigin-RevId: 225548043
Fixing tf nightly build.
PiperOrigin-RevId: 225933307
Add a warning message which happens when contrib is imported.
PiperOrigin-RevId: 226075926
PiperOrigin-RevId: 226087365
Update toolchain for arm.
1.13.0-rc0 cherry-pick request: Add k8 to toolchains
PiperOrigin-RevId: 226115035
1.13.0-rc0 cherry-pick request: add armebi toolchain
Update version to 1.13.0-rc0
PiperOrigin-RevId: 226115035
PiperOrigin-RevId: 226087365
PiperOrigin-RevId: 226230363
PiperOrigin-RevId: 226087680
This had previously been done but not uniformly. Change to remove #!/usr/bin/env python in October caused this problems in latest release. PiperOrigin-RevId: 226221579
PiperOrigin-RevId: 226094885
PiperOrigin-RevId: 226233807
toolchains from CROSSTOOL files. PiperOrigin-RevId: 226385901
PiperOrigin-RevId: 226386044
… cherrypicks_QP3RO
Cherrypicks qp3 ro
This allows conversion of TFLite models with support for select TF ops via the standard pip installation. Note that support for *executing* TFLite models with select TF ops, via Python, will land separately. PiperOrigin-RevId: 226355228
PiperOrigin-RevId: 226419504
PiperOrigin-RevId: 226385826
Fix visibility of a few targets
This also adds the 3 compatibility flags on windows builds, as I missed doing that in #30583
Remove additional bazel flags in pip_smoke_test
Python3.5 and Python3.6 have errors while building: ``` ERROR: /tmpfs/src/github/tensorflow/bazel_pip/tensorflow/tools/api/tests/BUILD:16:1: in py_test rule //bazel_pip/tensorflow/tools/api/tests:api_compatibility_test: target '//tensorflow:tf_python_api_gen_v2' is not visible from target '//bazel_pip/tensorflow/tools/api/tests:api_compatibility_test'. Check the visibility declaration of the former target if you think the dependency is legitimate ``` Most likely Bazel default python doesn't properly catch the visibility declaration, so we're trying to use this fix instead.
Final fixes for the patch release
nhuthai
requested review from
MarkDaoust,
aaroey,
alextp,
annarev,
ebrevdo,
jaingaurav,
jvdillon,
mrry,
nataliaponomareva,
rsepassi,
smit-hinsu,
sshrdp,
yk5 and
yongtang
as code owners
|
Thanks for your pull request. It looks like this may be your first contribution to a Google open source project (if not, look below for help). Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA). 📝 Please visit https://cla.developers.google.com/ to sign. Once you've signed (or fixed any issues), please reply here with What to do if you already signed the CLAIndividual signers
Corporate signers
ℹ️ Googlers: Go here for more info. |
Contributor
|
Please send this pull request to tensorflow/addons; new optimizers go there instead of in core TF |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Implement Rectified Adam.
Paper: https://arxiv.org/pdf/1908.03265v1.pdf