Skip to content

feat(dev-infra): create shared platform for remote execution #41767

Closed
devversion wants to merge 5 commits into
angular:masterfrom
devversion:build/use-own-platform-for-rbe
Closed

feat(dev-infra): create shared platform for remote execution #41767
devversion wants to merge 5 commits into
angular:masterfrom
devversion:build/use-own-platform-for-rbe

Conversation

@devversion

@devversion devversion commented Apr 22, 2021

Copy link
Copy Markdown
Member

Introduces a shared Bazel platform for remote execution builds
using Google cloud. Previously we used bazel_toolchains for
providing the platform w/ additional CPP and Java toolchains

bazel_toolchains no longer provides default toolchains with the
latest version, but provides a tool (linux and windows only) for
generating toolchain/platforms, which then need to be checked
into the repository. This is quite inconvenient and cumbersome
(especially with no macOS support), so we just provide our own
platform and CPP toolchain within //dev-infra. This is more
simple than all the effort we'd need to make the toolchain
generation tool work (while it would also increase the amount
of checked-in sources significantly; with more unused toolchains
for CPP or Java)

@google-cla google-cla Bot added the cla: yes label Apr 22, 2021
@jessicajaniuk jessicajaniuk added the area: dev-infra Issues related to Angular's own dev infra (build, test, CI, releasing) label Apr 22, 2021
@ngbot ngbot Bot added this to the Backlog milestone Apr 22, 2021
@devversion devversion force-pushed the build/use-own-platform-for-rbe branch 2 times, most recently from 12f7219 to bc48671 Compare April 22, 2021 16:58
Introduces a shared Bazel platform for remote execution builds
using Google cloud. Previously we used `bazel_toolchains` for
providing the platform w/ additional CPP and Java toolchains

`bazel_toolchains` no longer provides default toolchains with the
latest version, but provides a tool (linux and windows only) for
generating toolchain/platforms, which then need to be checked
into the repository. This is quite inconvenient and cumbersome
(especially with no macOS support), so we just provide our own
platform and CPP toolchain within `//dev-infra`. This is more
simple than all the effort we'd need to make the toolchain
generation tool work (while it would also increase the amount
of checked-in sources significantly; with more unused toolchains
for CPP or Java)
@devversion devversion force-pushed the build/use-own-platform-for-rbe branch from bc48671 to 35c284d Compare April 22, 2021 17:09
A test for the dev-infra publish tool currently relies on an external
http request by accident. This will break if we disallow internet
access within RBE containers.
Uses the new shared RBE platform from the dev-infra package.
@devversion devversion force-pushed the build/use-own-platform-for-rbe branch from 35c284d to 2f3c3bb Compare April 22, 2021 17:47
@devversion devversion marked this pull request as ready for review April 22, 2021 18:09
@pullapprove pullapprove Bot requested a review from kyliau April 22, 2021 18:09
@devversion devversion added action: review The PR is still awaiting reviews from at least one requested reviewer target: rc This PR is targeted for the next release-candidate labels Apr 22, 2021
@devversion

Copy link
Copy Markdown
Member Author

Note that this also fixes RBE on macOS and allows potential use w/ Windows (I got RBE working in the past)

@josephperrott josephperrott left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Just the one comment, but it's not a huge deal.

Comment thread dev-infra/bazel/remote-execution/BUILD.bazel
@josephperrott josephperrott removed the request for review from kyliau April 23, 2021 17:14
@devversion devversion added action: merge The PR is ready for merge by the caretaker and removed action: review The PR is still awaiting reviews from at least one requested reviewer labels Apr 23, 2021
@jessicajaniuk jessicajaniuk added action: merge The PR is ready for merge by the caretaker and removed action: merge The PR is ready for merge by the caretaker labels Apr 23, 2021
jessicajaniuk pushed a commit that referenced this pull request Apr 23, 2021
#41767)

A test for the dev-infra publish tool currently relies on an external
http request by accident. This will break if we disallow internet
access within RBE containers.

PR Close #41767
jessicajaniuk pushed a commit that referenced this pull request Apr 23, 2021
#41767)

Uses the new shared RBE platform from the dev-infra package.

PR Close #41767
jessicajaniuk pushed a commit that referenced this pull request Apr 23, 2021
Introduces a shared Bazel platform for remote execution builds
using Google cloud. Previously we used `bazel_toolchains` for
providing the platform w/ additional CPP and Java toolchains

`bazel_toolchains` no longer provides default toolchains with the
latest version, but provides a tool (linux and windows only) for
generating toolchain/platforms, which then need to be checked
into the repository. This is quite inconvenient and cumbersome
(especially with no macOS support), so we just provide our own
platform and CPP toolchain within `//dev-infra`. This is more
simple than all the effort we'd need to make the toolchain
generation tool work (while it would also increase the amount
of checked-in sources significantly; with more unused toolchains
for CPP or Java)

PR Close #41767
jessicajaniuk pushed a commit that referenced this pull request Apr 23, 2021
#41767)

A test for the dev-infra publish tool currently relies on an external
http request by accident. This will break if we disallow internet
access within RBE containers.

PR Close #41767
jessicajaniuk pushed a commit that referenced this pull request Apr 23, 2021
#41767)

Uses the new shared RBE platform from the dev-infra package.

PR Close #41767
devversion added a commit to devversion/material2 that referenced this pull request Apr 23, 2021
Uses the new shared RBE platform from the dev-infra package.

We introduced a shared Bazel platform for remote execution builds
using Google cloud. Previously we used `bazel_toolchains` for
providing the platform w/ additional CPP and Java toolchains

`bazel_toolchains` no longer provides default toolchains with the
latest version, but provides a tool (linux and windows only) for
generating toolchain/platforms, which then need to be checked
into the repository. This is quite inconvenient and cumbersome
(especially with no macOS support), so we just provided our own
platform and CPP toolchain within `//dev-infra`. This is more
simple than all the effort we'd need to make the toolchain
generation tool work (while it would also increase the amount
of checked-in sources significantly; with more unused toolchains
for CPP or Java)

See: angular/angular#41767.
devversion added a commit to devversion/material2 that referenced this pull request Apr 27, 2021
Uses the new shared RBE platform from the dev-infra package.

We introduced a shared Bazel platform for remote execution builds
using Google cloud. Previously we used `bazel_toolchains` for
providing the platform w/ additional CPP and Java toolchains

`bazel_toolchains` no longer provides default toolchains with the
latest version, but provides a tool (linux and windows only) for
generating toolchain/platforms, which then need to be checked
into the repository. This is quite inconvenient and cumbersome
(especially with no macOS support), so we just provided our own
platform and CPP toolchain within `//dev-infra`. This is more
simple than all the effort we'd need to make the toolchain
generation tool work (while it would also increase the amount
of checked-in sources significantly; with more unused toolchains
for CPP or Java)

See: angular/angular#41767.
andrewseguin pushed a commit to angular/components that referenced this pull request Apr 28, 2021
#22555)

Uses the new shared RBE platform from the dev-infra package.

We introduced a shared Bazel platform for remote execution builds
using Google cloud. Previously we used `bazel_toolchains` for
providing the platform w/ additional CPP and Java toolchains

`bazel_toolchains` no longer provides default toolchains with the
latest version, but provides a tool (linux and windows only) for
generating toolchain/platforms, which then need to be checked
into the repository. This is quite inconvenient and cumbersome
(especially with no macOS support), so we just provided our own
platform and CPP toolchain within `//dev-infra`. This is more
simple than all the effort we'd need to make the toolchain
generation tool work (while it would also increase the amount
of checked-in sources significantly; with more unused toolchains
for CPP or Java)

See: angular/angular#41767.
clydin pushed a commit to angular/angular-cli that referenced this pull request May 5, 2021
Uses the new shared RBE platform from the dev-infra package.

We introduced a shared Bazel platform for remote execution builds
using Google cloud. Previously we used `bazel_toolchains` for
providing the platform w/ additional CPP and Java toolchains

`bazel_toolchains` no longer provides default toolchains with the
latest version, but provides a tool (linux and windows only) for
generating toolchain/platforms, which then need to be checked
into the repository. This is quite inconvenient and cumbersome
(especially with no macOS support), so we just provided our own
platform and CPP toolchain within `@angular/dev-infra-private`. This is
more simple than all the effort we'd need to make the toolchain
generation tool work (while it would also increase the amount
of checked-in sources significantly; with more unused toolchains
for CPP or Java)

See: angular/angular#41767.
@angular-automatic-lock-bot

Copy link
Copy Markdown

This issue has been automatically locked due to inactivity.
Please file a new issue if you are encountering a similar or related problem.

Read more about our automatic conversation locking policy.

This action has been performed automatically by a bot.

@angular-automatic-lock-bot angular-automatic-lock-bot Bot locked and limited conversation to collaborators May 24, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

action: merge The PR is ready for merge by the caretaker area: dev-infra Issues related to Angular's own dev infra (build, test, CI, releasing) cla: yes target: rc This PR is targeted for the next release-candidate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants