Skip to content

Commit a73a1c5

Browse files
H-HuangH-Huang
committed
Update on "[14/N] Refactor _new_process_group_helper() to remove repeated code"
 Changes: - refactor parts of `_new_process_group_helper()` to remove repeated code [ghstack-poisoned]
2 parents cc2fcd8 + 4a7ebe3 commit a73a1c5

File tree

219 files changed

+4141
-1949
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

219 files changed

+4141
-1949
lines changed

‎.github/ci_commit_pins/vision.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
e64784cdea465d833d9d0f66dc73d7abe217933d
1+
bf58902b2fd881c760cd2eeacfae2d7c468ebf1f

‎.github/ci_commit_pins/xla.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
5ff192eac058d54cc5f22c8ddf9cf6acfa51325d
1+
7889d2d3be16675943d84e4a4133ed7c245a623f

‎.github/scripts/filter_test_configs.py‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,8 @@
2323
"force_on_cpu",
2424
"functorch",
2525
"inductor",
26+
"inductor_distributed",
27+
"inductor_timm",
2628
"jit_legacy",
2729
"multigpu",
2830
"nogpu_AVX512",

‎.github/scripts/install_nvidia_utils_linux.sh‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -74,7 +74,8 @@ install_nvidia_driver_amzn2() {
7474
DEVICE_ENABLED=$(cat /sys/bus/pci/devices/$PCI_ID/enable)
7575

7676
echo "Reseting $PCI_ID (enabled state: $DEVICE_ENABLED)"
77-
echo "1" > /sys/bus/pci/devices/$PCI_ID/reset
77+
# This requires sudo permission of course
78+
echo "1" | sudo tee /sys/bus/pci/devices/$PCI_ID/reset
7879
sleep 1
7980
done
8081
fi

‎.github/workflows/_android-build-test.yml‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -28,18 +28,18 @@ jobs:
2828
if: github.repository_owner == 'pytorch'
2929
runs-on: [self-hosted, linux.2xlarge]
3030
steps:
31+
- name: Setup SSH (Click me for login details)
32+
uses: pytorch/test-infra/.github/actions/setup-ssh@main
33+
with:
34+
github-secret: ${{ secrets.GITHUB_TOKEN }}
35+
3136
# [see note: pytorch repo ref]
3237
- name: Checkout PyTorch
3338
uses: pytorch/pytorch/.github/actions/checkout-pytorch@master
3439

3540
- name: Setup Linux
3641
uses: ./.github/actions/setup-linux
3742

38-
- name: Setup SSH (Click me for login details)
39-
uses: pytorch/test-infra/.github/actions/setup-ssh@main
40-
with:
41-
github-secret: ${{ secrets.GITHUB_TOKEN }}
42-
4343
- name: Calculate docker image
4444
id: calculate-docker-image
4545
uses: ./.github/actions/calculate-docker-image

‎.github/workflows/_android-full-build-test.yml‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -28,18 +28,18 @@ jobs:
2828
if: github.repository_owner == 'pytorch'
2929
runs-on: [self-hosted, linux.2xlarge]
3030
steps:
31+
- name: Setup SSH (Click me for login details)
32+
uses: pytorch/test-infra/.github/actions/setup-ssh@main
33+
with:
34+
github-secret: ${{ secrets.GITHUB_TOKEN }}
35+
3136
# [see note: pytorch repo ref]
3237
- name: Checkout PyTorch
3338
uses: pytorch/pytorch/.github/actions/checkout-pytorch@master
3439

3540
- name: Setup Linux
3641
uses: ./.github/actions/setup-linux
3742

38-
- name: Setup SSH (Click me for login details)
39-
uses: pytorch/test-infra/.github/actions/setup-ssh@main
40-
with:
41-
github-secret: ${{ secrets.GITHUB_TOKEN }}
42-
4343
- name: Calculate docker image
4444
id: calculate-docker-image
4545
uses: ./.github/actions/calculate-docker-image

‎.github/workflows/_bazel-build-test.yml‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -28,18 +28,18 @@ jobs:
2828
if: github.repository_owner == 'pytorch'
2929
runs-on: [self-hosted, linux.2xlarge]
3030
steps:
31+
- name: Setup SSH (Click me for login details)
32+
uses: pytorch/test-infra/.github/actions/setup-ssh@main
33+
with:
34+
github-secret: ${{ secrets.GITHUB_TOKEN }}
35+
3136
# [see note: pytorch repo ref]
3237
- name: Checkout PyTorch
3338
uses: pytorch/pytorch/.github/actions/checkout-pytorch@master
3439

3540
- name: Setup Linux
3641
uses: ./.github/actions/setup-linux
3742

38-
- name: Setup SSH (Click me for login details)
39-
uses: pytorch/test-infra/.github/actions/setup-ssh@main
40-
with:
41-
github-secret: ${{ secrets.GITHUB_TOKEN }}
42-
4343
- name: Calculate docker image
4444
id: calculate-docker-image
4545
uses: ./.github/actions/calculate-docker-image

‎.github/workflows/_binary-build-linux.yml‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -126,16 +126,16 @@ jobs:
126126
- name: List the env
127127
shell: bash
128128
run: env
129+
- name: "[FB EMPLOYEES] Enable SSH (Click me for login details)"
130+
uses: pytorch/test-infra/.github/actions/setup-ssh@main
131+
with:
132+
github-secret: ${{ secrets.github-token }}
129133
- name: Checkout PyTorch
130134
uses: pytorch/pytorch/.github/actions/checkout-pytorch@master
131135
- name: Setup Linux
132136
uses: ./.github/actions/setup-linux
133137
- name: Chown workspace
134138
uses: ./.github/actions/chown-workspace
135-
- name: "[FB EMPLOYEES] Enable SSH (Click me for login details)"
136-
uses: pytorch/test-infra/.github/actions/setup-ssh@main
137-
with:
138-
github-secret: ${{ secrets.github-token }}
139139
- name: Clean workspace
140140
shell: bash
141141
run: |

‎.github/workflows/_binary-test-linux.yml‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -122,17 +122,17 @@ jobs:
122122
echo "SHA1=${{ env.SHA1 }}"
123123
} >> "${GITHUB_ENV} }}"
124124
125+
- name: "[FB EMPLOYEES] Enable SSH (Click me for login details)"
126+
uses: pytorch/test-infra/.github/actions/setup-ssh@main
127+
with:
128+
github-secret: ${{ secrets.github-token }}
125129
# Setup the environment
126130
- name: Checkout PyTorch
127131
uses: pytorch/pytorch/.github/actions/checkout-pytorch@master
128132
- name: Setup Linux
129133
uses: ./.github/actions/setup-linux
130134
- name: Chown workspace
131135
uses: ./.github/actions/chown-workspace
132-
- name: "[FB EMPLOYEES] Enable SSH (Click me for login details)"
133-
uses: pytorch/test-infra/.github/actions/setup-ssh@main
134-
with:
135-
github-secret: ${{ secrets.github-token }}
136136
- name: Clean workspace
137137
shell: bash
138138
run: |

‎.github/workflows/_buck-build-test.yml‎

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -34,16 +34,16 @@ jobs:
3434
max_attempts: 5
3535
command: |
3636
conda install -y \
37-
cffi \
38-
cmake \
39-
mkl \
40-
mkl-include \
41-
ninja \
42-
numpy \
43-
pyyaml \
44-
requests \
45-
setuptools \
46-
typing_extensions
37+
cffi=1.15.1 \
38+
cmake=3.22.1 \
39+
mkl=2022.1.0 \
40+
mkl-include=2022.1.0 \
41+
ninja=1.10.2 \
42+
numpy=1.23.3 \
43+
pyyaml=6.0 \
44+
requests=2.28.1 \
45+
setuptools=65.5.0 \
46+
typing_extensions=4.3.0
4747
4848
- name: Install Buck
4949
uses: nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482

0 commit comments

Comments
 (0)