Actually run backward criterion tests. #44029

gchanan · 2020-09-02T16:11:26Z

Stack from ghstack:

Actually run backward criterion tests. #44029 Actually run backward criterion tests.

This looks to have been a mistake from #9287.

This looks to have been a mistake from #9287. [ghstack-poisoned]

dr-ci · 2020-09-02T16:40:55Z

💊 CI failures summary and remediations

As of commit 51feb69 (more details on the Dr. CI page):

10/10 failures possibly* introduced in this PR
- 2/10 non-CircleCI failure(s)

🕵️ 8 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

pytorch_linux_xenial_py3_6_gcc5_4_ge_config_simple_test (1/8)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Sep 02 17:32:36 ERROR [0.019s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN)

Sep 02 17:32:36     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 17:32:36   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 17:32:36     self._forward_criterion(criterion, input, target) 
Sep 02 17:32:36   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 17:32:36     output = criterion(input, target, *extra_args) 
Sep 02 17:32:36   File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 727, in _call_impl 
Sep 02 17:32:36     result = self.forward(*input, **kwargs) 
Sep 02 17:32:36 TypeError: forward() missing 2 required positional arguments: 'input_lengths' and 'target_lengths' 
Sep 02 17:32:36  
Sep 02 17:32:36 ====================================================================== 
Sep 02 17:32:36 ERROR [0.019s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN) 
Sep 02 17:32:36 ---------------------------------------------------------------------- 
Sep 02 17:32:36 Traceback (most recent call last): 
Sep 02 17:32:36   File "test_nn.py", line 8611, in <lambda> 
Sep 02 17:32:36     add(test_name, lambda self, test=test: test(self)) 
Sep 02 17:32:36   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4889, in __call__ 
Sep 02 17:32:36     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 17:32:36   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 17:32:36     self._forward_criterion(criterion, input, target) 
Sep 02 17:32:36   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 17:32:36     output = criterion(input, target, *extra_args)

pytorch_linux_xenial_cuda10_2_cudnn7_py3_gcc7_test (2/8)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Sep 02 17:10:21 ERROR [0.023s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN)

Sep 02 17:10:21     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 17:10:21   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 17:10:21     self._forward_criterion(criterion, input, target) 
Sep 02 17:10:21   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 17:10:21     output = criterion(input, target, *extra_args) 
Sep 02 17:10:21   File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 727, in _call_impl 
Sep 02 17:10:21     result = self.forward(*input, **kwargs) 
Sep 02 17:10:21 TypeError: forward() missing 2 required positional arguments: 'input_lengths' and 'target_lengths' 
Sep 02 17:10:21  
Sep 02 17:10:21 ====================================================================== 
Sep 02 17:10:21 ERROR [0.023s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN) 
Sep 02 17:10:21 ---------------------------------------------------------------------- 
Sep 02 17:10:21 Traceback (most recent call last): 
Sep 02 17:10:21   File "test_nn.py", line 8611, in <lambda> 
Sep 02 17:10:21     add(test_name, lambda self, test=test: test(self)) 
Sep 02 17:10:21   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4889, in __call__ 
Sep 02 17:10:21     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 17:10:21   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 17:10:21     self._forward_criterion(criterion, input, target) 
Sep 02 17:10:21   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 17:10:21     output = criterion(input, target, *extra_args)

pytorch_linux_bionic_py3_6_clang9_test (3/8)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Sep 02 16:49:55 ERROR [0.017s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN)

Sep 02 16:49:55     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 16:49:55   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 16:49:55     self._forward_criterion(criterion, input, target) 
Sep 02 16:49:55   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 16:49:55     output = criterion(input, target, *extra_args) 
Sep 02 16:49:55   File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 727, in _call_impl 
Sep 02 16:49:55     result = self.forward(*input, **kwargs) 
Sep 02 16:49:55 TypeError: forward() missing 2 required positional arguments: 'input_lengths' and 'target_lengths' 
Sep 02 16:49:55  
Sep 02 16:49:55 ====================================================================== 
Sep 02 16:49:55 ERROR [0.017s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN) 
Sep 02 16:49:55 ---------------------------------------------------------------------- 
Sep 02 16:49:55 Traceback (most recent call last): 
Sep 02 16:49:55   File "test_nn.py", line 8611, in <lambda> 
Sep 02 16:49:55     add(test_name, lambda self, test=test: test(self)) 
Sep 02 16:49:55   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4889, in __call__ 
Sep 02 16:49:55     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 16:49:55   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 16:49:55     self._forward_criterion(criterion, input, target) 
Sep 02 16:49:55   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 16:49:55     output = criterion(input, target, *extra_args)

pytorch_linux_xenial_py3_clang5_asan_test1 (4/8)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Sep 02 16:47:46 SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /var/lib/jenkins/workspace/aten/src/ATen/Utils.cpp:11:3 in

Sep 02 16:47:46     #7 0x56454583d7eb in PyEval_EvalCode /tmp/build/80754af9/python_1588903631989/work/Python/ceval.c:731 
Sep 02 16:47:46     #8 0x5645458bde73 in run_mod /tmp/build/80754af9/python_1588903631989/work/Python/pythonrun.c:1025 
Sep 02 16:47:46     #9 0x5645458bdf0c in PyRun_StringFlags /tmp/build/80754af9/python_1588903631989/work/Python/pythonrun.c:949 
Sep 02 16:47:46     #10 0x5645458bdf6e in PyRun_SimpleStringFlags /tmp/build/80754af9/python_1588903631989/work/Python/pythonrun.c:445 
Sep 02 16:47:46     #11 0x5645458c1d72 in run_command /tmp/build/80754af9/python_1588903631989/work/Modules/main.c:301 
Sep 02 16:47:46     #12 0x5645458c1d72 in Py_Main /tmp/build/80754af9/python_1588903631989/work/Modules/main.c:749 
Sep 02 16:47:46     #13 0x56454578bf2d in main /tmp/build/80754af9/python_1588903631989/work/Programs/python.c:69 
Sep 02 16:47:46     #14 0x7f9c2637a83f in __libc_start_main /build/glibc-e6zv40/glibc-2.23/csu/../csu/libc-start.c:291 
Sep 02 16:47:46     #15 0x56454586b27e in _start /home/rdonnelly/mc/conda-bld/compilers_linux-64_1534865402226/work/.build/src/glibc-2.12.2/csu/../sysdeps/x86_64/elf/start.S:103 
Sep 02 16:47:46  
Sep 02 16:47:46 SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior /var/lib/jenkins/workspace/aten/src/ATen/Utils.cpp:11:3 in  
Sep 02 16:47:46 + retcode=1 
Sep 02 16:47:46 + set -e 
Sep 02 16:47:46 + return 1 
Sep 02 16:47:46 + [[ pytorch-linux-xenial-py3-clang5-asan-test1 == *-NO_AVX-* ]] 
Sep 02 16:47:46 + [[ pytorch-linux-xenial-py3-clang5-asan-test1 == *-NO_AVX2-* ]] 
Sep 02 16:47:46 + '[' -n https://github.com/pytorch/pytorch/pull/44029 ']' 
Sep 02 16:47:46 + [[ pytorch-linux-xenial-py3-clang5-asan-test1 != *coverage* ]] 
Sep 02 16:47:46 ++ mktemp 
Sep 02 16:47:46 + DETERMINE_FROM=/tmp/tmp.jnmVOQ5soU 
Sep 02 16:47:46 + file_diff_from_base /tmp/tmp.jnmVOQ5soU

pytorch_windows_vs2019_py36_cuda10.1_test2 (5/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

RuntimeError: test_nn failed!

Generated XML report: test-reports\python-unittest\TEST-TestModuleGlobalHooks-20200902164152.xml 
Generated XML report: test-reports\python-unittest\TEST-TestNN-20200902164152.xml 
Generated XML report: test-reports\python-unittest\TEST-TestNNDeviceTypeCPU-20200902164152.xml 
Generated XML report: test-reports\python-unittest\TEST-TestNNDeviceTypeCUDA-20200902164152.xml 
Generated XML report: test-reports\python-unittest\TEST-TestNNInit-20200902164152.xml 
Traceback (most recent call last): 
  File "run_test.py", line 734, in <module> 
    main() 
  File "run_test.py", line 717, in main 
    raise RuntimeError(err_message) 
RuntimeError: test_nn failed! 
 
(base) circleci@PACKER-5F0EEC91 C:\Users\circleci\project\test>if ERRORLEVEL 1 exit /b 1  
+ cleanup
+ retcode=1
+ set +x

pytorch_macos_10_13_py3_test (6/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

Sep 02 09:53:25 RuntimeError: test_nn failed!

Sep 02 09:53:25 Generated XML report: test-reports/python-unittest/TEST-TestFusionEval-20200902093952.xml 
Sep 02 09:53:25 Generated XML report: test-reports/python-unittest/TEST-TestModuleGlobalHooks-20200902093952.xml 
Sep 02 09:53:25 Generated XML report: test-reports/python-unittest/TEST-TestNN-20200902093952.xml 
Sep 02 09:53:25 Generated XML report: test-reports/python-unittest/TEST-TestNNDeviceTypeCPU-20200902093952.xml 
Sep 02 09:53:25 Generated XML report: test-reports/python-unittest/TEST-TestNNInit-20200902093952.xml 
Sep 02 09:53:25 Traceback (most recent call last): 
Sep 02 09:53:25   File "test/run_test.py", line 734, in <module> 
Sep 02 09:53:25     main() 
Sep 02 09:53:25   File "test/run_test.py", line 717, in main 
Sep 02 09:53:25     raise RuntimeError(err_message) 
Sep 02 09:53:25 RuntimeError: test_nn failed! 
Sep 02 09:53:26 + cleanup 
Sep 02 09:53:26 + retcode=1 
Sep 02 09:53:26 + set +x

pytorch_linux_xenial_py3_6_gcc5_4_test (7/8)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Sep 02 17:32:52 ERROR [0.020s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN)

Sep 02 17:32:52     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 17:32:52   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 17:32:52     self._forward_criterion(criterion, input, target) 
Sep 02 17:32:52   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 17:32:52     output = criterion(input, target, *extra_args) 
Sep 02 17:32:52   File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 727, in _call_impl 
Sep 02 17:32:52     result = self.forward(*input, **kwargs) 
Sep 02 17:32:52 TypeError: forward() missing 2 required positional arguments: 'input_lengths' and 'target_lengths' 
Sep 02 17:32:52  
Sep 02 17:32:52 ====================================================================== 
Sep 02 17:32:52 ERROR [0.020s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN) 
Sep 02 17:32:52 ---------------------------------------------------------------------- 
Sep 02 17:32:52 Traceback (most recent call last): 
Sep 02 17:32:52   File "test_nn.py", line 8611, in <lambda> 
Sep 02 17:32:52     add(test_name, lambda self, test=test: test(self)) 
Sep 02 17:32:52   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4889, in __call__ 
Sep 02 17:32:52     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 17:32:52   File "/opt/conda/lib/python3.6/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 17:32:52     self._forward_criterion(criterion, input, target) 
Sep 02 17:32:52   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 17:32:52     output = criterion(input, target, *extra_args)

pytorch_linux_bionic_py3_8_gcc9_coverage_test (8/8)

Step: "Run tests" (full log | diagnosis details | 🔁 rerun)

Sep 02 17:01:03 ERROR [0.020s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN)

Sep 02 17:01:03     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 17:01:03   File "/opt/conda/lib/python3.8/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 17:01:03     self._forward_criterion(criterion, input, target) 
Sep 02 17:01:03   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 17:01:03     output = criterion(input, target, *extra_args) 
Sep 02 17:01:03   File "/opt/conda/lib/python3.8/site-packages/torch/nn/modules/module.py", line 727, in _call_impl 
Sep 02 17:01:03     result = self.forward(*input, **kwargs) 
Sep 02 17:01:03 TypeError: forward() missing 2 required positional arguments: 'input_lengths' and 'target_lengths' 
Sep 02 17:01:03  
Sep 02 17:01:03 ====================================================================== 
Sep 02 17:01:03 ERROR [0.020s]: test_CTCLoss_lengths_tensors_sum_reduction (__main__.TestNN) 
Sep 02 17:01:03 ---------------------------------------------------------------------- 
Sep 02 17:01:03 Traceback (most recent call last): 
Sep 02 17:01:03   File "test_nn.py", line 8611, in <lambda> 
Sep 02 17:01:03     add(test_name, lambda self, test=test: test(self)) 
Sep 02 17:01:03   File "/opt/conda/lib/python3.8/site-packages/torch/testing/_internal/common_nn.py", line 4889, in __call__ 
Sep 02 17:01:03     test_case.check_criterion_jacobian(module, input, target) 
Sep 02 17:01:03   File "/opt/conda/lib/python3.8/site-packages/torch/testing/_internal/common_nn.py", line 4572, in check_criterion_jacobian 
Sep 02 17:01:03     self._forward_criterion(criterion, input, target) 
Sep 02 17:01:03   File "test_nn.py", line 332, in _forward_criterion 
Sep 02 17:01:03     output = criterion(input, target, *extra_args)

ci.pytorch.org: 2 failed

Failed: pr/caffe2-pytorch-linux-bionic-rocm3.7-py3.6-test
Failed: pr/pytorch-linux-bionic-rocm3.7-py3.6

This comment was automatically generated by Dr. CI (expand for details).

Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions on the GitHub issue tracker or post in the (internal) Dr. CI Users group.

See how this bot performed.

This comment has been revised 8 times.

Actually run backward criterion tests.

51feb69

This looks to have been a mistake from #9287. [ghstack-poisoned]

gchanan closed this Sep 3, 2020

facebook-github-bot deleted the gh/gchanan/313/head branch October 4, 2020 14:18

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Actually run backward criterion tests. #44029

Actually run backward criterion tests. #44029

Uh oh!

gchanan commented Sep 2, 2020 •

edited

Loading

Uh oh!

dr-ci bot commented Sep 2, 2020 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Actually run backward criterion tests. #44029

Actually run backward criterion tests. #44029

Uh oh!

Conversation

gchanan commented Sep 2, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

dr-ci bot commented Sep 2, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

💊 CI failures summary and remediations

🕵️ 8 new failures recognized by patterns

pytorch_linux_xenial_py3_6_gcc5_4_ge_config_simple_test (1/8)

pytorch_linux_xenial_cuda10_2_cudnn7_py3_gcc7_test (2/8)

pytorch_linux_bionic_py3_6_clang9_test (3/8)

pytorch_linux_xenial_py3_clang5_asan_test1 (4/8)

pytorch_windows_vs2019_py36_cuda10.1_test2 (5/8)

pytorch_macos_10_13_py3_test (6/8)

pytorch_linux_xenial_py3_6_gcc5_4_test (7/8)

pytorch_linux_bionic_py3_8_gcc9_coverage_test (8/8)

ci.pytorch.org: 2 failed

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

gchanan commented Sep 2, 2020 •

edited

Loading

dr-ci bot commented Sep 2, 2020 •

edited

Loading