Skip to content

Add script for posting perf results back to GH#30526

Merged
weswigham merged 3 commits into
microsoft:masterfrom
weswigham:add-perf-result-post-script
Mar 23, 2019
Merged

Add script for posting perf results back to GH#30526
weswigham merged 3 commits into
microsoft:masterfrom
weswigham:add-perf-result-post-script

Conversation

@weswigham

@weswigham weswigham commented Mar 21, 2019

Copy link
Copy Markdown
Member

And now to test~

@microsoft microsoft deleted a comment from typescript-bot Mar 21, 2019
@microsoft microsoft deleted a comment from typescript-bot Mar 21, 2019
@weswigham

weswigham commented Mar 21, 2019

Copy link
Copy Markdown
Member Author

@typescript-bot perf test

@typescript-bot

typescript-bot commented Mar 21, 2019 •
edited
Loading

Copy link
Copy Markdown
Contributor

Heya @weswigham, I've started to run the perf test suite on this PR at e080b0a. You can monitor the build here. It should now contribute to this PR's status checks.

Update: The results are in!

@typescript-bot

typescript-bot commented Mar 21, 2019

Copy link
Copy Markdown
Contributor

@weswigham
The results of the perf run you requested are in! Here they are:

@weswigham

weswigham commented Mar 21, 2019

Copy link
Copy Markdown
Member Author

@typescript-bot perf test

@typescript-bot

typescript-bot commented Mar 21, 2019 •
edited
Loading

Copy link
Copy Markdown
Contributor

Heya @weswigham, I've started to run the perf test suite on this PR at 250e0fc. You can monitor the build here. It should now contribute to this PR's status checks.

Update: The results are in!

@typescript-bot

typescript-bot commented Mar 21, 2019

Copy link
Copy Markdown
Contributor

@weswigham
The results of the perf run you requested are in! Here they are:

@weswigham

weswigham commented Mar 21, 2019

Copy link
Copy Markdown
Member Author

@typescript-bot perf test

@typescript-bot

typescript-bot commented Mar 21, 2019 •
edited
Loading

Copy link
Copy Markdown
Contributor

Heya @weswigham, I've started to run the perf test suite on this PR at 250e0fc. You can monitor the build here. It should now contribute to this PR's status checks.

Update: The results are in!

@rbuckton

rbuckton commented Mar 22, 2019

Copy link
Copy Markdown
Contributor

Yeah... that didn't format very well.

@microsoft microsoft deleted a comment from typescript-bot Mar 22, 2019
@weswigham

weswigham commented Mar 22, 2019

Copy link
Copy Markdown
Member Author

@typescript-bot perf test

@typescript-bot

typescript-bot commented Mar 22, 2019 •
edited
Loading

Copy link
Copy Markdown
Contributor

Heya @weswigham, I've started to run the perf test suite on this PR at 250e0fc. You can monitor the build here. It should now contribute to this PR's status checks.

@weswigham

weswigham commented Mar 22, 2019

Copy link
Copy Markdown
Member Author

@typescript-bot perf test

@typescript-bot

typescript-bot commented Mar 22, 2019 •
edited
Loading

Copy link
Copy Markdown
Contributor

Heya @weswigham, I've started to run the perf test suite on this PR at 250e0fc. You can monitor the build here. It should now contribute to this PR's status checks.

Update: The results are in!

@typescript-bot

typescript-bot commented Mar 23, 2019

Copy link
Copy Markdown
Contributor

@weswigham
The results of the perf run you requested are in! Here they are:

Comparison Report - master..30526

Metric master 30526 Delta Best Worst
Angular - node (v6.5.0, x64)
Memory used 341,319k (± 0.41%) 341,124k (± 0.39%) -195k (- 0.06%) 338,450k 342,546k
Parse Time 1.56s (± 1.36%) 1.55s (± 0.91%) -0.01s (- 0.51%) 1.53s 1.60s
Bind Time 1.66s (± 2.21%) 1.65s (± 2.26%) -0.01s (- 0.60%) 1.51s 1.70s
Check Time 4.75s (± 0.67%) 4.72s (± 0.65%) -0.03s (- 0.55%) 4.68s 4.83s
Emit Time 6.48s (± 1.35%) 6.51s (± 2.05%) +0.04s (+ 0.54%) 6.19s 6.76s
Total Time 14.44s (± 0.64%) 14.43s (± 0.99%) -0.01s (- 0.06%) 14.11s 14.75s
Monaco - node (v6.5.0, x64)
Memory used 363,889k (± 0.01%) 363,927k (± 0.01%) +38k (+ 0.01%) 363,845k 364,025k
Parse Time 1.26s (± 0.59%) 1.26s (± 0.44%) -0.00s (- 0.08%) 1.25s 1.27s
Bind Time 1.51s (± 0.37%) 1.52s (± 1.49%) +0.01s (+ 0.46%) 1.49s 1.60s
Check Time 5.58s (± 1.11%) 5.59s (± 1.08%) +0.00s (+ 0.09%) 5.36s 5.67s
Emit Time 3.60s (± 2.10%) 3.63s (± 0.56%) +0.03s (+ 0.83%) 3.58s 3.68s
Total Time 11.95s (± 0.91%) 12.00s (± 0.56%) +0.04s (+ 0.35%) 11.75s 12.07s
TFS - node (v6.5.0, x64)
Memory used 320,904k (± 0.01%) 320,892k (± 0.01%) -13k (- 0.00%) 320,815k 320,931k
Parse Time 0.97s (± 0.37%) 0.98s (± 0.69%) +0.01s (+ 1.03%) 0.97s 1.00s
Bind Time 1.27s (± 0.78%) 1.27s (± 1.48%) +0.00s (+ 0.08%) 1.24s 1.32s
Check Time 4.26s (± 0.62%) 4.27s (± 0.52%) +0.01s (+ 0.26%) 4.22s 4.33s
Emit Time 3.15s (± 0.34%) 3.18s (± 1.29%) +0.04s (+ 1.18%) 3.12s 3.28s
Total Time 9.65s (± 0.41%) 9.71s (± 0.45%) +0.06s (+ 0.66%) 9.58s 9.79s
Angular - node (v6.5.0, x86)
Memory used 190,556k (± 0.01%) 190,556k (± 0.00%) 0k ( 0.00%) 190,532k 190,573k
Parse Time 1.46s (± 0.68%) 1.46s (± 0.56%) -0.00s (- 0.07%) 1.43s 1.47s
Bind Time 1.52s (± 1.22%) 1.51s (± 1.08%) -0.02s (- 1.05%) 1.47s 1.54s
Check Time 4.61s (± 0.78%) 4.64s (± 0.54%) +0.03s (+ 0.59%) 4.58s 4.70s
Emit Time 6.05s (± 1.23%) 6.03s (± 0.85%) -0.02s (- 0.25%) 5.90s 6.13s
Total Time 13.64s (± 0.87%) 13.63s (± 0.42%) -0.01s (- 0.04%) 13.49s 13.74s
Monaco - node (v6.5.0, x86)
Memory used 204,156k (± 0.00%) 204,154k (± 0.01%) -2k (- 0.00%) 204,119k 204,221k
Parse Time 1.26s (± 0.66%) 1.27s (± 0.74%) +0.01s (+ 0.88%) 1.25s 1.30s
Bind Time 1.55s (± 0.80%) 1.55s (± 0.47%) -0.01s (- 0.32%) 1.54s 1.57s
Check Time 4.50s (± 1.10%) 4.50s (± 0.48%) -0.01s (- 0.16%) 4.45s 4.54s
Emit Time 3.18s (± 1.39%) 3.21s (± 0.61%) +0.03s (+ 1.01%) 3.17s 3.25s
Total Time 10.49s (± 0.18%) 10.52s (± 0.31%) +0.03s (+ 0.27%) 10.42s 10.58s
TFS - node (v6.5.0, x86)
Memory used 180,195k (± 0.01%) 180,191k (± 0.01%) -3k (- 0.00%) 180,166k 180,235k
Parse Time 0.98s (± 0.79%) 0.98s (± 0.86%) +0.00s (+ 0.00%) 0.96s 1.00s
Bind Time 1.30s (± 0.58%) 1.30s (± 0.43%) -0.00s (- 0.15%) 1.29s 1.31s
Check Time 3.82s (± 0.33%) 3.83s (± 0.38%) +0.01s (+ 0.21%) 3.80s 3.86s
Emit Time 2.57s (± 1.05%) 2.58s (± 0.59%) +0.01s (+ 0.43%) 2.56s 2.62s
Total Time 8.68s (± 0.30%) 8.70s (± 0.28%) +0.02s (+ 0.22%) 8.65s 8.76s
Angular - node (v8.9.0, x64)
Memory used 329,858k (± 0.01%) 329,810k (± 0.01%) -48k (- 0.01%) 329,706k 329,903k
Parse Time 1.78s (± 0.28%) 1.78s (± 0.34%) +0.00s (+ 0.06%) 1.77s 1.80s
Bind Time 1.35s (± 1.36%) 1.34s (± 0.90%) -0.00s (- 0.07%) 1.32s 1.38s
Check Time 4.44s (± 1.29%) 4.46s (± 1.78%) +0.02s (+ 0.38%) 4.37s 4.68s
Emit Time 6.13s (± 1.41%) 6.08s (± 3.05%) -0.04s (- 0.67%) 5.56s 6.34s
Total Time 13.69s (± 0.43%) 13.67s (± 0.93%) -0.02s (- 0.15%) 13.40s 14.00s
Monaco - node (v8.9.0, x64)
Memory used 358,134k (± 0.02%) 358,132k (± 0.02%) -2k (- 0.00%) 358,022k 358,253k
Parse Time 1.45s (± 0.46%) 1.45s (± 0.48%) +0.00s (+ 0.14%) 1.44s 1.47s
Bind Time 1.54s (± 1.05%) 1.52s (± 0.51%) -0.02s (- 1.17%) 1.50s 1.54s
Check Time 4.68s (± 1.67%) 4.63s (± 0.95%) -0.05s (- 1.00%) 4.58s 4.80s
Emit Time 3.15s (± 4.62%) 3.24s (± 2.99%) +0.09s (+ 2.73%) 2.85s 3.30s
Total Time 10.81s (± 0.80%) 10.84s (± 0.60%) +0.02s (+ 0.22%) 10.58s 10.90s
TFS - node (v8.9.0, x64)
Memory used 313,683k (± 0.01%) 313,648k (± 0.02%) -36k (- 0.01%) 313,561k 313,747k
Parse Time 1.14s (± 0.52%) 1.14s (± 0.49%) +0.01s (+ 0.53%) 1.13s 1.15s
Bind Time 1.23s (± 1.04%) 1.23s (± 0.97%) -0.00s (- 0.24%) 1.21s 1.27s
Check Time 4.12s (± 0.53%) 4.09s (± 0.31%) -0.02s (- 0.58%) 4.06s 4.12s
Emit Time 3.15s (± 0.48%) 3.13s (± 0.80%) -0.03s (- 0.86%) 3.07s 3.18s
Total Time 9.63s (± 0.41%) 9.59s (± 0.22%) -0.04s (- 0.45%) 9.55s 9.63s
Angular - node (v8.9.0, x86)
Memory used 186,679k (± 0.01%) 186,686k (± 0.02%) +7k (+ 0.00%) 186,594k 186,781k
Parse Time 1.73s (± 0.63%) 1.73s (± 0.45%) -0.00s (- 0.17%) 1.72s 1.75s
Bind Time 1.53s (± 0.70%) 1.52s (± 0.66%) -0.01s (- 0.91%) 1.49s 1.54s
Check Time 4.15s (± 0.66%) 4.18s (± 0.84%) +0.03s (+ 0.77%) 4.10s 4.25s
Emit Time 5.64s (± 1.43%) 5.65s (± 0.99%) +0.00s (+ 0.04%) 5.47s 5.77s
Total Time 13.06s (± 0.74%) 13.07s (± 0.65%) +0.01s (+ 0.11%) 12.82s 13.27s
Monaco - node (v8.9.0, x86)
Memory used 199,646k (± 0.02%) 199,588k (± 0.02%) -57k (- 0.03%) 199,512k 199,671k
Parse Time 1.50s (± 0.35%) 1.50s (± 0.39%) +0.00s (+ 0.13%) 1.49s 1.52s
Bind Time 1.39s (± 0.48%) 1.41s (± 1.04%) +0.02s (+ 1.08%) 1.39s 1.46s
Check Time 4.47s (± 0.46%) 4.47s (± 0.63%) -0.00s (- 0.02%) 4.42s 4.53s
Emit Time 3.08s (± 0.36%) 3.10s (± 0.49%) +0.02s (+ 0.49%) 3.06s 3.13s
Total Time 10.44s (± 0.29%) 10.47s (± 0.35%) +0.03s (+ 0.28%) 10.39s 10.54s
TFS - node (v8.9.0, x86)
Memory used 175,729k (± 0.02%) 175,726k (± 0.02%) -3k (- 0.00%) 175,678k 175,810k
Parse Time 1.20s (± 0.57%) 1.19s (± 0.89%) -0.00s (- 0.08%) 1.18s 1.23s
Bind Time 1.24s (± 0.90%) 1.24s (± 0.55%) +0.00s (+ 0.08%) 1.22s 1.25s
Check Time 3.90s (± 0.78%) 3.94s (± 0.94%) +0.03s (+ 0.87%) 3.89s 4.06s
Emit Time 2.76s (± 0.88%) 2.77s (± 1.30%) +0.01s (+ 0.22%) 2.69s 2.84s
Total Time 9.10s (± 0.46%) 9.14s (± 0.54%) +0.04s (+ 0.44%) 9.06s 9.29s
Angular - node (v9.0.0, x64)
Memory used 329,657k (± 0.02%) 329,612k (± 0.02%) -45k (- 0.01%) 329,514k 329,752k
Parse Time 1.63s (± 0.42%) 1.63s (± 0.36%) +0.00s (+ 0.12%) 1.61s 1.64s
Bind Time 1.33s (± 0.74%) 1.33s (± 0.56%) -0.00s (- 0.15%) 1.32s 1.35s
Check Time 4.22s (± 0.58%) 4.21s (± 0.68%) -0.01s (- 0.24%) 4.15s 4.29s
Emit Time 5.91s (± 0.34%) 5.95s (± 0.70%) +0.04s (+ 0.69%) 5.88s 6.07s
Total Time 13.08s (± 0.32%) 13.12s (± 0.42%) +0.03s (+ 0.25%) 13.03s 13.27s
Monaco - node (v9.0.0, x64)
Memory used 357,901k (± 0.01%) 357,905k (± 0.01%) +4k (+ 0.00%) 357,844k 357,981k
Parse Time 1.29s (± 0.45%) 1.29s (± 0.73%) +0.00s (+ 0.08%) 1.27s 1.32s
Bind Time 1.51s (± 0.73%) 1.52s (± 0.44%) +0.00s (+ 0.26%) 1.50s 1.53s
Check Time 4.56s (± 0.39%) 4.55s (± 0.55%) -0.01s (- 0.15%) 4.50s 4.61s
Emit Time 3.22s (± 0.35%) 3.20s (± 0.26%) -0.01s (- 0.34%) 3.18s 3.22s
Total Time 10.58s (± 0.23%) 10.57s (± 0.39%) -0.01s (- 0.10%) 10.48s 10.66s
TFS - node (v9.0.0, x64)
Memory used 313,607k (± 0.02%) 313,589k (± 0.01%) -18k (- 0.01%) 313,527k 313,741k
Parse Time 1.01s (± 0.66%) 1.01s (± 0.47%) 0.00s ( 0.00%) 1.00s 1.02s
Bind Time 1.21s (± 0.63%) 1.21s (± 0.60%) -0.00s (- 0.25%) 1.20s 1.23s
Check Time 4.15s (± 2.09%) 4.12s (± 1.65%) -0.03s (- 0.77%) 3.99s 4.30s
Emit Time 3.01s (± 2.34%) 3.02s (± 1.86%) +0.01s (+ 0.30%) 2.87s 3.17s
Total Time 9.39s (± 0.66%) 9.37s (± 0.42%) -0.02s (- 0.21%) 9.27s 9.48s
Angular - node (v9.0.0, x86)
Memory used 186,830k (± 0.03%) 186,840k (± 0.03%) +10k (+ 0.01%) 186,755k 187,035k
Parse Time 1.54s (± 0.53%) 1.55s (± 0.72%) +0.01s (+ 0.52%) 1.53s 1.59s
Bind Time 1.50s (± 0.35%) 1.51s (± 1.08%) +0.01s (+ 0.80%) 1.49s 1.57s
Check Time 3.91s (± 0.44%) 3.91s (± 0.67%) +0.00s (+ 0.05%) 3.85s 3.97s
Emit Time 5.29s (± 0.79%) 5.33s (± 0.58%) +0.04s (+ 0.76%) 5.26s 5.38s
Total Time 12.24s (± 0.38%) 12.30s (± 0.42%) +0.06s (+ 0.49%) 12.16s 12.44s
Monaco - node (v9.0.0, x86)
Memory used 199,696k (± 0.02%) 199,672k (± 0.02%) -24k (- 0.01%) 199,550k 199,721k
Parse Time 1.32s (± 0.51%) 1.32s (± 0.73%) -0.00s (- 0.23%) 1.30s 1.34s
Bind Time 1.36s (± 1.15%) 1.35s (± 0.56%) -0.01s (- 0.66%) 1.34s 1.37s
Check Time 4.37s (± 0.56%) 4.39s (± 0.50%) +0.02s (+ 0.53%) 4.35s 4.45s
Emit Time 3.01s (± 0.90%) 3.02s (± 0.77%) +0.00s (+ 0.13%) 2.96s 3.08s
Total Time 10.06s (± 0.54%) 10.08s (± 0.40%) +0.02s (+ 0.17%) 10.00s 10.16s
TFS - node (v9.0.0, x86)
Memory used 175,896k (± 0.03%) 175,879k (± 0.02%) -17k (- 0.01%) 175,813k 175,943k
Parse Time 1.03s (± 0.79%) 1.04s (± 0.54%) +0.01s (+ 0.48%) 1.03s 1.05s
Bind Time 1.22s (± 0.48%) 1.22s (± 0.71%) +0.00s (+ 0.08%) 1.21s 1.24s
Check Time 3.80s (± 0.56%) 3.82s (± 0.38%) +0.02s (+ 0.63%) 3.78s 3.85s
Emit Time 2.70s (± 1.01%) 2.71s (± 0.41%) +0.01s (+ 0.56%) 2.68s 2.73s
Total Time 8.75s (± 0.50%) 8.79s (± 0.30%) +0.05s (+ 0.53%) 8.75s 8.85s

System

Machine Namets-ci-ubuntu
Platformlinux 4.4.0-142-generic
Architecturex64
Available Memory16 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz

Hosts

  • node (v6.5.0, x64)* node (v6.5.0, x86)* node (v8.9.0, x64)* node (v8.9.0, x86)* node (v9.0.0, x64)* node (v9.0.0, x86)

Scenarios

  • Angular - node (v6.5.0, x64)* Angular - node (v6.5.0, x86)* Angular - node (v8.9.0, x64)* Angular - node (v8.9.0, x86)* Angular - node (v9.0.0, x64)* Angular - node (v9.0.0, x86)* Monaco - node (v6.5.0, x64)* Monaco - node (v6.5.0, x86)* Monaco - node (v8.9.0, x64)* Monaco - node (v8.9.0, x86)* Monaco - node (v9.0.0, x64)* Monaco - node (v9.0.0, x86)* TFS - node (v6.5.0, x64)* TFS - node (v6.5.0, x86)* TFS - node (v8.9.0, x64)* TFS - node (v8.9.0, x86)* TFS - node (v9.0.0, x64)* TFS - node (v9.0.0, x86)

Summary

Benchmark Name Iterations
Current 30526 10
Baseline master 10

@weswigham weswigham merged commit e20b87f into microsoft:master Mar 23, 2019
@microsoft microsoft locked as resolved and limited conversation to collaborators Oct 21, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@weswigham @typescript-bot @rbuckton