Skip to content

Remove Debug namespace runtime modification #53228

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 8 commits into from
Closed

Remove Debug namespace runtime modification #53228

wants to merge 8 commits into from

Conversation

jakebailey
Copy link
Member

Pulling this out of #51455 for a more directed review.

Perf testing #51455 showed that this mechanism doesn't seem to have a measurable performance impact, and if Debug is a module, we can't do this sort of thing without a bunch of setters.

@typescript-bot typescript-bot added Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug labels Mar 13, 2023
@jakebailey
Copy link
Member Author

@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 13, 2023 •
edited
Loading

Heya @jakebailey, I've started to run the perf test suite on this PR at f2c6bb4. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - main..53228
Metric main 53228 Delta Best Worst p-value
Angular - node (v18.10.0, x64)
Memory used 363,619k (± 0.01%) 363,692k (± 0.01%) +73k (+ 0.02%) 363,658k 363,727k p=0.020 n=6
Parse Time 3.39s (± 0.57%) 3.42s (± 0.80%) +0.04s (+ 1.03%) 3.39s 3.47s p=0.035 n=6
Bind Time 1.13s (± 1.41%) 1.13s (± 0.48%) ~ 1.13s 1.14s p=0.675 n=6
Check Time 8.66s (± 0.47%) 8.73s (± 0.47%) +0.07s (+ 0.81%) 8.66s 8.78s p=0.024 n=6
Emit Time 7.41s (± 0.47%) 7.46s (± 0.91%) ~ 7.36s 7.53s p=0.260 n=6
Total Time 20.61s (± 0.27%) 20.75s (± 0.48%) +0.15s (+ 0.72%) 20.66s 20.91s p=0.019 n=6
Compiler-Unions - node (v18.10.0, x64)
Memory used 193,822k (± 1.63%) 190,984k (± 0.03%) ~ 190,903k 191,043k p=0.575 n=6
Parse Time 1.49s (± 0.50%) 1.51s (± 0.97%) +0.02s (+ 1.12%) 1.49s 1.53s p=0.046 n=6
Bind Time 0.77s (± 0.53%) 0.78s (± 0.71%) ~ 0.77s 0.78s p=0.054 n=6
Check Time 9.33s (± 0.65%) 9.46s (± 0.30%) +0.13s (+ 1.38%) 9.42s 9.50s p=0.005 n=6
Emit Time 2.73s (± 0.45%) 2.74s (± 0.58%) ~ 2.73s 2.77s p=0.086 n=6
Total Time 14.31s (± 0.41%) 14.48s (± 0.19%) +0.17s (+ 1.16%) 14.44s 14.51s p=0.005 n=6
Monaco - node (v18.10.0, x64)
Memory used 347,468k (± 0.02%) 347,444k (± 0.01%) ~ 347,408k 347,479k p=0.810 n=6
Parse Time 2.58s (± 1.11%) 2.61s (± 0.75%) ~ 2.58s 2.63s p=0.063 n=6
Bind Time 1.01s (± 0.97%) 1.02s (± 0.80%) ~ 1.01s 1.03s p=0.181 n=6
Check Time 7.06s (± 0.53%) 7.11s (± 0.33%) +0.04s (+ 0.59%) 7.06s 7.12s p=0.042 n=6
Emit Time 4.21s (± 0.36%) 4.28s (± 1.27%) ~ 4.19s 4.34s p=0.052 n=6
Total Time 14.87s (± 0.33%) 15.02s (± 0.50%) +0.14s (+ 0.98%) 14.88s 15.09s p=0.020 n=6
TFS - node (v18.10.0, x64)
Memory used 300,788k (± 0.01%) 300,762k (± 0.01%) ~ 300,728k 300,807k p=0.173 n=6
Parse Time 2.06s (± 1.28%) 2.07s (± 1.66%) ~ 2.02s 2.12s p=0.418 n=6
Bind Time 1.13s (± 0.72%) 1.14s (± 0.36%) ~ 1.14s 1.15s p=0.056 n=6
Check Time 6.52s (± 0.42%) 6.56s (± 0.49%) ~ 6.52s 6.61s p=0.076 n=6
Emit Time 3.86s (± 0.81%) 3.90s (± 0.70%) ~ 3.87s 3.94s p=0.054 n=6
Total Time 13.58s (± 0.31%) 13.68s (± 0.41%) +0.11s (+ 0.80%) 13.61s 13.77s p=0.008 n=6
material-ui - node (v18.10.0, x64)
Memory used 478,412k (± 0.01%) 478,418k (± 0.01%) ~ 478,319k 478,500k p=0.936 n=6
Parse Time 2.97s (± 2.84%) 3.04s (± 2.54%) ~ 2.96s 3.16s p=0.108 n=6
Bind Time 1.01s (± 7.96%) 1.00s (± 7.36%) ~ 0.93s 1.08s p=0.747 n=6
Check Time 17.07s (± 0.73%) 17.20s (± 0.52%) ~ 17.10s 17.33s p=0.109 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 21.05s (± 0.72%) 21.25s (± 0.44%) +0.20s (+ 0.94%) 21.13s 21.37s p=0.030 n=6
xstate - node (v18.10.0, x64)
Memory used 553,222k (± 0.03%) 553,163k (± 0.03%) ~ 552,978k 553,378k p=0.689 n=6
Parse Time 3.77s (± 0.39%) 3.81s (± 0.82%) +0.04s (+ 1.15%) 3.78s 3.86s p=0.019 n=6
Bind Time 1.68s (± 1.03%) 1.71s (± 0.80%) +0.03s (+ 1.69%) 1.69s 1.73s p=0.015 n=6
Check Time 2.77s (± 0.60%) 2.80s (± 1.02%) ~ 2.75s 2.83s p=0.102 n=6
Emit Time 0.08s (± 0.00%) 0.08s (± 0.00%) ~ 0.08s 0.08s p=1.000 n=6
Total Time 8.30s (± 0.39%) 8.40s (± 0.41%) +0.10s (+ 1.23%) 8.34s 8.43s p=0.006 n=6
Angular - node (v16.17.1, x64)
Memory used 362,978k (± 0.00%) 363,047k (± 0.01%) +69k (+ 0.02%) 362,994k 363,124k p=0.008 n=6
Parse Time 3.52s (± 1.04%) 3.51s (± 0.79%) ~ 3.48s 3.54s p=0.462 n=6
Bind Time 1.18s (± 0.69%) 1.20s (± 0.34%) +0.02s (+ 1.55%) 1.20s 1.21s p=0.003 n=6
Check Time 9.46s (± 0.48%) 9.51s (± 0.30%) ~ 9.46s 9.54s p=0.065 n=6
Emit Time 7.93s (± 0.54%) 7.93s (± 0.75%) ~ 7.86s 8.01s p=0.936 n=6
Total Time 22.09s (± 0.35%) 22.15s (± 0.45%) ~ 22.02s 22.27s p=0.334 n=6
Compiler-Unions - node (v16.17.1, x64)
Memory used 192,698k (± 0.05%) 193,277k (± 0.71%) ~ 192,656k 196,086k p=0.630 n=6
Parse Time 1.57s (± 1.77%) 1.59s (± 0.76%) ~ 1.57s 1.60s p=0.372 n=6
Bind Time 0.82s (± 0.77%) 0.83s (± 0.00%) +0.01s (+ 1.22%) 0.83s 0.83s p=0.008 n=6
Check Time 10.09s (± 0.49%) 10.17s (± 0.60%) +0.08s (+ 0.78%) 10.10s 10.27s p=0.042 n=6
Emit Time 3.01s (± 0.59%) 3.02s (± 0.77%) ~ 2.99s 3.05s p=0.285 n=6
Total Time 15.49s (± 0.35%) 15.61s (± 0.40%) +0.12s (+ 0.75%) 15.53s 15.70s p=0.013 n=6
Monaco - node (v16.17.1, x64)
Memory used 346,714k (± 0.00%) 346,721k (± 0.01%) ~ 346,682k 346,740k p=0.298 n=6
Parse Time 2.73s (± 0.64%) 2.73s (± 0.46%) ~ 2.71s 2.74s p=0.934 n=6
Bind Time 1.09s (± 0.37%) 1.09s (± 0.76%) ~ 1.09s 1.11s p=0.115 n=6
Check Time 7.76s (± 0.23%) 7.77s (± 0.48%) ~ 7.73s 7.82s p=0.747 n=6
Emit Time 4.47s (± 0.39%) 4.50s (± 0.48%) +0.04s (+ 0.86%) 4.47s 4.53s p=0.019 n=6
Total Time 16.04s (± 0.19%) 16.10s (± 0.40%) ~ 16.04s 16.19s p=0.090 n=6
TFS - node (v16.17.1, x64)
Memory used 300,144k (± 0.01%) 300,090k (± 0.00%) -54k (- 0.02%) 300,069k 300,106k p=0.005 n=6
Parse Time 2.16s (± 0.29%) 2.18s (± 0.65%) +0.02s (+ 0.93%) 2.16s 2.20s p=0.020 n=6
Bind Time 1.24s (± 0.61%) 1.24s (± 0.94%) ~ 1.23s 1.26s p=0.933 n=6
Check Time 7.17s (± 0.11%) 7.20s (± 0.43%) ~ 7.15s 7.23s p=0.222 n=6
Emit Time 4.31s (± 0.54%) 4.36s (± 0.90%) +0.05s (+ 1.16%) 4.32s 4.40s p=0.029 n=6
Total Time 14.89s (± 0.19%) 14.98s (± 0.57%) +0.10s (+ 0.65%) 14.88s 15.09s p=0.036 n=6
material-ui - node (v16.17.1, x64)
Memory used 477,713k (± 0.02%) 477,761k (± 0.00%) ~ 477,728k 477,796k p=0.298 n=6
Parse Time 3.22s (± 0.44%) 3.21s (± 1.22%) ~ 3.15s 3.25s p=0.746 n=6
Bind Time 0.95s (± 1.03%) 0.97s (± 1.60%) +0.02s (+ 1.93%) 0.96s 1.00s p=0.026 n=6
Check Time 18.14s (± 0.62%) 18.13s (± 0.83%) ~ 17.99s 18.34s p=1.000 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 22.32s (± 0.51%) 22.31s (± 0.76%) ~ 22.12s 22.55s p=0.936 n=6
xstate - node (v16.17.1, x64)
Memory used 550,761k (± 0.02%) 550,724k (± 0.01%) ~ 550,654k 550,845k p=0.810 n=6
Parse Time 3.96s (± 0.23%) 3.96s (± 0.47%) ~ 3.94s 3.99s p=0.683 n=6
Bind Time 1.78s (± 0.55%) 1.82s (± 0.57%) +0.04s (+ 1.96%) 1.80s 1.83s p=0.004 n=6
Check Time 2.99s (± 0.41%) 3.01s (± 0.46%) +0.02s (+ 0.67%) 2.98s 3.02s p=0.034 n=6
Emit Time 0.09s (± 0.00%) 0.09s (± 0.00%) ~ 0.09s 0.09s p=1.000 n=6
Total Time 8.82s (± 0.20%) 8.88s (± 0.36%) +0.06s (+ 0.70%) 8.85s 8.94s p=0.006 n=6
Angular - node (v14.15.1, x64)
Memory used 356,843k (± 0.01%) 356,873k (± 0.00%) ~ 356,850k 356,890k p=0.298 n=6
Parse Time 3.59s (± 0.14%) 3.63s (± 0.67%) +0.04s (+ 1.07%) 3.60s 3.67s p=0.004 n=6
Bind Time 1.23s (± 0.42%) 1.25s (± 0.41%) +0.01s (+ 1.08%) 1.24s 1.25s p=0.009 n=6
Check Time 9.75s (± 0.61%) 9.78s (± 0.24%) ~ 9.75s 9.82s p=0.167 n=6
Emit Time 8.36s (± 0.62%) 8.36s (± 0.41%) ~ 8.34s 8.43s p=0.688 n=6
Total Time 22.93s (± 0.19%) 23.01s (± 0.11%) +0.09s (+ 0.38%) 22.98s 23.04s p=0.010 n=6
Compiler-Unions - node (v14.15.1, x64)
Memory used 187,961k (± 0.01%) 187,973k (± 0.00%) ~ 187,961k 187,982k p=0.230 n=6
Parse Time 1.60s (± 0.61%) 1.61s (± 0.91%) ~ 1.59s 1.63s p=0.440 n=6
Bind Time 0.84s (± 0.48%) 0.85s (± 0.00%) +0.01s (+ 0.99%) 0.85s 0.85s p=0.007 n=6
Check Time 10.21s (± 0.44%) 10.28s (± 0.43%) +0.07s (+ 0.73%) 10.24s 10.36s p=0.019 n=6
Emit Time 3.12s (± 0.89%) 3.14s (± 0.71%) ~ 3.11s 3.17s p=0.195 n=6
Total Time 15.78s (± 0.28%) 15.88s (± 0.41%) +0.11s (+ 0.68%) 15.79s 15.97s p=0.020 n=6
Monaco - node (v14.15.1, x64)
Memory used 341,706k (± 0.00%) 341,709k (± 0.00%) ~ 341,694k 341,727k p=0.689 n=6
Parse Time 2.83s (± 0.50%) 2.85s (± 0.37%) +0.02s (+ 0.88%) 2.84s 2.87s p=0.015 n=6
Bind Time 1.09s (± 0.76%) 1.11s (± 0.57%) +0.02s (+ 1.37%) 1.10s 1.12s p=0.018 n=6
Check Time 8.14s (± 0.62%) 8.17s (± 0.57%) ~ 8.13s 8.25s p=0.412 n=6
Emit Time 4.68s (± 0.59%) 4.74s (± 0.51%) +0.05s (+ 1.18%) 4.71s 4.78s p=0.012 n=6
Total Time 16.74s (± 0.39%) 16.87s (± 0.36%) +0.12s (+ 0.73%) 16.78s 16.95s p=0.013 n=6
TFS - node (v14.15.1, x64)
Memory used 295,229k (± 0.01%) 295,180k (± 0.01%) -49k (- 0.02%) 295,153k 295,199k p=0.005 n=6
Parse Time 2.39s (± 0.94%) 2.40s (± 0.99%) ~ 2.37s 2.43s p=0.370 n=6
Bind Time 1.07s (± 0.51%) 1.08s (± 0.51%) +0.01s (+ 0.94%) 1.07s 1.08s p=0.024 n=6
Check Time 7.50s (± 0.41%) 7.51s (± 0.22%) ~ 7.49s 7.53s p=0.464 n=6
Emit Time 4.27s (± 1.17%) 4.34s (± 0.90%) +0.07s (+ 1.64%) 4.30s 4.41s p=0.045 n=6
Total Time 15.23s (± 0.52%) 15.32s (± 0.40%) +0.09s (+ 0.62%) 15.23s 15.39s p=0.045 n=6
material-ui - node (v14.15.1, x64)
Memory used 473,290k (± 0.00%) 473,335k (± 0.01%) +45k (+ 0.01%) 473,297k 473,379k p=0.031 n=6
Parse Time 3.33s (± 0.23%) 3.36s (± 0.41%) +0.04s (+ 1.05%) 3.34s 3.38s p=0.006 n=6
Bind Time 1.00s (± 0.63%) 1.02s (± 0.80%) +0.02s (+ 2.33%) 1.02s 1.04s p=0.003 n=6
Check Time 18.97s (± 0.26%) 19.22s (± 0.64%) +0.24s (+ 1.28%) 19.09s 19.43s p=0.005 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 23.30s (± 0.19%) 23.60s (± 0.50%) +0.30s (+ 1.29%) 23.49s 23.80s p=0.005 n=6
xstate - node (v14.15.1, x64)
Memory used 539,303k (± 0.00%) 539,303k (± 0.01%) ~ 539,250k 539,333k p=0.575 n=6
Parse Time 4.25s (± 0.55%) 4.27s (± 0.83%) ~ 4.24s 4.33s p=0.466 n=6
Bind Time 1.66s (± 0.45%) 1.70s (± 0.00%) +0.04s (+ 2.51%) 1.70s 1.70s p=0.003 n=6
Check Time 3.17s (± 0.37%) 3.18s (± 0.68%) ~ 3.14s 3.20s p=0.625 n=6
Emit Time 0.09s (± 4.45%) 0.10s (± 4.15%) +0.01s (+ 7.27%) 0.09s 0.10s p=0.034 n=6
Total Time 9.16s (± 0.18%) 9.24s (± 0.59%) +0.07s (+ 0.78%) 9.18s 9.30s p=0.019 n=6
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)
Benchmark Name Iterations
Current 53228 6
Baseline main 6

TSServer

Comparison Report - main..53228
Metric main 53228 Delta Best Worst p-value
Compiler-UnionsTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 2,389ms (± 0.20%) 2,396ms (± 0.93%) ~ 2,367ms 2,433ms p=0.467 n=6
Req 2 - geterr 5,371ms (± 0.64%) 5,388ms (± 0.45%) ~ 5,355ms 5,413ms p=0.630 n=6
Req 3 - references 337ms (± 0.35%) 338ms (± 0.89%) ~ 334ms 342ms p=0.870 n=6
Req 4 - navto 280ms (± 0.37%) 283ms (± 0.43%) +2ms (+ 0.83%) 281ms 284ms p=0.014 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 79ms (± 6.30%) 72ms (± 7.64%) ~ 66ms 79ms p=0.054 n=6
CompilerTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 2,522ms (± 1.58%) 2,531ms (± 0.72%) ~ 2,506ms 2,549ms p=0.689 n=6
Req 2 - geterr 4,001ms (± 0.75%) 4,018ms (± 0.58%) ~ 3,990ms 4,055ms p=0.423 n=6
Req 3 - references 348ms (± 1.00%) 352ms (± 1.11%) ~ 345ms 356ms p=0.126 n=6
Req 4 - navto 292ms (± 0.28%) 294ms (± 0.64%) ~ 290ms 295ms p=0.101 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 74ms (± 6.60%) 82ms (± 3.61%) +8ms (+11.06%) 79ms 85ms p=0.023 n=6
xstateTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 3,048ms (± 0.50%) 3,068ms (± 0.50%) +20ms (+ 0.67%) 3,047ms 3,085ms p=0.045 n=6
Req 2 - geterr 1,602ms (± 0.75%) 1,606ms (± 0.96%) ~ 1,587ms 1,631ms p=0.688 n=6
Req 3 - references 109ms (± 1.71%) 109ms (± 0.95%) ~ 107ms 110ms p=0.806 n=6
Req 4 - navto 358ms (± 0.49%) 360ms (± 0.48%) ~ 358ms 362ms p=0.052 n=6
Req 5 - completionInfo count 3,177 (± 0.00%) 3,177 (± 0.00%) ~ 3,177 3,177 p=1.000 n=6
Req 5 - completionInfo 422ms (± 1.17%) 420ms (± 0.44%) ~ 418ms 422ms p=1.000 n=6
Compiler-UnionsTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 2,504ms (± 0.67%) 2,518ms (± 0.65%) ~ 2,501ms 2,548ms p=0.296 n=6
Req 2 - geterr 5,739ms (± 0.25%) 5,795ms (± 0.39%) +56ms (+ 0.98%) 5,765ms 5,829ms p=0.005 n=6
Req 3 - references 346ms (± 0.93%) 350ms (± 1.00%) ~ 343ms 353ms p=0.102 n=6
Req 4 - navto 278ms (± 0.77%) 279ms (± 1.55%) ~ 274ms 285ms p=0.872 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 74ms (± 1.02%) 74ms (± 1.91%) ~ 72ms 76ms p=0.867 n=6
CompilerTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 2,680ms (± 0.33%) 2,700ms (± 1.07%) ~ 2,664ms 2,750ms p=0.227 n=6
Req 2 - geterr 4,370ms (± 0.61%) 4,375ms (± 0.25%) ~ 4,362ms 4,388ms p=0.936 n=6
Req 3 - references 360ms (± 1.03%) 359ms (± 0.55%) ~ 358ms 363ms p=0.806 n=6
Req 4 - navto 291ms (± 0.35%) 292ms (± 0.28%) +2ms (+ 0.57%) 291ms 293ms p=0.021 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 78ms (± 6.64%) 74ms (± 4.00%) ~ 68ms 76ms p=0.152 n=6
xstateTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 3,198ms (± 0.42%) 3,220ms (± 0.40%) +22ms (+ 0.68%) 3,208ms 3,238ms p=0.020 n=6
Req 2 - geterr 1,743ms (± 1.17%) 1,745ms (± 0.58%) ~ 1,729ms 1,756ms p=0.689 n=6
Req 3 - references 119ms (± 0.68%) 119ms (± 1.24%) ~ 116ms 120ms p=0.666 n=6
Req 4 - navto 344ms (± 0.30%) 345ms (± 0.62%) ~ 342ms 348ms p=0.289 n=6
Req 5 - completionInfo count 3,177 (± 0.00%) 3,177 (± 0.00%) ~ 3,177 3,177 p=1.000 n=6
Req 5 - completionInfo 429ms (± 0.49%) 433ms (± 0.64%) +4ms (+ 0.97%) 431ms 438ms p=0.028 n=6
Compiler-UnionsTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,594ms (± 0.68%) 2,615ms (± 0.33%) +22ms (+ 0.84%) 2,601ms 2,627ms p=0.020 n=6
Req 2 - geterr 6,112ms (± 0.98%) 6,153ms (± 0.35%) ~ 6,118ms 6,181ms p=0.297 n=6
Req 3 - references 366ms (± 0.45%) 369ms (± 1.50%) ~ 363ms 377ms p=0.809 n=6
Req 4 - navto 280ms (± 1.38%) 283ms (± 1.41%) ~ 278ms 288ms p=0.227 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 93ms (±10.86%) 92ms (±10.07%) ~ 81ms 104ms p=1.000 n=6
CompilerTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,809ms (± 0.70%) 2,834ms (± 0.67%) ~ 2,801ms 2,853ms p=0.066 n=6
Req 2 - geterr 4,573ms (± 2.85%) 4,593ms (± 2.99%) ~ 4,449ms 4,735ms p=0.936 n=6
Req 3 - references 399ms (± 7.09%) 391ms (± 6.59%) ~ 370ms 425ms p=0.574 n=6
Req 4 - navto 288ms (± 0.57%) 290ms (± 0.94%) ~ 286ms 293ms p=0.418 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 90ms (±10.88%) 88ms (± 9.46%) ~ 81ms 100ms p=0.934 n=6
xstateTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 3,506ms (± 0.34%) 3,513ms (± 0.22%) ~ 3,505ms 3,524ms p=0.173 n=6
Req 2 - geterr 1,852ms (± 0.54%) 1,856ms (± 0.40%) ~ 1,847ms 1,868ms p=0.687 n=6
Req 3 - references 125ms (± 0.94%) 127ms (± 2.61%) ~ 124ms 131ms p=0.461 n=6
Req 4 - navto 367ms (± 0.44%) 369ms (± 0.71%) ~ 365ms 373ms p=0.103 n=6
Req 5 - completionInfo count 3,177 (± 0.00%) 3,177 (± 0.00%) ~ 3,177 3,177 p=1.000 n=6
Req 5 - completionInfo 442ms (± 1.19%) 452ms (± 3.40%) ~ 437ms 479ms p=0.170 n=6
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Compiler-UnionsTSServer - node (v18.10.0, x64)
  • Compiler-UnionsTSServer - node (v16.17.1, x64)
  • Compiler-UnionsTSServer - node (v14.15.1, x64)
  • CompilerTSServer - node (v18.10.0, x64)
  • CompilerTSServer - node (v16.17.1, x64)
  • CompilerTSServer - node (v14.15.1, x64)
  • xstateTSServer - node (v18.10.0, x64)
  • xstateTSServer - node (v16.17.1, x64)
  • xstateTSServer - node (v14.15.1, x64)
Benchmark Name Iterations
Current 53228 6
Baseline main 6

Startup

Comparison Report - main..53228
Metric main 53228 Delta Best Worst p-value
tsc-startup - node (v16.17.1, x64)
Execution time 141.87ms (± 0.18%) 141.55ms (± 0.21%) -0.33ms (- 0.23%) 140.88ms 146.78ms p=0.000 n=600
tsserver-startup - node (v16.17.1, x64)
Execution time 227.70ms (± 0.30%) 226.94ms (± 0.16%) -0.76ms (- 0.33%) 225.99ms 231.93ms p=0.000 n=600
tsserverlibrary-startup - node (v16.17.1, x64)
Execution time 229.22ms (± 0.25%) 228.65ms (± 0.18%) -0.58ms (- 0.25%) 227.72ms 235.64ms p=0.000 n=600
typescript-startup - node (v16.17.1, x64)
Execution time 210.10ms (± 0.25%) 209.36ms (± 0.17%) -0.74ms (- 0.35%) 208.53ms 215.54ms p=0.000 n=600
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v16.17.1, x64)
Scenarios
  • tsc-startup - node (v16.17.1, x64)
  • tsserver-startup - node (v16.17.1, x64)
  • tsserverlibrary-startup - node (v16.17.1, x64)
  • typescript-startup - node (v16.17.1, x64)
Benchmark Name Iterations
Current 53228 6
Baseline main 6

Developer Information:

Download Benchmark

@jakebailey
Copy link
Member Author

Uh oh, it's about a percent worse across the board. No thanks.

Maybe perf boost of direct usage via scope hoisting offsets this and that explains the lack of any perf change?

@jakebailey jakebailey marked this pull request as draft March 13, 2023 04:33
@jakebailey
Copy link
Member Author

@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 13, 2023 •
edited
Loading

Heya @jakebailey, I've started to run the perf test suite on this PR at a6bfdaa. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - main..53228
Metric main 53228 Delta Best Worst p-value
Angular - node (v18.10.0, x64)
Memory used 363,790k (± 0.01%) 363,826k (± 0.01%) ~ 363,798k 363,860k p=0.054 n=6
Parse Time 3.40s (± 0.51%) 3.41s (± 0.91%) ~ 3.38s 3.46s p=0.627 n=6
Bind Time 1.13s (± 1.35%) 1.13s (± 0.67%) ~ 1.12s 1.14s p=0.557 n=6
Check Time 8.71s (± 0.22%) 8.72s (± 0.59%) ~ 8.66s 8.79s p=0.572 n=6
Emit Time 7.47s (± 0.56%) 7.42s (± 1.05%) ~ 7.31s 7.52s p=0.230 n=6
Total Time 20.70s (± 0.26%) 20.68s (± 0.50%) ~ 20.56s 20.78s p=0.936 n=6
Compiler-Unions - node (v18.10.0, x64)
Memory used 191,889k (± 1.20%) 192,869k (± 1.49%) ~ 190,954k 196,684k p=0.128 n=6
Parse Time 1.49s (± 0.92%) 1.50s (± 0.98%) ~ 1.48s 1.52s p=0.188 n=6
Bind Time 0.77s (± 0.67%) 0.77s (± 1.05%) ~ 0.76s 0.78s p=0.140 n=6
Check Time 9.44s (± 0.71%) 9.45s (± 0.74%) ~ 9.39s 9.57s p=0.936 n=6
Emit Time 2.71s (± 0.56%) 2.72s (± 0.76%) ~ 2.69s 2.74s p=0.458 n=6
Total Time 14.41s (± 0.44%) 14.45s (± 0.42%) ~ 14.38s 14.53s p=0.421 n=6
Monaco - node (v18.10.0, x64)
Memory used 347,437k (± 0.01%) 347,454k (± 0.00%) ~ 347,432k 347,474k p=0.748 n=6
Parse Time 2.59s (± 0.90%) 2.60s (± 0.95%) ~ 2.57s 2.63s p=0.331 n=6
Bind Time 1.00s (± 0.51%) 1.01s (± 1.35%) ~ 1.00s 1.03s p=0.190 n=6
Check Time 7.08s (± 0.47%) 7.07s (± 0.26%) ~ 7.05s 7.10s p=0.936 n=6
Emit Time 4.24s (± 0.75%) 4.25s (± 0.79%) ~ 4.21s 4.29s p=0.686 n=6
Total Time 14.90s (± 0.37%) 14.94s (± 0.36%) ~ 14.86s 15.00s p=0.469 n=6
TFS - node (v18.10.0, x64)
Memory used 300,792k (± 0.01%) 300,774k (± 0.01%) ~ 300,738k 300,818k p=0.470 n=6
Parse Time 2.06s (± 2.16%) 2.08s (± 1.28%) ~ 2.03s 2.11s p=0.872 n=6
Bind Time 1.14s (± 0.66%) 1.14s (± 0.45%) ~ 1.13s 1.14s p=0.784 n=6
Check Time 6.54s (± 0.63%) 6.54s (± 0.54%) ~ 6.49s 6.58s p=0.872 n=6
Emit Time 3.87s (± 0.81%) 3.89s (± 0.58%) ~ 3.87s 3.92s p=0.222 n=6
Total Time 13.62s (± 0.60%) 13.65s (± 0.40%) ~ 13.57s 13.71s p=0.629 n=6
material-ui - node (v18.10.0, x64)
Memory used 478,384k (± 0.01%) 478,441k (± 0.01%) ~ 478,388k 478,476k p=0.066 n=6
Parse Time 3.05s (± 3.48%) 3.02s (± 2.26%) ~ 2.94s 3.10s p=0.575 n=6
Bind Time 0.95s (± 7.45%) 1.02s (± 8.80%) ~ 0.90s 1.09s p=0.569 n=6
Check Time 17.10s (± 0.57%) 17.16s (± 0.71%) ~ 17.00s 17.34s p=0.521 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 21.11s (± 0.70%) 21.20s (± 0.65%) ~ 21.00s 21.39s p=0.422 n=6
xstate - node (v18.10.0, x64)
Memory used 553,310k (± 0.01%) 553,264k (± 0.03%) ~ 553,120k 553,555k p=0.378 n=6
Parse Time 3.76s (± 0.22%) 3.78s (± 0.76%) ~ 3.75s 3.83s p=0.192 n=6
Bind Time 1.67s (± 0.49%) 1.70s (± 1.16%) +0.03s (+ 1.89%) 1.69s 1.73s p=0.004 n=6
Check Time 2.77s (± 0.81%) 2.80s (± 0.97%) ~ 2.77s 2.85s p=0.073 n=6
Emit Time 0.08s (± 0.00%) 0.08s (± 0.00%) ~ 0.08s 0.08s p=1.000 n=6
Total Time 8.29s (± 0.34%) 8.37s (± 0.71%) +0.07s (+ 0.90%) 8.29s 8.47s p=0.020 n=6
Angular - node (v16.17.1, x64)
Memory used 363,141k (± 0.01%) 363,199k (± 0.00%) +58k (+ 0.02%) 363,179k 363,217k p=0.005 n=6
Parse Time 3.52s (± 0.33%) 3.52s (± 0.38%) ~ 3.50s 3.53s p=1.000 n=6
Bind Time 1.18s (± 0.64%) 1.20s (± 0.43%) +0.02s (+ 1.56%) 1.19s 1.20s p=0.006 n=6
Check Time 9.47s (± 0.44%) 9.43s (± 0.31%) ~ 9.39s 9.48s p=0.056 n=6
Emit Time 7.90s (± 0.36%) 7.87s (± 0.60%) ~ 7.83s 7.96s p=0.145 n=6
Total Time 22.07s (± 0.28%) 22.02s (± 0.23%) ~ 21.94s 22.09s p=0.128 n=6
Compiler-Unions - node (v16.17.1, x64)
Memory used 193,319k (± 0.71%) 193,330k (± 0.72%) ~ 192,681k 196,169k p=0.689 n=6
Parse Time 1.57s (± 0.77%) 1.57s (± 1.99%) ~ 1.51s 1.59s p=0.805 n=6
Bind Time 0.82s (± 0.50%) 0.83s (± 0.66%) ~ 0.82s 0.83s p=0.054 n=6
Check Time 10.15s (± 0.39%) 10.14s (± 0.84%) ~ 10.05s 10.23s p=0.873 n=6
Emit Time 2.98s (± 1.09%) 3.00s (± 0.98%) ~ 2.96s 3.04s p=0.374 n=6
Total Time 15.53s (± 0.34%) 15.52s (± 0.58%) ~ 15.43s 15.63s p=1.000 n=6
Monaco - node (v16.17.1, x64)
Memory used 346,725k (± 0.00%) 346,712k (± 0.00%) ~ 346,694k 346,739k p=0.093 n=6
Parse Time 2.73s (± 0.51%) 2.74s (± 0.50%) ~ 2.72s 2.76s p=0.139 n=6
Bind Time 1.09s (± 0.37%) 1.09s (± 0.90%) ~ 1.08s 1.11s p=0.673 n=6
Check Time 7.76s (± 0.48%) 7.75s (± 0.46%) ~ 7.71s 7.79s p=0.686 n=6
Emit Time 4.47s (± 0.39%) 4.46s (± 0.34%) ~ 4.44s 4.48s p=0.250 n=6
Total Time 16.03s (± 0.26%) 16.03s (± 0.25%) ~ 15.98s 16.09s p=0.871 n=6
TFS - node (v16.17.1, x64)
Memory used 300,129k (± 0.01%) 300,101k (± 0.01%) ~ 300,061k 300,160k p=0.298 n=6
Parse Time 2.18s (± 0.82%) 2.17s (± 0.79%) ~ 2.15s 2.19s p=0.461 n=6
Bind Time 1.24s (± 0.51%) 1.23s (± 0.95%) ~ 1.22s 1.25s p=0.179 n=6
Check Time 7.18s (± 0.32%) 7.18s (± 0.46%) ~ 7.15s 7.24s p=0.806 n=6
Emit Time 4.35s (± 0.97%) 4.35s (± 0.93%) ~ 4.31s 4.42s p=0.871 n=6
Total Time 14.95s (± 0.24%) 14.94s (± 0.30%) ~ 14.87s 14.98s p=0.573 n=6
material-ui - node (v16.17.1, x64)
Memory used 477,754k (± 0.01%) 477,762k (± 0.00%) ~ 477,733k 477,787k p=1.000 n=6
Parse Time 3.22s (± 0.76%) 3.24s (± 0.80%) ~ 3.19s 3.26s p=0.225 n=6
Bind Time 0.95s (± 0.54%) 0.97s (± 1.81%) ~ 0.95s 1.00s p=0.070 n=6
Check Time 18.20s (± 1.04%) 18.11s (± 0.35%) ~ 18.02s 18.19s p=0.688 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 22.38s (± 0.78%) 22.31s (± 0.33%) ~ 22.23s 22.43s p=0.810 n=6
xstate - node (v16.17.1, x64)
Memory used 550,767k (± 0.03%) 550,901k (± 0.03%) ~ 550,738k 551,080k p=0.128 n=6
Parse Time 3.94s (± 0.19%) 3.95s (± 0.35%) ~ 3.94s 3.97s p=0.142 n=6
Bind Time 1.79s (± 0.42%) 1.81s (± 0.46%) +0.02s (+ 0.93%) 1.80s 1.82s p=0.009 n=6
Check Time 3.00s (± 0.72%) 3.00s (± 0.39%) ~ 2.98s 3.01s p=0.935 n=6
Emit Time 0.09s (± 0.00%) 0.09s (± 0.00%) ~ 0.09s 0.09s p=1.000 n=6
Total Time 8.82s (± 0.35%) 8.85s (± 0.26%) ~ 8.83s 8.89s p=0.163 n=6
Angular - node (v14.15.1, x64)
Memory used 356,969k (± 0.00%) 357,016k (± 0.00%) +47k (+ 0.01%) 356,991k 357,035k p=0.005 n=6
Parse Time 3.60s (± 0.79%) 3.60s (± 0.77%) ~ 3.58s 3.65s p=0.805 n=6
Bind Time 1.23s (± 0.42%) 1.24s (± 0.41%) +0.01s (+ 0.81%) 1.24s 1.25s p=0.018 n=6
Check Time 9.76s (± 0.44%) 9.83s (± 0.71%) ~ 9.76s 9.96s p=0.145 n=6
Emit Time 8.36s (± 1.00%) 8.41s (± 1.29%) ~ 8.25s 8.58s p=0.520 n=6
Total Time 22.96s (± 0.47%) 23.08s (± 0.62%) ~ 22.88s 23.25s p=0.196 n=6
Compiler-Unions - node (v14.15.1, x64)
Memory used 187,934k (± 0.02%) 187,930k (± 0.01%) ~ 187,911k 187,948k p=0.575 n=6
Parse Time 1.60s (± 0.25%) 1.60s (± 1.21%) ~ 1.58s 1.63s p=0.607 n=6
Bind Time 0.84s (± 0.65%) 0.85s (± 0.48%) ~ 0.84s 0.85s p=0.282 n=6
Check Time 10.20s (± 0.67%) 10.19s (± 0.38%) ~ 10.15s 10.25s p=0.810 n=6
Emit Time 3.11s (± 0.43%) 3.12s (± 1.04%) ~ 3.08s 3.16s p=0.464 n=6
Total Time 15.76s (± 0.52%) 15.77s (± 0.26%) ~ 15.72s 15.82s p=1.000 n=6
Monaco - node (v14.15.1, x64)
Memory used 341,706k (± 0.00%) 341,705k (± 0.00%) ~ 341,688k 341,723k p=1.000 n=6
Parse Time 2.83s (± 0.73%) 2.86s (± 0.61%) +0.03s (+ 1.06%) 2.83s 2.88s p=0.041 n=6
Bind Time 1.10s (± 0.74%) 1.10s (± 0.68%) ~ 1.09s 1.11s p=0.306 n=6
Check Time 8.13s (± 0.64%) 8.15s (± 0.37%) ~ 8.10s 8.19s p=0.421 n=6
Emit Time 4.68s (± 0.80%) 4.71s (± 0.72%) ~ 4.65s 4.75s p=0.146 n=6
Total Time 16.74s (± 0.41%) 16.82s (± 0.37%) ~ 16.73s 16.91s p=0.076 n=6
TFS - node (v14.15.1, x64)
Memory used 295,235k (± 0.01%) 295,198k (± 0.00%) -36k (- 0.01%) 295,182k 295,215k p=0.005 n=6
Parse Time 2.40s (± 0.85%) 2.43s (± 0.61%) +0.03s (+ 1.25%) 2.41s 2.45s p=0.029 n=6
Bind Time 1.07s (± 0.51%) 1.07s (± 0.70%) ~ 1.06s 1.08s p=0.476 n=6
Check Time 7.52s (± 0.52%) 7.50s (± 0.22%) ~ 7.48s 7.52s p=0.625 n=6
Emit Time 4.30s (± 0.79%) 4.27s (± 0.82%) ~ 4.23s 4.33s p=0.229 n=6
Total Time 15.28s (± 0.35%) 15.28s (± 0.30%) ~ 15.21s 15.35s p=1.000 n=6
material-ui - node (v14.15.1, x64)
Memory used 473,290k (± 0.00%) 473,401k (± 0.01%) +110k (+ 0.02%) 473,322k 473,437k p=0.005 n=6
Parse Time 3.32s (± 0.27%) 3.38s (± 0.67%) +0.06s (+ 1.96%) 3.36s 3.42s p=0.005 n=6
Bind Time 1.01s (± 0.51%) 1.02s (± 0.51%) +0.01s (+ 0.99%) 1.01s 1.02s p=0.018 n=6
Check Time 19.01s (± 0.75%) 19.09s (± 0.74%) ~ 18.92s 19.24s p=0.470 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 23.34s (± 0.63%) 23.49s (± 0.64%) ~ 23.29s 23.65s p=0.108 n=6
xstate - node (v14.15.1, x64)
Memory used 539,299k (± 0.00%) 539,320k (± 0.00%) ~ 539,294k 539,350k p=0.108 n=6
Parse Time 4.23s (± 0.69%) 4.27s (± 0.41%) +0.04s (+ 0.91%) 4.24s 4.29s p=0.024 n=6
Bind Time 1.67s (± 0.59%) 1.69s (± 0.71%) +0.02s (+ 1.30%) 1.68s 1.71s p=0.016 n=6
Check Time 3.19s (± 0.48%) 3.19s (± 0.65%) ~ 3.15s 3.21s p=1.000 n=6
Emit Time 0.09s (± 0.00%) 0.10s (± 5.34%) +0.01s (+ 7.41%) 0.09s 0.10s p=0.025 n=6
Total Time 9.17s (± 0.37%) 9.24s (± 0.36%) +0.06s (+ 0.69%) 9.18s 9.27s p=0.022 n=6
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)
Benchmark Name Iterations
Current 53228 6
Baseline main 6

TSServer

Comparison Report - main..53228
Metric main 53228 Delta Best Worst p-value
Compiler-UnionsTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 2,390ms (± 0.84%) 2,394ms (± 0.56%) ~ 2,375ms 2,407ms p=0.378 n=6
Req 2 - geterr 5,359ms (± 0.30%) 5,388ms (± 0.79%) ~ 5,343ms 5,450ms p=0.298 n=6
Req 3 - references 335ms (± 0.48%) 340ms (± 0.80%) +5ms (+ 1.54%) 337ms 345ms p=0.008 n=6
Req 4 - navto 279ms (± 0.49%) 280ms (± 0.50%) ~ 278ms 282ms p=0.118 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 82ms (± 3.36%) 69ms (± 2.71%) 🟩-13ms (-16.26%) 67ms 71ms p=0.005 n=6
CompilerTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 2,505ms (± 0.99%) 2,518ms (± 0.47%) ~ 2,495ms 2,529ms p=0.470 n=6
Req 2 - geterr 3,993ms (± 0.36%) 4,038ms (± 0.62%) +46ms (+ 1.14%) 4,017ms 4,075ms p=0.005 n=6
Req 3 - references 353ms (± 0.46%) 353ms (± 0.77%) ~ 349ms 357ms p=0.685 n=6
Req 4 - navto 292ms (± 0.83%) 293ms (± 0.85%) ~ 290ms 296ms p=0.415 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 84ms (± 2.54%) 82ms (± 3.56%) ~ 79ms 86ms p=0.285 n=6
xstateTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 3,049ms (± 0.24%) 3,080ms (± 0.53%) +31ms (+ 1.03%) 3,060ms 3,102ms p=0.005 n=6
Req 2 - geterr 1,604ms (± 1.02%) 1,602ms (± 0.97%) ~ 1,582ms 1,625ms p=0.936 n=6
Req 3 - references 108ms (± 0.95%) 109ms (± 1.61%) ~ 107ms 112ms p=1.000 n=6
Req 4 - navto 360ms (± 0.54%) 360ms (± 0.58%) ~ 357ms 362ms p=0.511 n=6
Req 5 - completionInfo count 3,177 (± 0.00%) 3,177 (± 0.00%) ~ 3,177 3,177 p=1.000 n=6
Req 5 - completionInfo 420ms (± 0.81%) 419ms (± 0.73%) ~ 415ms 423ms p=0.574 n=6
Compiler-UnionsTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 2,508ms (± 0.60%) 2,506ms (± 0.50%) ~ 2,490ms 2,522ms p=0.936 n=6
Req 2 - geterr 5,775ms (± 0.47%) 5,747ms (± 0.37%) ~ 5,711ms 5,772ms p=0.093 n=6
Req 3 - references 349ms (± 0.57%) 348ms (± 1.12%) ~ 343ms 352ms p=0.517 n=6
Req 4 - navto 278ms (± 0.81%) 281ms (± 1.12%) ~ 278ms 285ms p=0.221 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 74ms (± 0.55%) 75ms (± 3.21%) ~ 74ms 80ms p=0.115 n=6
CompilerTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 2,682ms (± 0.32%) 2,701ms (± 1.12%) ~ 2,660ms 2,747ms p=0.297 n=6
Req 2 - geterr 4,366ms (± 0.42%) 4,373ms (± 0.49%) ~ 4,342ms 4,401ms p=0.471 n=6
Req 3 - references 361ms (± 0.84%) 359ms (± 0.62%) ~ 356ms 362ms p=0.255 n=6
Req 4 - navto 289ms (± 0.34%) 290ms (± 0.51%) ~ 289ms 292ms p=0.151 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 78ms (± 4.83%) 73ms (± 7.17%) ~ 68ms 80ms p=0.120 n=6
xstateTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 3,195ms (± 0.51%) 3,213ms (± 0.22%) ~ 3,200ms 3,219ms p=0.066 n=6
Req 2 - geterr 1,763ms (± 1.04%) 1,745ms (± 0.73%) ~ 1,730ms 1,764ms p=0.066 n=6
Req 3 - references 119ms (± 1.24%) 119ms (± 0.82%) ~ 118ms 120ms p=0.677 n=6
Req 4 - navto 345ms (± 0.65%) 344ms (± 0.60%) ~ 342ms 347ms p=0.871 n=6
Req 5 - completionInfo count 3,177 (± 0.00%) 3,177 (± 0.00%) ~ 3,177 3,177 p=1.000 n=6
Req 5 - completionInfo 430ms (± 0.62%) 431ms (± 0.87%) ~ 425ms 434ms p=0.517 n=6
Compiler-UnionsTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,586ms (± 0.58%) 2,599ms (± 0.78%) ~ 2,574ms 2,632ms p=0.296 n=6
Req 2 - geterr 6,134ms (± 0.65%) 6,154ms (± 0.60%) ~ 6,098ms 6,200ms p=0.575 n=6
Req 3 - references 365ms (± 0.74%) 365ms (± 0.63%) ~ 361ms 368ms p=0.935 n=6
Req 4 - navto 280ms (± 1.65%) 282ms (± 1.95%) ~ 276ms 289ms p=0.688 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 99ms (± 5.55%) 96ms (± 8.63%) ~ 82ms 102ms p=0.517 n=6
CompilerTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,802ms (± 0.68%) 2,831ms (± 0.62%) +29ms (+ 1.02%) 2,800ms 2,853ms p=0.031 n=6
Req 2 - geterr 4,617ms (± 2.60%) 4,475ms (± 0.25%) ~ 4,459ms 4,489ms p=0.230 n=6
Req 3 - references 390ms (± 7.46%) 404ms (± 6.80%) ~ 375ms 430ms p=0.108 n=6
Req 4 - navto 290ms (± 0.52%) 292ms (± 1.74%) ~ 285ms 298ms p=0.747 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 86ms (± 8.28%) 91ms (± 8.25%) ~ 84ms 101ms p=0.122 n=6
xstateTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 3,499ms (± 0.45%) 3,499ms (± 0.47%) ~ 3,485ms 3,529ms p=1.000 n=6
Req 2 - geterr 1,852ms (± 0.57%) 1,861ms (± 0.23%) ~ 1,854ms 1,865ms p=0.172 n=6
Req 3 - references 126ms (± 0.32%) 130ms (± 1.51%) +4ms (+ 3.05%) 126ms 131ms p=0.010 n=6
Req 4 - navto 369ms (± 0.42%) 371ms (± 0.62%) ~ 368ms 374ms p=0.193 n=6
Req 5 - completionInfo count 3,177 (± 0.00%) 3,177 (± 0.00%) ~ 3,177 3,177 p=1.000 n=6
Req 5 - completionInfo 447ms (± 1.81%) 464ms (± 2.62%) +17ms (+ 3.84%) 444ms 474ms p=0.020 n=6
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Compiler-UnionsTSServer - node (v18.10.0, x64)
  • Compiler-UnionsTSServer - node (v16.17.1, x64)
  • Compiler-UnionsTSServer - node (v14.15.1, x64)
  • CompilerTSServer - node (v18.10.0, x64)
  • CompilerTSServer - node (v16.17.1, x64)
  • CompilerTSServer - node (v14.15.1, x64)
  • xstateTSServer - node (v18.10.0, x64)
  • xstateTSServer - node (v16.17.1, x64)
  • xstateTSServer - node (v14.15.1, x64)
Benchmark Name Iterations
Current 53228 6
Baseline main 6

Startup

Comparison Report - main..53228
Metric main 53228 Delta Best Worst p-value
tsc-startup - node (v16.17.1, x64)
Execution time 141.09ms (± 0.24%) 141.00ms (± 0.22%) -0.10ms (- 0.07%) 140.18ms 146.24ms p=0.000 n=600
tsserver-startup - node (v16.17.1, x64)
Execution time 226.32ms (± 0.25%) 225.43ms (± 0.17%) -0.88ms (- 0.39%) 224.34ms 232.00ms p=0.000 n=600
tsserverlibrary-startup - node (v16.17.1, x64)
Execution time 228.28ms (± 0.25%) 227.74ms (± 0.21%) -0.53ms (- 0.23%) 226.57ms 233.29ms p=0.000 n=600
typescript-startup - node (v16.17.1, x64)
Execution time 208.79ms (± 0.18%) 208.53ms (± 0.23%) -0.26ms (- 0.12%) 207.37ms 213.90ms p=0.000 n=600
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v16.17.1, x64)
Scenarios
  • tsc-startup - node (v16.17.1, x64)
  • tsserver-startup - node (v16.17.1, x64)
  • tsserverlibrary-startup - node (v16.17.1, x64)
  • typescript-startup - node (v16.17.1, x64)
Benchmark Name Iterations
Current 53228 6
Baseline main 6

Developer Information:

Download Benchmark

@jakebailey jakebailey mentioned this pull request Jul 13, 2023
Closed
@jakebailey
Copy link
Member Author

@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 19, 2024 •
edited
Loading

Heya @jakebailey, I've started to run the regular perf test suite on this PR at 6518c76. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - node (v18.15.0, x64)
Memory used 295,637k (± 0.00%) 295,714k (± 0.01%) +77k (+ 0.03%) 295,692k 295,756k p=0.005 n=6
Parse Time 2.65s (± 0.19%) 2.66s (± 0.21%) ~ 2.65s 2.66s p=0.640 n=6
Bind Time 0.83s (± 0.62%) 0.83s (± 0.00%) ~ 0.83s 0.83s p=0.174 n=6
Check Time 8.17s (± 0.24%) 8.15s (± 0.23%) ~ 8.13s 8.18s p=0.101 n=6
Emit Time 7.09s (± 0.37%) 7.06s (± 0.24%) -0.03s (- 0.38%) 7.04s 7.08s p=0.046 n=6
Total Time 18.74s (± 0.11%) 18.69s (± 0.15%) -0.05s (- 0.24%) 18.67s 18.75s p=0.030 n=6
Compiler-Unions - node (v18.15.0, x64)
Memory used 192,000k (± 0.60%) 194,491k (± 1.66%) ~ 191,528k 197,581k p=0.229 n=6
Parse Time 1.36s (± 0.38%) 1.36s (± 0.38%) ~ 1.35s 1.36s p=1.000 n=6
Bind Time 0.72s (± 0.00%) 0.73s (± 0.00%) +0.01s (+ 1.39%) 0.73s 0.73s p=0.001 n=6
Check Time 9.37s (± 0.33%) 9.36s (± 0.33%) ~ 9.32s 9.40s p=0.687 n=6
Emit Time 2.63s (± 0.82%) 2.62s (± 0.48%) ~ 2.60s 2.63s p=0.252 n=6
Total Time 14.08s (± 0.17%) 14.07s (± 0.24%) ~ 14.03s 14.12s p=0.684 n=6
Monaco - node (v18.15.0, x64)
Memory used 347,403k (± 0.01%) 347,402k (± 0.00%) ~ 347,378k 347,419k p=0.810 n=6
Parse Time 2.46s (± 0.60%) 2.49s (± 0.21%) +0.03s (+ 1.15%) 2.48s 2.49s p=0.007 n=6
Bind Time 0.92s (± 0.90%) 0.93s (± 0.00%) ~ 0.93s 0.93s p=0.121 n=6
Check Time 6.86s (± 0.24%) 6.88s (± 0.34%) ~ 6.86s 6.92s p=0.089 n=6
Emit Time 4.04s (± 0.44%) 4.05s (± 0.51%) ~ 4.02s 4.07s p=0.624 n=6
Total Time 14.28s (± 0.24%) 14.34s (± 0.22%) +0.06s (+ 0.40%) 14.30s 14.38s p=0.043 n=6
TFS - node (v18.15.0, x64)
Memory used 302,790k (± 0.00%) 302,807k (± 0.01%) ~ 302,768k 302,833k p=0.093 n=6
Parse Time 2.02s (± 0.49%) 2.02s (± 1.14%) ~ 1.99s 2.05s p=0.935 n=6
Bind Time 1.00s (± 0.83%) 1.01s (± 1.02%) ~ 1.00s 1.02s p=0.923 n=6
Check Time 6.30s (± 0.13%) 6.30s (± 0.41%) ~ 6.26s 6.33s p=0.732 n=6
Emit Time 3.60s (± 0.48%) 3.60s (± 0.49%) ~ 3.57s 3.61s p=0.934 n=6
Total Time 12.94s (± 0.12%) 12.92s (± 0.12%) ~ 12.89s 12.93s p=0.183 n=6
material-ui - node (v18.15.0, x64)
Memory used 511,150k (± 0.00%) 511,159k (± 0.00%) ~ 511,143k 511,176k p=0.298 n=6
Parse Time 2.63s (± 0.94%) 2.67s (± 0.28%) +0.04s (+ 1.65%) 2.66s 2.68s p=0.006 n=6
Bind Time 0.99s (± 1.05%) 0.99s (± 0.99%) ~ 0.98s 1.00s p=0.673 n=6
Check Time 17.14s (± 0.43%) 17.14s (± 0.72%) ~ 17.04s 17.36s p=0.936 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 20.76s (± 0.37%) 20.81s (± 0.59%) ~ 20.70s 21.02s p=0.575 n=6
mui-docs - node (v18.15.0, x64)
Memory used 1,695,864k (± 0.00%) 1,695,881k (± 0.00%) ~ 1,695,842k 1,695,924k p=0.423 n=6
Parse Time 6.51s (± 0.29%) 6.60s (± 0.64%) +0.09s (+ 1.33%) 6.54s 6.65s p=0.008 n=6
Bind Time 2.35s (± 0.38%) 2.36s (± 0.44%) +0.02s (+ 0.64%) 2.35s 2.38s p=0.039 n=6
Check Time 55.53s (± 0.54%) 55.50s (± 0.52%) ~ 55.20s 55.91s p=1.000 n=6
Emit Time 0.16s (± 0.00%) 0.16s (± 0.00%) ~ 0.16s 0.16s p=1.000 n=6
Total Time 64.55s (± 0.45%) 64.63s (± 0.49%) ~ 64.29s 65.05s p=0.630 n=6
self-build-src - node (v18.15.0, x64)
Memory used 2,412,796k (± 0.03%) 2,412,760k (± 0.03%) ~ 2,412,245k 2,413,599k p=1.000 n=6
Parse Time 4.94s (± 1.07%) 4.95s (± 0.68%) ~ 4.90s 4.99s p=0.378 n=6
Bind Time 1.87s (± 0.48%) 1.88s (± 0.92%) ~ 1.86s 1.91s p=0.452 n=6
Check Time 33.20s (± 0.19%) 33.14s (± 0.45%) ~ 32.92s 33.37s p=0.378 n=6
Emit Time 2.71s (± 1.50%) 2.69s (± 1.97%) ~ 2.60s 2.76s p=0.936 n=6
Total Time 42.73s (± 0.29%) 42.69s (± 0.31%) ~ 42.53s 42.89s p=0.630 n=6
self-compiler - node (v18.15.0, x64)
Memory used 419,546k (± 0.01%) 419,484k (± 0.00%) -63k (- 0.01%) 419,462k 419,510k p=0.008 n=6
Parse Time 2.75s (± 3.21%) 2.78s (± 2.85%) ~ 2.67s 2.84s p=0.292 n=6
Bind Time 1.15s (± 6.86%) 1.13s (± 6.64%) ~ 1.08s 1.23s p=0.675 n=6
Check Time 15.00s (± 0.30%) 14.95s (± 0.47%) ~ 14.89s 15.08s p=0.126 n=6
Emit Time 1.17s (± 0.64%) 1.17s (± 2.00%) ~ 1.14s 1.20s p=0.566 n=6
Total Time 20.06s (± 0.30%) 20.02s (± 0.45%) ~ 19.94s 20.19s p=0.261 n=6
vscode - node (v18.15.0, x64)
Memory used 2,807,311k (± 0.00%) 2,807,293k (± 0.00%) ~ 2,807,200k 2,807,370k p=1.000 n=6
Parse Time 10.65s (± 0.57%) 10.61s (± 0.29%) ~ 10.59s 10.67s p=0.088 n=6
Bind Time 3.38s (± 0.26%) 3.40s (± 0.59%) ~ 3.38s 3.43s p=0.084 n=6
Check Time 59.11s (± 0.49%) 59.42s (± 0.46%) ~ 59.10s 59.75s p=0.092 n=6
Emit Time 16.05s (± 0.34%) 16.08s (± 0.51%) ~ 16.00s 16.23s p=0.517 n=6
Total Time 89.19s (± 0.28%) 89.50s (± 0.38%) ~ 89.08s 89.95s p=0.066 n=6
webpack - node (v18.15.0, x64)
Memory used 392,391k (± 0.03%) 392,355k (± 0.02%) ~ 392,279k 392,425k p=0.689 n=6
Parse Time 3.05s (± 1.36%) 3.05s (± 0.81%) ~ 3.00s 3.07s p=0.744 n=6
Bind Time 1.41s (± 0.70%) 1.42s (± 0.74%) ~ 1.40s 1.43s p=0.547 n=6
Check Time 13.99s (± 0.41%) 13.98s (± 0.16%) ~ 13.94s 14.00s p=0.748 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 18.45s (± 0.53%) 18.44s (± 0.29%) ~ 18.34s 18.48s p=0.688 n=6
xstate - node (v18.15.0, x64)
Memory used 513,361k (± 0.01%) 513,393k (± 0.01%) ~ 513,316k 513,486k p=0.336 n=6
Parse Time 3.29s (± 0.23%) 3.30s (± 0.16%) ~ 3.30s 3.31s p=0.058 n=6
Bind Time 1.54s (± 0.35%) 1.56s (± 0.52%) +0.02s (+ 1.19%) 1.55s 1.57s p=0.008 n=6
Check Time 2.84s (± 0.81%) 2.84s (± 0.68%) ~ 2.82s 2.87s p=1.000 n=6
Emit Time 0.08s (± 0.00%) 0.08s (± 0.00%) ~ 0.08s 0.08s p=1.000 n=6
Total Time 7.75s (± 0.24%) 7.78s (± 0.32%) ~ 7.75s 7.81s p=0.061 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • Angular - node (v18.15.0, x64)
  • Compiler-Unions - node (v18.15.0, x64)
  • Monaco - node (v18.15.0, x64)
  • TFS - node (v18.15.0, x64)
  • material-ui - node (v18.15.0, x64)
  • mui-docs - node (v18.15.0, x64)
  • self-build-src - node (v18.15.0, x64)
  • self-compiler - node (v18.15.0, x64)
  • vscode - node (v18.15.0, x64)
  • webpack - node (v18.15.0, x64)
  • xstate - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

tsserver

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,350ms (± 0.67%) 2,340ms (± 0.51%) ~ 2,319ms 2,353ms p=0.297 n=6
Req 2 - geterr 5,486ms (± 1.01%) 5,498ms (± 1.46%) ~ 5,425ms 5,623ms p=0.688 n=6
Req 3 - references 323ms (± 1.22%) 322ms (± 0.46%) ~ 320ms 324ms p=1.000 n=6
Req 4 - navto 276ms (± 1.11%) 274ms (± 0.90%) ~ 271ms 277ms p=0.157 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 84ms (± 6.35%) 88ms (± 7.56%) ~ 79ms 95ms p=0.211 n=6
CompilerTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,484ms (± 0.93%) 2,471ms (± 1.37%) ~ 2,411ms 2,502ms p=0.521 n=6
Req 2 - geterr 4,182ms (± 2.05%) 4,218ms (± 1.95%) ~ 4,100ms 4,286ms p=0.295 n=6
Req 3 - references 336ms (± 1.13%) 335ms (± 1.35%) ~ 328ms 340ms p=0.809 n=6
Req 4 - navto 284ms (± 0.26%) 285ms (± 1.04%) ~ 281ms 290ms p=0.558 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 82ms (± 9.17%) 80ms (± 7.70%) ~ 74ms 88ms p=0.462 n=6
xstateTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,601ms (± 0.66%) 2,628ms (± 0.24%) +27ms (+ 1.04%) 2,621ms 2,639ms p=0.005 n=6
Req 2 - geterr 1,717ms (± 2.57%) 1,690ms (± 2.15%) ~ 1,652ms 1,732ms p=0.128 n=6
Req 3 - references 109ms (± 7.65%) 113ms (± 9.17%) ~ 105ms 126ms p=0.354 n=6
Req 4 - navto 365ms (± 0.00%) 364ms (± 0.78%) ~ 359ms 367ms p=1.000 n=6
Req 5 - completionInfo count 2,078 (± 0.00%) 2,078 (± 0.00%) ~ 2,078 2,078 p=1.000 n=6
Req 5 - completionInfo 311ms (± 2.53%) 306ms (± 1.03%) ~ 300ms 309ms p=0.260 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • CompilerTSServer - node (v18.15.0, x64)
  • Compiler-UnionsTSServer - node (v18.15.0, x64)
  • xstateTSServer - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - node (v18.15.0, x64)
Execution time 154.06ms (± 0.20%) 153.99ms (± 0.21%) ~ 152.81ms 157.66ms p=0.065 n=600
tsserver-startup - node (v18.15.0, x64)
Execution time 229.77ms (± 0.15%) 229.41ms (± 0.18%) -0.36ms (- 0.16%) 228.02ms 235.77ms p=0.000 n=600
tsserverlibrary-startup - node (v18.15.0, x64)
Execution time 232.24ms (± 0.20%) 232.37ms (± 0.19%) +0.13ms (+ 0.06%) 230.65ms 239.26ms p=0.005 n=600
typescript-startup - node (v18.15.0, x64)
Execution time 231.18ms (± 0.17%) 231.10ms (± 0.17%) ~ 229.48ms 233.81ms p=0.065 n=600
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • tsc-startup - node (v18.15.0, x64)
  • tsserver-startup - node (v18.15.0, x64)
  • tsserverlibrary-startup - node (v18.15.0, x64)
  • typescript-startup - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey
Copy link
Member Author

@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 19, 2024 •
edited
Loading

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this ✅ Started 👀 Results

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - node (v18.15.0, x64)
Memory used 295,751k (± 0.01%) 295,739k (± 0.01%) ~ 295,652k 295,766k p=0.810 n=6
Parse Time 2.66s (± 0.19%) 2.67s (± 0.21%) ~ 2.66s 2.67s p=0.640 n=6
Bind Time 0.83s (± 0.00%) 0.83s (± 0.62%) ~ 0.83s 0.84s p=0.174 n=6
Check Time 8.21s (± 0.26%) 8.20s (± 0.39%) ~ 8.16s 8.24s p=0.628 n=6
Emit Time 7.13s (± 0.35%) 7.09s (± 0.35%) -0.05s (- 0.65%) 7.06s 7.13s p=0.023 n=6
Total Time 18.84s (± 0.20%) 18.78s (± 0.16%) -0.06s (- 0.31%) 18.75s 18.82s p=0.024 n=6
Compiler-Unions - node (v18.15.0, x64)
Memory used 194,899k (± 0.72%) 192,637k (± 0.72%) -2,262k (- 1.16%) 191,937k 195,439k p=0.045 n=6
Parse Time 1.36s (± 1.10%) 1.36s (± 0.86%) ~ 1.35s 1.38s p=0.730 n=6
Bind Time 0.72s (± 0.00%) 0.73s (± 0.00%) +0.01s (+ 1.39%) 0.73s 0.73s p=0.001 n=6
Check Time 9.51s (± 0.79%) 9.51s (± 1.13%) ~ 9.38s 9.63s p=1.000 n=6
Emit Time 2.65s (± 0.57%) 2.65s (± 0.67%) ~ 2.62s 2.67s p=0.680 n=6
Total Time 14.24s (± 0.67%) 14.25s (± 0.80%) ~ 14.11s 14.37s p=1.000 n=6
Monaco - node (v18.15.0, x64)
Memory used 347,372k (± 0.00%) 347,411k (± 0.01%) +39k (+ 0.01%) 347,372k 347,439k p=0.037 n=6
Parse Time 2.48s (± 0.69%) 2.50s (± 0.36%) +0.02s (+ 0.87%) 2.49s 2.51s p=0.039 n=6
Bind Time 0.93s (± 0.44%) 0.93s (± 0.00%) ~ 0.93s 0.93s p=0.405 n=6
Check Time 7.00s (± 0.44%) 7.04s (± 0.41%) ~ 6.99s 7.06s p=0.143 n=6
Emit Time 4.06s (± 0.26%) 4.08s (± 0.51%) ~ 4.05s 4.10s p=0.512 n=6
Total Time 14.47s (± 0.22%) 14.53s (± 0.22%) +0.06s (+ 0.41%) 14.48s 14.57s p=0.023 n=6
TFS - node (v18.15.0, x64)
Memory used 302,717k (± 0.01%) 302,759k (± 0.00%) +42k (+ 0.01%) 302,741k 302,776k p=0.008 n=6
Parse Time 2.01s (± 0.81%) 2.02s (± 0.68%) ~ 2.00s 2.04s p=0.871 n=6
Bind Time 1.00s (± 1.17%) 1.01s (± 0.81%) ~ 1.00s 1.02s p=0.401 n=6
Check Time 6.32s (± 0.47%) 6.31s (± 0.42%) ~ 6.29s 6.36s p=0.373 n=6
Emit Time 3.61s (± 0.48%) 3.63s (± 0.57%) ~ 3.60s 3.66s p=0.292 n=6
Total Time 12.95s (± 0.43%) 12.96s (± 0.21%) ~ 12.92s 12.99s p=1.000 n=6
material-ui - node (v18.15.0, x64)
Memory used 511,357k (± 0.00%) 511,384k (± 0.00%) ~ 511,351k 511,413k p=0.093 n=6
Parse Time 2.66s (± 0.28%) 2.69s (± 0.58%) +0.03s (+ 1.06%) 2.66s 2.70s p=0.021 n=6
Bind Time 0.98s (± 0.64%) 0.98s (± 0.83%) ~ 0.97s 0.99s p=0.432 n=6
Check Time 17.36s (± 0.47%) 17.34s (± 0.26%) ~ 17.28s 17.40s p=0.810 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 21.01s (± 0.38%) 21.01s (± 0.30%) ~ 20.92s 21.09s p=0.873 n=6
mui-docs - node (v18.15.0, x64)
Memory used 1,719,161k (± 0.00%) 1,719,172k (± 0.00%) ~ 1,719,145k 1,719,222k p=0.423 n=6
Parse Time 6.53s (± 0.43%) 6.62s (± 0.44%) +0.09s (+ 1.40%) 6.59s 6.66s p=0.005 n=6
Bind Time 2.36s (± 0.46%) 2.36s (± 0.32%) ~ 2.35s 2.37s p=0.604 n=6
Check Time 56.28s (± 0.44%) 56.19s (± 0.44%) ~ 55.93s 56.56s p=0.575 n=6
Emit Time 0.13s (± 3.10%) 0.13s (± 3.87%) ~ 0.13s 0.14s p=0.595 n=6
Total Time 65.30s (± 0.40%) 65.30s (± 0.36%) ~ 65.03s 65.66s p=0.936 n=6
self-build-src - node (v18.15.0, x64)
Memory used 2,395,712k (± 0.02%) 2,395,141k (± 0.02%) ~ 2,394,337k 2,395,670k p=0.093 n=6
Parse Time 5.01s (± 1.21%) 5.03s (± 0.86%) ~ 4.98s 5.09s p=0.470 n=6
Bind Time 1.89s (± 0.54%) 1.91s (± 1.10%) ~ 1.89s 1.94s p=0.157 n=6
Check Time 33.54s (± 0.47%) 33.49s (± 0.31%) ~ 33.35s 33.64s p=0.378 n=6
Emit Time 2.72s (± 1.13%) 2.72s (± 1.49%) ~ 2.66s 2.76s p=0.872 n=6
Total Time 43.17s (± 0.38%) 43.16s (± 0.28%) ~ 42.99s 43.28s p=0.936 n=6
self-compiler - node (v18.15.0, x64)
Memory used 416,105k (± 0.01%) 416,003k (± 0.01%) -101k (- 0.02%) 415,977k 416,037k p=0.005 n=6
Parse Time 2.83s (± 0.98%) 2.81s (± 1.20%) ~ 2.77s 2.86s p=0.628 n=6
Bind Time 1.07s (± 0.76%) 1.07s (± 0.76%) ~ 1.06s 1.08s p=0.204 n=6
Check Time 15.30s (± 0.35%) 15.27s (± 0.24%) ~ 15.23s 15.32s p=0.370 n=6
Emit Time 1.14s (± 1.51%) 1.15s (± 0.78%) ~ 1.14s 1.16s p=0.458 n=6
Total Time 20.34s (± 0.34%) 20.31s (± 0.34%) ~ 20.24s 20.43s p=0.470 n=6
vscode - node (v18.15.0, x64)
Memory used 2,884,059k (± 0.00%) 2,883,909k (± 0.00%) -150k (- 0.01%) 2,883,844k 2,883,997k p=0.008 n=6
Parse Time 10.82s (± 0.28%) 10.84s (± 0.27%) ~ 10.80s 10.88s p=0.226 n=6
Bind Time 3.46s (± 0.38%) 3.48s (± 0.56%) ~ 3.46s 3.51s p=0.157 n=6
Check Time 61.80s (± 0.70%) 61.36s (± 0.26%) ~ 61.23s 61.65s p=0.054 n=6
Emit Time 16.97s (± 8.27%) 16.43s (± 0.76%) ~ 16.24s 16.54s p=0.810 n=6
Total Time 93.04s (± 1.84%) 92.10s (± 0.19%) ~ 91.95s 92.43s p=0.128 n=6
webpack - node (v18.15.0, x64)
Memory used 408,057k (± 0.01%) 408,053k (± 0.02%) ~ 407,983k 408,172k p=0.810 n=6
Parse Time 3.22s (± 0.51%) 3.23s (± 0.54%) ~ 3.21s 3.26s p=0.413 n=6
Bind Time 1.38s (± 0.79%) 1.40s (± 0.78%) +0.02s (+ 1.45%) 1.39s 1.41s p=0.015 n=6
Check Time 14.27s (± 0.41%) 14.29s (± 0.32%) ~ 14.21s 14.34s p=0.688 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 18.88s (± 0.37%) 18.93s (± 0.23%) ~ 18.86s 18.98s p=0.335 n=6
xstate - node (v18.15.0, x64)
Memory used 513,072k (± 0.01%) 513,078k (± 0.01%) ~ 512,992k 513,155k p=0.689 n=6
Parse Time 3.27s (± 0.12%) 3.28s (± 0.27%) ~ 3.27s 3.29s p=0.086 n=6
Bind Time 1.54s (± 0.27%) 1.55s (± 0.58%) +0.01s (+ 0.76%) 1.54s 1.56s p=0.025 n=6
Check Time 2.85s (± 0.72%) 2.85s (± 0.29%) ~ 2.84s 2.86s p=0.683 n=6
Emit Time 0.07s (± 5.69%) 0.07s (± 5.69%) ~ 0.07s 0.08s p=1.000 n=6
Total Time 7.74s (± 0.27%) 7.75s (± 0.23%) ~ 7.74s 7.79s p=0.252 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • Angular - node (v18.15.0, x64)
  • Compiler-Unions - node (v18.15.0, x64)
  • Monaco - node (v18.15.0, x64)
  • TFS - node (v18.15.0, x64)
  • material-ui - node (v18.15.0, x64)
  • mui-docs - node (v18.15.0, x64)
  • self-build-src - node (v18.15.0, x64)
  • self-compiler - node (v18.15.0, x64)
  • vscode - node (v18.15.0, x64)
  • webpack - node (v18.15.0, x64)
  • xstate - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

tsserver

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,347ms (± 0.69%) 2,333ms (± 0.35%) ~ 2,322ms 2,347ms p=0.172 n=6
Req 2 - geterr 5,793ms (± 0.55%) 5,764ms (± 0.56%) ~ 5,722ms 5,793ms p=0.229 n=6
Req 3 - references 323ms (± 0.25%) 325ms (± 1.05%) +3ms (+ 0.77%) 323ms 332ms p=0.025 n=6
Req 4 - navto 272ms (± 1.35%) 273ms (± 0.15%) ~ 273ms 274ms p=0.446 n=6
Req 5 - completionInfo count 1,357 (± 0.00%) 1,357 (± 0.00%) ~ 1,357 1,357 p=1.000 n=6
Req 5 - completionInfo 93ms (± 4.91%) 95ms (± 0.43%) ~ 94ms 95ms p=0.753 n=6
CompilerTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,493ms (± 0.68%) 2,485ms (± 0.56%) ~ 2,465ms 2,497ms p=0.377 n=6
Req 2 - geterr 4,282ms (± 0.46%) 4,265ms (± 0.19%) ~ 4,254ms 4,279ms p=0.230 n=6
Req 3 - references 333ms (± 0.82%) 332ms (± 0.42%) ~ 330ms 334ms p=0.491 n=6
Req 4 - navto 284ms (± 0.70%) 284ms (± 0.37%) ~ 282ms 285ms p=1.000 n=6
Req 5 - completionInfo count 1,519 (± 0.00%) 1,519 (± 0.00%) ~ 1,519 1,519 p=1.000 n=6
Req 5 - completionInfo 78ms (± 0.52%) 78ms (± 1.33%) ~ 76ms 79ms p=0.390 n=6
xstateTSServer - node (v18.15.0, x64)
Req 1 - updateOpen 2,613ms (± 0.52%) 2,626ms (± 0.14%) ~ 2,622ms 2,631ms p=0.109 n=6
Req 2 - geterr 1,707ms (± 2.76%) 1,708ms (± 2.39%) ~ 1,666ms 1,782ms p=0.810 n=6
Req 3 - references 118ms (± 9.61%) 122ms (± 8.90%) ~ 108ms 132ms p=0.683 n=6
Req 4 - navto 373ms (± 0.79%) 372ms (± 0.28%) ~ 370ms 373ms p=0.742 n=6
Req 5 - completionInfo count 2,079 (± 0.00%) 2,079 (± 0.00%) ~ 2,079 2,079 p=1.000 n=6
Req 5 - completionInfo 309ms (± 2.29%) 306ms (± 1.02%) ~ 303ms 312ms p=0.280 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • CompilerTSServer - node (v18.15.0, x64)
  • Compiler-UnionsTSServer - node (v18.15.0, x64)
  • xstateTSServer - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - node (v18.15.0, x64)
Execution time 154.17ms (± 0.21%) 154.36ms (± 0.18%) +0.19ms (+ 0.13%) 153.37ms 157.53ms p=0.000 n=600
tsserver-startup - node (v18.15.0, x64)
Execution time 229.01ms (± 0.17%) 228.95ms (± 0.15%) ~ 227.52ms 233.47ms p=0.158 n=600
tsserverlibrary-startup - node (v18.15.0, x64)
Execution time 222.66ms (± 0.17%) 222.55ms (± 0.13%) -0.11ms (- 0.05%) 221.28ms 225.12ms p=0.005 n=600
typescript-startup - node (v18.15.0, x64)
Execution time 222.89ms (± 0.14%) 223.06ms (± 0.15%) +0.16ms (+ 0.07%) 221.75ms 228.07ms p=0.000 n=600
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • tsc-startup - node (v18.15.0, x64)
  • tsserver-startup - node (v18.15.0, x64)
  • tsserverlibrary-startup - node (v18.15.0, x64)
  • typescript-startup - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey
Copy link
Member Author

@typescript-bot perf test this faster

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jul 1, 2024 •
edited
Loading

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - node (v18.15.0, x64)
Errors 30 30 ~ ~ ~ p=1.000 n=6
Symbols 62,153 62,153 ~ ~ ~ p=1.000 n=6
Types 50,242 50,242 ~ ~ ~ p=1.000 n=6
Memory used 193,946k (± 1.02%) 192,254k (± 0.12%) ~ 192,071k 192,558k p=0.109 n=6
Parse Time 1.31s (± 0.48%) 1.30s (± 0.97%) ~ 1.28s 1.31s p=0.152 n=6
Bind Time 0.71s 0.71s (± 0.57%) ~ 0.71s 0.72s p=0.405 n=6
Check Time 9.45s (± 0.42%) 9.44s (± 0.53%) ~ 9.35s 9.50s p=0.686 n=6
Emit Time 2.76s (± 0.56%) 2.74s (± 0.40%) -0.02s (- 0.72%) 2.72s 2.75s p=0.046 n=6
Total Time 14.22s (± 0.22%) 14.19s (± 0.47%) ~ 14.07s 14.27s p=0.373 n=6
angular-1 - node (v18.15.0, x64)
Errors 5 5 ~ ~ ~ p=1.000 n=6
Symbols 944,114 944,114 ~ ~ ~ p=1.000 n=6
Types 407,050 407,050 ~ ~ ~ p=1.000 n=6
Memory used 1,218,387k (± 0.00%) 1,218,386k (± 0.00%) ~ 1,218,313k 1,218,451k p=0.873 n=6
Parse Time 6.65s (± 0.91%) 6.73s (± 1.03%) ~ 6.67s 6.83s p=0.065 n=6
Bind Time 1.87s (± 0.55%) 1.87s (± 0.28%) ~ 1.87s 1.88s p=0.242 n=6
Check Time 30.64s (± 0.35%) 30.62s (± 0.63%) ~ 30.38s 30.85s p=1.000 n=6
Emit Time 13.55s (± 0.34%) 13.52s (± 0.38%) ~ 13.44s 13.58s p=0.197 n=6
Total Time 52.71s (± 0.16%) 52.74s (± 0.45%) ~ 52.43s 53.00s p=0.936 n=6
mui-docs - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 2,136,980 2,136,980 ~ ~ ~ p=1.000 n=6
Types 929,117 929,117 ~ ~ ~ p=1.000 n=6
Memory used 2,117,703k (± 0.01%) 2,117,717k (± 0.01%) ~ 2,117,542k 2,117,985k p=1.000 n=6
Parse Time 9.67s (± 0.42%) 9.82s (± 0.49%) +0.15s (+ 1.60%) 9.78s 9.91s p=0.005 n=6
Bind Time 3.39s (± 0.39%) 3.41s (± 0.45%) +0.02s (+ 0.64%) 3.40s 3.44s p=0.027 n=6
Check Time 103.31s (± 0.77%) 102.16s (± 1.03%) ~ 100.19s 103.27s p=0.066 n=6
Emit Time 0.19s 0.19s (± 2.67%) ~ 0.19s 0.20s p=0.174 n=6
Total Time 116.56s (± 0.69%) 115.59s (± 0.89%) ~ 113.66s 116.68s p=0.128 n=6
self-build-src - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,225,260 1,225,079 -181 (- 0.01%) ~ ~ p=0.001 n=6
Types 261,341 261,246 -95 (- 0.04%) ~ ~ p=0.001 n=6
Memory used 2,340,977k (± 0.06%) 2,339,487k (± 0.02%) ~ 2,338,834k 2,340,021k p=0.066 n=6
Parse Time 5.00s (± 0.62%) 5.05s (± 1.14%) ~ 4.95s 5.12s p=0.090 n=6
Bind Time 1.90s (± 0.58%) 1.93s (± 0.80%) +0.03s (+ 1.58%) 1.91s 1.95s p=0.007 n=6
Check Time 34.41s (± 0.70%) 34.12s (± 0.23%) -0.29s (- 0.85%) 34.03s 34.26s p=0.045 n=6
Emit Time 2.58s (± 2.73%) 2.79s (± 4.57%) 🔻+0.21s (+ 8.07%) 2.65s 2.98s p=0.008 n=6
Total Time 43.91s (± 0.70%) 43.91s (± 0.31%) ~ 43.73s 44.03s p=1.000 n=6
self-build-src-public-api - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,225,260 1,225,079 -181 (- 0.01%) ~ ~ p=0.001 n=6
Types 261,341 261,246 -95 (- 0.04%) ~ ~ p=0.001 n=6
Memory used 2,415,045k (± 0.03%) 2,414,692k (± 0.05%) ~ 2,412,803k 2,416,008k p=0.471 n=6
Parse Time 6.21s (± 0.80%) 6.28s (± 0.59%) +0.07s (+ 1.18%) 6.24s 6.35s p=0.043 n=6
Bind Time 2.02s (± 0.99%) 2.00s (± 0.49%) ~ 1.99s 2.02s p=0.119 n=6
Check Time 40.72s (± 0.55%) 40.71s (± 0.66%) ~ 40.48s 41.13s p=0.688 n=6
Emit Time 3.21s (± 7.52%) 3.21s (± 3.88%) ~ 3.09s 3.39s p=0.471 n=6
Total Time 52.15s (± 0.47%) 52.21s (± 0.82%) ~ 51.88s 52.92s p=0.936 n=6
self-compiler - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 258,194 258,013 -181 (- 0.07%) ~ ~ p=0.001 n=6
Types 104,737 104,642 -95 (- 0.09%) ~ ~ p=0.001 n=6
Memory used 427,520k (± 0.01%) 427,349k (± 0.01%) -171k (- 0.04%) 427,319k 427,378k p=0.005 n=6
Parse Time 3.31s (± 0.82%) 3.32s (± 0.78%) ~ 3.29s 3.36s p=0.746 n=6
Bind Time 1.32s (± 1.32%) 1.32s (± 1.12%) ~ 1.30s 1.34s p=0.684 n=6
Check Time 17.82s (± 0.13%) 17.92s (± 0.42%) +0.10s (+ 0.55%) 17.80s 18.01s p=0.044 n=6
Emit Time 1.25s (± 0.84%) 1.27s (± 0.50%) +0.02s (+ 2.01%) 1.26s 1.28s p=0.005 n=6
Total Time 23.70s (± 0.17%) 23.83s (± 0.39%) +0.13s (+ 0.55%) 23.70s 23.97s p=0.020 n=6
ts-pre-modules - node (v18.15.0, x64)
Errors 35 35 ~ ~ ~ p=1.000 n=6
Symbols 224,565 224,565 ~ ~ ~ p=1.000 n=6
Types 93,734 93,734 ~ ~ ~ p=1.000 n=6
Memory used 369,508k (± 0.04%) 369,489k (± 0.03%) ~ 369,359k 369,652k p=1.000 n=6
Parse Time 2.77s (± 1.06%) 2.77s (± 0.82%) ~ 2.74s 2.80s p=1.000 n=6
Bind Time 1.58s (± 0.80%) 1.58s (± 0.57%) ~ 1.57s 1.59s p=0.933 n=6
Check Time 15.47s (± 0.53%) 15.49s (± 0.15%) ~ 15.45s 15.51s p=0.810 n=6
Emit Time 0.00s 0.00s ~ ~ ~ p=1.000 n=6
Total Time 19.82s (± 0.43%) 19.84s (± 0.21%) ~ 19.77s 19.89s p=0.936 n=6
vscode - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 2,879,975 2,879,975 ~ ~ ~ p=1.000 n=6
Types 975,327 975,327 ~ ~ ~ p=1.000 n=6
Memory used 3,042,871k (± 0.00%) 3,042,780k (± 0.00%) -91k (- 0.00%) 3,042,700k 3,042,855k p=0.008 n=6
Parse Time 13.71s (± 0.36%) 13.74s (± 0.21%) ~ 13.69s 13.77s p=0.228 n=6
Bind Time 4.19s (± 0.28%) 4.24s (± 2.35%) ~ 4.17s 4.44s p=0.222 n=6
Check Time 74.70s (± 2.61%) 73.98s (± 2.29%) ~ 73.12s 77.41s p=0.149 n=6
Emit Time 23.22s (± 7.83%) 23.50s (± 6.98%) ~ 20.21s 24.50s p=1.000 n=6
Total Time 115.81s (± 0.34%) 115.46s (± 0.21%) ~ 115.15s 115.78s p=0.230 n=6
webpack - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 267,117 267,117 ~ ~ ~ p=1.000 n=6
Types 108,775 108,775 ~ ~ ~ p=1.000 n=6
Memory used 411,601k (± 0.02%) 411,559k (± 0.01%) ~ 411,464k 411,629k p=0.575 n=6
Parse Time 4.68s (± 0.17%) 4.71s (± 0.63%) ~ 4.66s 4.75s p=0.061 n=6
Bind Time 2.08s (± 0.36%) 2.07s (± 0.66%) ~ 2.05s 2.09s p=0.273 n=6
Check Time 20.73s (± 0.43%) 20.74s (± 0.37%) ~ 20.66s 20.86s p=0.872 n=6
Emit Time 0.00s 0.00s ~ ~ ~ p=1.000 n=6
Total Time 27.49s (± 0.36%) 27.51s (± 0.24%) ~ 27.43s 27.59s p=0.575 n=6
xstate-main - node (v18.15.0, x64)
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 525,251 525,251 ~ ~ ~ p=1.000 n=6
Types 178,574 178,574 ~ ~ ~ p=1.000 n=6
Memory used 462,704k (± 0.08%) 462,891k (± 0.08%) ~ 462,399k 463,359k p=0.230 n=6
Parse Time 3.18s (± 0.69%) 3.22s (± 0.47%) +0.04s (+ 1.36%) 3.21s 3.25s p=0.008 n=6
Bind Time 1.17s (± 0.54%) 1.18s (± 0.44%) +0.01s (+ 1.14%) 1.18s 1.19s p=0.009 n=6
Check Time 17.95s (± 0.17%) 17.93s (± 0.32%) ~ 17.88s 18.04s p=0.171 n=6
Emit Time 0.00s 0.00s ~ ~ ~ p=1.000 n=6
Total Time 22.30s (± 0.10%) 22.34s (± 0.25%) ~ 22.28s 22.44s p=0.126 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • Compiler-Unions - node (v18.15.0, x64)
  • angular-1 - node (v18.15.0, x64)
  • mui-docs - node (v18.15.0, x64)
  • self-build-src - node (v18.15.0, x64)
  • self-build-src-public-api - node (v18.15.0, x64)
  • self-compiler - node (v18.15.0, x64)
  • ts-pre-modules - node (v18.15.0, x64)
  • vscode - node (v18.15.0, x64)
  • webpack - node (v18.15.0, x64)
  • xstate-main - node (v18.15.0, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey jakebailey closed this Jul 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

Copilot code review Copilot Awaiting requested review from Copilot Copilot will automatically review once the pull request is marked ready for review

Assignees

@jakebailey jakebailey

Labels
Author: Team For Uncommitted Bug PR for untriaged, rejected, closed or missing bug
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jakebailey @typescript-bot