Skip to content

Conversation

Zzzen
Copy link
Contributor

@Zzzen Zzzen commented Aug 5, 2023

…izer

Fixes #30907

@typescript-bot typescript-bot added the For Backlog Bug PRs that fix a backlog bug label Aug 5, 2023
@gabritto
Copy link
Member

@Zzzen could you fix the merge conflicts? I couldn't push to your branch myself

@Zzzen
Copy link
Contributor Author

Zzzen commented Aug 25, 2023

Of course, fixed.

@gabritto

This comment was marked as duplicate.

@gabritto
Copy link
Member

@typescript-bot run DT
@typescript-bot user test this
@typescript-bot test top100
@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 25, 2023

Heya @gabritto, I've started to run the parallelized Definitely Typed test suite on this PR at 3ae0fa4. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 25, 2023

Heya @gabritto, I've started to run the diff-based top-repos suite on this PR at 3ae0fa4. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 25, 2023

Heya @gabritto, I've started to run the diff-based user code test suite on this PR at 3ae0fa4. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 25, 2023

Heya @gabritto, I've started to run the regular perf test suite on this PR at 3ae0fa4. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@gabritto Here are the results of running the user test suite comparing main and refs/pull/55279/merge:

There were infrastructure failures potentially unrelated to your change:

  • 1 instance of "Unknown failure"
  • 2 instances of "Package install failed"

Otherwise...

Something interesting changed - please have a look.

Details

rxjs-src

/mnt/ts_downloads/rxjs-src/build.sh

  • [NEW] error TS2428: All declarations of 'WeakMap' must have identical type parameters.
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.symbol.wellknown.d.ts(140,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.symbol.wellknown.d.ts(140,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.symbol.wellknown.d.ts(140,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.symbol.wellknown.d.ts(140,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-55279/lib/lib.es2015.symbol.wellknown.d.ts(140,11)
  • [MISSING] error TS2428: All declarations of 'WeakMap' must have identical type parameters.
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.symbol.wellknown.d.ts(140,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.symbol.wellknown.d.ts(140,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.symbol.wellknown.d.ts(140,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.symbol.wellknown.d.ts(140,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.collection.d.ts(62,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.iterable.d.ts(162,11)
    • /home/vsts/work/1/s/typescript-main/lib/lib.es2015.symbol.wellknown.d.ts(140,11)

@typescript-bot
Copy link
Collaborator

@gabritto
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - node (v16.17.1, x64)
Memory used 300,239k (± 0.00%) 300,252k (± 0.01%) ~ 300,222k 300,270k p=0.199 n=6
Parse Time 3.03s (± 0.21%) 3.03s (± 0.25%) ~ 3.02s 3.04s p=0.718 n=6
Bind Time 0.93s (± 0.00%) 0.93s (± 0.00%) ~ 0.93s 0.93s p=1.000 n=6
Check Time 9.33s (± 1.27%) 9.31s (± 0.30%) ~ 9.28s 9.35s p=0.293 n=6
Emit Time 7.63s (± 0.21%) 7.62s (± 0.30%) ~ 7.59s 7.65s p=0.685 n=6
Total Time 20.91s (± 0.63%) 20.89s (± 0.14%) ~ 20.87s 20.94s p=0.147 n=6
Compiler-Unions - node (v16.17.1, x64)
Memory used 193,962k (± 0.01%) 194,433k (± 0.67%) ~ 193,830k 197,089k p=0.128 n=6
Parse Time 1.58s (± 0.33%) 1.58s (± 0.26%) ~ 1.58s 1.59s p=0.595 n=6
Bind Time 0.80s (± 0.65%) 0.80s (± 0.51%) ~ 0.79s 0.80s p=0.595 n=6
Check Time 9.92s (± 0.28%) 9.91s (± 0.41%) ~ 9.85s 9.96s p=0.936 n=6
Emit Time 2.73s (± 0.19%) 2.73s (± 0.30%) ~ 2.72s 2.74s p=0.929 n=6
Total Time 15.03s (± 0.15%) 15.02s (± 0.28%) ~ 14.95s 15.06s p=0.746 n=6
Monaco - node (v16.17.1, x64)
Memory used 347,153k (± 0.00%) 347,155k (± 0.00%) ~ 347,135k 347,170k p=0.872 n=6
Parse Time 2.68s (± 0.19%) 2.68s (± 0.19%) ~ 2.68s 2.69s p=1.000 n=6
Bind Time 0.99s (± 0.00%) 0.99s (± 0.00%) ~ 0.99s 0.99s p=1.000 n=6
Check Time 7.93s (± 0.19%) 7.91s (± 0.22%) -0.03s (- 0.34%) 7.88s 7.93s p=0.029 n=6
Emit Time 4.26s (± 0.36%) 4.27s (± 0.26%) ~ 4.26s 4.29s p=0.502 n=6
Total Time 15.87s (± 0.09%) 15.85s (± 0.17%) ~ 15.81s 15.89s p=0.145 n=6
TFS - node (v16.17.1, x64)
Memory used 301,147k (± 0.01%) 301,144k (± 0.00%) ~ 301,127k 301,167k p=0.748 n=6
Parse Time 2.17s (± 0.56%) 2.18s (± 0.63%) ~ 2.16s 2.19s p=1.000 n=6
Bind Time 1.11s (± 0.37%) 1.11s (± 1.33%) ~ 1.08s 1.12s p=1.000 n=6
Check Time 7.21s (± 0.31%) 7.21s (± 0.07%) ~ 7.21s 7.22s p=0.560 n=6
Emit Time 3.99s (± 0.40%) 3.98s (± 0.19%) ~ 3.97s 3.99s p=0.209 n=6
Total Time 14.48s (± 0.25%) 14.47s (± 0.14%) ~ 14.45s 14.50s p=0.572 n=6
material-ui - node (v16.17.1, x64)
Memory used 479,452k (± 0.00%) 479,450k (± 0.00%) ~ 479,429k 479,480k p=0.574 n=6
Parse Time 3.15s (± 0.00%) 3.15s (± 0.26%) ~ 3.15s 3.17s p=0.405 n=6
Bind Time 0.91s (± 0.00%) 0.91s (± 0.00%) ~ 0.91s 0.91s p=1.000 n=6
Check Time 17.76s (± 0.33%) 17.75s (± 0.48%) ~ 17.63s 17.89s p=0.872 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 21.82s (± 0.27%) 21.81s (± 0.42%) ~ 21.69s 21.97s p=0.872 n=6
xstate - node (v16.17.1, x64)
Memory used 542,805k (± 0.01%) 542,836k (± 0.01%) ~ 542,757k 542,958k p=0.689 n=6
Parse Time 3.70s (± 0.24%) 3.70s (± 0.22%) ~ 3.69s 3.71s p=0.550 n=6
Bind Time 1.34s (± 0.39%) 1.34s (± 0.30%) ~ 1.33s 1.34s p=0.595 n=6
Check Time 3.34s (± 0.72%) 3.31s (± 0.68%) ~ 3.29s 3.35s p=0.064 n=6
Emit Time 0.08s (± 0.00%) 0.08s (± 0.00%) ~ 0.08s 0.08s p=1.000 n=6
Total Time 8.46s (± 0.43%) 8.43s (± 0.22%) ~ 8.40s 8.46s p=0.158 n=6
System info unknown
Hosts
  • node (v16.17.1, x64)
Scenarios
  • Angular - node (v16.17.1, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Monaco - node (v16.17.1, x64)
  • TFS - node (v16.17.1, x64)
  • material-ui - node (v16.17.1, x64)
  • xstate - node (v16.17.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

tsserver

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 2,490ms (± 0.11%) 2,490ms (± 0.17%) ~ 2,483ms 2,496ms p=1.000 n=6
Req 2 - geterr 5,931ms (± 0.39%) 5,964ms (± 0.37%) +34ms (+ 0.57%) 5,939ms 5,996ms p=0.031 n=6
Req 3 - references 343ms (± 0.52%) 342ms (± 0.30%) ~ 341ms 344ms p=0.616 n=6
Req 4 - navto 278ms (± 0.88%) 278ms (± 0.90%) ~ 276ms 282ms p=1.000 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 84ms (± 5.48%) 83ms (± 6.88%) ~ 76ms 93ms p=0.560 n=6
CompilerTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 2,637ms (± 0.59%) 2,621ms (± 0.70%) ~ 2,607ms 2,647ms p=0.172 n=6
Req 2 - geterr 4,769ms (± 0.30%) 4,767ms (± 0.23%) ~ 4,752ms 4,786ms p=0.630 n=6
Req 3 - references 350ms (± 0.23%) 351ms (± 0.43%) ~ 349ms 353ms p=0.354 n=6
Req 4 - navto 270ms (± 0.28%) 269ms (± 0.30%) ~ 268ms 270ms p=0.383 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 79ms (± 0.52%) 78ms (± 3.01%) ~ 73ms 79ms p=0.248 n=6
xstateTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 2,718ms (± 0.13%) 2,714ms (± 0.20%) ~ 2,706ms 2,720ms p=0.260 n=6
Req 2 - geterr 1,952ms (± 1.98%) 1,938ms (± 2.84%) ~ 1,853ms 1,985ms p=1.000 n=6
Req 3 - references 133ms (± 6.85%) 137ms (± 2.87%) ~ 133ms 143ms p=1.000 n=6
Req 4 - navto 353ms (± 0.49%) 353ms (± 0.45%) ~ 352ms 356ms p=1.000 n=6
Req 5 - completionInfo count 2,071 (± 0.00%) 2,071 (± 0.00%) ~ 2,071 2,071 p=1.000 n=6
Req 5 - completionInfo 315ms (± 1.52%) 316ms (± 2.24%) ~ 310ms 326ms p=0.808 n=6
System info unknown
Hosts
  • node (v16.17.1, x64)
Scenarios
  • CompilerTSServer - node (v16.17.1, x64)
  • Compiler-UnionsTSServer - node (v16.17.1, x64)
  • xstateTSServer - node (v16.17.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - node (v16.17.1, x64)
Execution time 155.73ms (± 0.20%) 155.56ms (± 0.16%) -0.17ms (- 0.11%) 154.15ms 157.78ms p=0.000 n=600
tsserver-startup - node (v16.17.1, x64)
Execution time 230.28ms (± 0.12%) 231.02ms (± 0.15%) +0.74ms (+ 0.32%) 228.86ms 236.19ms p=0.000 n=600
tsserverlibrary-startup - node (v16.17.1, x64)
Execution time 235.09ms (± 0.12%) 235.86ms (± 0.15%) +0.78ms (+ 0.33%) 234.40ms 239.91ms p=0.000 n=600
typescript-startup - node (v16.17.1, x64)
Execution time 235.72ms (± 0.13%) 235.63ms (± 0.12%) -0.09ms (- 0.04%) 234.37ms 238.09ms p=0.002 n=600
System info unknown
Hosts
  • node (v16.17.1, x64)
Scenarios
  • tsc-startup - node (v16.17.1, x64)
  • tsserver-startup - node (v16.17.1, x64)
  • tsserverlibrary-startup - node (v16.17.1, x64)
  • typescript-startup - node (v16.17.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@typescript-bot
Copy link
Collaborator

@gabritto Here are the results of running the top-repos suite comparing main and refs/pull/55279/merge:

Everything looks good!

@typescript-bot
Copy link
Collaborator

Hey @gabritto, it looks like the DT test run failed. Please check the log for more details.
You can check the log here.

@gabritto
Copy link
Member

@typescript-bot run DT

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 25, 2023

Heya @gabritto, I've started to run the parallelized Definitely Typed test suite on this PR at 3ae0fa4. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

Hey @gabritto, it looks like the DT test run failed. Please check the log for more details.
You can check the log here.

@gabritto
Copy link
Member

@typescript-bot run DT

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 25, 2023

Heya @gabritto, I've started to run the parallelized Definitely Typed test suite on this PR at 3ae0fa4. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

Hey @gabritto, the results of running the DT tests are ready.
Everything looks the same!
You can check the log here.

@gabritto gabritto merged commit 788239f into microsoft:main Aug 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
For Backlog Bug PRs that fix a backlog bug
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

IIFEs should not be CFA-inlined if the FE is a generator function
4 participants