Update Swift CI to Xcode 15.1 Beta 2 with macOS 13.6

[shahmishal]

Update the Xcode and macOS on Swift CI with Xcode 15.1 Beta 2 with macOS 13.6

Verify

• main and release/5.10 branches build
  • source compat suite
  • Pull request
  • toolchain

[shahmishal]

Tracking changes for supporting new Xcode #69482

[shahmishal]

New blocker: swiftlang/swift-llbuild#894

[shahmishal]

Results from source compat suite:

Following are already failing on main, and these should be fixed by swiftlang/swift-source-compat-suite#859:

• AsyncNinja
• Kingfisher
• ReactiveCocoa
• SwifterSwift

New failure:

• FAIL: BricBrac, 5.3, 92447f, Swift Package

BricBrac failure:

Assertion failed: (index < getNumSILArguments()), function getSILArgumentConvention, file SILArgument.cpp, line 89.

Test failing report:

========================================
XFailures:
  XFAIL: https://github.com/apple/swift/issues/65197, ProcedureKit, 5.0, a7fa56, ProcedureKit, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, ProcedureKit, 4.2, 94193d, ProcedureKit, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, PromiseKit, 5.0, 8e5f5d, PromiseKit, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, PromiseKit, 4.0, c538a2, PromiseKit, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65204, R.swift, 5.0, f96758, Swift Package
  XFAIL: https://github.com/apple/swift/issues/65204, R.swift, 4.2, f96758, Swift Package
  XFAIL: https://github.com/apple/swift/issues/57554, RxReactiveObjC, 5.0, ec478b, Swift Package
  XFAIL: https://github.com/apple/swift/issues/57554, RxReactiveObjC, 4.2, ec478b, Swift Package
  XFAIL: https://github.com/apple/swift/issues/65202, swift-protobuf-plugin-example, 5.0, 85bec0, Swift Package
  XFAIL: https://github.com/apple/swift/issues/65197, mapper, 5.0, 877dc5, Mapper, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, mapper, 4.2, d501cb, Mapper, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, mapper, 4.0, d501cb, Mapper, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/57431, siesta, 5.0, cb9c1b, Swift Package
  XFAIL: https://github.com/apple/swift/issues/69096, swift-testing, 5.9, f9deef, Swift Package
========================================
Failures:
  FAIL: AsyncNinja, 5.0, 12887f, AsyncNinja, generic/platform=watchOS
  FAIL: AsyncNinja, 4.0, efc83b, AsyncNinja, generic/platform=watchOS
  FAIL: BricBrac, 5.3, 92447f, Swift Package
  FAIL: Kingfisher, 5.0, 44450a, Kingfisher, generic/platform=watchOS
  FAIL: ReactiveCocoa, 5.0, 78e2c7, ReactiveCocoa-watchOS, generic/platform=watchOS
  FAIL: SwifterSwift, 5.0, ccdc4e, SwifterSwift-watchOS, generic/platform=watchOS
  FAIL: SwifterSwift, 5.0, ccdc4e, SwifterSwift-tvOS, generic/platform=tvOS
  FAIL: SwifterSwift, 5.0, ccdc4e, SwifterSwift-macOS, generic/platform=macOS
  FAIL: SwifterSwift, 5.0, ccdc4e, SwifterSwift-iOS, generic/platform=iOS
  FAIL: SwifterSwift, 4.0, d3c3fd, SwifterSwift-watchOS, generic/platform=watchOS
========================================
Action Summary:
     Passed: 345
     Failed: 10
    XFailed: 14
    UPassed: 0
      Total: 369
========================================
Repository Summary:
      Total: 122
========================================
Result: FAIL
========================================

[shahmishal]

New failure: #69511

/Users/ec2-user/jenkins/workspace/test-new-xcode-oss-swift-pr-test-macos/swift/stdlib/public/runtime/Errors.cpp:47:10: fatal error: 'cxxabi.h' file not found
   47 | #include <cxxabi.h>
      |          ^~~~~~~~~~
1 error generated.

[shahmishal]

✅ Source Compat suite passed (main)

========================================
Action Summary:
     Passed: 345
     Failed: 0
    XFailed: 24
    UPassed: 0
      Total: 369
========================================
Repository Summary:
      Total: 122
========================================
Result: XFAIL
========================================

✅ Pull request (main)

Build Script Log: /Users/ec2-user/jenkins/workspace/test-new-xcode-oss-swift-pr-test-macos/build/.build_script_log
Build Percentage 	 Build Duration (sec) 	 Build Phase
================ 	 ==================== 	 ===========
33.0%             	 5426.72               	 macosx-x86_64-swift-test
21.1%             	 3466.78               	 macosx-x86_64-swift-build
6.2%              	 1012.07               	 macosx-x86_64-lldb-test
4.3%              	 702.69                	 Building swiftsyntax
4.2%              	 694.91                	 Running tests for swiftdriver
4.1%              	 674.29                	 Building swiftpm
3.3%              	 534.11                	 Running tests for swiftpm
3.0%              	 494.3                 	 Building llvm
2.9%              	 472.02                	 Building swiftformat
2.8%              	 467.21                	 Running tests for swiftdocc
2.3%              	 371.08                	 Installing swiftpm
1.9%              	 313.99                	 Building sourcekitlsp
1.6%              	 270.89                	 Installing swiftdocc
1.6%              	 262.95                	 Building swiftdocc
1.2%              	 200.05                	 Running tests for sourcekitlsp
1.2%              	 191.51                	 Building minimalstdlib
1.1%              	 172.96                	 Building swiftdriver
0.9%              	 143.77                	 Running tests for swiftsyntax
0.7%              	 116.84                	 Building earlyswiftdriver
0.6%              	 91.11                 	 Building skstresstester
0.5%              	 81.95                 	 macosx-x86_64-llbuild-build
0.5%              	 77.19                 	 macosx-x86_64-lldb-build
0.4%              	 58.46                 	 Building indexstoredb
0.2%              	 31.49                 	 Running tests for indexstoredb
0.2%              	 28.07                 	 Running tests for swiftformat
0.1%              	 18.33                 	 macosx-x86_64-libcxx-build
0.1%              	 17.24                 	 Building playgroundsupport
0.1%              	 14.72                 	 Running tests for skstresstester
0.1%              	 9.03                  	 Building cmark
0.0%              	 7.95                  	 macosx-x86_64-swift-install
0.0%              	 3.63                  	 Installing llvm
0.0%              	 2.4                   	 Installing swiftdriver
0.0%              	 0.22                  	 macosx-x86_64-llbuild-install
0.0%              	 0.18                  	 Cleaning swiftdriver
0.0%              	 0.13                  	 macosx-x86_64-libcxx-test
0.0%              	 0.13                  	 macosx-x86_64-libcxx-install
0.0%              	 0.12                  	 macosx-x86_64-llbuild-test
0.0%              	 0.11                  	 macosx-x86_64-lldb-install
0.0%              	 0.08                  	 merged-hosts-lipo-core
0.0%              	 0.08                  	 Cleaning swiftpm
0.0%              	 0.08                  	 macosx-x86_64-extractsymbols
0.0%              	 0.07                  	 macosx-x86_64-package
0.0%              	 0.07                  	 merged-hosts-lipo
0.0%              	 0.05                  	 Installing swiftdoccrender
0.0%              	 0.0                   	 Installing swiftsyntax
Total Duration: 16432.03 seconds (4h 33m 52s)

Next, need to verify toolchain (main too), pull request, source compat suite for release/5.10.

[shahmishal]

We are also seeing the same llbuild test failure on release/5.10

Failed Tests (2):
  llbuild-unit :: ./CoreTests/SQLiteBuildDBTest/ErrorHandling
  llbuild-unit :: ./CoreTests/SQLiteBuildDBTest/LockedWhileBuilding

[shahmishal]

New build started for release/5.10:

• disabled llbuild testing
• stopped installing libcxx

https://ci.swift.org/view/xInfrastructure/job/test-new-xcode-oss-swift-pr-test-macos/3901/console