Skip to content

Update Swift CI to Xcode 15.1 Beta 2 with macOS 13.6 #69485

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
shahmishal opened this issue Oct 28, 2023 · 11 comments
Closed

Update Swift CI to Xcode 15.1 Beta 2 with macOS 13.6 #69485

shahmishal opened this issue Oct 28, 2023 · 11 comments
Assignees
Labels
continuous integration macOS Platform: macOS task Xcode Flag: Involves Xcode

Comments

@shahmishal
Copy link
Member

Update the Xcode and macOS on Swift CI with Xcode 15.1 Beta 2 with macOS 13.6

Verify

  • main and release/5.10 branches build
    • source compat suite
    • Pull request
    • toolchain
@shahmishal shahmishal self-assigned this Oct 28, 2023
@shahmishal
Copy link
Member Author

Tracking changes for supporting new Xcode #69482

@shahmishal
Copy link
Member Author

New blocker: swiftlang/swift-llbuild#894

@shahmishal
Copy link
Member Author

shahmishal commented Oct 29, 2023

Results from source compat suite:

Following are already failing on main, and these should be fixed by swiftlang/swift-source-compat-suite#859:

  • AsyncNinja
  • Kingfisher
  • ReactiveCocoa
  • SwifterSwift

New failure:

  • FAIL: BricBrac, 5.3, 92447f, Swift Package

BricBrac failure:

Assertion failed: (index < getNumSILArguments()), function getSILArgumentConvention, file SILArgument.cpp, line 89.

Test failing report:

========================================
XFailures:
  XFAIL: https://github.com/apple/swift/issues/65197, ProcedureKit, 5.0, a7fa56, ProcedureKit, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, ProcedureKit, 4.2, 94193d, ProcedureKit, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, PromiseKit, 5.0, 8e5f5d, PromiseKit, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, PromiseKit, 4.0, c538a2, PromiseKit, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65204, R.swift, 5.0, f96758, Swift Package
  XFAIL: https://github.com/apple/swift/issues/65204, R.swift, 4.2, f96758, Swift Package
  XFAIL: https://github.com/apple/swift/issues/57554, RxReactiveObjC, 5.0, ec478b, Swift Package
  XFAIL: https://github.com/apple/swift/issues/57554, RxReactiveObjC, 4.2, ec478b, Swift Package
  XFAIL: https://github.com/apple/swift/issues/65202, swift-protobuf-plugin-example, 5.0, 85bec0, Swift Package
  XFAIL: https://github.com/apple/swift/issues/65197, mapper, 5.0, 877dc5, Mapper, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, mapper, 4.2, d501cb, Mapper, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/65197, mapper, 4.0, d501cb, Mapper, generic/platform=watchOS
  XFAIL: https://github.com/apple/swift/issues/57431, siesta, 5.0, cb9c1b, Swift Package
  XFAIL: https://github.com/apple/swift/issues/69096, swift-testing, 5.9, f9deef, Swift Package
========================================
Failures:
  FAIL: AsyncNinja, 5.0, 12887f, AsyncNinja, generic/platform=watchOS
  FAIL: AsyncNinja, 4.0, efc83b, AsyncNinja, generic/platform=watchOS
  FAIL: BricBrac, 5.3, 92447f, Swift Package
  FAIL: Kingfisher, 5.0, 44450a, Kingfisher, generic/platform=watchOS
  FAIL: ReactiveCocoa, 5.0, 78e2c7, ReactiveCocoa-watchOS, generic/platform=watchOS
  FAIL: SwifterSwift, 5.0, ccdc4e, SwifterSwift-watchOS, generic/platform=watchOS
  FAIL: SwifterSwift, 5.0, ccdc4e, SwifterSwift-tvOS, generic/platform=tvOS
  FAIL: SwifterSwift, 5.0, ccdc4e, SwifterSwift-macOS, generic/platform=macOS
  FAIL: SwifterSwift, 5.0, ccdc4e, SwifterSwift-iOS, generic/platform=iOS
  FAIL: SwifterSwift, 4.0, d3c3fd, SwifterSwift-watchOS, generic/platform=watchOS
========================================
Action Summary:
     Passed: 345
     Failed: 10
    XFailed: 14
    UPassed: 0
      Total: 369
========================================
Repository Summary:
      Total: 122
========================================
Result: FAIL
========================================

@shahmishal
Copy link
Member Author

New failure: #69511

/Users/ec2-user/jenkins/workspace/test-new-xcode-oss-swift-pr-test-macos/swift/stdlib/public/runtime/Errors.cpp:47:10: fatal error: 'cxxabi.h' file not found
   47 | #include <cxxabi.h>
      |          ^~~~~~~~~~
1 error generated.

@shahmishal
Copy link
Member Author

✅ Source Compat suite passed (main)

========================================
Action Summary:
     Passed: 345
     Failed: 0
    XFailed: 24
    UPassed: 0
      Total: 369
========================================
Repository Summary:
      Total: 122
========================================
Result: XFAIL
========================================

✅ Pull request (main)

Build Script Log: /Users/ec2-user/jenkins/workspace/test-new-xcode-oss-swift-pr-test-macos/build/.build_script_log
Build Percentage 	 Build Duration (sec) 	 Build Phase
================ 	 ==================== 	 ===========
33.0%             	 5426.72               	 macosx-x86_64-swift-test
21.1%             	 3466.78               	 macosx-x86_64-swift-build
6.2%              	 1012.07               	 macosx-x86_64-lldb-test
4.3%              	 702.69                	 Building swiftsyntax
4.2%              	 694.91                	 Running tests for swiftdriver
4.1%              	 674.29                	 Building swiftpm
3.3%              	 534.11                	 Running tests for swiftpm
3.0%              	 494.3                 	 Building llvm
2.9%              	 472.02                	 Building swiftformat
2.8%              	 467.21                	 Running tests for swiftdocc
2.3%              	 371.08                	 Installing swiftpm
1.9%              	 313.99                	 Building sourcekitlsp
1.6%              	 270.89                	 Installing swiftdocc
1.6%              	 262.95                	 Building swiftdocc
1.2%              	 200.05                	 Running tests for sourcekitlsp
1.2%              	 191.51                	 Building minimalstdlib
1.1%              	 172.96                	 Building swiftdriver
0.9%              	 143.77                	 Running tests for swiftsyntax
0.7%              	 116.84                	 Building earlyswiftdriver
0.6%              	 91.11                 	 Building skstresstester
0.5%              	 81.95                 	 macosx-x86_64-llbuild-build
0.5%              	 77.19                 	 macosx-x86_64-lldb-build
0.4%              	 58.46                 	 Building indexstoredb
0.2%              	 31.49                 	 Running tests for indexstoredb
0.2%              	 28.07                 	 Running tests for swiftformat
0.1%              	 18.33                 	 macosx-x86_64-libcxx-build
0.1%              	 17.24                 	 Building playgroundsupport
0.1%              	 14.72                 	 Running tests for skstresstester
0.1%              	 9.03                  	 Building cmark
0.0%              	 7.95                  	 macosx-x86_64-swift-install
0.0%              	 3.63                  	 Installing llvm
0.0%              	 2.4                   	 Installing swiftdriver
0.0%              	 0.22                  	 macosx-x86_64-llbuild-install
0.0%              	 0.18                  	 Cleaning swiftdriver
0.0%              	 0.13                  	 macosx-x86_64-libcxx-test
0.0%              	 0.13                  	 macosx-x86_64-libcxx-install
0.0%              	 0.12                  	 macosx-x86_64-llbuild-test
0.0%              	 0.11                  	 macosx-x86_64-lldb-install
0.0%              	 0.08                  	 merged-hosts-lipo-core
0.0%              	 0.08                  	 Cleaning swiftpm
0.0%              	 0.08                  	 macosx-x86_64-extractsymbols
0.0%              	 0.07                  	 macosx-x86_64-package
0.0%              	 0.07                  	 merged-hosts-lipo
0.0%              	 0.05                  	 Installing swiftdoccrender
0.0%              	 0.0                   	 Installing swiftsyntax
Total Duration: 16432.03 seconds (4h 33m 52s)

Next, need to verify toolchain (main too), pull request, source compat suite for release/5.10.

@AnthonyLatsis AnthonyLatsis added macOS Platform: macOS Xcode Flag: Involves Xcode labels Nov 3, 2023
@shahmishal
Copy link
Member Author

shahmishal commented Nov 6, 2023

We are also seeing the same llbuild test failure on release/5.10

Failed Tests (2):
  llbuild-unit :: ./CoreTests/SQLiteBuildDBTest/ErrorHandling
  llbuild-unit :: ./CoreTests/SQLiteBuildDBTest/LockedWhileBuilding

@shahmishal
Copy link
Member Author

New build started for release/5.10:

  • disabled llbuild testing
  • stopped installing libcxx

https://ci.swift.org/view/xInfrastructure/job/test-new-xcode-oss-swift-pr-test-macos/3901/console

@shahmishal
Copy link
Member Author

We are currently waiting on getting source compat suite working with newer Xcode.

@shahmishal
Copy link
Member Author

@shahmishal
Copy link
Member Author

Started new run for main branch because previous run failed due to compiler issue. https://ci.swift.org/view/xInfrastructure/job/test-new-xcode-oss-swift-pr-test-macos/3995/console

@shahmishal
Copy link
Member Author

Nodes updated to newer Xcode and macOS on ci.swift.org.

cyndyishida added a commit to cyndyishida/swift that referenced this issue Jan 8, 2024
Now that Xcode has been updated on builders(swiftlang#69485), these tests should pass.
cyndyishida added a commit that referenced this issue Jan 8, 2024
Now that Xcode has been updated on builders (#69485), these tests should pass.
Catfish-Man pushed a commit to Catfish-Man/swift that referenced this issue Jan 19, 2024
Now that Xcode has been updated on builders (swiftlang#69485), these tests should pass.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
continuous integration macOS Platform: macOS task Xcode Flag: Involves Xcode
Projects
None yet
Development

No branches or pull requests

2 participants