Skip to content

[devops] Run macOS tests on macOS Golden Gate.#25733

Open
rolfbjarne wants to merge 10 commits into
xcode27.0from
devops-🌉

Hidden character warning

The head ref may contain hidden characters: "devops-\ud83c\udf09"
Open

[devops] Run macOS tests on macOS Golden Gate.#25733
rolfbjarne wants to merge 10 commits into
xcode27.0from
devops-🌉

Conversation

@rolfbjarne

Copy link
Copy Markdown
Member

No description provided.

Copilot AI review requested due to automatic review settings June 18, 2026 05:59

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the Azure DevOps macOS test matrix to add a new macOS Golden Gate (27) arm64 test stage, and updates the devops documentation to reflect the new stage lineup.

Changes:

  • Add a new mac_27_arm64 macOS test stage targeting macOS Golden Gate (27) in the tests-stage template.
  • Add a corresponding macOS Golden Gate (27) entry to the testConfigurations matrix in configure.yml.
  • Update tools/devops/README.md to document the updated macOS stage list (including mac_27_arm64).

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File Description
tools/devops/README.md Updates the documented macOS test stages to include mac_27_arm64.
tools/devops/automation/templates/tests-stage.yml Adds a new macOS Golden Gate (27) arm64 test stage configuration.
tools/devops/automation/templates/common/configure.yml Adds a new test configuration entry for macOS Golden Gate (27) to the test matrix.

Comment thread tools/devops/automation/templates/common/configure.yml Outdated
@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@dalexsoto dalexsoto left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🌉 ✅

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

rolfbjarne and others added 2 commits June 18, 2026 13:30
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

✅ [CI Build #562372f] Build passed (Build packages) ✅

Pipeline on Agent
Hash: 562372f51d2260a601b28d8d5fbb9a3207f65ce9 [PR build]

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

✅ [CI Build #562372f] Build passed (Detect API changes) ✅

Pipeline on Agent
Hash: 562372f51d2260a601b28d8d5fbb9a3207f65ce9 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

🔥 [CI Build #562372f] Build failed (Build macOS tests) 🔥

Build failed for the job 'Build macOS tests' (with job status 'Failed')

Pipeline on Agent
Hash: 562372f51d2260a601b28d8d5fbb9a3207f65ce9 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

✅ API diff for current PR / commit

NET (empty diffs)

✅ API diff vs stable

NET (empty diffs)

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: 562372f51d2260a601b28d8d5fbb9a3207f65ce9 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

🔥 [CI Build #562372f] Test results 🔥

Test results

❌ Tests failed on VSTS: test results

0 tests crashed, 22 tests failed, 191 tests passed.

Failures

❌ generator tests

1 tests failed, 4 tests passed.

Failed tests

  • Roslyn Generator tests: Failed (Execution failed with exit code 1)
    • Microsoft.Macios.Generator.Tests.Classes.ClassGenerationTests.Mi...: Assert.Equal() Failure
      ↓ (pos 6870)
      Expected: ···unt")]\n\t\tget\n\t\t{\n\t\t\tAppKit...

Html Report (VSDrops) Download

❌ monotouch tests (macOS)

1 tests failed, 23 tests passed.

Failed tests

  • monotouch-test/macOS/Release (NativeAOT, x64): Failed (Test run failed.
    Tests run: 3716 Passed: 3580 Inconclusive: 4 Failed: 1 Ignored: 135)

Html Report (VSDrops) Download

❌ monotouch tests (tvOS)

19 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/tvOS - simulator/Debug: LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (link sdk): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (link all): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (PrepareAssemblies): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (LinkSdk): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (static registrar): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (all optimizations): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (ARM64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (NativeAOT, ARM64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (trimmable static registrar, NativeAOT, ARM64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (managed static registrar): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (managed static registrar, all optimizations): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (interpreter): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (interpreter): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (compat inline Class.GetHandle): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (strict inline Class.GetHandle): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (compat inline dlfcn): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (strict inline dlfcn, link sdk): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (NativeAOT, .NET 11 defaults): LaunchTimedOut

Html Report (VSDrops) Download

❌ Tests on macOS Golden Gate (27) tests

1 tests failed, 4 tests passed.

Failed tests

  • introspection: Failed (exit code 2)
    • No test failure details available. stderr output:
      • 2026-06-19 01:04:45.392 introspection[11136:42977] [PASS] TypoTest
      • 2026-06-19 01:04:45.392 introspection[11136:42977] Introspection.ApiTypoTest : 99596.4088 ms
      • 2026-06-19 01:04:45.392 introspection[11136:42977] Introspection.iOSApiClassPtrTest
      • 2026-06-19 01:04:45.496 introspection[11136:42977] [PASS] VerifyClassPtr
      • 2026-06-19 01:04:45.518 introspection[11136:42977] [PASS] VerifyClassPtrCategories
      • 2026-06-19 01:04:45.518 introspection[11136:42977] Introspection.iOSApiClassPtrTest : 125.6585 ms
      • 2026-06-19 01:04:45.518 introspection[11136:42977] Introspection.iOSApiCtorInitTest
      • 2026-06-19 01:04:45.600 introspection[11136:42761] _computeLocationButtonTag kCGColorSpaceModelRGB 0 0.533333 1 1 UIExtendedSRGBColorSpace 1 1 1 1
      • make[1]: *** [exec-maccatalyst-dotnet-arm64-introspection] Error 133
      • make: *** [exec-introspection] Error 1

Html Report (VSDrops) Download

Successes

✅ assembly-processing: All 1 tests passed. Html Report (VSDrops) Download
✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 2 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 4 tests passed. Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download
✅ introspection: All 8 tests passed. Html Report (VSDrops) Download
✅ linker (iOS): All 15 tests passed. Html Report (VSDrops) Download
✅ linker (MacCatalyst): All 15 tests passed. Html Report (VSDrops) Download
✅ linker (macOS): All 21 tests passed. Html Report (VSDrops) Download
✅ linker (tvOS): All 15 tests passed. Html Report (VSDrops) Download
✅ monotouch (iOS): All 19 tests passed. Html Report (VSDrops) Download
✅ monotouch (MacCatalyst): All 24 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ sharpie: All 1 tests passed. Html Report (VSDrops) Download
✅ windows: All 3 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

macOS tests

✅ Tests on macOS Sonoma (14): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Sequoia (15): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Tahoe (26): All 5 tests passed. Html Report (VSDrops) Download

Linux Build Verification

Linux build succeeded

Pipeline on Agent
Hash: 562372f51d2260a601b28d8d5fbb9a3207f65ce9 [PR build]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants