Enable NativeAOT library tests on Apple mobile platforms by kotlarmilos · Pull Request #125437 · dotnet/runtime

kotlarmilos · 2026-03-11T12:46:57Z

Description

Replace NativeAOT runtime test legs with library test legs on iOS/tvOS devices, iOS/tvOS simulators, and Mac Catalyst.

Replace NativeAOT runtime test legs with library test legs on iOS/tvOS devices, iOS/tvOS simulators, and Mac Catalyst. The runtime tests (nativeaot/SmokeTests) provide minimal value on mobile since the compiler doesn't meaningfully distinguish between iOS and macOS. Library tests exercise OS-specific APIs (crypto, networking, etc.) that are the real quality gate. Changes: - ioslike: remove NativeAOT runtime test leg, update existing library test leg to use dynamic smoke test arg - ioslikesimulator: replace NativeAOT runtime test leg with library test leg, fix isiOSLikeSimulatorOnlyBuild parameter - maccatalyst: replace both NativeAOT runtime test legs (regular + AppSandbox) with library test legs, fix coreclrContainsChange variable (was incorrectly using monoContainsChange) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot

Pull request overview

This PR updates the Apple “extra platforms” CI legs to validate NativeAOT on iOS/tvOS devices, iOS/tvOS simulators, and Mac Catalyst by running libraries tests (via Helix) instead of the minimal NativeAOT runtime SmokeTests, improving OS-specific coverage (crypto/networking/globalization) on mobile.

Changes:

Switch NativeAOT Apple-mobile legs from runtime SmokeTests submission to eng/pipelines/libraries/helix.yml submission of libraries tests.
Use eng/pipelines/libraries/helix-queues-setup.yml and pass NeedsToBuildAppsOnHelix=true for the new legs.
Update naming/args to use $(_runSmokeTestsOnlyArg) and fix path-evaluation variable naming in affected legs.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.

File	Description
eng/pipelines/extra-platforms/runtime-extra-platforms-maccatalyst.yml	Replaces NativeAOT runtime SmokeTests legs with libraries test legs (including App Sandbox variant) using libraries Helix templates/queues.
eng/pipelines/extra-platforms/runtime-extra-platforms-ioslikesimulator.yml	Replaces NativeAOT runtime SmokeTests on iOS/tvOS simulators with libraries tests using libraries Helix templates/queues.
eng/pipelines/extra-platforms/runtime-extra-platforms-ioslike.yml	Adjusts NativeAOT iOS/tvOS device leg to use `$(_runSmokeTestsOnlyArg)` for libraries tests and removes the old NativeAOT runtime SmokeTests device leg.

You can also share your feedback on Copilot code review. Take the survey.

…60312.1 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26162.1

…60312.3 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26162.3

…60314.3 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26164.3

…60317.2 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26167.2

…60318.1 On relative base path root Microsoft.DotNet.XHarness.CLI , Microsoft.DotNet.XHarness.TestRunners.Common , Microsoft.DotNet.XHarness.TestRunners.Xunit From Version 11.0.0-prerelease.26160.2 -> To Version 11.0.0-prerelease.26168.1

…bb6-53258cb4f260' into enable-nativeaot-libs-tests-mobile

Copilot

Pull request overview

Copilot reviewed 6 out of 6 changed files in this pull request and generated no new comments.

You can also share your feedback on Copilot code review. Take the survey.

Copilot

Pull request overview

Copilot reviewed 15 out of 15 changed files in this pull request and generated 1 comment.

Copilot

Pull request overview

Copilot reviewed 16 out of 16 changed files in this pull request and generated no new comments.

The build command passes EnableAggressiveTrimming=true which sets PublishTrimmed=true in tests.mobile.targets. This causes the SDK's ILLink to run during the test project's dotnet publish, but ILLink fails with IL1007 (Missing predefined System.NotSupportedException) during cross-compilation for ios-arm64. Fix: Set PublishTrimmed=false for all NativeAOT tests (including functional tests) in tests.ioslike.targets. Trimming is correctly handled by ILC's integrated ILLink via _CompileNativeAOTOnBuildMachine, which invokes the ProxyProject's RunNativeAOTCompilation target on the build machine. Only app bundling and signing happen on Helix (with SkipIlcCompile=true). Also remove the explicit ILLink targets import from AppleBuild.targets. ILC targets set PublishTrimmed=true which causes the SDK to import ILLink targets automatically. The explicit import caused MSB4011 (double-import error). Also add DynamicCodeSupport=false since NativeAOT does not support dynamic code generation. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

These tests should work on NativeAOT Apple mobile the same way they work on other NativeAOT platforms without platform-specific exclusions. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Copilot reviewed 11 out of 11 changed files in this pull request and generated 2 comments.

On Apple mobile, the test runner (AppleTestRunner.dll) is the IlcCompileInput while test assemblies are IlcReference. This causes ILC to trim module-level attributes, global fields/methods, and custom modifiers from test assemblies. Setting IlcTrimMetadata=false preserves all reflection metadata, fixing 16 test failures (ModifiedTypeTests, ModuleTests, GetCustomAttribute). Also restores ActiveIssue for DoubleTests.ParsePatterns (file path issue on iOS) and reformats MSBuild Properties for readability. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

MichalStrehovsky · 2026-04-16T21:24:29Z

+  <PropertyGroup Condition="'$(UseNativeAOTRuntime)' == 'true' and '$(IncludesTestRunner)' == 'true'">
+    <NoWarn>$(NoWarn);IL3000;IL3001;IL3002;IL3003;IL3050;IL3051;IL3052;IL3053</NoWarn>
+    <TrimMode>partial</TrimMode>
+    <IlcTrimMetadata>false</IlcTrimMetadata>


Why is this needed? (What this setting does is that it will consider everything that was compiled also available as a target of reflection. It will make some extra reflection in the program work. Mostly by luck.)

Is there any way we could set the TestNativeAot property to true when doing iDevice testing so the trimming/IlcPaths/everything is configured by the normal libs testing infrastructure? We might need to do some targeted exclusion for when TestNativeAot is trying to use the single file runner, but the rest should ideally come from the shared infra.

Yes, trying to achieve that. On Helix we should only do app bundling + signing. ILC and trimming should execute on the build machine.

…e build process

Copilot

Pull request overview

Copilot reviewed 13 out of 13 changed files in this pull request and generated 1 comment.

When TestNativeAot=true on Apple mobile, the test project publishes as a static library (NativeLib=Static) with OutputType != Exe, so ILLink does not auto-root the main assembly under TrimMode=partial. This caused IL1007 'Missing predefined System.NotSupportedException type' because nothing reached into corelib. Explicitly root the test assembly so its transitive closure (including System.Private.CoreLib) is resolved. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

The previous refactor excluded OutputType=Exe for Apple mobile with TestNativeAot=true to accommodate NativeLib=Static, but this left ILLink without an entry assembly to root under TrimMode=partial, causing IL1007 'Missing predefined System.NotSupportedException type' because System.Private.CoreLib was never included in the trim closure. ILC's NativeLib=Static produces a static library regardless of OutputType, so OutputType=Exe (matching desktop NativeAOT) is compatible: ILLink properly roots the entry assembly and resolves corelib, while ILC still emits the .a consumed by AppleBuild on Helix. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Copilot reviewed 13 out of 13 changed files in this pull request and generated 2 comments.

Copilot · 2026-04-17T12:42:13Z

+  <!-- For NativeAOT on Apple mobile use the shared library-test NativeAOT infrastructure
+       (tests.singlefile.targets). The test project's own publish runs trimming and ILC,
+       producing a static library that AppleAppBuilder consumes in library-mode.
+       The test project becomes OutputType=Exe with AppleTestRunner.cs supplying Main,
+       matching how desktop NativeAOT library tests are structured. -->
+  <PropertyGroup Condition="'$(UseNativeAOTRuntime)' == 'true'">
+    <TestNativeAot>true</TestNativeAot>
+    <NativeLib>Static</NativeLib>
+    <CustomNativeMain>true</CustomNativeMain>
+  </PropertyGroup>


The new comment describes Apple NativeAOT as producing a static library that AppleAppBuilder consumes in “library-mode”, but this target only sets NativeLib/CustomNativeMain and doesn’t enable AppleAppBuilder’s IsLibraryMode path. In AppleBuild.props, NativeAOT “library mode” is currently tied to NativeLib == Shared (not static). Please update the comment to reflect the actual flow, or adjust properties so the build really runs in library-mode if that’s required.

Copilot · 2026-04-17T12:42:13Z

    </PropertyGroup>

+    <!-- Explicitly set IntermediateAssembly so ManagedBinary resolves correctly for NativeAOT -->
+    <ItemGroup Condition="'$(UseNativeAOTRuntime)' == 'true' and '$(IncludesTestRunner)' == 'true'">


This IntermediateAssembly override is documented as necessary for NativeAOT so that ManagedBinary resolves correctly, but it’s currently gated on IncludesTestRunner == true. The Helix/mobile infrastructure also runs “run-only” apps with IncludesTestRunner=false, and those can still be NativeAOT; in that case ManagedBinary/%(ManagedBinary.IlcOutputFile) may end up empty and break linking/bundling. Consider applying this override for all UseNativeAOTRuntime==true cases (or at least when @(IntermediateAssembly) is otherwise empty), not only when the test runner is included.

Suggested change

<ItemGroup Condition="'$(UseNativeAOTRuntime)' == 'true' and '$(IncludesTestRunner)' == 'true'">

<ItemGroup Condition="'$(UseNativeAOTRuntime)' == 'true'">

Copilot AI review requested due to automatic review settings March 11, 2026 12:46

github-actions bot added the area-Infrastructure-mono label Mar 11, 2026

dotnet-policy-service bot assigned kotlarmilos Mar 11, 2026

Copilot started reviewing on behalf of kotlarmilos March 11, 2026 12:47 View session

kotlarmilos added area-Infrastructure-coreclr os-ios Apple iOS and removed area-Infrastructure-mono labels Mar 11, 2026

github-project-automation bot added this to Runtime Infra Mar 11, 2026

kotlarmilos requested review from MichalStrehovsky, jkoritzinsky, matouskozak and vitek-karas March 11, 2026 12:50

Copilot AI reviewed Mar 11, 2026

View reviewed changes

Comment thread eng/pipelines/extra-platforms/runtime-extra-platforms-ioslikesimulator.yml

matouskozak approved these changes Mar 11, 2026

View reviewed changes

build-analysis bot mentioned this pull request Mar 11, 2026

slow macOS - "##[error]The job running on agent Azure Pipelines 9 ran longer than the maximum time of 60 minutes." dotnet/dnceng#1883

Open

3 tasks

jkoritzinsky approved these changes Mar 11, 2026

View reviewed changes

dotnet-maestro bot and others added 5 commits March 12, 2026 10:30

Merge branch 'main' into enable-nativeaot-libs-tests-mobile

9e2a877

This was referenced Mar 17, 2026

XHarness package install failure on iOS due to devicectl NSPOSIXErrorDomain error 49 #123796

Open

MsQuic fails with QUIC_STATUS_OUT_OF_MEMORY on AzureLinux #123216

Open

kotlarmilos marked this pull request as draft March 18, 2026 12:57

Merge remote-tracking branch 'upstream/darc-main-98c14788-b6c2-47d8-8…

98a831a

…bb6-53258cb4f260' into enable-nativeaot-libs-tests-mobile

Copilot AI review requested due to automatic review settings March 18, 2026 13:02

Copilot started reviewing on behalf of kotlarmilos March 18, 2026 13:03 View session

Copilot AI reviewed Mar 18, 2026

View reviewed changes

Copilot started reviewing on behalf of kotlarmilos April 13, 2026 19:43 View session

Copilot AI reviewed Apr 13, 2026

View reviewed changes

Comment thread src/libraries/Common/tests/AppleTestRunner/AppleTestRunner.cs

build-analysis bot mentioned this pull request Apr 14, 2026

System.Net.NameResolution.Tests DNS failures: Name or service not known #126641

Open

Copilot AI review requested due to automatic review settings April 14, 2026 13:49

kotlarmilos force-pushed the enable-nativeaot-libs-tests-mobile branch from 93b6448 to aa765b8 Compare April 14, 2026 13:49

Copilot started reviewing on behalf of kotlarmilos April 14, 2026 13:50 View session

Copilot AI reviewed Apr 14, 2026

View reviewed changes

kotlarmilos force-pushed the enable-nativeaot-libs-tests-mobile branch from aa765b8 to 5947a8d Compare April 15, 2026 08:21

build-analysis bot mentioned this pull request Apr 15, 2026

Android WebSocket failure #121518

Open

Revert ActiveIssue annotations for NativeAOT Apple mobile tests

355b060

These tests should work on NativeAOT Apple mobile the same way they work on other NativeAOT platforms without platform-specific exclusions. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot AI review requested due to automatic review settings April 15, 2026 15:16

Copilot started reviewing on behalf of kotlarmilos April 15, 2026 15:17 View session

Copilot AI reviewed Apr 15, 2026

View reviewed changes

Comment thread eng/testing/tests.ioslike.targets

Comment thread eng/testing/tests.ioslike.targets Outdated

This was referenced Apr 16, 2026

Known Build Error: Blazor SimpleRunTests/BlazorBuildRunTest Playwright timeout on Counter click #126489

Open

[browser] Could not resolve type with token 01000001 from typeref #126997

Open

MichalStrehovsky reviewed Apr 16, 2026

View reviewed changes

Comment thread src/libraries/System.Runtime/tests/System.Runtime.Tests/System/DoubleTests.cs Outdated

MichalStrehovsky reviewed Apr 16, 2026

View reviewed changes

Refactor NativeAOT test configurations for Apple mobile and streamlin…

0401877

…e build process

Copilot AI review requested due to automatic review settings April 17, 2026 08:23

Copilot started reviewing on behalf of kotlarmilos April 17, 2026 08:23 View session

Copilot AI reviewed Apr 17, 2026

View reviewed changes

Comment thread eng/testing/tests.ioslike.targets

kotlarmilos and others added 2 commits April 17, 2026 11:59

Copilot AI review requested due to automatic review settings April 17, 2026 12:30

Copilot started reviewing on behalf of kotlarmilos April 17, 2026 12:31 View session

Copilot AI reviewed Apr 17, 2026

View reviewed changes

This was referenced Apr 17, 2026

Libraries .NET 4.8.1 build failing #127007

Open

System.DirectoryServices.Protocols.LdapException : The LDAP server is unavailable. #127070

Open

	<ItemGroup Condition="'$(UseNativeAOTRuntime)' == 'true' and '$(IncludesTestRunner)' == 'true'">
	<ItemGroup Condition="'$(UseNativeAOTRuntime)' == 'true'">

Conversation

kotlarmilos commented Mar 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

MichalStrehovsky Apr 16, 2026

Choose a reason for hiding this comment

Uh oh!

kotlarmilos Apr 17, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Copilot AI Apr 17, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 17, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

kotlarmilos commented Mar 11, 2026 •

edited

Loading