Enable test builds with --bootstrap by am11 · Pull Request #127909 · dotnet/runtime

am11 · 2026-05-07T12:10:13Z

Enable UseBootstrap in libraries.tests
Enable --use-bootstrap in runtime testss (src/tests/build.sh --use-bootstrap --cross --riscv64 ...)
Use local target pack infra from eng/ in src/tests (once discussed with @hoyosjs Enable building tests with UseLocalAppHostPack=true #99354 (review))

am11 · 2026-05-07T12:36:46Z

For community platforms, this is the cross-build workflow for runtime development/testing:

os=linux
arch=riscv64

# ROOTFS_DIR is set

# cross-build product, --bootstrap
./build.sh clr+libs --cross --arch $arch --os $os --bootstrap

# for rebuild (e.g. after editing code), --use-bootstrap
./build.sh clr+libs --cross --arch $arch --os $os --use-bootstrap

# runtime tests cross-build, --use-bootstrap
src/tests/build.sh -cross -$arch -$os -p:LibrariesConfiguration=Debug --use-bootstrap

# libraries tests cross-build, --use-bootstrap
./build.sh libs.tests --cross --arch $arch --os $os --use-bootstrap

cc:
riscv64: @clamp03, @dotnet/samsung
loongarch64: @LuckyXu-HF, @shushanhf
illumos: @gwr
FreeBSD: @Thefrank, @sec
Haiku: @trungnt2910
OpenBSD: @sethjackson

jkotas · 2026-05-07T13:38:38Z

Update PR title to match the content?

am11 · 2026-05-07T13:46:15Z

Update PR title to match the content?

Ah, it somehow used cached title from my previous PR.

Thefrank · 2026-05-08T07:20:02Z

So if I am reading this correctly, after this PR, I can:

Use Enable test builds with --bootstrap #127909 (comment) to make nightly runtime tests for freebsd-ARCH
Copy over zipped tests to freebsd system (assuming /p:ArchiveTests still exists if not done automatically)
Run
...and finally enjoy easy nightly builds

This is pretty awesome. I gave up trying to do nightly runtime builds / tests more than a year ago because it was such a hassle natively.

am11 · 2026-05-08T20:04:50Z

Use Enable test builds with --bootstrap #127909 (comment) to make nightly runtime tests for freebsd-ARCH

Copy over zipped tests to freebsd system (assuming /p:ArchiveTests still exists if not done automatically)

Run

...and finally enjoy easy nightly builds

Yes, it exists, e.g. in the build container:

$ docker run --rm -v$(pwd):/runtime -w /runtime -e ROOTFS_DIR=/crossrootfs/<xxx> -it <container-urn>
$ os=<yyy>; arch=<xxx>;
$ ./build.sh clr+libs --cross --arch $arch --os $os --bootstrap
$ ./build.sh libs.tests --cross --arch $arch --os $os --use-bootstrap -p:ArchiveTests=true

from host:

# pack and upload testhost to the machine
$ tar -czf testhost_net11.0-<yyy>-Debug-<xxx>.tar.gz artifacts/bin/testhost/net11.0-<yyy>-Debug-<xxx>
$ scp testhost_net11.0-<yyy>-Debug-<xxx>.tar.gz $TargetMachine:/tmp

# copy tests to the machine
$ scp artifacts/helix/tests/linux.AnyCPU.Debug/System.Text.RegularExpressions.Unit.Tests.zip $TargetMachine:/tmp

# usage
$ ssh $TargetMachine

$ mkdir testhost
$ tar -xzf /tmp/testhost_net11.0-<yyy>-Debug-<xxx>.tar.gz -C testhost
$ mkdir regex-tests
$ cd $_
$ unzip System.Text.RegularExpressions.Unit.Tests.zip

$ ./RunTests.sh --runtime-path ~/testhost/artifacts/bin/testhost/net11.0-<yyy>-Debug-<xxx>

For runtime tests, after the build, just pack and upload artifacts/tests/coreclr/<yyy>.<xxx>.Debug to remove machine and after extraction, and then e.g. to run interpreter tests: CORE_ROOT=$(pwd)/artifacts/tests/coreclr/<yyy>.<xxx>.Debug/Tests/Core_Root DOTNET_TieredCompilation=0 artifacts/tests/coreclr/<yyy>.<xxx>.Debug/JIT/Interpreter/InterpreterTester/InterpreterTester.sh

The only thing which doesn't work in general (unrelated to bootstrap) is building / packing individual library tests. e.g. the zip file generated by ./dotnet.sh build -p:UseBootstrap=true -p:ArchiveTests=true -p:TargetOS=$os -p:TargetArchitecture=$arch -p:CrossBuild=true src/libraries/System.Formats.Nrbf/tests misses xunit.console.runtimeconfig.json etc. so it's unusble. Perhaps we need to pass more properties? I just built the. whole libs.tests subset which is exercised in the CI.

First time we ran the tests (with #127909) and found issues with interpreter tests. 1. clang-21 defaults to rvv baseline, previously clang-18 was defaulting to rv64gc; so we need to pin to our baseline for runtime binaries. This program helped figuring out SIGILL: ```sh $ cat riscv_default_probe.c #if defined(__riscv_v) #error At RVV (__riscv_v) #elif defined(__riscv_b) #error At Bitmanip (__riscv_b) #elif defined(__riscv_zfa) #error At Zfa #elif defined(__riscv_zfh) #error At Zfh #elif defined(__riscv_d) #error At D #elif defined(__riscv_f) #error At F #elif defined(__riscv_c) #error At C #elif defined(__riscv_m) #error At M #elif defined(__riscv_a) #error At A #elif defined(__riscv_i) #error At I #else #error At unknown baseline #endif $ clang-21 --target=riscv64-unknown-linux-gnu -c riscv_default_probe.c riscv_default_probe.c:2:2: error: At RVV (__riscv_v) 2 | #error At RVV (__riscv_v) | ^ # vs. $ clang-18 --target=riscv64-unknown-linux-gnu -c riscv_default_probe.c riscv_default_probe.c:10:2: error: At D 10 | #error At D | ^ ``` 2. Remove negative sign from prolog offset; it was growing in opposite direction. 3. Remove an invalid assert in the RISC-V/LoongArch return classification path. After fixing offset issue, tests progressed to `TestCallingConvention2Rev` and then tripped a debug-only check that is AMD64-specific and not applicable on these targets. Return classification here is already handled by FP-struct info plus size-based integer mapping, so removing the assert preserves intended behavior and unblocks the interpreter calling-convention tests. Fixes #127860

dotnet-policy-service · 2026-05-24T18:28:34Z

Tagging subscribers to this area: @dotnet/runtime-infrastructure
See info in area-owners.md if you want to be subscribed.

am11 · 2026-05-29T12:41:37Z

@akoeplinger, @janvorli, it looks like Jeremy is not available, could you please sign off and merge this PR? I am carrying this patch across multiple branches. It fixes testing on community platforms which regressed since the --bootstrap work. Thanks!

janvorli

LGTM, I just have few minor questions. Thank you!

Enable test builds with --bootstrap

2027b1c

github-actions Bot added the area-Infrastructure-coreclr Only use for closed issues label May 7, 2026

github-project-automation Bot added this to Runtime Infra May 7, 2026

dotnet-policy-service Bot added the community-contribution Indicates that the PR has been added by a community member label May 7, 2026

am11 requested a review from jkoritzinsky May 7, 2026 12:38

am11 changed the title ~~Inline remaining usages of OpenProcess on Unix~~ Enable test builds with --bootstrap May 7, 2026

am11 added 2 commits May 7, 2026 17:02

Trim trailing slash for windows

6802573

Merge branch 'main' into feature/tests-build-with-bootstrap

35e835c

am11 mentioned this pull request May 7, 2026

Apply fixes for coreclr-interp on linux-riscv64 #127919

Merged

am11 added 5 commits May 7, 2026 18:59

Add missing condition

93488b2

Fix win

ca29f16

Merge branch 'main' into feature/tests-build-with-bootstrap

93662f5

Add another condition

8369bdc

Merge branch 'main' into feature/tests-build-with-bootstrap

1d07ced

This was referenced May 7, 2026

slow macOS - "##[error]The job running on agent Azure Pipelines 9 ran longer than the maximum time of 60 minutes." dotnet/dnceng#1883

Open

The Operation will be canceled. The next steps may not contain expected logs. dotnet/dnceng#3008

Open

am11 added 2 commits May 8, 2026 02:05

Fix wasm

cb12c34

Merge dotnet/main into feature/tests-build-with-bootstrap

f6b70d2

am11 force-pushed the feature/tests-build-with-bootstrap branch from f6b1128 to f6b70d2 Compare May 7, 2026 23:06

.

5749142

am11 added 2 commits May 8, 2026 23:51

Update docs

8b2760b

Merge dotnet/main into feature/tests-build-with-bootstrap

830dc90

jkotas added area-Infrastructure and removed area-Infrastructure-coreclr Only use for closed issues labels May 24, 2026

janvorli approved these changes May 29, 2026

View reviewed changes

Comment thread src/libraries/tests.proj

Comment thread src/tests/build.proj

akoeplinger approved these changes May 29, 2026

View reviewed changes

akoeplinger merged commit 185fbc3 into dotnet:main May 29, 2026
190 checks passed

github-project-automation Bot moved this to Done in Runtime Infra May 29, 2026

am11 deleted the feature/tests-build-with-bootstrap branch May 29, 2026 18:31

dotnet-maestro Bot mentioned this pull request May 30, 2026

[main] Source code updates from dotnet/runtime dotnet/dotnet#6925

Merged

dotnet-milestone-bot Bot added this to the 11.0-preview6 milestone May 30, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Enable test builds with --bootstrap#127909

Enable test builds with --bootstrap#127909
akoeplinger merged 13 commits into
dotnet:mainfrom
am11:feature/tests-build-with-bootstrap

am11 commented May 7, 2026

Uh oh!

am11 commented May 7, 2026

Uh oh!

jkotas commented May 7, 2026

Uh oh!

am11 commented May 7, 2026

Uh oh!

Thefrank commented May 8, 2026

Uh oh!

am11 commented May 8, 2026 •

edited

Loading

Uh oh!

dotnet-policy-service Bot commented May 24, 2026

Uh oh!

am11 commented May 29, 2026

Uh oh!

janvorli left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Conversation

am11 commented May 7, 2026

Uh oh!

am11 commented May 7, 2026

Uh oh!

jkotas commented May 7, 2026

Uh oh!

am11 commented May 7, 2026

Uh oh!

Thefrank commented May 8, 2026

Uh oh!

am11 commented May 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

dotnet-policy-service Bot commented May 24, 2026

Uh oh!

am11 commented May 29, 2026

Uh oh!

janvorli left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

am11 commented May 8, 2026 •

edited

Loading