Haven't tried it yet, but looking it over I think it looks great, and is exactly what I was hoping for/suggesting in #28247. Thank you for putting this together.

One thought: would it make sense to split compilation testing from executing the results? Not sure how that might work, my concern was regarding cross-compilers.

Short of a good answer to that, perhaps we can add an assert or something to indicate this is only intended for native compilers?

Anyway I'd rather see this merged without such consideration than stuck trying to accommodate them-- we really should have basic toolchain testing before marking things good for a channel update.

Yeah, to support cross builds this would need some more work and it's probably a bit more tricky to get that working properly on hydra since it requires multiple platforms to test.

I think what @dtzWill is saying is, for now, build the test exes but not run them for testing cross compilation. That strikes me as a fine plan.