Also CC @lweichselbaum (sorry Lukas: GitHub didn't allow me to designate you as a reviewer)

The check named, "wpt-decision-task" failed on the latest commit, reporting:

subprocess.CalledProcessError: Command '[u'git', 'diff', '--name-only', '-z', u'0d794eb31a9920dd63065a1c4de2d14132b986f5..5e4ad738d4758f62d16410afae6485f839cf8f44']' returned non-zero exit status 128
[taskcluster 2020-08-28 18:39:39.241Z] === Task Finished ===
[taskcluster 2020-08-28 18:39:39.336Z] Unsuccessful task run with exit code: 1 completed in 45.22 seconds

It had a similar problem with the prior head of this branch, though it was successful when I initially opened this pull request. Both of the failed commands work locally, so this may be related to branch availability. This branch is located on a fork of WPT.

@Hexcles (hello!) are you familiar with the failing task?

I saw a similar failure on my PR just now but forgot to keep the link. Closing and reopening the PR seems to have fixed it.

Thanks; I'll give that a try

I'm glad to hear that, @arturjanc. The configuration file is where the complexity of the generation logic is most apparent, so I really tried to make it as clear as possible. There's still a lot to take in, but it's encouraging to hear that someone other than me can make some sense of it.

From what I understand, this is reviewed and ready to land. The stability checks failed I believe because this introduces too many tests and so the stability checks time out.

@jugglinmike is currently working on a different project. Worst case if these tests somehow catch fire, we can revert.

Any objection to merging?

Ha! I thought this landed months ago. Yes. Please merge it. :)

@jugglinmike I've rebased this branch to resolve conflicts, can you enable "Allow edits and access to secrets by maintainers" so I can push those? (@zcorpan asked me)

https://wpt.fyi/results/fetch/metadata?label=pr_head&max-count=1&pr=25247 show the results.

Everything looks OK except https://wpt.fyi/results/fetch/metadata/generated/appcache-manifest.https.sub.html?label=pr_head&max-count=1&pr=25247 where there's a harness error:

Test named "sec-fetch-site - Same origin" passed a function to async_test that returned a value. Consider using promise_test instead when using Promises or async/await.

This should be fixed by just not returning a promise, it's already chained correctly to pass or fail the async test.

Stability jobs are failing on /webaudio/the-audio-api/the-mediaelementaudiosourcenode-interface/no-cors.https.html because fetch/api/resources/redirect.py was updated, but the test does a regular GET request and I presume was already flaky. I'll admin merge to ignore this failure.

https://wpt.fyi/results/fetch/metadata/generated/appcache-manifest.https.sub.html?label=pr_head&max-count=1&pr=25247 looks better now, no longer a harness error.

Thank you @foolip !