New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ofborg: post a finished check if evaluation starts #527
Conversation
This wouldn't give a PR the "all clear" (green check) because |
Exactly it's posted right after the initial pending status. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should be fine, but I'd like to hear what @grahamc has to say (if anything).
Didn't Graham say he'd be AFK for a while this month? Hasn't been active on github or irc for a week. |
cc @LnL7 |
I've bumped the timeout from 30min to 45min as we're still getting builds going red. Update: I've just reset a bunch of PRs that timed out at 45mins. |
Just a quick note: I'm in favor of merging this, but I just tried to redeploy to get our 3rd evaluator back, which failed. Even if I did merge this, nothing would change until Graham has time to look into the deployment problem, so I'll just wait for him to be available again and 1) have him look at that; and 2) comment on this PR (if necessary). |
Lets disable the actions until this is resolved so we don't have pages of red PRs. |
What do we think about using actions to manually set a pending status without a timeout that is then cleared as part of this step? There would be two actions statuses, one for the pending job and another from the job that sets it. |
That would work too and is probably the better solution. |
I am not quite sure if it is possible so because the github token in github actions comes from the user that opens the pull request. |
Hopefully this would allow us to use a token in PRs? |
Yes. This sounds great. We could also use this for cachix. We could even implement this without using ofborg:
|
I will update this PR to mark the |
ping @grahamc |
@grahamc If we're going to start running more actions in PRs it would be nice to get this resolved. |
Why did you ping me? |
Sorry, meant to link to IRC. This PR would address your comment about |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It is a bit unfortunate that we need this bit of code at all. Thanks to GitHubs limited external CI API. That being said this looks simple enough and solves a real-world pain that several people have noticed and disliked (myself included).
Until we have a way to signal that we started doing our job this seems like the best solution.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If yall don't merge this 🤣
We need this for better integration into github.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Diff LGTM, thanks.
Ok(CommitStatus::new( | ||
api, | ||
commit, | ||
"ofborg-eval-started".to_owned(), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graham has expressed the desire to remove the grahamc
prefix from all the ofborg
checks (https://twitter.com/grhmc/status/1353171107550027776 as a recent example), so I decided to do that for this new one here.
Note that I haven't deployed this change yet. In order to streamline this: which PR, if any, needs to be merged after the deploy succeeds? |
|
Done. |
We need this for better integration into github.