Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nixUnstable: pre20201205_a5d85d0 -> pre20210219_548437c #109309

Closed
wants to merge 2 commits into from

Conversation

jonringer
Copy link
Contributor

@jonringer jonringer commented Jan 13, 2021

Motivation for this change

update nixUnstable

had to pin gcc to gcc9 as additional work was merged since the last update which is not compatible. Pragmatically, we can bump to gcc10 when upstream has CI around gcc10

Using the version of nixUnstable which hydra is using. and just picked the patches that I really want to use.

Things done
  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Ensured that relevant documentation is up to date
  • Fits CONTRIBUTING.md.

@Ma27
Copy link
Member

Ma27 commented Jan 13, 2021

Last time I checked the current hydra-unstable in here didn't build with latest Nix master. Can you please check if bumping Hydra would resolve the issue?

Also, this should be backported IMHO.

@jonringer
Copy link
Contributor Author

updating hydra to latest, then picking what the flake.lock is locked to

@jonringer jonringer added the 9.needs: port to stable A PR needs a backport to the stable release. label Jan 14, 2021
@jonringer
Copy link
Contributor Author

https://github.com/NixOS/nixpkgs/pull/109309

1 package marked as broken and skipped:
nix-exec

1 package failed to build:
hercules-ci-agent

53 packages built:
bundix cabal2nix cachix common-updater-scripts crate2nix crystal2nix dep2nix disnix disnixos dydisnix fusionInventory go2nix hydra-unstable libnixxml lispPackages.quicklisp-to-nix lispPackages.quicklisp-to-nix-system-info nix nix-binary-cache nix-bundle nix-direnv nix-doc nix-du nix-index nix-pin nix-plugins nix-prefetch nix-prefetch-bzr nix-prefetch-cvs nix-prefetch-docker nix-prefetch-git nix-prefetch-hg nix-prefetch-scripts nix-prefetch-svn nix-review nix-serve nix-update nix-update-source nixFlakes nixos-generators nixos-shell nixui python37Packages.nix-kernel python37Packages.nixpkgs python37Packages.pythonix python38Packages.nix-kernel python38Packages.nixpkgs python38Packages.pythonix python39Packages.nix-kernel python39Packages.nixpkgs python39Packages.pythonix update-nix-fetchgit vgo2nix vulnix

@jonringer
Copy link
Contributor Author

@GrahamcOfBorg build hydra-unstable

@SuperSandro2000
Copy link
Member

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 109309 run on x86_64-darwin 1

3 packages marked as broken and skipped:
  • fusionInventory
  • nix-exec
  • nixui
51 packages failed to build and are new build failures:
  • bundix: log was empty
  • cabal2nix: log was empty
  • cachix: log was empty
  • crate2nix: log was empty
  • crystal2nix: log was empty
  • dep2nix: log was empty
  • disnix: log was empty
  • dydisnix: log was empty
  • go2nix: log was empty
  • haskellPackages.cachix: log was empty
  • haskellPackages.hercules-ci-agent: log was empty
  • haskellPackages.nix-paths: log was empty
  • haskellPackages.update-nix-fetchgit: log was empty
  • hercules-ci-agent: log was empty
  • libnixxml: log was empty
  • nix: log https://termbin.com/wn4l
  • (nixStable): log was empty
  • nix-bundle: log was empty
  • nix-direnv: log was empty
  • nix-doc: log was empty
  • nix-du: log was empty
  • nix-index: log was empty
  • nix-pin: log was empty
  • nix-plugins: log was empty
  • nix-prefetch-bzr: log was empty
  • nix-prefetch-cvs: log was empty
  • nix-prefetch-docker: log was empty
  • nix-prefetch-git: log was empty
  • nix-prefetch-hg: log was empty
  • nix-prefetch-scripts: log was empty
  • nix-prefetch-svn: log was empty
  • nix-serve: log was empty
  • nix-update: log was empty
  • nix-update-source: log was empty
  • nixFlakes: log https://termbin.com/h2iy
  • (nixUnstable): log was empty
  • nixos-generators: log was empty
  • nixos-shell: log was empty
  • nixpkgs-review: log was empty
  • python37Packages.nix-kernel: log was empty
  • python37Packages.nixpkgs: log was empty
  • python37Packages.pythonix: log was empty
  • python38Packages.nix-kernel: log was empty
  • python38Packages.nixpkgs: log was empty
  • python38Packages.pythonix: log was empty
  • python39Packages.nix-kernel: log was empty
  • python39Packages.nixpkgs: log was empty
  • python39Packages.pythonix: log was empty
  • update-nix-fetchgit: log was empty
  • vgo2nix: log was empty
  • vulnix: log was empty

@jonringer
Copy link
Contributor Author

gah, darwin :(

@SuperSandro2000
Copy link
Member

gah, darwin :(

It is already broken now and I think some tests are failing. We should fix it eventually.

@jonringer
Copy link
Contributor Author

Yea, but the current darwin build is passing https://hydra.nixos.org/build/135058690 so I don't want to break darwin users. Especially since this should be backported.

Wish darwin wasn't so expensive to get CI for. (Free for linux)

@jonringer
Copy link
Contributor Author

looks like NixOS/nix@86a2cee was merged which would allow me to revert gcc version pinning

@Ma27
Copy link
Member

Ma27 commented Jan 27, 2021

if we can't merge this because of darwin yet, we should at least apply the patch from NixOS/nix#4470.

@jonringer
Copy link
Contributor Author

reverted the gcc9 change, because it's no longer relevant, may also fix the darwin build

added the related flake inputs changes which I cared about and attempted to open this PR in the first place

@SuperSandro2000 do you mind doing a darwin review?

@jonringer
Copy link
Contributor Author

https://github.com/NixOS/nixpkgs/pull/109309

1 package marked as broken and skipped:
nix-exec

1 package failed to build:
hercules-ci-agent

51 packages built:
bundix cabal2nix cachix common-updater-scripts crate2nix crystal2nix dep2nix fusionInventory go2nix hydra-unstable libnixxml lispPackages.quicklisp-to-nix lispPackages.quicklisp-to-nix-system-info nix nix-binary-cache nix-bundle nix-direnv nix-doc nix-du nix-index nix-pin nix-plugins nix-prefetch nix-prefetch-bzr nix-prefetch-cvs nix-prefetch-docker nix-prefetch-git nix-prefetch-hg nix-prefetch-scripts nix-prefetch-svn nix-review nix-serve nix-update nix-update-source nixFlakes nixos-generators nixos-rebuild nixos-shell nixui python37Packages.nix-kernel python37Packages.nixpkgs python37Packages.pythonix python38Packages.nix-kernel python38Packages.nixpkgs python38Packages.pythonix python39Packages.nix-kernel python39Packages.nixpkgs python39Packages.pythonix update-nix-fetchgit vgo2nix vulnix

hercules-ci-agent is already broken on master

@SuperSandro2000
Copy link
Member

SuperSandro2000 commented Feb 3, 2021

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
If you have any questions or problems please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 109309 run on x86_64-darwin 1

4 packages failed to build and are new build failures:
  • nix-update: log was empty
  • nixFlakes: log https://termbin.com/ha8z
  • (nixUnstable): log was empty
  • nixpkgs-review: log was empty

Not sure if this is related to the sandbox or not.

Edit: it is not.

@SuperSandro2000

This comment has been minimized.

@SuperSandro2000
Copy link
Member

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
If you have any questions or problems please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 109309 run on x86_64-linux 1

1 package marked as broken and skipped:
  • nix-exec
2 packages blacklisted:
  • tests.nixos-functions.nixos-test
  • tests.nixos-functions.nixosTest-test
2 packages failed to build and are new build failures:
53 packages built:
  • bundix
  • cabal2nix
  • cachix
  • common-updater-scripts
  • crate2nix
  • crystal2nix
  • dep2nix
  • fusionInventory
  • go2nix
  • haskellPackages.cachix
  • haskellPackages.nix-paths
  • haskellPackages.update-nix-fetchgit
  • hydra-unstable
  • libnixxml
  • lispPackages.quicklisp-to-nix
  • lispPackages.quicklisp-to-nix-system-info
  • nix (nixStable)
  • nix-bundle
  • nix-direnv
  • nix-doc
  • nix-du
  • nix-index
  • nix-pin
  • nix-plugins
  • nix-prefetch
  • nix-prefetch-bzr
  • nix-prefetch-cvs
  • nix-prefetch-docker
  • nix-prefetch-git
  • nix-prefetch-hg
  • nix-prefetch-scripts
  • nix-prefetch-svn
  • nix-serve
  • nix-update
  • nix-update-source
  • nixFlakes (nixUnstable)
  • nixos-generators
  • nixos-rebuild
  • nixos-shell
  • nixpkgs-review
  • nixui
  • python37Packages.nix-kernel
  • python37Packages.nixpkgs
  • python37Packages.pythonix
  • python38Packages.nix-kernel
  • python38Packages.nixpkgs
  • python38Packages.pythonix
  • python39Packages.nix-kernel
  • python39Packages.nixpkgs
  • python39Packages.pythonix
  • update-nix-fetchgit
  • vgo2nix
  • vulnix

@jonringer
Copy link
Contributor Author

I think that failure has been a long time flakey issue

can you try to build it again?

@Ma27
Copy link
Member

Ma27 commented Feb 3, 2021

Can confirm. I regularly compile Nix on my own since I have a few patches on top and this is one of the tests that fail from time to time.

@SuperSandro2000
Copy link
Member

can you try to build it again?

I have build it at least two times with that issue.

@jonringer
Copy link
Contributor Author

can you try to build it again?

I have build it at least two times with that issue.

I had another coworker be able to build it fine. I might just merge and babysit, restarting it.

@jonringer
Copy link
Contributor Author

cc @edolstra @Ma27 do you mind if I pin the nix version for hydra, and the nixUnstable package can more closely follow the development branch?

@jonringer jonringer changed the title nixUnstable: pre20201205_a5d85d0 -> pre20210113_3da9a92 nixUnstable: pre20201205_a5d85d0 -> pre20210219_548437c Mar 8, 2021
@ofborg ofborg bot requested a review from Ma27 March 8, 2021 20:27
@Ma27
Copy link
Member

Ma27 commented Mar 8, 2021

Don't have the capacity to test (tonight at least in my tz), but LGTM 👍

Copy link
Member

@Ma27 Ma27 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jonringer LGTM, can be merged from my PoV 👍

@SuperSandro2000
Copy link
Member

@ofborg eval

@SuperSandro2000
Copy link
Member

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
If you have any questions or problems please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 109309 run on x86_64-linux 1

1 package marked as broken and skipped:
  • nix-exec
2 packages blacklisted:
  • tests.nixos-functions.nixos-test
  • tests.nixos-functions.nixosTest-test
3 packages failed to build and already failed to build on hydra master:
  • haskellPackages.hercules-ci-agent: log was empty
  • hercules-ci-agent: log was empty
  • libnixxml: log was empty
50 packages built:
  • bundix
  • cabal2nix
  • cachix
  • common-updater-scripts
  • crate2nix
  • crystal2nix
  • dep2nix
  • fusionInventory
  • go2nix
  • haskellPackages.cachix
  • haskellPackages.hercules-ci-cnix-store
  • haskellPackages.nix-paths
  • haskellPackages.update-nix-fetchgit
  • hydra-unstable
  • lispPackages.quicklisp-to-nix
  • lispPackages.quicklisp-to-nix-system-info
  • nix (nixStable)
  • nix-bundle
  • nix-direnv
  • nix-doc
  • nix-du
  • nix-index
  • nix-pin
  • nix-plugins
  • nix-prefetch
  • nix-prefetch-bzr
  • nix-prefetch-cvs
  • nix-prefetch-docker
  • nix-prefetch-git
  • nix-prefetch-hg
  • nix-prefetch-scripts
  • nix-prefetch-svn
  • nix-serve
  • nix-update
  • nix-update-source
  • nixFlakes (nixUnstable)
  • nixos-generators
  • nixos-rebuild
  • nixos-shell
  • nixpkgs-review
  • nixui
  • python38Packages.nix-kernel
  • python38Packages.nixpkgs
  • python38Packages.pythonix
  • python39Packages.nix-kernel
  • python39Packages.nixpkgs
  • python39Packages.pythonix
  • update-nix-fetchgit
  • vgo2nix
  • vulnix

@ofborg ofborg bot requested a review from Ma27 March 10, 2021 23:40
@SuperSandro2000
Copy link
Member

This is a semi-automatic executed nixpkgs-review with nixpkgs-review-checks extension. It is checked by a human on a best effort basis and does not build all packages (e.g. lumo, tensorflow or pytorch).
If you have any questions or problems please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 109309 run on x86_64-darwin 1

5 packages failed to build and already failed to build on hydra master:
  • nix-direnv: log was empty
  • (nixpkgs-review): log was empty
  • nix-update: log was empty
  • nixFlakes: plain log | pretty log
  • (nixUnstable): log was empty
1 package failed to build and are new build failure:
  • nix-review: log was empty

The following issues got detected with the above build packages.
Please fix at least the ones listed with your changed packages:

nix-direnv:

warning: unused-argument
Unused argument: nix.
Near pkgs/tools/misc/nix-direnv/default.nix:1:42:

  |
1 | { lib, stdenv, fetchFromGitHub, gnugrep, nix, nixFlakes }:
  |                                          ^
nixFlakes:

warning: EvalError
Cannot evaluate attribute ‘nixFlakes’ in ‘/nix/store/2pii6w5m7138dxg0vwjaxwnv8d8jrx1p-nixpkgs’.

@shlevy
Copy link
Member

shlevy commented Mar 11, 2021

nixUnstable is now past this.

@jonringer
Copy link
Contributor Author

closing due to other PR

@jonringer jonringer closed this Mar 11, 2021
@jonringer jonringer deleted the bump-nixunstable branch March 11, 2021 19:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants