Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bintools-wrapper, cc-wrapper: infer propagateDoc automatically #46119

Closed
wants to merge 2 commits into from

Conversation

oxij
Copy link
Member

@oxij oxij commented Sep 5, 2018

See discussion in #43547. This is a piece of #46115.

@GrahamcOfBorg
Copy link

Timed out, unknown build status on x86_64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

cannot build derivation '/nix/store/9w2ahaqdl9y8a0dpnkn6zll3gm55v2a7-help2man-1.47.6.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/yh5c89g34rdc85050syn8wkfh2f70v05-binutils-wrapper-2.30.drv': 4 dependencies couldn't be built
cannot build derivation '/nix/store/qbg9v6hw9fkdd1r9h22n3ihdscklgrdx-diffutils-3.6.drv': 3 dependencies couldn't be built
cannot build derivation '/nix/store/kk27kz3cxqvyrly28zzqz2mdbvbfwcf3-findutils-4.6.0.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/52ygs768ymfavvbgsyl783nzn116l9pc-libtool-2.4.6.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/1wspdr4iiz5nj1bp7szn6qz8ir3dzdym-gcc-wrapper-7.3.0.drv': 5 dependencies couldn't be built
cannot build derivation '/nix/store/xs8f4lqq56hvpfcabwma5v1d5l90nrf8-hook.drv': 3 dependencies couldn't be built
cannot build derivation '/nix/store/h0h0c6ss11qpxdmqxdsalh5lbp1my4rb-patch-2.7.6.drv': 3 dependencies couldn't be built
cannot build derivation '/nix/store/filvacj4zdnnsjhw3d60qm324lhmmsdx-stdenv-linux.drv': 23 dependencies couldn't be built
error: build of '/nix/store/filvacj4zdnnsjhw3d60qm324lhmmsdx-stdenv-linux.drv' failed

@GrahamcOfBorg
Copy link

Success on aarch64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

shrinking /nix/store/zf2q4xp1rsn76yafnqk4gn6qabxv3rxi-findutils-4.6.0/bin/find
gzipping man pages under /nix/store/zf2q4xp1rsn76yafnqk4gn6qabxv3rxi-findutils-4.6.0/share/man/
strip is /nix/store/8zbl35kgg8v7gircl3pvy9027vslll1q-bootstrap-tools/bin/strip
stripping (with command strip and flags -S) in /nix/store/zf2q4xp1rsn76yafnqk4gn6qabxv3rxi-findutils-4.6.0/libexec  /nix/store/zf2q4xp1rsn76yafnqk4gn6qabxv3rxi-findutils-4.6.0/bin
checking for references to /build in /nix/store/zf2q4xp1rsn76yafnqk4gn6qabxv3rxi-findutils-4.6.0...
shrinking RPATHs of ELF executables and libraries in /nix/store/5yhf7lm88vy6d7sk4rj3hjj0vrakwmap-findutils-4.6.0-info
strip is /nix/store/8zbl35kgg8v7gircl3pvy9027vslll1q-bootstrap-tools/bin/strip
checking for references to /build in /nix/store/5yhf7lm88vy6d7sk4rj3hjj0vrakwmap-findutils-4.6.0-info...
building '/nix/store/w5d4c3lnmyd96lpqdcq86hja0v473imi-stdenv-linux.drv'...
/nix/store/ihbnr7hbi3lwl0f8ws44wgxwm7h6s38v-stdenv-linux

@oxij oxij reopened this Sep 5, 2018
@oxij oxij force-pushed the stdenv/bintools-cc-autopropagate branch from 09721c6 to 1bb1e7a Compare September 5, 2018 23:31
@oxij oxij changed the title bintools-wrapper, cc-wrapper, stdenv: infer propagateDoc automatically bintools-wrapper, cc-wrapper: infer propagateDoc automatically Sep 5, 2018
@GrahamcOfBorg GrahamcOfBorg removed the 6.topic: stdenv Standard environment label Sep 5, 2018
@oxij oxij force-pushed the stdenv/bintools-cc-autopropagate branch 2 times, most recently from d0270a3 to 5297be3 Compare September 6, 2018 00:03
@GrahamcOfBorg GrahamcOfBorg added the 6.topic: stdenv Standard environment label Sep 6, 2018
@oxij oxij force-pushed the stdenv/bintools-cc-autopropagate branch from 5297be3 to c8ba9df Compare September 6, 2018 00:08
@GrahamcOfBorg
Copy link

Success on aarch64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

/nix/store/pjq5v1xgljr4ygb1h1xfybdjydczcqiw-stdenv-linux

@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

copying path '/nix/store/5hir9w0mnrw86yv7sf4qghsard0ccwl1-glibc-2.27-bin' from 'https://cache.nixos.org'...
copying path '/nix/store/3jg1sj3va3rmm4fhw5xkybq9q3v8wnyi-pcre-8.42' from 'https://cache.nixos.org'...
copying path '/nix/store/26lgqf0ja6rx8dnz972a3f56vfxmmmv5-xz-5.2.4-bin' from 'https://cache.nixos.org'...
copying path '/nix/store/akak0rxhbi4n87z3nx78ipv76frvj841-glibc-2.27-dev' from 'https://cache.nixos.org'...
copying path '/nix/store/9f89z51na7w931aja8lqlmhqny9h16cj-gnugrep-3.1' from 'https://cache.nixos.org'...
copying path '/nix/store/6yz7851vibc1xjxpiyfzqqi2ksbv6qah-binutils-wrapper-2.30' from 'https://cache.nixos.org'...
copying path '/nix/store/vv4r320p5yd1k01kld62q1lppjxcswhb-gcc-7.3.0' from 'https://cache.nixos.org'...
copying path '/nix/store/iw94llkj05wgaz268mlzvgx8jkbi1ss0-gcc-wrapper-7.3.0' from 'https://cache.nixos.org'...
copying path '/nix/store/i6vl5lwlz5jbkg4r6p340dwmj6fha3xq-stdenv-linux' from 'https://cache.nixos.org'...
/nix/store/i6vl5lwlz5jbkg4r6p340dwmj6fha3xq-stdenv-linux

@GrahamcOfBorg
Copy link

Success on aarch64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

/nix/store/pjq5v1xgljr4ygb1h1xfybdjydczcqiw-stdenv-linux

@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

/nix/store/i6vl5lwlz5jbkg4r6p340dwmj6fha3xq-stdenv-linux

@oxij oxij force-pushed the stdenv/bintools-cc-autopropagate branch from c33cf36 to afe6c1c Compare September 6, 2018 00:41
@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

/nix/store/i6vl5lwlz5jbkg4r6p340dwmj6fha3xq-stdenv-linux

@GrahamcOfBorg
Copy link

Success on aarch64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

/nix/store/pjq5v1xgljr4ygb1h1xfybdjydczcqiw-stdenv-linux

@oxij
Copy link
Member Author

oxij commented Sep 6, 2018

Yay, a noop! But look at the pinned values of propagateDoc.

pkgs/top-level/all-packages.nix Show resolved Hide resolved
@Ericson2314 Ericson2314 force-pushed the stdenv/bintools-cc-autopropagate branch from afe6c1c to 6805be7 Compare September 6, 2018 12:19
@oxij
Copy link
Member Author

oxij commented Sep 6, 2018 via email

@Ericson2314
Copy link
Member

Oh. Well I won't on principle merge a PR that the author doesn't want merged, but I still think it would be good to use this. Then you can make the other remove all the hacks, old and new, which most clearly indicates the benefit symlinks.

@GrahamcOfBorg
Copy link

Success on aarch64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

/nix/store/pjq5v1xgljr4ygb1h1xfybdjydczcqiw-stdenv-linux

@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: stdenv

Partial log (click to expand)

/nix/store/i6vl5lwlz5jbkg4r6p340dwmj6fha3xq-stdenv-linux

@oxij
Copy link
Member Author

oxij commented Sep 6, 2018

Symlinks are a separate issue. My problem here is that, as it turns out, propagateDoc values in the wrappers are inconsistent with the underlying thing they wrap (an issue I didn't even know I fixed in #44558), which is likely to just produce more instances of #43547, if not now, then eventually. The first patch of #46115 is the correct solution to this whole thing. You can apply that patch separately, which would still give no symlinks, but it's still a mass rebuild. However, it makes absolutely no sense to me not to use symlinks there, hence, I would simply merge #46115 and backport that to staging-18.09 or whatever.

This whole issue has long run out of its allocated time, so I'm not going to change anything related unless the motivation for that is internal for a while now. Closing this, feel free to do whatever, but I think #46115 is the correct thing to do, I'm merging that to SLNOS.

@oxij oxij closed this Sep 6, 2018
oxij added a commit to oxij/nixpkgs that referenced this pull request Sep 23, 2018
02c09e0 (NixOS#44558) was reverted in
c981787 but, as it turns out, it fixed an issue
I didn't know about at the time: the values of `propagateDoc` options were
(and now again are) inconsistent with the underlying things those wrappers wrap
(see NixOS#46119), which was (and now is) likely to produce more instances
of NixOS#43547, if not now, then eventually as stdenv changes.

This patch (which is a simplified version of the original reverted patch) is the
simplest solution to this whole thing: it forces wrappers to directly inspect the
outputs of the things they are wrapping instead of making stdenv guess the correct
values.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants