New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
bundlerEnv: improve handling of groups #51884
Conversation
Suppose I have a Gemfile like this: source "https://rubygems.org" gem "actioncable" gem "websocket-driver", group: :test The gemset.nix generated by Bundix 2.4.1 will set ActionCable's groups to [ "default" ], and websocket-driver's to [ "test" ]. This means that the generated bundlerEnv wouldn't include websocket-driver unless the test group was included, even though it's required by the default group. This is arguably a bug in Bundix (websocket-driver's groups should probably be [ "default" "test" ] or just [ "default" ]), but there's no reason bundlerEnv should omit dependencies even given such an input -- it won't necessarily come from Bundix, and it would be good for bundlerEnv to do the right thing. To fix this, filterGemset is now a recursive function, that adds dependencies of gems in the group to the filtered gemset until it stabilises on the gems that match the required groups, and all of their recursive dependencies.
This wasn't really an issue until the latest minor release of Bundix (2.4), because prior to then Bundix didn't emit group attributes, and so this functionality of bundlerEnv wasn't really used. However, it is now apparent that a better default for bundlerEnv would be to include all gem groups by default, not just the default group. This matches the behavior of Bundler, and makes more sense, because the default group alone isn't necessarily useful for anything -- consider a Rails app with production, development, and test groups. It has the additional benefit of being backwards compatible with how this would have worked before the Bundix update.
"default" isn't really a group, it's more the absence of one. With Bundler, this means that a gem should be installed unconditionally, regardless of which groups are specified. It doesn't really make sense to allow these gems to be omitted from a bundlerEnv.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
really nice, thanks!
lgtm on a light review |
# nix-repl> converge (x: x / 2) 16 | ||
# 0 | ||
converge = f: x: | ||
if (f x) == x |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@alyssais
This could be optimized by introducing a let binding, i.e.
converge = f: x:
let f_of_x = f x;
in if f_of_x == x
then x
else converge f f_of_x;
That way f x
doesn't have to be evaluated twice.
Motivation for this change
The most recent version of Bundix introduces group attribute generation. This has revealed some deficiencies with how groups are handled by bundlerEnv. These would be addressed by making the following changes:
Suppose I have a Gemfile like this:
The gemset.nix generated by Bundix 2.4.1 will set ActionCable's groups to
[ "default" ]
, and websocket-driver's to[ "test" ]
. This means that the generatedbundlerEnv
wouldn't include websocket-driver unless the test group was included, even though it's required by the default group.This is arguably a bug in Bundix ("default" isn't included in groups on transitive dependencies listed explicitly in other groups nix-community/bundix#39) (websocket-driver's groups should probably be
[ "default" "test" ]
or just[ "default" ]
), but there's no reasonbundlerEnv
should omit dependencies even given such an input -- it won't necessarily come from Bundix, and it would be good forbundlerEnv
to do the right thing.To fix this,
filterGemset
is now a recursive function, that adds dependencies of gems in the group to the filtered gemset until it stabilises on the gems that match the required groups, and all of their recursive dependencies.All groups are now included by default. This wasn't really an issue until the latest minor release of Bundix (2.4), because prior to then Bundix didn't emit group attributes, and so this functionality of
bundlerEnv
wasn't really used. However, it is now apparent that a better default forbundlerEnv
would be to include all gem groups by default, not just the default group. This matches the behavior of Bundler, and makes more sense, because the default group alone isn't necessarily useful for anything -- consider a Rails app with production, development, and test groups. It has the additional benefit of being backwards compatible with how this would have worked before the Bundix update.Default gems are always included.
default
isn't really a group, it's more the absence of one. With Bundler, this means that a gem should be installed unconditionally, regardless of which groups are specified. It doesn't really make sense to allow these gems to be omitted from abundlerEnv
.Things done
sandbox
innix.conf
on non-NixOS)nix-shell -p nox --run "nox-review wip"
./result/bin/
)nix path-info -S
before and after)