Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ceph: Bring back ceph-volume #78243

Merged
merged 1 commit into from Jan 22, 2020
Merged

Conversation

srhb
Copy link
Contributor

@srhb srhb commented Jan 22, 2020

Motivation for this change

In #73187 ceph-volume unfortunately got lost. I completely missed this in the backport as well, which means that OSDs using bluestore become inoperable. Therefore, this needs a backport asap.

Things done

Brought back the (admittedly hacky) pythonpath shenanigans that enable the build system to pick up the necessities and not silently skip installing ceph-volume and friends.

Deployed to a testing cluster and noted that ceph-volume correctly activates bluestore volumes. It seems the python wrapper is no longer necessary, the path is baked into the .py file.

  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Ensured that relevant documentation is up to date
  • Fits CONTRIBUTING.md.

Copy link
Contributor

@flokli flokli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for finding this!

Can we update the test to include a bluestore volume, or at least ensure ceph-volume exists?

@@ -136,6 +137,7 @@ in rec {
# for pybind/rgw to find internal dep
export LD_LIBRARY_PATH="$PWD/build/lib:$LD_LIBRARY_PATH"
# install target needs to be in PYTHONPATH for "*.pth support" check to succeed
export PYTHONPATH=${ceph-python-env}/lib/python${pyVersion}/site-packages:$lib/lib/python${pyVersion}/site-packages/:$out/lib/python${pyVersion}/site-packages/
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we add a line here

# set PYTHONPATH, so the build system doesn't silently skip installing `ceph-volume`

?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@srhb @flokli Why was this needed?

Isn't this what

pythonPath = [ ceph-python-env "${placeholder "out"}/${ceph-python-env.sitePackages}" ];

does? (I haven't found yet where exactly the usage of pythonPath in mkDerivation is implemented)

I found it confusing that we currently set both, so it would be nice to understand why pythonPath isn't enough.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure. @srhb ?

pkgs/tools/filesystems/ceph/default.nix Outdated Show resolved Hide resolved
pkgs/tools/filesystems/ceph/default.nix Outdated Show resolved Hide resolved
pkgs/tools/filesystems/ceph/default.nix Outdated Show resolved Hide resolved
@srhb srhb force-pushed the ceph-revert-lost-ceph-volume branch from 5279ff8 to 9be2935 Compare January 22, 2020 11:24
@srhb srhb force-pushed the ceph-revert-lost-ceph-volume branch from 9be2935 to 585ac58 Compare January 22, 2020 11:27
@flokli
Copy link
Contributor

flokli commented Jan 22, 2020

@GrahamcOfBorg test ceph-single-node ceph-multi-node

@flokli flokli merged commit 79bf9ef into NixOS:master Jan 22, 2020
@nh2 nh2 mentioned this pull request Nov 29, 2021
23 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants