Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pythonPackages.dask-*: init #46627

Merged
merged 8 commits into from Sep 18, 2018
Merged

pythonPackages.dask-*: init #46627

merged 8 commits into from Sep 18, 2018

Conversation

costrouc
Copy link
Member

Motivation for this change

Have been doing a lot of work with dask. Wanted to add most used dask modules.

Things done

pythonPackages.dask-xgboost: init at 0.1.5
pythonPackages.dask-image: init at 01.1
pythonPackages.slicerator: init at 0.9.8
pythonPackages.pims: init at 0.4.1
pythonPackages.dask-jobqueue: init at 0.4.0
pythonPackages.dask-glm: init at 0.1.0
pythonPackages.dask-ml: init at 0.10.0
pythonPackages.distributed: refactor fix broken build (did not register version properly)

  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Fits CONTRIBUTING.md.

@FRidh
Copy link
Member

FRidh commented Sep 18, 2018

@GrahamcOfBorg build pythonPackages.dask-xgboost pythonPackages.dask-image pythonPackages.slicerator pythonPackages.pims pythonPackages.dask-jobqueue pythonPackages.dask-glm pythonPackages.dask-ml
pythonPackages.distributed python3Packages.dask-xgboost python3Packages.dask-image python3Packages.slicerator python3Packages.pims python3Packages.dask-jobqueue python3Packages.dask-glm python3Packages.dask-ml
python3Packages.distributed

@GrahamcOfBorg
Copy link

Failure on x86_64-darwin (full log)

Attempted: pythonPackages.dask-xgboost, pythonPackages.dask-image, pythonPackages.slicerator, pythonPackages.pims, pythonPackages.dask-jobqueue, pythonPackages.dask-glm, pythonPackages.dask-ml

Partial log (click to expand)

Requirement already satisfied: pyparsing>=2.0.2 in /nix/store/56w12zli8nzyfzym98nrdcqxh55vsi5i-python2.7-pyparsing-2.2.0/lib/python2.7/site-packages (from packaging->dask-ml==0.10.0) (2.2.0)
Requirement already satisfied: cloudpickle>=0.2.2 in /nix/store/xyqy01gg5nvnnzr2fgcvxx46q5yc3jd1-python2.7-cloudpickle-0.5.5/lib/python2.7/site-packages (from dask-glm->dask-ml==0.10.0) (0.5.5)
Installing collected packages: dask-ml
Successfully installed dask-ml-0.10.0
/private/tmp/nix-build-python2.7-dask-ml-0.10.0.drv-0/dask-ml-0.10.0
post-installation fixup
strip is /nix/store/df6k4mgdjxciy0f637lryp7c9ln7n1m3-cctools-binutils-darwin/bin/strip
stripping (with command strip and flags -S) in /nix/store/1ffmsz0xscavamaz9a91fcclwf1q8c33-python2.7-dask-ml-0.10.0/lib
patching script interpreter paths in /nix/store/1ffmsz0xscavamaz9a91fcclwf1q8c33-python2.7-dask-ml-0.10.0
error: build of '/nix/store/qwkmb5gmr8x0zbnaggm9c52lbsq8315q-python2.7-dask-xgboost-0.1.5.drv' failed

@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: pythonPackages.dask-xgboost, pythonPackages.dask-image, pythonPackages.slicerator, pythonPackages.pims, pythonPackages.dask-jobqueue, pythonPackages.dask-glm, pythonPackages.dask-ml

Partial log (click to expand)


-- Docs: https://docs.pytest.org/en/latest/warnings.html
============== 990 passed, 8 skipped, 8 warnings in 39.38 seconds ==============
/nix/store/7srafyzmn40wyfqp59x9436ppcrad589-python2.7-dask-xgboost-0.1.5
/nix/store/qvcfz3pz8xg4n7d1pniw6sbjyi7l6zki-python2.7-dask-image-0.1.1
/nix/store/78klavl0jc82qrvfajkzkcd2yrj6yzvj-python2.7-slicerator-0.9.8
/nix/store/i1y5hypxdzjgwzwzx6nirlzk2r4vb2x4-python2.7-PIMS-0.4.1
/nix/store/ml7rp853488nfpx6vyygi0h1j7bm0snm-python2.7-dask-jobqueue-0.4.0
/nix/store/6ah7j833g9gqcgsb1amx31v7q1vxwkks-python2.7-dask-glm-0.1.0
/nix/store/bd9l6vkapl79fs3bfyhr3xnqrd5lzlw8-python2.7-dask-ml-0.10.0

@costrouc
Copy link
Member Author

costrouc commented Sep 18, 2018 •
edited

Darwin failure looks like it is due to libxgboost which should be included in xgboost. Here is the error message.

ERROR: Failure: OSError (dlopen(/nix/store/kcb0syrkqp9xs2zgwzfqsq05dd1vrn4r-xgboost-0.72/lib/libxgboost.so, 6): image not found)

I do not have a mac so I will have a hard time tracking down this issue

@FRidh FRidh merged commit 3126be4 into NixOS:master Sep 18, 2018
@GrahamcOfBorg
Copy link

Timed out, unknown build status on aarch64-linux (full log)

Attempted: pythonPackages.dask-image, pythonPackages.slicerator, pythonPackages.pims, pythonPackages.dask-jobqueue, pythonPackages.dask-glm, pythonPackages.dask-ml

The following builds were skipped because they don't evaluate on aarch64-linux: pythonPackages.dask-xgboost

Partial log (click to expand)

cannot build derivation '/nix/store/ygqffarb34clqzghzfilrzjniv6viw95-python2.7-partd-0.3.8.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/6vr0l3c25khg7s4wj5lwpm4n2jan7sxc-python2.7-dask-0.18.2.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/pvdb42aqn7dxibx950iyzz6hspy5q5yg-python2.7-dask-glm-0.1.0.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/3lmmy6wwlpz5m5bzsixfn4fw5f8rk6ap-python2.7-distributed-1.23.1.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/dwmjx0md9s4b3aa8c8yg72nnahj2jarl-python2.7-scikit-image-0.14.0.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/cx8k1qnysklh56m1k4as5s1gg703nl5f-python2.7-PIMS-0.4.1.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/5iznhlr6lwy6a1fvnl5kvpyk40qfd1fw-python2.7-dask-jobqueue-0.4.0.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/j0is7sgdhyhvkyw7ib9l8h6pm8z5wbv5-python2.7-dask-ml-0.10.0.drv': 3 dependencies couldn't be built
cannot build derivation '/nix/store/fncanxxympxrin4pbds3gwfmfh8br178-python2.7-dask-image-0.1.1.drv': 3 dependencies couldn't be built
error: build of '/nix/store/5iznhlr6lwy6a1fvnl5kvpyk40qfd1fw-python2.7-dask-jobqueue-0.4.0.drv', '/nix/store/cx8k1qnysklh56m1k4as5s1gg703nl5f-python2.7-PIMS-0.4.1.drv', '/nix/store/fncanxxympxrin4pbds3gwfmfh8br178-python2.7-dask-image-0.1.1.drv', '/nix/store/j0is7sgdhyhvkyw7ib9l8h6pm8z5wbv5-python2.7-dask-ml-0.10.0.drv', '/nix/store/pvdb42aqn7dxibx950iyzz6hspy5q5yg-python2.7-dask-glm-0.1.0.drv' failed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@FRidh FRidh Awaiting requested review from FRidh

Assignees
No one assigned
Labels
6.topic: python 8.has: package (new) 10.rebuild-darwin: 11-100 10.rebuild-linux: 11-100
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@costrouc @FRidh @GrahamcOfBorg