Python package updates #34553

FRidh · 2018-02-03T11:44:55Z

Motivation for this change

Things done

Tested using sandboxing (nix.useSandbox on NixOS, or option build-use-sandbox in nix.conf on non-NixOS)
Built on platform(s)
- NixOS
- macOS
- other Linux distributions
Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
Tested execution of all binary files (usually in ./result/bin/)
Fits CONTRIBUTING.md.

https://hydra.nixos.org/jobset/nixpkgs/python-unstable

dotlambda · 2018-02-03T11:50:31Z

Please add dotlambda@130542e

dotlambda · 2018-02-03T12:31:50Z

I also updated typing: dotlambda/nixpkgs@fd753e1
I however had to disable tests for Python 3.6. I must say I can't really follow python/typing#280 but typing should have any effect for Python 3.5 or later anyway.
Is there a way to add typing to buildInputs only for Python 3.4 and below? For example by making it null otherwise? This could however lead to unsatisfied requirements.

dotlambda

Wouldn't it make sense to remove all names in the updated derivations?

FRidh · 2018-02-03T12:45:13Z

Is there a way to add typing to buildInputs only for Python 3.4 and below? For example by making it null otherwise? This could however lead to unsatisfied requirements.

buildInputs = [ ] ++ optionals pythonOlder "3.5" [ typing ];

Other solution we use mostly for backports:

typing = if pythonAtLeast "3.5" then null else buildPythonPackage rec { ... };

Wouldn't it make sense to remove all names in the updated derivations?

Feel free to create a commit that removes all of them. These updates are generated automatically.

dotlambda · 2018-02-03T12:56:24Z

I had already tried the second solution but that would cause packages requiring typing in their setup.py to fail to build. So I guess it is best left as is.

dotlambda · 2018-02-03T14:17:11Z

Don't you want to include the typing update?

grahamc · 2018-02-03T16:16:13Z

@GrahamcOfBorg eval

GrahamcOfBorg · 2018-02-03T16:32:48Z

Failure on x86_64-darwin (full log)

Partial log (click to expand)

Package ‘spyder-3.2.6’ in /private/var/lib/ofborg/checkout/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/lnl7-mac/pkgs/applications/science/spyder/default.nix:47 is not supported on ‘x86_64-darwin’, refusing to evaluate.

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

FRidh · 2018-02-03T16:35:33Z

(@grahamc vs @GrahamcOfBorg 😆 )

GrahamcOfBorg · 2018-02-03T16:36:51Z

Failure on x86_64-darwin (full log)

Partial log (click to expand)

Package ‘spyder-3.2.6’ in /private/var/lib/ofborg/checkout/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/lnl7-mac/pkgs/applications/science/spyder/default.nix:47 is not supported on ‘x86_64-darwin’, refusing to evaluate.

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

GrahamcOfBorg · 2018-02-03T16:42:47Z

Failure on x86_64-linux (full log)

Partial log (click to expand)

Requirement already satisfied: pylint in /nix/store/hg7z39d2ifi0i83njd4j4xswbsfdfkjf-python2.7-pylint-1.8.2/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: jedi>=0.9.0 in /nix/store/mzaj8hm6x9szwskh1z6gmm4vcl4bz3ik-python2.7-jedi-0.11.1/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: pycodestyle in /nix/store/47fniyjczd3nacnym72mya9i4w8kinkz-python2.7-pycodestyle-2.3.1/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: psutil in /nix/store/96ral8lnx118a1qccink2z2bhsmyg7ar-python2.7-psutil-5.4.3/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: nbconvert in /nix/store/18mqml1f4gb9ya5w2plxvkf56bds2hh1-python2.7-nbconvert-5.3.1/lib/python2.7/site-packages (from spyder==3.2.6)
Collecting pyopengl; platform_system == "Linux" (from spyder==3.2.6)
  Could not find a version that satisfies the requirement pyopengl; platform_system == "Linux" (from spyder==3.2.6) (from versions: )
No matching distribution found for pyopengl; platform_system == "Linux" (from spyder==3.2.6)
builder for ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed with exit code 1
error: build of ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed

GrahamcOfBorg · 2018-02-03T16:55:15Z

Failure on x86_64-darwin (full log)

Partial log (click to expand)

Package ‘spyder-3.2.6’ in /private/var/lib/ofborg/checkout/repo/38dca4e3aa6bca43ea96d2fcc04e8229/builder/lnl7-mac/pkgs/applications/science/spyder/default.nix:47 is not supported on ‘x86_64-darwin’, refusing to evaluate.

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

GrahamcOfBorg · 2018-02-03T17:25:30Z

Failure on x86_64-linux (full log)

Partial log (click to expand)

Requirement already satisfied: pylint in /nix/store/hg7z39d2ifi0i83njd4j4xswbsfdfkjf-python2.7-pylint-1.8.2/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: jedi>=0.9.0 in /nix/store/mzaj8hm6x9szwskh1z6gmm4vcl4bz3ik-python2.7-jedi-0.11.1/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: pycodestyle in /nix/store/47fniyjczd3nacnym72mya9i4w8kinkz-python2.7-pycodestyle-2.3.1/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: psutil in /nix/store/96ral8lnx118a1qccink2z2bhsmyg7ar-python2.7-psutil-5.4.3/lib/python2.7/site-packages (from spyder==3.2.6)
Requirement already satisfied: nbconvert in /nix/store/18mqml1f4gb9ya5w2plxvkf56bds2hh1-python2.7-nbconvert-5.3.1/lib/python2.7/site-packages (from spyder==3.2.6)
Collecting pyopengl; platform_system == "Linux" (from spyder==3.2.6)
  Could not find a version that satisfies the requirement pyopengl; platform_system == "Linux" (from spyder==3.2.6) (from versions: )
No matching distribution found for pyopengl; platform_system == "Linux" (from spyder==3.2.6)
builder for ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed with exit code 1
error: build of ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed

GrahamcOfBorg · 2018-02-03T17:26:20Z

Failure on x86_64-linux (full log)

Partial log (click to expand)

                         yyParenDepth--;
                         ^~~~~~~~~~~~
g++ -c -pipe -O2 -fno-exceptions -Wall -W -D_REENTRANT -fPIC -DSIP_PROTECTED_IS_PUBLIC -Dprotected=public -DPy_LIMITED_API=0x03040000 -DQT_NO_EXCEPTIONS -DQT_NO_DEBUG -DQT_PLUGIN -DQT_XML_LIB -DQT_CORE_LIB -I. -I. -isystem /nix/store/w81d7rbysi0rmf9c47njqbxjnllqv9cq-python-2.7.14/include/python2.7 -I../qpy/pylupdate -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtXml -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtCore -I. -I/nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/mkspecs/linux-g++ -o metatranslator.o ../qpy/pylupdate/metatranslator.cpp
g++ -c -pipe -O2 -fno-exceptions -Wall -W -D_REENTRANT -fPIC -DSIP_PROTECTED_IS_PUBLIC -Dprotected=public -DPy_LIMITED_API=0x03040000 -DQT_NO_EXCEPTIONS -DQT_NO_DEBUG -DQT_PLUGIN -DQT_XML_LIB -DQT_CORE_LIB -I. -I. -isystem /nix/store/w81d7rbysi0rmf9c47njqbxjnllqv9cq-python-2.7.14/include/python2.7 -I../qpy/pylupdate -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtXml -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtCore -I. -I/nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/mkspecs/linux-g++ -o numberh.o ../qpy/pylupdate/numberh.cpp
g++ -c -pipe -O2 -fno-exceptions -Wall -W -D_REENTRANT -fPIC -DSIP_PROTECTED_IS_PUBLIC -Dprotected=public -DPy_LIMITED_API=0x03040000 -DQT_NO_EXCEPTIONS -DQT_NO_DEBUG -DQT_PLUGIN -DQT_XML_LIB -DQT_CORE_LIB -I. -I. -isystem /nix/store/w81d7rbysi0rmf9c47njqbxjnllqv9cq-python-2.7.14/include/python2.7 -I../qpy/pylupdate -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtXml -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtCore -I. -I/nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/mkspecs/linux-g++ -o proparser.o ../qpy/pylupdate/proparser.cpp
g++ -c -pipe -O2 -fno-exceptions -Wall -W -D_REENTRANT -fPIC -DSIP_PROTECTED_IS_PUBLIC -Dprotected=public -DPy_LIMITED_API=0x03040000 -DQT_NO_EXCEPTIONS -DQT_NO_DEBUG -DQT_PLUGIN -DQT_XML_LIB -DQT_CORE_LIB -I. -I. -isystem /nix/store/w81d7rbysi0rmf9c47njqbxjnllqv9cq-python-2.7.14/include/python2.7 -I../qpy/pylupdate -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtXml -isystem /nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/include/QtCore -I. -I/nix/store/ibfm5z49nv2jvdcv4wk0p5d4pp8czk4f-qtbase-5.10.0-dev/mkspecs/linux-g++ -o sametexth.o ../qpy/pylupdate/sametexth.cpp
building of ‘/nix/store/nqg1b3h2dmvp7gr9zw1mf58il85flhrc-python2.7-PyQt-5.10.drv’ timed out after 1800 seconds
cannot build derivation ‘/nix/store/lr138a8lj9x8ajhxsvd0m3z3lghniac4-python2.7-qtconsole-4.3.1.drv’: 1 dependencies couldn't be built
cannot build derivation ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’: 1 dependencies couldn't be built
error: build of ‘/nix/store/xqwzwxz29ipxvf081sxd44qpxk4bfqgs-spyder-3.2.6.drv’ failed

GrahamcOfBorg · 2018-02-03T17:27:00Z

Failure on aarch64-linux (full log)

Partial log (click to expand)

[2967/21250] CXX obj/services/service_manager/public/cpp/cpp/service_runner.o
[2968/21250] ACTION //third_party/WebKit/Source/bindings/core/v8:generate_bindings_core_v8_interfaces(/build/qtwebengine-everywhere-src-5.10.0/src/toolchain:target)
[2969/21250] CXX obj/services/service_manager/public/cpp/cpp/service.o
[2970/21250] ACTION //third_party/WebKit/Source/bindings/core/v8:bindings_core_conditional_features(/build/qtwebengine-everywhere-src-5.10.0/src/toolchain:target)
[2971/21250] CXX obj/services/service_manager/public/cpp/standalone_service/standalone_service/linux_sandbox.o
building of '/nix/store/k1zx0cqlwfyqpap7igla25vvryfq6af3-qtwebengine-5.10.0.drv' timed out after 3200 seconds
cannot build derivation '/nix/store/c9a3yajs6qidn9xv32wf539bfx673nxf-python2.7-PyQt-5.10.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/71fzqc715hcfjilnlpw8fcpjdn5fkhkb-python2.7-qtconsole-4.3.1.drv': 5 dependencies couldn't be built
cannot build derivation '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv': 9 dependencies couldn't be built
error: build of '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv' failed

GrahamcOfBorg · 2018-02-03T18:27:05Z

Failure on aarch64-linux (full log)

Partial log (click to expand)

[4934/21250] CXX obj/third_party/icu/bundled_icui18n/regeximp.o
[4935/21250] CC obj/third_party/libvpx/bundled_libvpx/idct32x32_34_add_neon.o
[4936/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/rdft.o
[4937/21250] CXX obj/third_party/libwebm/libwebm/mkvmuxer.o
[4938/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/autorename_libavformat_options.o
building of '/nix/store/k1zx0cqlwfyqpap7igla25vvryfq6af3-qtwebengine-5.10.0.drv' timed out after 3600 seconds
cannot build derivation '/nix/store/c9a3yajs6qidn9xv32wf539bfx673nxf-python2.7-PyQt-5.10.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/71fzqc715hcfjilnlpw8fcpjdn5fkhkb-python2.7-qtconsole-4.3.1.drv': 5 dependencies couldn't be built
cannot build derivation '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv': 9 dependencies couldn't be built
error: build of '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv' failed

GrahamcOfBorg · 2018-02-03T19:27:15Z

Failure on aarch64-linux (full log)

Partial log (click to expand)

[4930/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/flacdec.o
[4931/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/id3v1.o
[4932/21250] CXX obj/third_party/icu/bundled_icuuc/uhash_us.o
[4933/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/options.o
[4934/21250] CC obj/third_party/ffmpeg/ffmpeg_internal/rmsipr.o
building of '/nix/store/k1zx0cqlwfyqpap7igla25vvryfq6af3-qtwebengine-5.10.0.drv' timed out after 3600 seconds
cannot build derivation '/nix/store/c9a3yajs6qidn9xv32wf539bfx673nxf-python2.7-PyQt-5.10.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/71fzqc715hcfjilnlpw8fcpjdn5fkhkb-python2.7-qtconsole-4.3.1.drv': 5 dependencies couldn't be built
cannot build derivation '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv': 9 dependencies couldn't be built
error: build of '/nix/store/41fcq1sk2g0ppsvq13jls3jm5i4sqjam-spyder-3.2.6.drv' failed

Note I still get ``` This application failed to start because it could not find or load the Qt platform plugin "xcb" in "". ``` but that may be because I run it from the store which is not support for Qt5 applications.

FRidh added the 6.topic: python label Feb 3, 2018

FRidh changed the base branch from master to staging February 3, 2018 11:45

FRidh mentioned this pull request Feb 3, 2018

pythonPackages.pyyaml: move derivation #34551

Closed

8 tasks

FRidh force-pushed the python-unstable branch from b3bd3fa to cf3fc6c Compare February 3, 2018 11:56

GrahamcOfBorg added 10.rebuild-darwin: 501+ 10.rebuild-linux: 501+ labels Feb 3, 2018

dotlambda reviewed Feb 3, 2018

View reviewed changes

grahamc removed the 6.topic: python label Feb 3, 2018

GrahamcOfBorg added the 6.topic: python label Feb 3, 2018

grahamc removed the 6.topic: python label Feb 3, 2018

GrahamcOfBorg added the 6.topic: python label Feb 3, 2018

FRidh added 9 commits February 3, 2018 17:43

python.pkgs.pyopenssl: move expression

ef93322

python: adal: 0.4.7 -> 0.5.0

16754b1

python: agate-excel: 0.2.1 -> 0.2.2

154db19

python: agate-sql: 0.5.2 -> 0.5.3

127ebeb

python: ansicolor: 0.2.4 -> 0.2.6

e21699a

python: asgiref: 2.1.0 -> 2.1.1

6e8273a

python: astroid: 1.6.0 -> 1.6.1

af3b738

python: autopep8: 1.3.3 -> 1.3.4

806fb76

python: botocore: 1.8.33 -> 1.8.36

bfc92f8

FRidh and others added 19 commits February 3, 2018 17:43

python.pkgs.pyqt5: 5.9.2 -> 5.10

e375e77

python.pkgs.cryptography_vectors: move expression

40aff3b

python.pkgs.cryptography: move expression

bba1393

python: cryptography: 2.0.3 -> 2.1.4

796a7d6

python.pkgs.cryptography_vectors: 2.0.3 -> 2.1.4

dbb5b59

pythonPackages.pyyaml: move derivation

7953e05

python: pytz: 2017.2 -> 2017.3

330cad0

python.pkgs.simplegeneric: move expression

b18a0f4

python.pkgs.sympy: move expression

8e0a2b7

python.pkgs.sympy: 1.0 -> 1.1.1

84fe409

python.pkgs.packet-python: move expression

29e8365

python.pkgs.packet-python: 1.33 -> 1.37.1

7afd65a

python.pkgs.webcolors: 1.4 -> 1.7

6fee907

python.pkgs.dicttoxml: 1.6.4 -> 1.7.4

f875b10

python.pkgs.ovh: 0.4.5 -> 0.4.8

0821a22

python.pkgs.pybrain: remove broken and unmaintained package

6a87242

python.pkgs.pygments_2_0: remove unused expression

7765bd9

python.pkgs.quantities: 0.10.1 -> 0.12.1

4bd9faf

python: typing: 3.5.3.0 -> 3.6.4

66dc266

FRidh force-pushed the python-unstable branch from f065779 to 66dc266 Compare February 3, 2018 16:43

FRidh added 2 commits February 4, 2018 10:16

python.pkgs.pyqt5: minor improvements

be964d0

python.pkgs.spyder: fix expression

aaa50d5

Note I still get ``` This application failed to start because it could not find or load the Qt platform plugin "xcb" in "". ``` but that may be because I run it from the store which is not support for Qt5 applications.

FRidh merged commit c1d7950 into staging Feb 4, 2018

FRidh deleted the python-unstable branch February 4, 2018 13:29

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Python package updates #34553

Python package updates #34553

FRidh commented Feb 3, 2018

dotlambda commented Feb 3, 2018

dotlambda commented Feb 3, 2018

dotlambda left a comment

FRidh commented Feb 3, 2018

dotlambda commented Feb 3, 2018

dotlambda commented Feb 3, 2018

grahamc commented Feb 3, 2018 •

edited

GrahamcOfBorg commented Feb 3, 2018

FRidh commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

Python package updates #34553

Python package updates #34553

Conversation

FRidh commented Feb 3, 2018

Motivation for this change

Things done

dotlambda commented Feb 3, 2018

dotlambda commented Feb 3, 2018

dotlambda left a comment

Choose a reason for hiding this comment

FRidh commented Feb 3, 2018

dotlambda commented Feb 3, 2018

dotlambda commented Feb 3, 2018

grahamc commented Feb 3, 2018 • edited

GrahamcOfBorg commented Feb 3, 2018

FRidh commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

GrahamcOfBorg commented Feb 3, 2018

grahamc commented Feb 3, 2018 •

edited