Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pythonPackages.*: Disable various checkPhases with zero tests run, libgda: Fix building with newest mysql, vtk_{7,8}: Fix compiling #108799

Merged
merged 14 commits into from Jan 10, 2021

Conversation

SuperSandro2000
Copy link
Member

Motivation for this change
Things done
  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Ensured that relevant documentation is up to date
  • Fits CONTRIBUTING.md.

Copy link
Member

@cole-h cole-h left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Even if there are no tests at this point in time, I don't think the checkPhase should be disabled. If upstream ever adds tests, we now have to remove the doCheck = false; line, rather than just bumping the version (and maybe disabling certain tests that don't work).

It takes an extra bit of time to figure out it has no tests and just move on to the next phase. Maybe it's just me, but I don't think the disabling of the checkPhase is necessary or desired.

@SuperSandro2000
Copy link
Member Author

Even if there are no tests at this point in time, I don't think the checkPhase should be disabled. If upstream ever adds tests, we now have to remove the doCheck = false; line, rather than just bumping the version (and maybe disabling certain tests that don't work).

It is a maintainers duty to keep up with this. Also most of the time we would need to add pytestCheckHook anyway because python setup.py test is going away and planned to be disabled by default in the future because many pythonApplications who do not have any tests also execute it.

Also a maintainers duty is it to check if all dependencies are still required and the package works correctly. Also python is the only place where we execute those tests by default which most of the time do not reveal bugs in our packaging but code bugs. If we are doing pythomImportsCheck everywhere it is enough for the simpler packages. Complicated things like tensorflow or pandas require tests.

It takes an extra bit of time to figure out it has no tests and just move on to the next phase. Maybe it's just me, but I don't think the disabling of the checkPhase is necessary or desired.

I didn't come up with it but jonringer and I think he knows what he is doing. If we update something I don't want to deal with failing tests which where not there before.

@SuperSandro2000
Copy link
Member Author

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 108799 run on x86_64-linux 1

29 packages failed to build and are new build failures:
  • appcsxcad: log was empty
  • cq-editor: log was empty
  • gtkd: log was empty
  • horizon-eda: log was empty
  • inkcut: log was empty
  • inkscape-extensions.inkcut: log was empty
  • libsForQt5.qcsxcad: log was empty
  • (libsForQt515.qcsxcad): log was empty
  • libsForQt512.qcsxcad: log was empty
  • libsForQt514.qcsxcad: log was empty
  • openems: log was empty
  • python37Packages.cadquery: log was empty
  • python37Packages.enamlx: log was empty
  • python37Packages.python-csxcad: log was empty
  • python37Packages.python-openems: log was empty
  • python37Packages.pythonocc-core: log was empty
  • python37Packages.vtk_8: log https://termbin.com/gzzq
  • python38Packages.enamlx: log was empty
  • python38Packages.python-csxcad: log was empty
  • python38Packages.python-openems: log was empty
  • python38Packages.pythonocc-core: log was empty
  • python38Packages.vtk_8: log https://termbin.com/yqlb
  • python39Packages.enamlx: log was empty
  • python39Packages.python-csxcad: log was empty
  • python39Packages.python-openems: log was empty
  • python39Packages.pythonocc-core: log was empty
  • python39Packages.vtk_8: log https://termbin.com/4jpt
  • simpleitk: log https://termbin.com/9dvz
  • tilix: log was empty
60 packages built:
  • ants
  • c3d
  • csxcad
  • datasette (python38Packages.datasette)
  • dockbarx
  • elastix
  • ezminc
  • gdcm
  • glom
  • gnome3.anjuta
  • libgda (gnome3.libgda)
  • gtkpod
  • gtranslator
  • i3altlayout
  • itk
  • itk4
  • libgdamm
  • mirtk
  • mitmproxy (python38Packages.mitmproxy)
  • mrtrix
  • pantheon.elementary-music
  • python37Packages.asgiref
  • python37Packages.channels
  • python37Packages.channels-redis
  • python37Packages.clifford
  • python37Packages.daphne
  • python37Packages.datasette
  • python37Packages.dicom2nifti
  • python37Packages.django_3
  • python37Packages.gdcm
  • python37Packages.mayavi
  • python37Packages.mitmproxy
  • python37Packages.nixpkgs
  • python37Packages.vtk (python37Packages.vtk_7)
  • python38Packages.asgiref
  • python38Packages.channels
  • python38Packages.channels-redis
  • python38Packages.clifford
  • python38Packages.daphne
  • python38Packages.dicom2nifti
  • python38Packages.django_3
  • python38Packages.gdcm
  • python38Packages.mayavi
  • python38Packages.nixpkgs
  • python38Packages.vtk (python38Packages.vtk_7)
  • python39Packages.asgiref
  • python39Packages.channels
  • python39Packages.channels-redis
  • python39Packages.daphne
  • python39Packages.dicom2nifti
  • python39Packages.django_3
  • python39Packages.gdcm
  • python39Packages.mitmproxy
  • python39Packages.nixpkgs
  • python39Packages.vtk (python39Packages.vtk_7)
  • raiseorlaunch
  • remarkable-mouse
  • sequeler
  • urlwatch
  • xfce.xfce4-dockbarx-plugin (xfce.xfce4_dockbarx_plugin)

@SuperSandro2000
Copy link
Member Author

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 108799 run on x86_64-darwin 1

6 packages marked as broken and skipped:
  • cq-editor
  • gnome3.libgda
  • gtkd
  • libgda
  • python39Packages.datasette
  • remarkable-mouse
32 packages failed to build and are new build failures:
  • ants: log was empty
  • c3d: log was empty
  • elastix: log was empty
  • ezminc: log was empty
  • gdcm: log was empty
  • inkcut: log was empty
  • itk4: log was empty
  • mnemosyne: log https://termbin.com/uxgz
  • python37Packages.cadquery: log was empty
  • python37Packages.dicom2nifti: log was empty
  • python37Packages.enamlx: log was empty
  • python37Packages.gdcm: log was empty
  • python37Packages.mayavi: log was empty
  • python37Packages.pythonocc-core: log was empty
  • python37Packages.vtk: log https://termbin.com/xvhq
  • (python37Packages.vtk_7): log was empty
  • python37Packages.vtk_8: log https://termbin.com/khg1
  • python38Packages.dicom2nifti: log was empty
  • python38Packages.enamlx: log was empty
  • python38Packages.gdcm: log was empty
  • python38Packages.mayavi: log was empty
  • python38Packages.pythonocc-core: log was empty
  • python38Packages.vtk: log https://termbin.com/ilno
  • (python38Packages.vtk_7): log was empty
  • python38Packages.vtk_8: log https://termbin.com/nmsz
  • python39Packages.dicom2nifti: log was empty
  • python39Packages.enamlx: log was empty
  • python39Packages.gdcm: log was empty
  • python39Packages.pythonocc-core: log was empty
  • python39Packages.vtk: log https://termbin.com/9mur
  • (python39Packages.vtk_7): log was empty
  • python39Packages.vtk_8: log https://termbin.com/h0td
44 packages built:
  • anki
  • appdaemon
  • datasette (python38Packages.datasette)
  • gdbgui
  • mitmproxy (python38Packages.mitmproxy)
  • python37Packages.asgiref
  • python37Packages.asyncio-dgram
  • python37Packages.channels
  • python37Packages.channels-redis
  • python37Packages.clifford
  • python37Packages.daphne
  • python37Packages.datasette
  • python37Packages.django_3
  • python37Packages.flask-socketio
  • python37Packages.mitmproxy
  • python37Packages.nixpkgs
  • python37Packages.python-engineio
  • python37Packages.python-socketio
  • python37Packages.pywizlight
  • python38Packages.asgiref
  • python38Packages.asyncio-dgram
  • python38Packages.channels
  • python38Packages.channels-redis
  • python38Packages.clifford
  • python38Packages.daphne
  • python38Packages.django_3
  • python38Packages.flask-socketio
  • python38Packages.nixpkgs
  • python38Packages.python-engineio
  • python38Packages.python-socketio
  • python38Packages.pywizlight
  • python39Packages.asgiref
  • python39Packages.asyncio-dgram
  • python39Packages.channels
  • python39Packages.channels-redis
  • python39Packages.daphne
  • python39Packages.django_3
  • python39Packages.flask-socketio
  • python39Packages.mitmproxy
  • python39Packages.nixpkgs
  • python39Packages.python-engineio
  • python39Packages.python-socketio
  • python39Packages.pywizlight
  • urlwatch

@@ -16673,13 +16673,15 @@ in
vte_290 = callPackage ../development/libraries/vte/2.90.nix { };

vtk_7 = libsForQt515.callPackage ../development/libraries/vtk/7.x.nix {
stdenv = gcc9Stdenv;
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are no releases for 3 years for 7.X and there is probably no fix with gcc10 and I couldn't find a branch for it.

inherit (darwin) libobjc;
inherit (darwin.apple_sdk.libs) xpc;
inherit (darwin.apple_sdk.frameworks) Cocoa CoreServices DiskArbitration
IOKit CFNetwork Security ApplicationServices
CoreText IOSurface ImageIO OpenGL GLUT;
};
vtk_8 = libsForQt515.callPackage ../development/libraries/vtk/8.x.nix {
stdenv = gcc9Stdenv;
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are no releases for a year for 8.X and there is probably no fix with gcc10 and I couldn't find a branch for it.

@SuperSandro2000
Copy link
Member Author

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 108799 run on x86_64-darwin 1

31 packages failed to build and are new build failures:
  • ants: log was empty
  • c3d: log was empty
  • elastix: log was empty
  • ezminc: log was empty
  • gdcm: log was empty
  • inkcut: log was empty
  • inkscape-extensions.inkcut: log was empty
  • itk: log was empty
  • itk4: log was empty
  • mnemosyne: log https://termbin.com/scc9
  • python37Packages.cadquery: log was empty
  • python37Packages.dicom2nifti: log was empty
  • python37Packages.enamlx: log was empty
  • python37Packages.gdcm: log was empty
  • python37Packages.mayavi: log was empty
  • python37Packages.pythonocc-core: log was empty
  • python37Packages.vtk: log https://termbin.com/3km6
  • python37Packages.vtk_8: log https://termbin.com/w2jw
  • python38Packages.dicom2nifti: log was empty
  • python38Packages.enamlx: log was empty
  • python38Packages.gdcm: log was empty
  • python38Packages.mayavi: log was empty
  • python38Packages.pythonocc-core: log was empty
  • python38Packages.vtk: log https://termbin.com/wfmj
  • python38Packages.vtk_8: log https://termbin.com/nvmq
  • python39Packages.dicom2nifti: log was empty
  • python39Packages.enamlx: log was empty
  • python39Packages.gdcm: log was empty
  • python39Packages.pythonocc-core: log was empty
  • python39Packages.vtk: log https://termbin.com/eqmk
  • python39Packages.vtk_8: log https://termbin.com/1v4k
24 packages built:
  • anki
  • appdaemon
  • gdbgui
  • python37Packages.asyncio-dgram
  • python37Packages.clifford
  • python37Packages.flask-socketio
  • python37Packages.nixpkgs
  • python37Packages.python-engineio
  • python37Packages.python-socketio
  • python37Packages.pywizlight
  • python38Packages.asyncio-dgram
  • python38Packages.clifford
  • python38Packages.flask-socketio
  • python38Packages.nixpkgs
  • python38Packages.python-engineio
  • python38Packages.python-socketio
  • python38Packages.pywizlight
  • python39Packages.asyncio-dgram
  • python39Packages.flask-socketio
  • python39Packages.nixpkgs
  • python39Packages.python-engineio
  • python39Packages.python-socketio
  • python39Packages.pywizlight
  • urlwatch

@SuperSandro2000
Copy link
Member Author

SuperSandro2000 commented Jan 10, 2021

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 108799 run on x86_64-linux 1

14 packages failed to build and are new build failures:
  • appcsxcad: log was empty
  • gtkd: log was empty
  • qcsxcad: log was empty
  • (libsForQt5.qcsxcad): log was empty
  • libsForQt512.qcsxcad: log was empty
  • libsForQt514.qcsxcad: log was empty
  • openems: log was empty
  • python37Packages.python-csxcad: log was empty
  • python37Packages.python-openems: log was empty
  • python38Packages.python-csxcad: log was empty
  • python38Packages.python-openems: log was empty
  • python39Packages.python-csxcad: log was empty
  • python39Packages.python-openems: log was empty
  • tilix: log was empty
53 packages built:
  • ants
  • c3d
  • cq-editor
  • csxcad
  • dockbarx
  • elastix
  • ezminc
  • gdcm
  • glom
  • gnome3.anjuta
  • gnome3.libgda
  • gtkpod
  • gtranslator
  • horizon-eda
  • i3altlayout
  • inkcut
  • inkscape-extensions.inkcut
  • itk
  • itk4
  • libgdamm
  • mirtk
  • pantheon.elementary-music
  • python37Packages.cadquery
  • python37Packages.clifford
  • python37Packages.dicom2nifti
  • python37Packages.enamlx
  • python37Packages.gdcm
  • python37Packages.mayavi
  • python37Packages.nixpkgs
  • python37Packages.pythonocc-core
  • python37Packages.vtk
  • python37Packages.vtk_8
  • python38Packages.clifford
  • python38Packages.dicom2nifti
  • python38Packages.enamlx
  • python38Packages.gdcm
  • python38Packages.mayavi
  • python38Packages.nixpkgs
  • python38Packages.pythonocc-core
  • python38Packages.vtk
  • python38Packages.vtk_8
  • python39Packages.dicom2nifti
  • python39Packages.enamlx
  • python39Packages.gdcm
  • python39Packages.nixpkgs
  • python39Packages.pythonocc-core
  • python39Packages.vtk
  • python39Packages.vtk_8
  • raiseorlaunch
  • remarkable-mouse
  • sequeler
  • urlwatch
  • xfce.xfce4-dockbarx-plugin

The label is not correct. Those build failures are not new.

@SuperSandro2000 SuperSandro2000 merged commit f41dc35 into NixOS:master Jan 10, 2021
@SuperSandro2000 SuperSandro2000 deleted the fix-collection branch January 10, 2021 19:04
@SuperSandro2000
Copy link
Member Author

This is a semi-automatic executed nixpkgs-review which does not build all packages (e.g. lumo, tensorflow or pytorch)
If you find some bugs or got suggestions for further things to search or run please reach out to SuperSandro2000 on IRC.

Result of nixpkgs-review pr 108799 run on x86_64-linux 1

14 packages failed to build and are new build failures:
  • appcsxcad: log was empty
  • gtkd: log was empty
  • libsForQt5.qcsxcad: log was empty
  • (libsForQt515.qcsxcad): log was empty
  • libsForQt512.qcsxcad: log was empty
  • libsForQt514.qcsxcad: log was empty
  • openems: log was empty
  • python37Packages.python-csxcad: log was empty
  • python37Packages.python-openems: log was empty
  • python38Packages.python-csxcad: log was empty
  • python38Packages.python-openems: log was empty
  • python39Packages.python-csxcad: log was empty
  • python39Packages.python-openems: log was empty
  • tilix: log was empty
73 packages built:
  • ants
  • c3d
  • cq-editor
  • csxcad
  • datasette (python38Packages.datasette)
  • dockbarx
  • elastix
  • ezminc
  • gdcm
  • glom
  • gnome3.anjuta
  • libgda (gnome3.libgda)
  • gtkpod
  • gtranslator
  • horizon-eda
  • i3altlayout
  • inkcut
  • inkscape-extensions.inkcut
  • itk
  • itk4
  • libgdamm
  • mirtk
  • mitmproxy (python38Packages.mitmproxy)
  • pantheon.elementary-music
  • python37Packages.asgiref
  • python37Packages.cadquery
  • python37Packages.channels
  • python37Packages.channels-redis
  • python37Packages.clifford
  • python37Packages.daphne
  • python37Packages.datasette
  • python37Packages.dicom2nifti
  • python37Packages.django_3
  • python37Packages.enamlx
  • python37Packages.gdcm
  • python37Packages.mayavi
  • python37Packages.mitmproxy
  • python37Packages.nixpkgs
  • python37Packages.pythonocc-core
  • python37Packages.vtk (python37Packages.vtk_7)
  • python37Packages.vtk_8
  • python38Packages.asgiref
  • python38Packages.channels
  • python38Packages.channels-redis
  • python38Packages.clifford
  • python38Packages.daphne
  • python38Packages.dicom2nifti
  • python38Packages.django_3
  • python38Packages.enamlx
  • python38Packages.gdcm
  • python38Packages.mayavi
  • python38Packages.nixpkgs
  • python38Packages.pythonocc-core
  • python38Packages.vtk (python38Packages.vtk_7)
  • python38Packages.vtk_8
  • python39Packages.asgiref
  • python39Packages.channels
  • python39Packages.channels-redis
  • python39Packages.daphne
  • python39Packages.dicom2nifti
  • python39Packages.django_3
  • python39Packages.enamlx
  • python39Packages.gdcm
  • python39Packages.mitmproxy
  • python39Packages.nixpkgs
  • python39Packages.pythonocc-core
  • python39Packages.vtk (python39Packages.vtk_7)
  • python39Packages.vtk_8
  • raiseorlaunch
  • remarkable-mouse
  • sequeler
  • urlwatch
  • xfce.xfce4-dockbarx-plugin (xfce.xfce4_dockbarx_plugin)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants