Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[wip] Attempt to fix ARG_MAX issue in Haskell #42928

Closed
wants to merge 1 commit into from
Closed

[wip] Attempt to fix ARG_MAX issue in Haskell #42928

wants to merge 1 commit into from

Conversation

matthewbauer
Copy link
Member

Motivation for this change

@matthewbauer
Copy link
Member Author

matthewbauer commented Jul 3, 2018 •
edited

@GrahamcOfBorg build haskellPackages.stack

@GrahamcOfBorg
Copy link

No attempt on aarch64-linux (full log)

The following builds were skipped because they don't evaluate on aarch64-linux: haskellPackages.ghc

Partial log (click to expand)


a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowUnsupportedSystem = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowUnsupportedSystem = true; }
to ~/.config/nixpkgs/config.nix.

@GrahamcOfBorg
Copy link

No attempt on aarch64-linux (full log)

The following builds were skipped because they don't evaluate on aarch64-linux: haskellPackages.stack

Partial log (click to expand)


a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowUnsupportedSystem = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowUnsupportedSystem = true; }
to ~/.config/nixpkgs/config.nix.

@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: haskellPackages.stack

Partial log (click to expand)

copying path '/nix/store/lr72p6aya55yl01kcbpx5q6nxv0l79pl-zip-archive-0.3.2.5' from 'https://cache.nixos.org'...
copying path '/nix/store/f9z3zcyb33krrnj6ilwqhgl7da5si2m3-hpack-0.28.2' from 'https://cache.nixos.org'...
copying path '/nix/store/jn9z4q6zw7ffbwppmh92xsdqzlk44bml-mustache-2.3.0' from 'https://cache.nixos.org'...
copying path '/nix/store/i3qkgl33m24l7wkz2s37mca177vq172w-store-0.4.3.2' from 'https://cache.nixos.org'...
copying path '/nix/store/2yy8nn5ndfmjga045cxqlcw6jv01pcv5-http-api-data-0.3.7.2' from 'https://cache.nixos.org'...
copying path '/nix/store/lv3al86jy84k252jsdx4w8c7zxg8p69x-persistent-2.8.2' from 'https://cache.nixos.org'...
copying path '/nix/store/cf5g5qlzp8nzqlhn9szfn7pawhay3jjx-persistent-sqlite-2.8.1.2' from 'https://cache.nixos.org'...
copying path '/nix/store/j2vxia14h2aa73vbhnn87ckhq06zncpw-persistent-template-2.5.4' from 'https://cache.nixos.org'...
copying path '/nix/store/1jbcv1zjvhafrsmiyngw5asvb8icgyx9-stack-1.7.1' from 'https://cache.nixos.org'...
/nix/store/1jbcv1zjvhafrsmiyngw5asvb8icgyx9-stack-1.7.1

@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: haskellPackages.ghc

Partial log (click to expand)

these paths will be fetched (100.94 MiB download, 1306.19 MiB unpacked):
  /nix/store/jyyai23gkibjyqzj5ixhn2sm9ygvkf5s-ghc-8.2.2-doc
  /nix/store/p372bagly14f82850qkzpjyimvw8ipqy-ghc-8.2.2
copying path '/nix/store/jyyai23gkibjyqzj5ixhn2sm9ygvkf5s-ghc-8.2.2-doc' from 'https://cache.nixos.org'...
copying path '/nix/store/p372bagly14f82850qkzpjyimvw8ipqy-ghc-8.2.2' from 'https://cache.nixos.org'...
/nix/store/p372bagly14f82850qkzpjyimvw8ipqy-ghc-8.2.2

@GrahamcOfBorg
Copy link

Failure on x86_64-darwin (full log)

Attempted: haskellPackages.ghc

Partial log (click to expand)

<<ghc: 909726064 bytes, 110 GCs, 27597485/81936104 avg/max bytes residency (7 samples), 172M in use, 0.000 INIT (0.003 elapsed), 0.589 MUT (0.978 elapsed), 0.409 GC (0.592 elapsed) :ghc>>
"/nix/store/j55z1m3g5jykzrml2pnm0j0kdpgl9gxy-ghc-8.2.1-binary/bin/ghc" -hisuf hi -osuf  o -hcsuf hc -static  -H32m -O -Wall  -Iincludes -Iincludes/dist -Iincludes/dist-derivedconstants/header -Iincludes/dist-ghcconstants/header -package-db libraries/bootstrapping.conf  -this-unit-id ghc-8.2.2 -hide-all-packages -i -icompiler/backpack -icompiler/basicTypes -icompiler/cmm -icompiler/codeGen -icompiler/coreSyn -icompiler/deSugar -icompiler/ghci -icompiler/hsSyn -icompiler/iface -icompiler/llvmGen -icompiler/main -icompiler/nativeGen -icompiler/parser -icompiler/prelude -icompiler/profiling -icompiler/rename -icompiler/simplCore -icompiler/simplStg -icompiler/specialise -icompiler/stgSyn -icompiler/stranal -icompiler/typecheck -icompiler/types -icompiler/utils -icompiler/vectorise -icompiler/stage1/build -Icompiler/stage1/build -icompiler/stage1/build/./autogen -Icompiler/stage1/build/./autogen -Icompiler/. -Icompiler/parser -Icompiler/utils -Icompiler/stage1    -optP-include -optPcompiler/stage1/build/./autogen/cabal_macros.h -package-id base-4.10.0.0 -package-id deepseq-1.4.3.0 -package-id directory-1.3.0.2 -package-id process-1.6.1.0 -package-id bytestring-0.10.8.2 -package-id binary-0.8.5.1 -package-id time-1.8.0.2 -package-id containers-0.5.10.2 -package-id array-0.5.2.0 -package-id filepath-1.4.1.2 -package-id template-haskell-2.12.0.0 -package-id hpc-0.6.0.3 -package-id transformers-0.5.2.0 -package-id ghc-boot-8.2.2 -package-id ghc-boot-th-8.2.2 -package-id ghci-8.2.2 -package-id hoopl-3.10.2.2 -package-id unix-2.7.2.2 -package-id terminfo-0.4.1.0 -Wall -fno-warn-name-shadowing -this-unit-id ghc -XHaskell2010 -DSTAGE=1 -Rghc-timing   -no-user-package-db -rtsopts       -odir compiler/stage1/build -hidir compiler/stage1/build -stubdir compiler/stage1/build    -c compiler/deSugar/DsForeign.hs -o compiler/stage1/build/DsForeign.o
<<ghc: 2034286144 bytes, 110 GCs, 31625227/110449896 avg/max bytes residency (8 samples), 234M in use, 0.000 INIT (0.002 elapsed), 1.344 MUT (2.130 elapsed), 0.584 GC (0.804 elapsed) :ghc>>
"/nix/store/j55z1m3g5jykzrml2pnm0j0kdpgl9gxy-ghc-8.2.1-binary/bin/ghc" -hisuf hi -osuf  o -hcsuf hc -static  -H32m -O -Wall  -Iincludes -Iincludes/dist -Iincludes/dist-derivedconstants/header -Iincludes/dist-ghcconstants/header -package-db libraries/bootstrapping.conf  -this-unit-id ghc-8.2.2 -hide-all-packages -i -icompiler/backpack -icompiler/basicTypes -icompiler/cmm -icompiler/codeGen -icompiler/coreSyn -icompiler/deSugar -icompiler/ghci -icompiler/hsSyn -icompiler/iface -icompiler/llvmGen -icompiler/main -icompiler/nativeGen -icompiler/parser -icompiler/prelude -icompiler/profiling -icompiler/rename -icompiler/simplCore -icompiler/simplStg -icompiler/specialise -icompiler/stgSyn -icompiler/stranal -icompiler/typecheck -icompiler/types -icompiler/utils -icompiler/vectorise -icompiler/stage1/build -Icompiler/stage1/build -icompiler/stage1/build/./autogen -Icompiler/stage1/build/./autogen -Icompiler/. -Icompiler/parser -Icompiler/utils -Icompiler/stage1    -optP-include -optPcompiler/stage1/build/./autogen/cabal_macros.h -package-id base-4.10.0.0 -package-id deepseq-1.4.3.0 -package-id directory-1.3.0.2 -package-id process-1.6.1.0 -package-id bytestring-0.10.8.2 -package-id binary-0.8.5.1 -package-id time-1.8.0.2 -package-id containers-0.5.10.2 -package-id array-0.5.2.0 -package-id filepath-1.4.1.2 -package-id template-haskell-2.12.0.0 -package-id hpc-0.6.0.3 -package-id transformers-0.5.2.0 -package-id ghc-boot-8.2.2 -package-id ghc-boot-th-8.2.2 -package-id ghci-8.2.2 -package-id hoopl-3.10.2.2 -package-id unix-2.7.2.2 -package-id terminfo-0.4.1.0 -Wall -fno-warn-name-shadowing -this-unit-id ghc -XHaskell2010 -DSTAGE=1 -Rghc-timing   -no-user-package-db -rtsopts       -odir compiler/stage1/build -hidir compiler/stage1/build -stubdir compiler/stage1/build    -c compiler/deSugar/DsGRHSs.hs -o compiler/stage1/build/DsGRHSs.o
<<ghc: 440538632 bytes, 96 GCs, 16800304/43263792 avg/max bytes residency (6 samples), 98M in use, 0.000 INIT (0.002 elapsed), 0.285 MUT (0.724 elapsed), 0.246 GC (0.345 elapsed) :ghc>>
"/nix/store/j55z1m3g5jykzrml2pnm0j0kdpgl9gxy-ghc-8.2.1-binary/bin/ghc" -hisuf hi -osuf  o -hcsuf hc -static  -H32m -O -Wall  -Iincludes -Iincludes/dist -Iincludes/dist-derivedconstants/header -Iincludes/dist-ghcconstants/header -package-db libraries/bootstrapping.conf  -this-unit-id ghc-8.2.2 -hide-all-packages -i -icompiler/backpack -icompiler/basicTypes -icompiler/cmm -icompiler/codeGen -icompiler/coreSyn -icompiler/deSugar -icompiler/ghci -icompiler/hsSyn -icompiler/iface -icompiler/llvmGen -icompiler/main -icompiler/nativeGen -icompiler/parser -icompiler/prelude -icompiler/profiling -icompiler/rename -icompiler/simplCore -icompiler/simplStg -icompiler/specialise -icompiler/stgSyn -icompiler/stranal -icompiler/typecheck -icompiler/types -icompiler/utils -icompiler/vectorise -icompiler/stage1/build -Icompiler/stage1/build -icompiler/stage1/build/./autogen -Icompiler/stage1/build/./autogen -Icompiler/. -Icompiler/parser -Icompiler/utils -Icompiler/stage1    -optP-include -optPcompiler/stage1/build/./autogen/cabal_macros.h -package-id base-4.10.0.0 -package-id deepseq-1.4.3.0 -package-id directory-1.3.0.2 -package-id process-1.6.1.0 -package-id bytestring-0.10.8.2 -package-id binary-0.8.5.1 -package-id time-1.8.0.2 -package-id containers-0.5.10.2 -package-id array-0.5.2.0 -package-id filepath-1.4.1.2 -package-id template-haskell-2.12.0.0 -package-id hpc-0.6.0.3 -package-id transformers-0.5.2.0 -package-id ghc-boot-8.2.2 -package-id ghc-boot-th-8.2.2 -package-id ghci-8.2.2 -package-id hoopl-3.10.2.2 -package-id unix-2.7.2.2 -package-id terminfo-0.4.1.0 -Wall -fno-warn-name-shadowing -this-unit-id ghc -XHaskell2010 -DSTAGE=1 -Rghc-timing   -no-user-package-db -rtsopts       -odir compiler/stage1/build -hidir compiler/stage1/build -stubdir compiler/stage1/build    -c compiler/deSugar/DsBinds.hs -o compiler/stage1/build/DsBinds.o
<<ghc: 2006602800 bytes, 109 GCs, 26823174/93356920 avg/max bytes residency (8 samples), 198M in use, 0.000 INIT (0.012 elapsed), 1.440 MUT (2.197 elapsed), 0.560 GC (0.856 elapsed) :ghc>>
"/nix/store/j55z1m3g5jykzrml2pnm0j0kdpgl9gxy-ghc-8.2.1-binary/bin/ghc" -hisuf hi -osuf  o -hcsuf hc -static  -H32m -O -Wall  -Iincludes -Iincludes/dist -Iincludes/dist-derivedconstants/header -Iincludes/dist-ghcconstants/header -package-db libraries/bootstrapping.conf  -this-unit-id ghc-8.2.2 -hide-all-packages -i -icompiler/backpack -icompiler/basicTypes -icompiler/cmm -icompiler/codeGen -icompiler/coreSyn -icompiler/deSugar -icompiler/ghci -icompiler/hsSyn -icompiler/iface -icompiler/llvmGen -icompiler/main -icompiler/nativeGen -icompiler/parser -icompiler/prelude -icompiler/profiling -icompiler/rename -icompiler/simplCore -icompiler/simplStg -icompiler/specialise -icompiler/stgSyn -icompiler/stranal -icompiler/typecheck -icompiler/types -icompiler/utils -icompiler/vectorise -icompiler/stage1/build -Icompiler/stage1/build -icompiler/stage1/build/./autogen -Icompiler/stage1/build/./autogen -Icompiler/. -Icompiler/parser -Icompiler/utils -Icompiler/stage1    -optP-include -optPcompiler/stage1/build/./autogen/cabal_macros.h -package-id base-4.10.0.0 -package-id deepseq-1.4.3.0 -package-id directory-1.3.0.2 -package-id process-1.6.1.0 -package-id bytestring-0.10.8.2 -package-id binary-0.8.5.1 -package-id time-1.8.0.2 -package-id containers-0.5.10.2 -package-id array-0.5.2.0 -package-id filepath-1.4.1.2 -package-id template-haskell-2.12.0.0 -package-id hpc-0.6.0.3 -package-id transformers-0.5.2.0 -package-id ghc-boot-8.2.2 -package-id ghc-boot-th-8.2.2 -package-id ghci-8.2.2 -package-id hoopl-3.10.2.2 -package-id unix-2.7.2.2 -package-id terminfo-0.4.1.0 -Wall -fno-warn-name-shadowing -this-unit-id ghc -XHaskell2010 -DSTAGE=1 -Rghc-timing   -no-user-package-db -rtsopts       -odir compiler/stage1/build -hidir compiler/stage1/build -stubdir compiler/stage1/build    -c compiler/deSugar/MatchLit.hs -o compiler/stage1/build/MatchLit.o
building of '/nix/store/im184rhaf3hz0y8crzifhw3f3nz5vxr8-ghc-8.2.2.drv' timed out after 1800 seconds
�[31;1merror:�[0m build of '/nix/store/im184rhaf3hz0y8crzifhw3f3nz5vxr8-ghc-8.2.2.drv' failed

@GrahamcOfBorg
Copy link

Failure on x86_64-darwin (full log)

Attempted: haskellPackages.stack

Partial log (click to expand)

cannot build derivation '/nix/store/gxdnk89nrq5638kgmm4k9l2d43vsgbb0-hpack-0.28.2.drv': 21 dependencies couldn't be built
cannot build derivation '/nix/store/0r77h5mdy5h6qb1ph7isjnbdp43gri2n-http-conduit-2.3.1.drv': 11 dependencies couldn't be built
cannot build derivation '/nix/store/f2s011ghw4qprcliy365fmkghykqyaa1-monad-logger-0.3.28.5.drv': 17 dependencies couldn't be built
cannot build derivation '/nix/store/cv0c2hqfdr8lawrxip7mzcxyimzlx795-mustache-2.3.0.drv': 13 dependencies couldn't be built
cannot build derivation '/nix/store/2wp0p8m5ch9abn2f1n027n3zic9xzf6w-project-template-0.2.0.1.drv': 10 dependencies couldn't be built
cannot build derivation '/nix/store/q8x9hqfhn6gp32v3hgiawjd53f4zah4s-persistent-2.8.2.drv': 27 dependencies couldn't be built
cannot build derivation '/nix/store/djh3lq6jr9z8wwxyxxl9sw7b62jz1517-persistent-template-2.5.4.drv': 14 dependencies couldn't be built
cannot build derivation '/nix/store/1j1h54pqhbgj5pq8ss7i23vh28ffbh1h-persistent-sqlite-2.8.1.2.drv': 16 dependencies couldn't be built
cannot build derivation '/nix/store/v64ln0d9y9vam4l8wm222pmhxwc1rzvx-stack-1.7.1.drv': 73 dependencies couldn't be built
�[31;1merror:�[0m build of '/nix/store/v64ln0d9y9vam4l8wm222pmhxwc1rzvx-stack-1.7.1.drv' failed

@matthewbauer matthewbauer force-pushed the ghc-macos-argmax-fix branch 2 times, most recently from f429bfe to 846ad5d Compare July 3, 2018 20:03
@matthewbauer
Partial revert "haskell generic-builder: Always use separate pkg db f…
2349168 
…or custom setup"

This reverts commit f8ec07e.

GHC does not properly handle the small ARGMAX on macOS. Our separate
setup db will give us an "Argument list too long" on macOS. We disable
separate setup db on macOS for now with the hope of GHC fixing this
later on.

/cc @jwiegley @Ericson2314 @peti @mpickering
@matthewbauer
Copy link
Member Author

Doesn't seem to help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@edolstra edolstra Awaiting requested review from edolstra

@nbp nbp Awaiting requested review from nbp

@peti peti Awaiting requested review from peti

@Profpatsch Profpatsch Awaiting requested review from Profpatsch

Assignees
No one assigned
Labels
6.topic: haskell 10.rebuild-darwin: 501+ 10.rebuild-linux: 0
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@matthewbauer @GrahamcOfBorg