Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[18.09] Gitlab 11.5.0 #51072

Merged
merged 12 commits into from Nov 30, 2018
Merged

[18.09] Gitlab 11.5.0 #51072

merged 12 commits into from Nov 30, 2018

Conversation

flokli
Copy link
Contributor

@flokli flokli commented Nov 26, 2018

Motivation for this change

Backport of the GitLab updates from #50962 (excluding the updater.py script, as we cherry-pick updates anyhow, and don't need updater tooling in that branch)

Includes fix for CVE-2018-18643, released as 11.4.6.

Things done
  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Assured whether relevant documentation is up to date
  • Fits CONTRIBUTING.md.

we already set VERSION in makeFlags below.

(cherry picked from commit 8b51e83)
(cherry picked from commit 293a631)
(cherry picked from commit a33622e)
(cherry picked from commit 63f2547)
… as it should

The nixos test is a bit misleading, as the given nginx configuration
would always cause gitlab to redirect to localhost, which is clearly not
what you want in a production setup.

Instead we now enable services.nginx.recommendedProxySettings,
curl against http://gitlab, and assure we get redirected to that same
hostname, too.

(cherry picked from commit 6870eaf)
@flokli flokli requested review from globin and fpletz November 26, 2018 18:10
@flokli flokli changed the title [18.09] Gitlab 11.5.0 18.09 [18.09] Gitlab 11.5.0 Nov 26, 2018
@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: gitaly, gitlab, gitlab-shell, gitlab-workhorse

Partial log (click to expand)

strip is /nix/store/h0lbngpv6ln56hjj59i6l77vxq25flbz-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/xvs7w29fdqdgildph9vjadsz23wyvr3b-gitaly-0.129.0-ruby/lib  /nix/store/xvs7w29fdqdgildph9vjadsz23wyvr3b-gitaly-0.129.0-ruby/bin
patching script interpreter paths in /nix/store/xvs7w29fdqdgildph9vjadsz23wyvr3b-gitaly-0.129.0-ruby
/nix/store/xvs7w29fdqdgildph9vjadsz23wyvr3b-gitaly-0.129.0-ruby/bin/gitaly-ruby: interpreter directive changed from "/usr/bin/env ruby" to "/nix/store/3881yrlln39nc5901pljfnnvy8bzkpmi-wrapped-ruby-gitaly-env/bin/ruby"
/nix/store/xvs7w29fdqdgildph9vjadsz23wyvr3b-gitaly-0.129.0-ruby/bin/ruby-cd: interpreter directive changed from "/usr/bin/env ruby" to "/nix/store/3881yrlln39nc5901pljfnnvy8bzkpmi-wrapped-ruby-gitaly-env/bin/ruby"
checking for references to /build in /nix/store/xvs7w29fdqdgildph9vjadsz23wyvr3b-gitaly-0.129.0-ruby...
/nix/store/6hpw47iv6rd1nyl7liz34mzmvlmjxsn3-gitaly-0.129.0-bin
/nix/store/h0anwpwr87z5gavrckn1qw7wcz616vzw-gitlab-11.5.0
/nix/store/jj34q9wf8h3kz79vxk5m2wdiggj9il3c-gitlab-shell-8.4.1
/nix/store/28g0fi3774ni58b8973brmqk2vbw2y7c-gitlab-workhorse-7.1.0

@GrahamcOfBorg
Copy link

Success on aarch64-linux (full log)

Attempted: gitaly, gitlab, gitlab-shell, gitlab-workhorse

Partial log (click to expand)

/nix/store/qlvvqfjb62v9vlzfa0cx7gm42z1wph2q-gitlab-11.5.0/share/gitlab/scripts/detect-new-flaky-examples: interpreter directive changed from "/usr/bin/env ruby" to "/nix/store/g57lz7rgcijjhhk4i4zm7ykidlijdprj-wrapped-ruby-gitlab-env-11.5.0/bin/ruby"
/nix/store/qlvvqfjb62v9vlzfa0cx7gm42z1wph2q-gitlab-11.5.0/share/gitlab/scripts/build_assets_image: interpreter directive changed from "/bin/bash" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/bash"
/nix/store/qlvvqfjb62v9vlzfa0cx7gm42z1wph2q-gitlab-11.5.0/share/gitlab/qa/bin/test: interpreter directive changed from "/bin/bash" to "/nix/store/fqm2x6kiay1q4vg7pqp4wp17bdijlyc3-bash-4.4-p23/bin/bash"
/nix/store/qlvvqfjb62v9vlzfa0cx7gm42z1wph2q-gitlab-11.5.0/share/gitlab/qa/bin/qa: interpreter directive changed from "/usr/bin/env ruby" to "/nix/store/g57lz7rgcijjhhk4i4zm7ykidlijdprj-wrapped-ruby-gitlab-env-11.5.0/bin/ruby"
/nix/store/qlvvqfjb62v9vlzfa0cx7gm42z1wph2q-gitlab-11.5.0/share/gitlab/plugins/examples/save_to_file.rb: interpreter directive changed from "/usr/bin/env ruby" to "/nix/store/g57lz7rgcijjhhk4i4zm7ykidlijdprj-wrapped-ruby-gitlab-env-11.5.0/bin/ruby"
checking for references to /build in /nix/store/qlvvqfjb62v9vlzfa0cx7gm42z1wph2q-gitlab-11.5.0...
/nix/store/r3sdrnjqznx9x3n70kaai95n8ki7gn7c-gitaly-0.129.0-bin
/nix/store/qlvvqfjb62v9vlzfa0cx7gm42z1wph2q-gitlab-11.5.0
/nix/store/cw1dbadvsf2lhgk1nd0bn9xix8fahcxq-gitlab-shell-8.4.1
/nix/store/fk09ak1g7s0dj5n5h1wygd3yyajp2ga5-gitlab-workhorse-7.1.0

@GrahamcOfBorg
Copy link

Failure on x86_64-darwin (full log)

Attempted: gitaly, gitlab-shell, gitlab-workhorse

The following builds were skipped because they don't evaluate on x86_64-darwin: gitlab

Partial log (click to expand)

Successfully installed github-linguist-6.2.0
1 gem installed
post-installation fixup
patching script interpreter paths in /nix/store/0fphzj2y8qmbpkr7m365w1b91z0bxm1r-ruby2.5.3-github-linguist-6.2.0
/nix/store/0fphzj2y8qmbpkr7m365w1b91z0bxm1r-ruby2.5.3-github-linguist-6.2.0/lib/ruby/gems/2.5.0/gems/github-linguist-6.2.0/bin/git-linguist: interpreter directive changed from "/usr/bin/env ruby" to "/nix/store/dlsp4m6g9cz69pbx1a9q27x9fnmyhgxk-ruby-2.5.3/bin/ruby"
/nix/store/0fphzj2y8qmbpkr7m365w1b91z0bxm1r-ruby2.5.3-github-linguist-6.2.0/lib/ruby/gems/2.5.0/gems/github-linguist-6.2.0/bin/linguist: interpreter directive changed from "/usr/bin/env ruby" to "/nix/store/dlsp4m6g9cz69pbx1a9q27x9fnmyhgxk-ruby-2.5.3/bin/ruby"
cannot build derivation '/nix/store/g7cib802r73pyxf3nfarphdab022h68n-gitaly-env.drv': 2 dependencies couldn't be built
cannot build derivation '/nix/store/c1s2vaa7k764vp5nz54x1fa5g4w1c41a-wrapped-ruby-gitaly-env.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/3z289kx7jqg5gikby344skvvq7jvfp1m-gitaly-0.129.0.drv': 1 dependencies couldn't be built
error: build of '/nix/store/3z289kx7jqg5gikby344skvvq7jvfp1m-gitaly-0.129.0.drv' failed

(cherry picked from commit c3c57c7)
@flokli flokli mentioned this pull request Nov 27, 2018
10 tasks
@flokli
Copy link
Contributor Author

flokli commented Nov 27, 2018

cc @srhb

@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: gitaly, gitlab, gitlab-runner, gitlab-shell, gitlab-workhorse

Partial log (click to expand)

strip is /nix/store/h0lbngpv6ln56hjj59i6l77vxq25flbz-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin/bin
patching script interpreter paths in /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin
checking for references to /build in /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin...
strip is /nix/store/h0lbngpv6ln56hjj59i6l77vxq25flbz-binutils-2.30/bin/strip
/nix/store/6hpw47iv6rd1nyl7liz34mzmvlmjxsn3-gitaly-0.129.0-bin
/nix/store/h0anwpwr87z5gavrckn1qw7wcz616vzw-gitlab-11.5.0
/nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin
/nix/store/jj34q9wf8h3kz79vxk5m2wdiggj9il3c-gitlab-shell-8.4.1
/nix/store/28g0fi3774ni58b8973brmqk2vbw2y7c-gitlab-workhorse-7.1.0

@GrahamcOfBorg
Copy link

Failure on x86_64-darwin (full log)

Attempted: gitaly, gitlab-runner, gitlab-shell, gitlab-workhorse

The following builds were skipped because they don't evaluate on x86_64-darwin: gitlab

Partial log (click to expand)

find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
error: build of '/nix/store/3z289kx7jqg5gikby344skvvq7jvfp1m-gitaly-0.129.0.drv' failed

@GrahamcOfBorg
Copy link

Failure on aarch64-linux (full log)

Attempted: gitaly, gitlab, gitlab-runner, gitlab-shell, gitlab-workhorse

Partial log (click to expand)

gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/docker/oci
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution/registry/storage/cache
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution/registry/storage/cache/memory
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution/registry/client
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution/registry/client/auth
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/docker/pkg/jsonmessage
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/docker/pkg/httputils
builder for '/nix/store/24mk5wv9w8w8z0s1mbsqc41wbi65pjp8-gitlab-runner-11.5.0.drv' failed with exit code 28
error: build of '/nix/store/1qpdv9xpr8c850p14lx5idq4ysxhmnl7-gitaly-0.129.0.drv', '/nix/store/24mk5wv9w8w8z0s1mbsqc41wbi65pjp8-gitlab-runner-11.5.0.drv', '/nix/store/gm93lky6f5p0hxqa16k56ckxkcc9n8xz-gitlab-11.5.0.drv' failed

@srhb
Copy link
Contributor

srhb commented Nov 27, 2018

I've no problem with this backport. The test succeeded (eventually...) for me, though I guess it might fail on Hydra with this speed. 😀

@flokli
Copy link
Contributor Author

flokli commented Nov 27, 2018

Yeah, 9p filesystem seems to be pretty slow, and ruby very IO-hungry (it reads a lot of small files during migrations). I'm not sure how this can be accelerated.

I'm now taking a look into #49385 and also #49385 (comment), and will backport that into this PR as well

@GrahamcOfBorg
Copy link

Failure on x86_64-darwin (full log)

Attempted: gitaly, gitlab-runner, gitlab-shell, gitlab-workhorse

The following builds were skipped because they don't evaluate on x86_64-darwin: gitlab

Partial log (click to expand)

find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
find: '/nix/store/ai4napm1y6lqq82shpz0kwvk7hiilg5z-gitlab-runner-11.5.0': No such file or directory
error: build of '/nix/store/3z289kx7jqg5gikby344skvvq7jvfp1m-gitaly-0.129.0.drv' failed

@GrahamcOfBorg
Copy link

Failure on aarch64-linux (full log)

Attempted: gitaly, gitlab, gitlab-runner, gitlab-shell, gitlab-workhorse

Partial log (click to expand)

gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution/registry/storage/cache
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution/registry/storage/cache/memory
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/prometheus/client_model/go
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/matttproud/golang_protobuf_extensions/pbutil
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution/registry/client
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution/registry/client/auth
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/docker/pkg/jsonmessage
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/docker/pkg/httputils
builder for '/nix/store/24mk5wv9w8w8z0s1mbsqc41wbi65pjp8-gitlab-runner-11.5.0.drv' failed with exit code 29
error: build of '/nix/store/24mk5wv9w8w8z0s1mbsqc41wbi65pjp8-gitlab-runner-11.5.0.drv' failed

@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: gitaly, gitlab, gitlab-runner, gitlab-shell, gitlab-workhorse

Partial log (click to expand)

checking for references to /build in /nix/store/nylqihw9hvxa6az3bkmgsq5570bwpbp1-gitlab-11.5.0...
cannot link '/nix/store/.links/0c5dglrfz1ndrzp87jk0cw886l1i1cqppp0wm6f19n1hkk3k86d8' to '/nix/store/nylqihw9hvxa6az3bkmgsq5570bwpbp1-gitlab-11.5.0/share/gitlab/lib/gitlab/project_transfer.rb': No space left on device
cannot link '/nix/store/.links/01isxgznhyjm6qr176wqg02jrr1mbhndjm28h0qzwr7axzffqrir' to '/nix/store/nylqihw9hvxa6az3bkmgsq5570bwpbp1-gitlab-11.5.0/share/gitlab/public/assets/webpack/16.ceb75ea8.chunk.js.map.gz': No space left on device
cannot link '/nix/store/.links/1z24p455a9018158y6rk0k25sapvk4g29mh4fdz5c4wzz7dwfp00' to '/nix/store/nylqihw9hvxa6az3bkmgsq5570bwpbp1-gitlab-11.5.0/share/gitlab/spec/javascripts/vue_shared/components/stacked_progress_bar_spec.js': No space left on device
cannot link '/nix/store/.links/003m2q9yqqqxvqka9035rl3rv60fz7h5p142gz6c0knrg19askyp' to '/nix/store/nylqihw9hvxa6az3bkmgsq5570bwpbp1-gitlab-11.5.0/share/gitlab/doc/user/project/integrations/img/jira_service_page.png': No space left on device
/nix/store/6hpw47iv6rd1nyl7liz34mzmvlmjxsn3-gitaly-0.129.0-bin
/nix/store/nylqihw9hvxa6az3bkmgsq5570bwpbp1-gitlab-11.5.0
/nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin
/nix/store/v7i0a785vaa142amv16nqk635g87g7ar-gitlab-shell-8.4.1
/nix/store/28g0fi3774ni58b8973brmqk2vbw2y7c-gitlab-workhorse-7.1.0

@flokli
Copy link
Contributor Author

flokli commented Nov 29, 2018

@GrahamcOfBorg build gitlab-runner

@GrahamcOfBorg
Copy link

Success on x86_64-darwin (full log)

Attempted: gitlab-runner

Partial log (click to expand)

/nix/store/2bjcl0sdgxwnqfr32k0h7y05mamba0i6-gitlab-runner-11.5.0-bin

@GrahamcOfBorg
Copy link

Failure on aarch64-linux (full log)

Attempted: gitlab-runner

Partial log (click to expand)

gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/docker/pkg/pools
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/vbatts/tar-split/tar/asm
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/docker/api/types/reference
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/docker/distribution/registry/api/v2
gitlab.com/gitlab-org/gitlab-runner/vendor/gitlab.com/ayufan/golang-cli-helpers
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/prometheus/client_model/go
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/matttproud/golang_protobuf_extensions/pbutil
gitlab.com/gitlab-org/gitlab-runner/vendor/github.com/prometheus/common/expfmt
builder for '/nix/store/24mk5wv9w8w8z0s1mbsqc41wbi65pjp8-gitlab-runner-11.5.0.drv' failed with exit code 27
error: build of '/nix/store/24mk5wv9w8w8z0s1mbsqc41wbi65pjp8-gitlab-runner-11.5.0.drv' failed

@GrahamcOfBorg
Copy link

Success on x86_64-linux (full log)

Attempted: gitlab-runner

Partial log (click to expand)

shrinking /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin/bin/pull-images-for-tests
shrinking /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin/bin/gitlab-runner
shrinking /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin/bin/gitlab-runner-helper
shrinking /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin/bin/scripts
strip is /nix/store/h0lbngpv6ln56hjj59i6l77vxq25flbz-binutils-2.30/bin/strip
stripping (with command strip and flags -S) in /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin/bin
patching script interpreter paths in /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin
checking for references to /build in /nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin...
strip is /nix/store/h0lbngpv6ln56hjj59i6l77vxq25flbz-binutils-2.30/bin/strip
/nix/store/k300hr1g9xhzndrra3r4hkzhk2b85r8g-gitlab-runner-11.5.0-bin

@flokli flokli merged commit 43e3285 into NixOS:release-18.09 Nov 30, 2018
@flokli flokli deleted the gitlab-11.5.0-18.09 branch November 30, 2018 14:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants