Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

nixos/tests: add check mariadb galera cluster #84136

Merged
merged 4 commits into from
May 7, 2020
Merged

nixos/tests: add check mariadb galera cluster #84136

merged 4 commits into from
May 7, 2020
+459 −9

Conversation

Izorkin
Copy link
Contributor

@Izorkin Izorkin commented Apr 2, 2020

Motivation for this change

Moved mysql tests to subfolder.
Added check mariadb galera cluster.

cc @flokli @aanderse @worldofpeace @disassembler.

Things done
  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Ensured that relevant documentation is up to date
  • Fits CONTRIBUTING.md.

Sorry, something went wrong.

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 2, 2020

@GrahamcOfBorg test mariadbGalera

@ofborg ofborg bot added 6.topic: nixos Issues or PRs affecting NixOS modules, or package usability issues specific to NixOS 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin 10.rebuild-linux: 0 This PR does not cause any packages to rebuild on Linux labels Apr 2, 2020
@Izorkin Izorkin force-pushed the mariadb-galera-test branch from fbf483e to c3703a8 Compare April 2, 2020 21:26
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 2, 2020

@GrahamcOfBorg test mariadbGalera

@Izorkin Izorkin force-pushed the mariadb-galera-test branch 2 times, most recently from d864405 to 0da8331 Compare April 3, 2020 07:55
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 3, 2020

@GrahamcOfBorg test mariadbGalera

flokli
flokli reviewed Apr 3, 2020
View reviewed changes
@Izorkin Izorkin force-pushed the mariadb-galera-test branch from 0da8331 to 80722c8 Compare April 3, 2020 15:54
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 3, 2020

@GrahamcOfBorg test mariadbGalera

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 3, 2020

@GrahamcOfBorg test mariadb-galera

@Izorkin Izorkin force-pushed the mariadb-galera-test branch from 80722c8 to 1e0a6c7 Compare April 4, 2020 05:06
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 4, 2020

@GrahamcOfBorg test mariadb-galera

@ofborg ofborg bot added the ofborg-internal-error Ofborg encountered an error label Apr 4, 2020
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 4, 2020

@GrahamcOfBorg eval

@grahamc grahamc removed the ofborg-internal-error Ofborg encountered an error label Apr 4, 2020
@flokli
Copy link
Contributor

flokli commented Apr 4, 2020

@Izorkin Ran the test locally, it seems it's stuck at

galera_03_rsync # [  201.426407] mysqld[893]: 2020-04-04 22:46:55 0 [Note] WSREP: resuming provider at 10
galera_03_rsync # [  201.429545] mysqld[893]: 2020-04-04 22:46:55 0 [Note] WSREP: Provider resumed.
galera_04_rsync # [  142.918417] rsyncd[1436]: name lookup failed for 192.168.2.1: Temporary failure in name resolution
galera_04_rsync # [  142.920801] rsyncd[1436]: connect from UNKNOWN (192.168.2.1)
galera_04_rsync # [  142.924294] rsyncd[1436]: rsync to rsync_sst/ from UNKNOWN (192.168.2.1)
galera_04_rsync # [  142.925897] rsyncd[1436]: receiving file list
galera_04_rsync # [  142.972423] rsyncd[1436]: sent 48 bytes  received 193 bytes  total size 41
galera_03_rsync # [  216.515459] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: 0.0 (galera_03): State transfer to 1.0 (galera_04) complete.
galera_04_rsync # [  142.978348] mysqld[903]: 2020-04-04 22:47:10 0 [Note] WSREP: 0.0 (galera_03): State transfer to 1.0 (galera_04) complete.
galera_03_rsync # [  216.517765] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 5)
galera_03_rsync # [  216.521805] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: Member 0.0 (galera_03) synced with group.
galera_03_rsync # [  216.523508] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 5)
galera_04_rsync # [  142.983994] mysqld[903]: 2020-04-04 22:47:10 0 [Note] WSREP: Member 0.0 (galera_03) synced with group.
galera_03_rsync # [  216.525931] mysqld[893]: 2020-04-04 22:47:10 1 [Note] WSREP: Synchronized with group, ready for connections
galera_03_rsync # [  216.527844] mysqld[893]: 2020-04-04 22:47:10 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
galera_04_rsync # [  143.125731] mysqld[903]: WSREP_SST: [INFO] Joiner cleanup. rsync PID: 961 (20200404 22:47:10.567)
galera_04_rsync # [  143.528222] rsyncd[961]: sent 0 bytes  received 0 bytes  total size 0
galera_04_rsync # [  143.670738] mysqld[903]: WSREP_SST: [INFO] Joiner cleanup done. (20200404 22:47:11.112)
galera_04_rsync # [  143.678394] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: SST complete, seqno: 5
galera_04_rsync # [  143.703722] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Using Linux native AIO
galera_04_rsync # [  143.705639] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
galera_04_rsync # [  143.707979] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Uses event mutexes
galera_04_rsync # [  143.709711] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
galera_04_rsync # [  143.711215] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Number of pools: 1
galera_04_rsync # [  143.712594] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Using SSE2 crc32 instructions
galera_04_rsync # [  143.718026] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
galera_04_rsync # [  143.721941] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Completed initialization of buffer pool
galera_04_rsync # [  143.724946] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
galera_04_rsync # [  143.730072] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=1635075
galera_04_rsync # [  143.838651] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
galera_04_rsync # [  143.841085] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Creating shared tablespace for temporary tables
galera_04_rsync # [  143.844787] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
galera_04_rsync # [  143.849868] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
galera_04_rsync # [  143.852109] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Waiting for purge to start
galera_04_rsync # [  143.904178] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: 10.3.22 started; log sequence number 1635084; transaction id 33
galera_04_rsync # [  143.907945] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Plugin 'FEEDBACK' is disabled.
galera_03_rsync # [  217.454788] mysqld[893]: 2020-04-04 22:47:11 0 [Note] WSREP: 1.0 (galera_04): State transfer from 0.0 (galera_03) complete.
galera_04_rsync # [  143.914193] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
galera_03_rsync # [  217.456750] mysqld[893]: 2020-04-04 22:47:11 0 [Note] WSREP: Member 1.0 (galera_04) synced with group.
galera_04_rsync # [  143.919824] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Buffer pool(s) load completed at 200404 22:47:11
galera_04_rsync # [  143.922910] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Server socket created on IP: '0.0.0.0'.
galera_04_rsync # [  143.925181] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Signalling provider to continue.
galera_04_rsync # [  143.927311] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: SST received: c2866648-76c5-11ea-af3c-e751edcdf91b:5
galera_04_rsync # [  143.929547] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: 1.0 (galera_04): State transfer from 0.0 (galera_03) complete.
galera_04_rsync # [  143.931665] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 5)
galera_04_rsync # [  143.933587] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Member 1.0 (galera_04) synced with group.
galera_04_rsync # [  143.935348] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 5)
galera_04_rsync # [  143.937376] mysqld[903]: 2020-04-04 22:47:11 1 [Note] WSREP: Synchronized with group, ready for connections
galera_04_rsync # [  143.939631] mysqld[903]: 2020-04-04 22:47:11 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
galera_04_rsync # [  143.942303] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Reading of all Master_info entries succeeded
galera_04_rsync # [  143.944319] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Added new Master_info '' to hash table
galera_04_rsync # [  143.946434] mysqld[903]: 2020-04-04 22:47:11 0 [Note] /nix/store/kfiajz1r1cwxf5j9kmx2ma5cm42bf1l1-mariadb-server-10.3.22/bin/mysqld: ready for connections.
galera_04_rsync # [  143.949073] mysqld[903]: Version: '10.3.22-MariaDB'  socket: '/run/mysqld/mysqld.sock'  port: 3306  MariaDB Server
galera_04_rsync # [  143.988935] systemd[1]: Started MySQL Server.
galera_04_rsync # [  143.991279] systemd[1]: Reached target Multi-User System.
galera_04_rsync # [  143.992629] systemd[1]: Startup finished in 5.027s (kernel) + 2min 18.960s (userspace) = 2min 23.988s.

did you run it via nixosTests.mariadb-galera?

Also, I noticed a lot of spam about temporary failure in name resolution, while trying to do a reverse lookup of the internal IPs.

Could this be improved it we add the IPs and names to /etc/hosts, like it's done in nixos/tests/nfs/kerberos.nix?

Also, doing that, we might be able to switch some of the IPs to hostnames.

@Izorkin Izorkin force-pushed the mariadb-galera-test branch from 1e0a6c7 to 67a7e39 Compare April 5, 2020 06:16
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 5, 2020

did you run it via nixosTests.mariadb-galera?

Yes, it works for me

Added hostnames.

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 5, 2020

@GrahamcOfBorg test mariadb-galera

flokli
flokli reviewed Apr 5, 2020
View reviewed changes
@Izorkin Izorkin force-pushed the mariadb-galera-test branch from 67a7e39 to 551c3b0 Compare April 5, 2020 19:03
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 5, 2020

@GrahamcOfBorg test mariadb-galera-mariabackup
@GrahamcOfBorg test mariadb-galera-rsync

@flokli flokli requested review from florianjacob and dasJ April 6, 2020 08:13
@flokli
Copy link
Contributor

flokli commented Apr 6, 2020 •
edited
Loading

Pinging some more people contributing to mysql for some more feedback.

@Izorkin Izorkin force-pushed the mariadb-galera-test branch from 551c3b0 to 9574b20 Compare May 6, 2020 11:31
@Izorkin Izorkin force-pushed the mariadb-galera-test branch from 9574b20 to e080090 Compare May 6, 2020 12:31
@Izorkin Izorkin force-pushed the mariadb-galera-test branch from e080090 to 585bbc5 Compare May 6, 2020 13:48
@Izorkin
Copy link
Contributor Author

Izorkin commented May 6, 2020

@GrahamcOfBorg test mariadb-galera-mariabackup
@GrahamcOfBorg test mariadb-galera-rsync
@GrahamcOfBorg test mysql
@GrahamcOfBorg test mysql-autobackup
@GrahamcOfBorg test mysql-backup
@GrahamcOfBorg test mysql-replication

@Mic92 Mic92 merged commit c880c7b into NixOS:master May 7, 2020
@Izorkin Izorkin deleted the mariadb-galera-test branch May 7, 2020 16:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Mic92 Mic92

@flokli flokli

@florianjacob florianjacob

@dasJ dasJ

Assignees
No one assigned
Labels
6.topic: nixos Issues or PRs affecting NixOS modules, or package usability issues specific to NixOS 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin 10.rebuild-linux: 0 This PR does not cause any packages to rebuild on Linux
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
4 participants
@Izorkin @flokli @Mic92 @grahamc