Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nixos/tests: add check mariadb galera cluster #84136

Merged
merged 4 commits into from May 7, 2020

Conversation

Izorkin
Copy link
Contributor

@Izorkin Izorkin commented Apr 2, 2020

Motivation for this change

Moved mysql tests to subfolder.
Added check mariadb galera cluster.

cc @flokli @aanderse @worldofpeace @disassembler.

Things done
  • Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
  • Built on platform(s)
    • NixOS
    • macOS
    • other Linux distributions
  • Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
  • Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
  • Tested execution of all binary files (usually in ./result/bin/)
  • Determined the impact on package closure size (by running nix path-info -S before and after)
  • Ensured that relevant documentation is up to date
  • Fits CONTRIBUTING.md.

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 2, 2020

@GrahamcOfBorg test mariadbGalera

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 2, 2020

@GrahamcOfBorg test mariadbGalera

@Izorkin Izorkin force-pushed the mariadb-galera-test branch 2 times, most recently from d864405 to 0da8331 Compare April 3, 2020 07:55
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 3, 2020

@GrahamcOfBorg test mariadbGalera

nixos/tests/all-tests.nix Outdated Show resolved Hide resolved
nixos/tests/all-tests.nix Outdated Show resolved Hide resolved
nixos/tests/all-tests.nix Outdated Show resolved Hide resolved
nixos/tests/mysql/mariadb-galera.nix Outdated Show resolved Hide resolved
nixos/tests/mysql/mariadb-galera.nix Outdated Show resolved Hide resolved
nixos/tests/mysql/mariadb-galera.nix Outdated Show resolved Hide resolved
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 3, 2020

@GrahamcOfBorg test mariadbGalera

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 3, 2020

@GrahamcOfBorg test mariadb-galera

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 4, 2020

@GrahamcOfBorg test mariadb-galera

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 4, 2020

@GrahamcOfBorg eval

@flokli
Copy link
Contributor

flokli commented Apr 4, 2020

@Izorkin Ran the test locally, it seems it's stuck at

galera_03_rsync # [  201.426407] mysqld[893]: 2020-04-04 22:46:55 0 [Note] WSREP: resuming provider at 10
galera_03_rsync # [  201.429545] mysqld[893]: 2020-04-04 22:46:55 0 [Note] WSREP: Provider resumed.
galera_04_rsync # [  142.918417] rsyncd[1436]: name lookup failed for 192.168.2.1: Temporary failure in name resolution
galera_04_rsync # [  142.920801] rsyncd[1436]: connect from UNKNOWN (192.168.2.1)
galera_04_rsync # [  142.924294] rsyncd[1436]: rsync to rsync_sst/ from UNKNOWN (192.168.2.1)
galera_04_rsync # [  142.925897] rsyncd[1436]: receiving file list
galera_04_rsync # [  142.972423] rsyncd[1436]: sent 48 bytes  received 193 bytes  total size 41
galera_03_rsync # [  216.515459] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: 0.0 (galera_03): State transfer to 1.0 (galera_04) complete.
galera_04_rsync # [  142.978348] mysqld[903]: 2020-04-04 22:47:10 0 [Note] WSREP: 0.0 (galera_03): State transfer to 1.0 (galera_04) complete.
galera_03_rsync # [  216.517765] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 5)
galera_03_rsync # [  216.521805] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: Member 0.0 (galera_03) synced with group.
galera_03_rsync # [  216.523508] mysqld[893]: 2020-04-04 22:47:10 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 5)
galera_04_rsync # [  142.983994] mysqld[903]: 2020-04-04 22:47:10 0 [Note] WSREP: Member 0.0 (galera_03) synced with group.
galera_03_rsync # [  216.525931] mysqld[893]: 2020-04-04 22:47:10 1 [Note] WSREP: Synchronized with group, ready for connections
galera_03_rsync # [  216.527844] mysqld[893]: 2020-04-04 22:47:10 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
galera_04_rsync # [  143.125731] mysqld[903]: WSREP_SST: [INFO] Joiner cleanup. rsync PID: 961 (20200404 22:47:10.567)
galera_04_rsync # [  143.528222] rsyncd[961]: sent 0 bytes  received 0 bytes  total size 0
galera_04_rsync # [  143.670738] mysqld[903]: WSREP_SST: [INFO] Joiner cleanup done. (20200404 22:47:11.112)
galera_04_rsync # [  143.678394] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: SST complete, seqno: 5
galera_04_rsync # [  143.703722] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Using Linux native AIO
galera_04_rsync # [  143.705639] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
galera_04_rsync # [  143.707979] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Uses event mutexes
galera_04_rsync # [  143.709711] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
galera_04_rsync # [  143.711215] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Number of pools: 1
galera_04_rsync # [  143.712594] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Using SSE2 crc32 instructions
galera_04_rsync # [  143.718026] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
galera_04_rsync # [  143.721941] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Completed initialization of buffer pool
galera_04_rsync # [  143.724946] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
galera_04_rsync # [  143.730072] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=1635075
galera_04_rsync # [  143.838651] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
galera_04_rsync # [  143.841085] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Creating shared tablespace for temporary tables
galera_04_rsync # [  143.844787] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
galera_04_rsync # [  143.849868] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
galera_04_rsync # [  143.852109] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Waiting for purge to start
galera_04_rsync # [  143.904178] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: 10.3.22 started; log sequence number 1635084; transaction id 33
galera_04_rsync # [  143.907945] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Plugin 'FEEDBACK' is disabled.
galera_03_rsync # [  217.454788] mysqld[893]: 2020-04-04 22:47:11 0 [Note] WSREP: 1.0 (galera_04): State transfer from 0.0 (galera_03) complete.
galera_04_rsync # [  143.914193] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
galera_03_rsync # [  217.456750] mysqld[893]: 2020-04-04 22:47:11 0 [Note] WSREP: Member 1.0 (galera_04) synced with group.
galera_04_rsync # [  143.919824] mysqld[903]: 2020-04-04 22:47:11 0 [Note] InnoDB: Buffer pool(s) load completed at 200404 22:47:11
galera_04_rsync # [  143.922910] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Server socket created on IP: '0.0.0.0'.
galera_04_rsync # [  143.925181] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Signalling provider to continue.
galera_04_rsync # [  143.927311] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: SST received: c2866648-76c5-11ea-af3c-e751edcdf91b:5
galera_04_rsync # [  143.929547] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: 1.0 (galera_04): State transfer from 0.0 (galera_03) complete.
galera_04_rsync # [  143.931665] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 5)
galera_04_rsync # [  143.933587] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Member 1.0 (galera_04) synced with group.
galera_04_rsync # [  143.935348] mysqld[903]: 2020-04-04 22:47:11 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 5)
galera_04_rsync # [  143.937376] mysqld[903]: 2020-04-04 22:47:11 1 [Note] WSREP: Synchronized with group, ready for connections
galera_04_rsync # [  143.939631] mysqld[903]: 2020-04-04 22:47:11 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
galera_04_rsync # [  143.942303] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Reading of all Master_info entries succeeded
galera_04_rsync # [  143.944319] mysqld[903]: 2020-04-04 22:47:11 0 [Note] Added new Master_info '' to hash table
galera_04_rsync # [  143.946434] mysqld[903]: 2020-04-04 22:47:11 0 [Note] /nix/store/kfiajz1r1cwxf5j9kmx2ma5cm42bf1l1-mariadb-server-10.3.22/bin/mysqld: ready for connections.
galera_04_rsync # [  143.949073] mysqld[903]: Version: '10.3.22-MariaDB'  socket: '/run/mysqld/mysqld.sock'  port: 3306  MariaDB Server
galera_04_rsync # [  143.988935] systemd[1]: Started MySQL Server.
galera_04_rsync # [  143.991279] systemd[1]: Reached target Multi-User System.
galera_04_rsync # [  143.992629] systemd[1]: Startup finished in 5.027s (kernel) + 2min 18.960s (userspace) = 2min 23.988s.

did you run it via nixosTests.mariadb-galera?

Also, I noticed a lot of spam about temporary failure in name resolution, while trying to do a reverse lookup of the internal IPs.

Could this be improved it we add the IPs and names to /etc/hosts, like it's done in nixos/tests/nfs/kerberos.nix?

Also, doing that, we might be able to switch some of the IPs to hostnames.

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 5, 2020

did you run it via nixosTests.mariadb-galera?

Yes, it works for me

Added hostnames.

@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 5, 2020

@GrahamcOfBorg test mariadb-galera

nixos/tests/all-tests.nix Show resolved Hide resolved
nixos/tests/mysql/mariadb-galera.nix Outdated Show resolved Hide resolved
@Izorkin
Copy link
Contributor Author

Izorkin commented Apr 5, 2020

@GrahamcOfBorg test mariadb-galera-mariabackup
@GrahamcOfBorg test mariadb-galera-rsync

@flokli flokli requested review from florianjacob and dasJ April 6, 2020 08:13
@flokli
Copy link
Contributor

flokli commented Apr 6, 2020

Pinging some more people contributing to mysql for some more feedback.

@Izorkin
Copy link
Contributor Author

Izorkin commented May 6, 2020

@GrahamcOfBorg test mariadb-galera-mariabackup
@GrahamcOfBorg test mariadb-galera-rsync
@GrahamcOfBorg test mysql
@GrahamcOfBorg test mysql-autobackup
@GrahamcOfBorg test mysql-backup
@GrahamcOfBorg test mysql-replication

@Mic92 Mic92 merged commit c880c7b into NixOS:master May 7, 2020
@Izorkin Izorkin deleted the mariadb-galera-test branch May 7, 2020 16:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants