Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-8443

mysql-test - innodb.innodb_simulate_comp_failures 'innodb_plugin' is failing

        Details

        • Type: Bug
        • Status: Closed
        • Priority: Major
        • Resolution: Fixed
        • Affects Version/s: 10.0.20
        • Fix Version/s: 10.0.21
        • Component/s: Tests
        • Labels:

          Description

          Test innodb.innodb_simulate_comp_failures 'innodb_plugin' is fail

          ./mysql-test-run.pl innodb.innodb_simulate_comp_failures --force --big-test

...
innodb_zip.innodb_cmp_drop_table 'innodb_plugin' [ pass ]  40028
worker[1] Trying to dump core for [mysqltest - pid: 12539, winpid: 12539]
worker[1] Trying to dump core for [mysqld.1 - pid: 12515, winpid: 12515]
innodb.innodb_simulate_comp_failures 'innodb_plugin' [ fail ]  timeout after 900 seconds
        Test ended at 2015-07-07 21:49:53

Test case timeout after 900 seconds

== /usr/share/mysql-test/var/log/innodb_simulate_comp_failures.log == 
#
# Testing robustness against random compression failures
#
CREATE TABLE t1(id INT AUTO_INCREMENT PRIMARY KEY, msg VARCHAR(255), KEY msg_i(msg)) ENGINE=INNODB ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=8;
SET GLOBAL innodb_simulate_comp_failures = 25;

 == /usr/share/mysql-test/var/tmp/analyze-timeout-mysqld.1.err ==
mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/usr/share/mysql-test/var/tmp/mysqld.1.sock' (111 "Connection refused")


 - saving '/usr/share/mysql-test/var/log/innodb.innodb_simulate_comp_failures-innodb_plugin/' to '/usr/share/mysql-test/var/log/innodb.innodb_simulate_comp_failures-innodb_plugin/'
 - found 'core' (0/5)

Trying 'dbx' to get a backtrace

Trying 'gdb' to get a backtrace
Core generated by '/usr/sbin/mysqld'
Output from gdb follows. The first stack trace is from the failing thread.
The following stack traces are from all threads (so the failing one is
duplicated).
--------------------------

warning: /etc/gdbinit.d/gdb-heap.py: No such file or directory
[New LWP 12516]
[New LWP 12517]
[New LWP 12518]
[New LWP 12519]
[New LWP 12520]
[New LWP 12521]
[New LWP 12522]
[New LWP 12523]
[New LWP 12525]
[New LWP 12526]
[New LWP 12527]
[New LWP 12528]
[New LWP 12529]
[New LWP 12531]
[New LWP 12532]
[New LWP 12533]
[New LWP 12534]
[New LWP 12530]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/usr/sbin/mysqld --defaults-group-suffix=.1 --defaults-file=/usr/share/mysql-te'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6213f760d1 in pthread_kill () from /lib64/libpthread.so.0
#0  0x00007f6213f760d1 in pthread_kill () from /lib64/libpthread.so.0
#1  0x0000000000720184 in handle_fatal_signal ()
#2  <signal handler called>
#3  0x00007f6212e35c5d in poll () from /lib64/libc.so.6
#4  0x000000000055094b in handle_connections_sockets() ()
#5  0x00000000005577d0 in mysqld_main(int, char**) ()
#6  0x00007f6212d7ab05 in __libc_start_main () from /lib64/libc.so.6
#7  0x000000000054bde8 in _start ()

Thread 18 (Thread 0x7f62099e7700 (LWP 12530)):
#0  0x00007f6213f7802d in fsync () from /lib64/libpthread.so.0
#1  0x00007f620d55d3d4 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d4c9e2f in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f620d4846ac in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#4  0x00007f620d48ac8f in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#5  0x00007f620d48c55d in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#6  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#7  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 17 (Thread 0x7f62081af700 (LWP 12534)):
#0  0x00007f6213f785c9 in do_sigwait () from /lib64/libpthread.so.0
#1  0x00007f6213f78653 in sigwait () from /lib64/libpthread.so.0
#2  0x000000000054ec43 in signal_hand ()
#3  0x0000000000909564 in ?? ()
#4  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 16 (Thread 0x7f62017fa700 (LWP 12533)):
#0  0x00007f6213f75408 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f620d562013 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d5fd683 in ib_wqueue_timedwait(ib_wqueue_t*, long) () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f620d4f88e6 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#4  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 15 (Thread 0x7f6201ffb700 (LWP 12532)):
#0  0x00007f6213f75408 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f620d562013 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d4c03c3 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#4  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 14 (Thread 0x7f62027fc700 (LWP 12531)):
#0  0x00007f6213f7505f in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f620d561ec1 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d486d93 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#4  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 13 (Thread 0x7f6202ffd700 (LWP 12529)):
#0  0x00007f6213f7505f in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f620d561ec1 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d5d1c81 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#4  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 12 (Thread 0x7f62037fe700 (LWP 12528)):
#0  0x00007f6212e372f3 in select () from /lib64/libc.so.6
#1  0x00007f620d56306b in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d5d0633 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#4  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 11 (Thread 0x7f6203fff700 (LWP 12527)):
#0  0x00007f6213f75408 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f620d562013 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d5cf4bc in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#4  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 10 (Thread 0x7f62089e5700 (LWP 12526)):
#0  0x00007f6213f75408 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f620d562013 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d5cf8dc in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#4  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 9 (Thread 0x7f62091e6700 (LWP 12525)):
#0  0x00007f6213f75408 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007f620d562013 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d548a65 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#4  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 8 (Thread 0x7f620a3ed700 (LWP 12523)):
#0  0x00007f62145d76a4 in ?? () from /lib64/libaio.so.1
#1  0x00007f620d55fe15 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d4c7290 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f620d5d33c8 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#4  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 7 (Thread 0x7f620abee700 (LWP 12522)):
#0  0x00007f62145d76a4 in ?? () from /lib64/libaio.so.1
#1  0x00007f620d55fe15 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d4c7290 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f620d5d33c8 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#4  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 6 (Thread 0x7f620b3ef700 (LWP 12521)):
#0  0x00007f62145d76a4 in ?? () from /lib64/libaio.so.1
#1  0x00007f620d55fe15 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d4c7290 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f620d5d33c8 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#4  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 5 (Thread 0x7f620bbf0700 (LWP 12520)):
#0  0x00007f62145d76a4 in ?? () from /lib64/libaio.so.1
#1  0x00007f620d55fe15 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d4c7290 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f620d5d33c8 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#4  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 4 (Thread 0x7f620c3f1700 (LWP 12519)):
#0  0x00007f62145d76a4 in ?? () from /lib64/libaio.so.1
#1  0x00007f620d55fe15 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d4c7290 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f620d5d33c8 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#4  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 3 (Thread 0x7f620cbf2700 (LWP 12518)):
#0  0x00007f62145d76a4 in ?? () from /lib64/libaio.so.1
#1  0x00007f620d55fe15 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#2  0x00007f620d4c7290 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#3  0x00007f620d5d33c8 in ?? () from /usr/lib64/mysql/plugin/ha_innodb.so
#4  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 2 (Thread 0x7f620e094700 (LWP 12517)):
#0  0x00007f6213f75408 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x000000000088cfc6 in ?? ()
#2  0x0000000000884d89 in ?? ()
#3  0x0000000000909564 in ?? ()
#4  0x00007f6213f710a4 in start_thread () from /lib64/libpthread.so.0
#5  0x00007f6212e3e08d in clone () from /lib64/libc.so.6

Thread 1 (Thread 0x7f62149db740 (LWP 12516)):
#0  0x00007f6213f760d1 in pthread_kill () from /lib64/libpthread.so.0
#1  0x0000000000720184 in handle_fatal_signal ()
#2  <signal handler called>
#3  0x00007f6212e35c5d in poll () from /lib64/libc.so.6
#4  0x000000000055094b in handle_connections_sockets() ()
#5  0x00000000005577d0 in mysqld_main(int, char**) ()
#6  0x00007f6212d7ab05 in __libc_start_main () from /lib64/libc.so.6
#7  0x000000000054bde8 in _start ()

Compressed file /usr/share/mysql-test/var/log/innodb.innodb_simulate_comp_failures-innodb_plugin/mysqld.1/data/core
***Warnings generated in error logs during shutdown after running tests: innodb.innodb_simulate_comp_failures

Attempting backtrace. You can use the following information to find out


innodb.innodb_simulate_comp_failures_small 'innodb_plugin' [ pass ]  147737
innodb.innodb-bigblob 'innodb_plugin'    [ pass ]  400270
innodb.innochecksum 'innodb_plugin'      [ pass ]  105447
innodb.innodb_bug12400341 'innodb_plugin' [ skipped ]  Test requires InnoDB built with UNIV_DEBUG definition.
innodb.innodb-mdev-7408 'innodb_plugin'  [ pass ]    854
...

          mariadb-10.0.20-18.1.x86_64

          https://bugzilla.suse.com/show_bug.cgi?id=937343

            Gliffy Diagrams

              Attachments

                Activity

                Ascending order - Click to sort in descending order
                Hide
                Permalink
                jplindst Jan Lindström added a comment -

                It's seems that '--mem' option helps to pass this test.

                /usr/share/mysql-test # ./mysql-test-run.pl innodb.innodb_simulate_comp_failures --force --big-test --mem
Logging: ./mysql-test-run.pl  innodb.innodb_simulate_comp_failures --force --big-test --mem
vardir: /usr/share/mysql-test/var
Checking leftover processes...
Removing old var directory...
Creating var directory '/usr/share/mysql-test/var'...
 - symlinking 'var' to '/dev/shm/var_auto_rsnG'
Checking supported features...
MariaDB Version 10.0.20-MariaDB
 - SSL connections supported
Collecting tests...
Installing system database...

==============================================================================

TEST                                      RESULT   TIME (ms) or COMMENT
--------------------------------------------------------------------------

worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019
worker[1] mysql-test-run: WARNING: running this script as _root_ will cause some tests to be skipped
innodb.innodb_simulate_comp_failures 'innodb_plugin' [ pass ]  119206
innodb.innodb_simulate_comp_failures 'xtradb' [ pass ]  227047
--------------------------------------------------------------------------
The servers were restarted 1 times
Spent 346.253 of 353 seconds executing testcases

Completed: All 2 tests were successful.
                Show
                jplindst Jan Lindström added a comment - It's seems that '--mem' option helps to pass this test. /usr/share/mysql-test # ./mysql-test-run.pl innodb.innodb_simulate_comp_failures --force --big-test --mem Logging: ./mysql-test-run.pl innodb.innodb_simulate_comp_failures --force --big-test --mem vardir: /usr/share/mysql-test/var Checking leftover processes... Removing old var directory... Creating var directory '/usr/share/mysql-test/var'... - symlinking 'var' to '/dev/shm/var_auto_rsnG' Checking supported features... MariaDB Version 10.0.20-MariaDB - SSL connections supported Collecting tests... Installing system database... ============================================================================== TEST RESULT TIME (ms) or COMMENT -------------------------------------------------------------------------- worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019 worker[1] mysql-test-run: WARNING: running this script as _root_ will cause some tests to be skipped innodb.innodb_simulate_comp_failures 'innodb_plugin' [ pass ] 119206 innodb.innodb_simulate_comp_failures 'xtradb' [ pass ] 227047 -------------------------------------------------------------------------- The servers were restarted 1 times Spent 346.253 of 353 seconds executing testcases Completed: All 2 tests were successful.
                Hide
                Permalink
                jplindst Jan Lindström added a comment -

                commit 0bb0ace4204bdcc2dc9b8ca8aeeda03882c44a2e
                Author: Jan Lindström <jan.lindstrom@mariadb.com>
                Date: Mon Jul 20 14:36:30 2015 +0300

                MDEV-8443: mysql-test - innodb.innodb_simulate_comp_failures 'innodb_plugin' is failing

                Problem was that test just takes too long time in slow I/O and triggers
                testcase timeout. Reduced the number of operations and inserts to make
                test shorter.

                Show
                jplindst Jan Lindström added a comment - commit 0bb0ace4204bdcc2dc9b8ca8aeeda03882c44a2e Author: Jan Lindström <jan.lindstrom@mariadb.com> Date: Mon Jul 20 14:36:30 2015 +0300 MDEV-8443 : mysql-test - innodb.innodb_simulate_comp_failures 'innodb_plugin' is failing Problem was that test just takes too long time in slow I/O and triggers testcase timeout. Reduced the number of operations and inserts to make test shorter.

                  People

                  • Assignee:
                    jplindst Jan Lindström
                    Reporter:
                    nirbhay_c Nirbhay Choubey
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    2 Start watching this issue

                    Dates

                    • Created:
                      Updated:
                      Resolved:

                      Time Tracking

                      Estimated:
                      Original Estimate - Not Specified
                      Not Specified
                      Remaining:
                      Remaining Estimate - 0 minutes
                      0m
                      Logged:
                      Time Spent - 2 hours
                      2h