Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-3853

Deadlock or assertion ret < srv_page_size failure on concurrent ALTER TABLE and SELECT from I_S

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 10.0.1, 5.5.29, 5.3.10, 5.3.11, 5.2.13, 5.1.66
    • Fix Version/s: 5.3.13, 5.2.15, 5.1.73
    • Component/s: None
    • Labels:
      None

      Description

      It's a recent regression which seems to have appeared after merge from Percona-Server 5.1.66-rel14.1.
      A bug for Percona Server hasn't been filed yet as on some reason it's less reliably reproducible there, although I've seen it once.

      On MariaDB, reproducible starting from maria/5.1 revno 3163, maria/5.3 revno 3592.

      +----+------+-----------------+------+---------+------+-------------------+-----------------------------------------------------------------+----------+
      | Id | User | Host            | db   | Command | Time | State             | Info                                                            | Progress |
      +----+------+-----------------+------+---------+------+-------------------+-----------------------------------------------------------------+----------+
      |  2 | root | 127.0.0.1:59063 | test | Sleep   |  115 |                   | NULL                                                            |    0.000 |
      |  7 | root | 127.0.0.1:59068 | test | Query   |  106 | copy to tmp table | ALTER TABLE `E` ADD COLUMN o INTEGER                            |   54.524 |
      |  8 | root | 127.0.0.1:59069 | test | Query   |  105 | executing         | SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1 |    0.000 |
      |  9 | root | 127.0.0.1:59070 | test | Query   |  105 | executing         | SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1 |    0.000 |
      | 13 | root | 127.0.0.1:59074 | NULL | Query   |    0 | NULL              | show full processlist                                           |    0.000 |
      +----+------+-----------------+------+---------+------+-------------------+-----------------------------------------------------------------+----------+
      

      Stacks of the three threads executing statements:

      Thread 4 (Thread 0x7f818aa0f710 (LWP 3794)):
      #0  0x00007f81a940e39c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
      #1  0x0000000000bdb882 in safe_cond_wait (cond=0x7f81990945f0, mp=0x7f8199094540,
          file=0xdfaa60 "os/os0sync.c", line=210) at thr_mutex.c:498
      #2  0x0000000000ae990b in os_cond_wait (cond=0x7f81990945f0, mutex=0x7f8199094540)
          at os/os0sync.c:210
      #3  0x0000000000aea131 in os_event_wait_low (event=0x7f8199094540, reset_sig_count=26)
          at os/os0sync.c:636
      #4  0x0000000000b2b9d6 in sync_array_wait_event (arr=0x7f8198008e90, index=0)
          at sync/sync0arr.c:451
      #5  0x0000000000b2cd93 in rw_lock_x_lock_wait (lock=0x7f818ffedd70,
          file_name=0xe05040 "trx/trx0rec.c", line=1270) at sync/sync0rw.c:520
      #6  0x0000000000b2ce72 in rw_lock_x_lock_low (lock=0x7f818ffedd70, pass=0,
          file_name=0xe05040 "trx/trx0rec.c", line=1270) at sync/sync0rw.c:563
      #7  0x0000000000b2cf47 in rw_lock_x_lock_func (lock=0x7f818ffedd70, pass=0,
          file_name=0xe05040 "trx/trx0rec.c", line=1270) at sync/sync0rw.c:622
      #8  0x0000000000b62caf in buf_page_get_gen (space=0, zip_size=0, offset=46, rw_latch=2, guess=0x0,
          mode=10, file=0xe05040 "trx/trx0rec.c", line=1270, mtr=0x7f818aa0b060) at buf/buf0buf.c:2230
      #9  0x0000000000b3454a in trx_undo_report_row_operation (flags=0, op_type=1, thr=0x7f81992cc630,
          index=0x7f819930b518, clust_entry=0x7f8199308df8, update=0x0, cmpl_info=0, rec=0x0,
          roll_ptr=0x7f818aa0b5c0) at trx/trx0rec.c:1268
      #10 0x0000000000b51bed in btr_cur_ins_lock_and_undo (flags=0, cursor=0x7f818aa0bbf0,
          entry=0x7f8199308df8, thr=0x7f81992cc630, mtr=0x7f818aa0b740, inherit=0x7f818aa0b640)
          at btr/btr0cur.c:1083
      #11 0x0000000000b52092 in btr_cur_optimistic_insert (flags=0, cursor=0x7f818aa0bbf0,
          entry=0x7f8199308df8, rec=0x7f818aa0bbe8, big_rec=0x7f818aa0bbe0, n_ext=0, thr=0x7f81992cc630,
          mtr=0x7f818aa0b740) at btr/btr0cur.c:1284
      #12 0x0000000000b06c08 in row_ins_index_entry_low (mode=2, index=0x7f819930b518,
          entry=0x7f8199308df8, n_ext=0, thr=0x7f81992cc630) at row/row0ins.c:2184
      #13 0x0000000000b07053 in row_ins_index_entry (index=0x7f819930b518, entry=0x7f8199308df8,
          n_ext=0, foreign=1, thr=0x7f81992cc630) at row/row0ins.c:2296
      #14 0x0000000000b07295 in row_ins_index_entry_step (node=0x7f8199451070, thr=0x7f81992cc630)
          at row/row0ins.c:2381
      #15 0x0000000000b074e0 in row_ins (node=0x7f8199451070, thr=0x7f81992cc630) at row/row0ins.c:2513
      #16 0x0000000000b076f3 in row_ins_step (thr=0x7f81992cc630) at row/row0ins.c:2623
      #17 0x0000000000b0d460 in row_insert_for_mysql (mysql_rec=0x7f8199307230 "\f\374\210\003",
          prebuilt=0x7f819947c958) at row/row0mysql.c:1168
      #18 0x0000000000aafe21 in ha_innobase::write_row (this=0x7f819944ff40,
          record=0x7f8199307230 "\f\374\210\003") at handler/ha_innodb.cc:5649
      #19 0x0000000000862b85 in handler::ha_write_row (this=0x7f819944ff40,
          buf=0x7f8199307230 "\f\374\210\003") at handler.cc:4978
      #20 0x0000000000890d3f in copy_data_between_tables (thd=0x7f8199297e38, from=0x7f818400c768,
          to=0x7f81992a9428, create=..., ignore=false, order_num=0, order=0x0, copied=0x7f818aa0db30,
          deleted=0x7f818aa0db28, keys_onoff=LEAVE_AS_IS, error_if_not_empty=false) at sql_table.cc:8118
      #21 0x000000000088f000 in mysql_alter_table (thd=0x7f8199297e38, new_db=0x1c19148 "test",
          new_name=0x1c18d18 "E", create_info=0x7f818aa0e100, table_list=0x1c18d50,
          alter_info=0x7f818aa0e200, order_num=0, order=0x0, ignore=false, require_online=false)
          at sql_table.cc:7540
      #22 0x00000000006e4002 in mysql_execute_command (thd=0x7f8199297e38) at sql_parse.cc:2974
      #23 0x00000000006edc50 in mysql_parse (thd=0x7f8199297e38,
          rawbuf=0x1c18c50 "ALTER TABLE `E` ADD COLUMN o INTEGER", length=36,
          found_semicolon=0x7f818aa0ec98) at sql_parse.cc:6158
      #24 0x00000000006dfa90 in dispatch_command (command=COM_QUERY, thd=0x7f8199297e38,
          packet=0x7f81992dbe59 "ALTER TABLE `E` ADD COLUMN o INTEGER", packet_length=36)
          at sql_parse.cc:1228
      #25 0x00000000006dedc4 in do_command (thd=0x7f8199297e38) at sql_parse.cc:923
      #26 0x00000000006dbc12 in handle_one_connection (arg=0x7f8199297e38) at sql_connect.cc:1218
      #27 0x00007f81a9409a4f in start_thread () from /lib64/libpthread.so.0
      #28 0x00007f81a87f382d in clone () from /lib64/libc.so.6
      #29 0x0000000000000000 in ?? ()
      
      Thread 3 (Thread 0x7f818a9c7710 (LWP 3796)):
      #0  0x00007f81a940e39c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
      #1  0x0000000000bdb882 in safe_cond_wait (cond=0x7f8199086bf0, mp=0x7f8199086b40,
          file=0xdfaa60 "os/os0sync.c", line=210) at thr_mutex.c:498
      #2  0x0000000000ae990b in os_cond_wait (cond=0x7f8199086bf0, mutex=0x7f8199086b40)
          at os/os0sync.c:210
      #3  0x0000000000aea131 in os_event_wait_low (event=0x7f8199086b40, reset_sig_count=1)
          at os/os0sync.c:636
      #4  0x0000000000b2b9d6 in sync_array_wait_event (arr=0x7f8198008e90, index=2)
          at sync/sync0arr.c:451
      #5  0x0000000000b2d6a8 in mutex_spin_wait (mutex=0x7f818ffe65f8,
          file_name=0xe09b88 "./include/buf0buf.ic", line=347) at sync/sync0sync.c:621
      #6  0x0000000000b2d22b in mutex_enter_func (mutex=0x7f818ffe65f8,
          file_name=0xe09b88 "./include/buf0buf.ic", line=347) at ./include/sync0sync.ic:221
      #7  0x0000000000b5ee12 in buf_page_get_mutex_enter (bpage=0x7f818ffe6540)
          at ./include/buf0buf.ic:347
      #8  0x0000000000ac72fc in i_s_innodb_fill_buffer_pool (thd=0x7f81992dfe98, tables=0x1ba1918)
          at handler/i_s.cc:5796
      #9  0x0000000000ac74d7 in i_s_innodb_buffer_page_fill_table (thd=0x7f81992dfe98, tables=0x1ba1918)
          at handler/i_s.cc:5852
      #10 0x00000000008b27ed in get_schema_tables_result (join=0x1e514e0,
          executed_place=PROCESSED_BY_JOIN_EXEC) at sql_show.cc:7089
      #11 0x0000000000763e67 in JOIN::exec (this=0x1e514e0) at sql_select.cc:2225
      #12 0x00000000007668fd in mysql_select (thd=0x7f81992dfe98, rref_pointer_array=0x7f81992e2b88,
          tables=0x1ba1918, wild_num=1, fields=..., conds=0x0, og_num=0, order=0x0, group=0x0,
          having=0x0, proc_param=0x0, select_options=2684635648, result=0x1ba3410, unit=0x7f81992e2428,
          select_lex=0x7f81992e2930) at sql_select.cc:2983
      #13 0x000000000075d449 in handle_select (thd=0x7f81992dfe98, lex=0x7f81992e2388, result=0x1ba3410,
          setup_tables_done_option=0) at sql_select.cc:286
      #14 0x00000000006eb275 in execute_sqlcom_select (thd=0x7f81992dfe98, all_tables=0x1ba1918)
          at sql_parse.cc:5157
      #15 0x00000000006e2332 in mysql_execute_command (thd=0x7f81992dfe98) at sql_parse.cc:2290
      #16 0x00000000006edc50 in mysql_parse (thd=0x7f81992dfe98,
          rawbuf=0x1ba1670 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1", length=63,
          found_semicolon=0x7f818a9c6c98) at sql_parse.cc:6158
      #17 0x00000000006dfa90 in dispatch_command (command=COM_QUERY, thd=0x7f81992dfe98,
          packet=0x7f81992e35c9 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1",
          packet_length=63) at sql_parse.cc:1228
      #18 0x00000000006dedc4 in do_command (thd=0x7f81992dfe98) at sql_parse.cc:923
      #19 0x00000000006dbc12 in handle_one_connection (arg=0x7f81992dfe98) at sql_connect.cc:1218
      #20 0x00007f81a9409a4f in start_thread () from /lib64/libpthread.so.0
      #21 0x00007f81a87f382d in clone () from /lib64/libc.so.6
      #22 0x0000000000000000 in ?? ()
      
      Thread 2 (Thread 0x7f818a97f710 (LWP 3798)):
      #0  0x00007f81a940e39c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
      #1  0x0000000000bdb882 in safe_cond_wait (cond=0x7f8198ab38e0, mp=0x7f8198ab3830,
          file=0xdfaa60 "os/os0sync.c", line=210) at thr_mutex.c:498
      #2  0x0000000000ae990b in os_cond_wait (cond=0x7f8198ab38e0, mutex=0x7f8198ab3830)
          at os/os0sync.c:210
      #3  0x0000000000aea131 in os_event_wait_low (event=0x7f8198ab3830, reset_sig_count=16)
          at os/os0sync.c:636
      #4  0x0000000000b2b9d6 in sync_array_wait_event (arr=0x7f8198008e90, index=3)
          at sync/sync0arr.c:451
      #5  0x0000000000b2d6a8 in mutex_spin_wait (mutex=0x1a8b5e0, file_name=0xdf407f "handler/i_s.cc",
          line=5792) at sync/sync0sync.c:621
      #6  0x0000000000b2d22b in mutex_enter_func (mutex=0x1a8b5e0, file_name=0xdf407f "handler/i_s.cc",
          line=5792) at ./include/sync0sync.ic:221
      #7  0x0000000000ac72e6 in i_s_innodb_fill_buffer_pool (thd=0x7f81992f12f8, tables=0x1ea22e8)
          at handler/i_s.cc:5792
      #8  0x0000000000ac74d7 in i_s_innodb_buffer_page_fill_table (thd=0x7f81992f12f8, tables=0x1ea22e8)
          at handler/i_s.cc:5852
      #9  0x00000000008b27ed in get_schema_tables_result (join=0x7f818403d9b0,
          executed_place=PROCESSED_BY_JOIN_EXEC) at sql_show.cc:7089
      #10 0x0000000000763e67 in JOIN::exec (this=0x7f818403d9b0) at sql_select.cc:2225
      #11 0x00000000007668fd in mysql_select (thd=0x7f81992f12f8, rref_pointer_array=0x7f81992f3fe8,
          tables=0x1ea22e8, wild_num=1, fields=..., conds=0x0, og_num=0, order=0x0, group=0x0,
          having=0x0, proc_param=0x0, select_options=2684635648, result=0x1ea3de0, unit=0x7f81992f3888,
          select_lex=0x7f81992f3d90) at sql_select.cc:2983
      #12 0x000000000075d449 in handle_select (thd=0x7f81992f12f8, lex=0x7f81992f37e8, result=0x1ea3de0,
          setup_tables_done_option=0) at sql_select.cc:286
      #13 0x00000000006eb275 in execute_sqlcom_select (thd=0x7f81992f12f8, all_tables=0x1ea22e8)
          at sql_parse.cc:5157
      #14 0x00000000006e2332 in mysql_execute_command (thd=0x7f81992f12f8) at sql_parse.cc:2290
      #15 0x00000000006edc50 in mysql_parse (thd=0x7f81992f12f8,
          rawbuf=0x1ea2040 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1", length=63,
          found_semicolon=0x7f818a97ec98) at sql_parse.cc:6158
      #16 0x00000000006dfa90 in dispatch_command (command=COM_QUERY, thd=0x7f81992f12f8,
          packet=0x7f81992f4a29 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1",
          packet_length=63) at sql_parse.cc:1228
      #17 0x00000000006dedc4 in do_command (thd=0x7f81992f12f8) at sql_parse.cc:923
      #18 0x00000000006dbc12 in handle_one_connection (arg=0x7f81992f12f8) at sql_connect.cc:1218
      #19 0x00007f81a9409a4f in start_thread () from /lib64/libpthread.so.0
      #20 0x00007f81a87f382d in clone () from /lib64/libc.so.6
      #21 0x0000000000000000 in ?? ()
      

      RQG grammar (mdev-3853.yy):

      query:
              SELECT * FROM { $last_database = 'INFORMATION_SCHEMA' } . _table LIMIT 1 ;
      
      thread1:
              ALTER TABLE _table ADD COLUMN _letter INTEGER |
              ALTER TABLE _table DROP COLUMN _letter ;
      

      RQG command line, assuming you already have server up and running on port 3306:

       perl ./gentest.pl --threads=3 --duration=600 --queries=100M --grammar=mdev-3853.yy --engine=InnoDB --dsn=dbi:mysql:host=127.0.0.1:port=3306:user=root:database=test --gendata 
      

      The deadlock is reproducible on maria/5.1 revno 3180, maria/5.2 revno 3204, maria/5.3 revno 3619.
      I didn't see the deadlock on 5.5 and 10.0, but I'm getting the assertion failure instead (not every time, but often enough):

      130128  2:39:35  InnoDB: Assertion failure in thread 140451356055296 in file page0page.ic line 934
      InnoDB: Failing assertion: ret < srv_page_size
      
      #5  0x00007fbd5fc5fb0b in __GI_abort () at abort.c:92
      #6  0x0000000000b6f3fa in page_get_data_size (page=0x7fbd4d6ac000 "") at 10.0-base/storage/xtradb/include/page0page.ic:934
      #7  0x0000000000a688ea in i_s_innodb_buffer_pool_pages_index_fill (thd=0x43bb0b8, tables=0x7fbd3c1662d0, cond=0x0) at 10.0-base/storage/xtradb/handler/i_s.cc:6564
      #8  0x000000000069ec20 in do_fill_table (thd=0x43bb0b8, table_list=0x7fbd3c1662d0, join_table=0x7fbd3c284260) at 10.0-base/sql/sql_show.cc:7914
      #9  0x000000000069f032 in get_schema_tables_result (join=0x7fbd3c1f2330, executed_place=PROCESSED_BY_JOIN_EXEC) at 10.0-base/sql/sql_show.cc:8021
      #10 0x0000000000648560 in JOIN::exec_inner (this=0x7fbd3c1f2330) at 10.0-base/sql/sql_select.cc:2414
      #11 0x0000000000647bbd in JOIN::exec (this=0x7fbd3c1f2330) at 10.0-base/sql/sql_select.cc:2258
      #12 0x000000000064b1e5 in mysql_select (thd=0x43bb0b8, rref_pointer_array=0x43be040, tables=0x7fbd3c1662d0, wild_num=1, fields=..., conds=0x0, og_num=0, order=0x0, group=0x0, having=0x0, proc_param=0x0, select_options=2684619520, result=0x7fbd3c0a7890, unit=0x43bd698, select_lex=0x43bdd90) at 10.0-base/sql/sql_select.cc:3194
      #13 0x0000000000641a76 in handle_select (thd=0x43bb0b8, lex=0x43bd5e0, result=0x7fbd3c0a7890, setup_tables_done_option=0) at 10.0-base/sql/sql_select.cc:368
      #14 0x00000000006192b1 in execute_sqlcom_select (thd=0x43bb0b8, all_tables=0x7fbd3c1662d0) at 10.0-base/sql/sql_parse.cc:4765
      #15 0x0000000000611941 in mysql_execute_command (thd=0x43bb0b8) at 10.0-base/sql/sql_parse.cc:2245
      #16 0x000000000061bb1b in mysql_parse (thd=0x43bb0b8, rawbuf=0x7fbd3c1c0680 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_POOL_PAGES_INDEX` LIMIT 1", length=75, parser_state=0x7fbd612f8540) at 10.0-base/sql/sql_parse.cc:5881
      #17 0x000000000060ec8b in dispatch_command (command=COM_QUERY, thd=0x43bb0b8, packet=0x43c04d9 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_POOL_PAGES_INDEX` LIMIT 1", packet_length=75) at 10.0-base/sql/sql_parse.cc:1070
      #18 0x000000000060df42 in do_command (thd=0x43bb0b8) at 10.0-base/sql/sql_parse.cc:809
      #19 0x0000000000722735 in do_handle_one_connection (thd_arg=0x43bb0b8) at 10.0-base/sql/sql_connect.cc:1253
      #20 0x0000000000722120 in handle_one_connection (arg=0x43bb0b8) at 10.0-base/sql/sql_connect.cc:1168
      #21 0x00007fbd60998efc in start_thread (arg=0x7fbd612f9700) at pthread_create.c:304
      

      The stack trace is from

      revision-id: sergii@pisem.net-20130124165225-gczln6zrzi4lz4bx
      revno: 3485
      branch-nick: 10.0-base
      

      In all cases the server was built with BUILD/compile-pentium-valgrind-max-no-ndb.

        Gliffy Diagrams

          Attachments

            Activity

            Hide
            serg Sergei Golubchik added a comment -

            Cannot repeat on the latest 5.3 (neither on 5.2 or 5.1)

            Show
            serg Sergei Golubchik added a comment - Cannot repeat on the latest 5.3 (neither on 5.2 or 5.1)
            Hide
            elenst Elena Stepanova added a comment -

            Still reproducible for me on maria/5.1 revno 3180, Version: '5.1.67-MariaDB-valgrind-max-debug-log'

            mysql> show processlist;
            ----------------------------------------------------------------------------------------------------------------------------+

            Id User Host db Command Time State Info

            ----------------------------------------------------------------------------------------------------------------------------+

            2 root 127.0.0.1:43458 test Sleep 442   NULL
            7 root 127.0.0.1:43463 test Query 325 copy to tmp table ALTER TABLE `E` DROP COLUMN i
            8 root 127.0.0.1:43464 test Query 325 executing SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_POOL_STATS` LIMIT 1
            9 root 127.0.0.1:43465 test Query 325 executing SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1
            11 root 127.0.0.1:43467 NULL Query 0 NULL show processlist

            ----------------------------------------------------------------------------------------------------------------------------+

            But I'm running the full runall test, if you are using gentest instead, it might make the difference, since MTR1 adds lots of non-default options to the server. I will try gentest.

            Show
            elenst Elena Stepanova added a comment - Still reproducible for me on maria/5.1 revno 3180, Version: '5.1.67-MariaDB-valgrind-max-debug-log' mysql> show processlist; --- ---- --------------- ---- ------- ---- ----------------- ----------------------------------------------------------------------+ Id User Host db Command Time State Info --- ---- --------------- ---- ------- ---- ----------------- ----------------------------------------------------------------------+ 2 root 127.0.0.1:43458 test Sleep 442   NULL 7 root 127.0.0.1:43463 test Query 325 copy to tmp table ALTER TABLE `E` DROP COLUMN i 8 root 127.0.0.1:43464 test Query 325 executing SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_POOL_STATS` LIMIT 1 9 root 127.0.0.1:43465 test Query 325 executing SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1 11 root 127.0.0.1:43467 NULL Query 0 NULL show processlist --- ---- --------------- ---- ------- ---- ----------------- ----------------------------------------------------------------------+ But I'm running the full runall test, if you are using gentest instead, it might make the difference, since MTR1 adds lots of non-default options to the server. I will try gentest.
            Hide
            elenst Elena Stepanova added a comment - - edited

            If you just replaced basedir1 with dsn and runall with gentest, it's not going to work, because it also needs an extra option '--gendata' (it's assumed by default by runall, but not gentest). So, basically the test runs idle, on an empty datadir (ALTER TABLE doesn't work). The test produces a message about it on start, but it's easy to miss.

            Here is the command line for gentest.pl:

            perl ./gentest.pl --threads=3 --duration=600 --queries=100M --grammar=is.yy --engine=InnoDB --dsn=dbi:mysql:host=127.0.0.1:port=3306:user=root:database=test --gendata

            For me it hangs within a minute or so after start. It comes it two different forms: either the processlist shows hanging threads as described before, or I cannot connect to the server at all.

            No special mysqld options are required, here is my server command line (no defaults file on the system):

            ./bin/mysqld --no-defaults --basedir=. --datadir=./data --log-error=./data/ubuntu11.err --pid-file=./data/ubuntu11.pid

            maria/5.1 revno 3180, Version: '5.1.67-MariaDB-valgrind-max-debug-log'

            I will also check on a faster machine, maybe it requires more threads there.

            Upd: Checked on gentoo 8 GB / 3 cores. I finally managed to reproduce it, but it took much longer and wasn't reliable, and that's while my installation is not anyhow tuned. Increasing the number of threads doesn't help much. So, I suppose it will be more efficient if I set up a special VM to reproduce the problem.

            Show
            elenst Elena Stepanova added a comment - - edited If you just replaced basedir1 with dsn and runall with gentest, it's not going to work, because it also needs an extra option '--gendata' (it's assumed by default by runall, but not gentest). So, basically the test runs idle, on an empty datadir (ALTER TABLE doesn't work). The test produces a message about it on start, but it's easy to miss. Here is the command line for gentest.pl: perl ./gentest.pl --threads=3 --duration=600 --queries=100M --grammar=is.yy --engine=InnoDB --dsn=dbi:mysql:host=127.0.0.1:port=3306:user=root:database=test --gendata For me it hangs within a minute or so after start. It comes it two different forms: either the processlist shows hanging threads as described before, or I cannot connect to the server at all. No special mysqld options are required, here is my server command line (no defaults file on the system): ./bin/mysqld --no-defaults --basedir=. --datadir=./data --log-error=./data/ubuntu11.err --pid-file=./data/ubuntu11.pid maria/5.1 revno 3180, Version: '5.1.67-MariaDB-valgrind-max-debug-log' I will also check on a faster machine, maybe it requires more threads there. Upd: Checked on gentoo 8 GB / 3 cores. I finally managed to reproduce it, but it took much longer and wasn't reliable, and that's while my installation is not anyhow tuned. Increasing the number of threads doesn't help much. So, I suppose it will be more efficient if I set up a special VM to reproduce the problem.
            Hide
            elenst Elena Stepanova added a comment - - edited

            I've set up a kvm on terrier to reproduce the problem. It happens easily there.

            To start kvm, run the wrapper script as usual, then do

            runvm --user=buildbot --port=19304 --smp=2 --mem=4096 --cpu=qemu64 --kvm=-hdb --kvm=mdev-3853-spare-partition.qcow2 mdev-3853.qcow2 bash
            

            (port of your choice, both mdev-3853* images live in buildbot home folder).

            ssh to the machine
            server is in /data/5.1 (built with BUILD/compile-pentium-valgrind-max-no-ndb).
            There is a clean prepared datadir /data/5.1/data.clean in case you want to make sure you have a clean start.

            cd /data/5.1
            rm -rf data && cp -r data.clean data
            

            Run server as

            /data/5.1/sql/mysqld --datadir=/data/5.1/data/ --basedir=/data/5.1 --port=8306 --loose-language=/data/5.1/sql/share/english --socket=/tmp/master.sock &
            
            cd /data/randgen
            

            Run the test as

            perl ./gentest.pl --threads=3 --duration=600 --queries=100M --grammar=mdev-3853.yy --engine=InnoDB --dsn=dbi:mysql:host=127.0.0.1:port=8306:user=root:database=test --gendata
            

            Monitor the processlist in the process (from another console, of course):

             /data/5.1/client/mysql -uroot --protocol=tcp --port=8306 -e "show processlist"
            
            +----+------+-----------------+------+---------+------+-------------------+-----------------------------------------------------------------+
            | Id | User | Host            | db   | Command | Time | State             | Info                                                            |
            +----+------+-----------------+------+---------+------+-------------------+-----------------------------------------------------------------+
            |  5 | root | localhost:50837 | test | Query   |   89 | copy to tmp table | ALTER TABLE `E` ADD COLUMN c INTEGER                            |
            |  6 | root | localhost:50838 | test | Query   |   89 | executing         | SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1 |
            |  7 | root | localhost:50839 | test | Query   |   88 | NULL              | SELECT * FROM INFORMATION_SCHEMA . `STATISTICS` LIMIT 1         |
            | 11 | root | localhost:50843 | NULL | Query   |    0 | NULL              | show processlist                                                |
            +----+------+-----------------+------+---------+------+-------------------+-----------------------------------------------------------------+ 
            
            Show
            elenst Elena Stepanova added a comment - - edited I've set up a kvm on terrier to reproduce the problem. It happens easily there. To start kvm, run the wrapper script as usual, then do runvm --user=buildbot --port=19304 --smp=2 --mem=4096 --cpu=qemu64 --kvm=-hdb --kvm=mdev-3853-spare-partition.qcow2 mdev-3853.qcow2 bash (port of your choice, both mdev-3853* images live in buildbot home folder). ssh to the machine server is in /data/5.1 (built with BUILD/compile-pentium-valgrind-max-no-ndb). There is a clean prepared datadir /data/5.1/data.clean in case you want to make sure you have a clean start. cd /data/5.1 rm -rf data && cp -r data.clean data Run server as /data/5.1/sql/mysqld --datadir=/data/5.1/data/ --basedir=/data/5.1 --port=8306 --loose-language=/data/5.1/sql/share/english --socket=/tmp/master.sock & cd /data/randgen Run the test as perl ./gentest.pl --threads=3 --duration=600 --queries=100M --grammar=mdev-3853.yy --engine=InnoDB --dsn=dbi:mysql:host=127.0.0.1:port=8306:user=root:database=test --gendata Monitor the processlist in the process (from another console, of course): /data/5.1/client/mysql -uroot --protocol=tcp --port=8306 -e "show processlist" +----+------+-----------------+------+---------+------+-------------------+-----------------------------------------------------------------+ | Id | User | Host | db | Command | Time | State | Info | +----+------+-----------------+------+---------+------+-------------------+-----------------------------------------------------------------+ | 5 | root | localhost:50837 | test | Query | 89 | copy to tmp table | ALTER TABLE `E` ADD COLUMN c INTEGER | | 6 | root | localhost:50838 | test | Query | 89 | executing | SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_PAGE` LIMIT 1 | | 7 | root | localhost:50839 | test | Query | 88 | NULL | SELECT * FROM INFORMATION_SCHEMA . `STATISTICS` LIMIT 1 | | 11 | root | localhost:50843 | NULL | Query | 0 | NULL | show processlist | +----+------+-----------------+------+---------+------+-------------------+-----------------------------------------------------------------+
            Hide
            elenst Elena Stepanova added a comment -

            Added a part about assertion on 5.5 and 10.0; could not check if it's reproducible on Percona, since it seems to have bigger problems with the same flow at the moment, it aborts almost immediately with a different assertion failure.

            Also updated the RQG line to gentest.

            The VM described above only has setup for 5.1, please try to use it to reproduce the deadlock
            If the assertion on 5.5/10.0 looks like a different problem, I will check it separately.

            Show
            elenst Elena Stepanova added a comment - Added a part about assertion on 5.5 and 10.0; could not check if it's reproducible on Percona, since it seems to have bigger problems with the same flow at the moment, it aborts almost immediately with a different assertion failure. Also updated the RQG line to gentest. The VM described above only has setup for 5.1, please try to use it to reproduce the deadlock If the assertion on 5.5/10.0 looks like a different problem, I will check it separately.
            Hide
            serg Sergei Golubchik added a comment -

            cannot repeat on 5.5, nothing bad happens.

            Show
            serg Sergei Golubchik added a comment - cannot repeat on 5.5, nothing bad happens.
            Hide
            elenst Elena Stepanova added a comment -

            I'll check again, maybe Percona fixed it in XtraDB

            Show
            elenst Elena Stepanova added a comment - I'll check again, maybe Percona fixed it in XtraDB
            Hide
            elenst Elena Stepanova added a comment - - edited

            Getting the assertion failure again, on current 5.5 tree (after 5.5.38), with

            perl runall-new.pl  --no-mask --seed=1339736060 --threads=8 --duration=3600 --queries=100M --reporters=QueryTimeout,Backtrace,ErrorLog,Deadlock --grammar=conf/runtime/information_schema.yy --engine=InnoDB  --mysqld=--log-output=FILE --mtr-build-thread=300  --basedir1=/home/elenst/bzr/5.5 --vardir1=/home/elenst/test_results/analyze3c
            

            But it takes long time, over 30 min, is not reliable, and I cannot reproduce it on 10.0.
            Given that, I'll keep observing – if it's gone in 10.0, maybe it's not worth fixing at all, otherwise we'll need a better test.

            140622 20:24:36  InnoDB: Assertion failure in thread 139743704536832 in file page0page.ic line 934
            InnoDB: Failing assertion: ret < srv_page_size
            

            All threads:

            [New LWP 6316]
            [New LWP 6284]
            [New LWP 6269]
            [New LWP 6271]
            [New LWP 6268]
            [New LWP 6270]
            [New LWP 6272]
            [New LWP 6312]
            [New LWP 6266]
            [New LWP 6286]
            [New LWP 6308]
            [New LWP 6304]
            [New LWP 6273]
            [New LWP 6278]
            [New LWP 6310]
            [New LWP 6277]
            [New LWP 6276]
            [New LWP 6290]
            [New LWP 6275]
            [New LWP 6281]
            [New LWP 6283]
            [New LWP 6285]
            [New LWP 6282]
            [New LWP 6280]
            [New LWP 6274]
            [New LWP 6306]
            [New LWP 6314]
            [New LWP 6302]
            [Thread debugging using libthread_db enabled]
            Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
            Core was generated by `/home/elenst/bzr/5.5/sql/mysqld --no-defaults --basedir=/home/elenst/bzr/5.5 --'.
            Program terminated with signal SIGABRT, Aborted.
            #0  0x00007f189eb34f8c in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0
            
            Thread 28 (Thread 0x7f189f876700 (LWP 6302)):
            #0  0x00007f189e25625d in fdatasync () from /lib/x86_64-linux-gnu/libc.so.6
            #1  0x0000000000c3c191 in os_file_fsync (file=11, metadata=0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:2279
            #2  0x0000000000c3c27c in os_file_flush_func (file=11, metadata=0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:2386
            #3  0x0000000000bcdc8b in pfs_os_file_flush_func (file=11, metadata=0, src_file=0xeb9de8 "/home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c", src_line=5822) at /home/elenst/bzr/5.5/storage/xtradb/include/os0file.ic:385
            #4  0x0000000000bdf9c1 in fil_flush (space_id=4294967280, metadata=0) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5822
            #5  0x0000000000c217de in log_write_up_to (lsn=42772681, wait=92, flush_to_disk=1) at /home/elenst/bzr/5.5/storage/xtradb/log/log0log.c:1749
            #6  0x0000000000b3ef89 in trx_commit_off_kernel (trx=0x7f1874875678) at /home/elenst/bzr/5.5/storage/xtradb/trx/trx0trx.c:1256
            #7  0x0000000000b40a90 in trx_commit_for_mysql (trx=0x7f1874875678) at /home/elenst/bzr/5.5/storage/xtradb/trx/trx0trx.c:1931
            #8  0x0000000000aea31a in row_rename_table_for_mysql (old_name=0x7f1875c6f0e0 "test/AA#P#p3", new_name=0x7f1875c6f020 "test/#sql2-187a-9#P#p3", trx=0x7f1874875678, commit=1) at /home/elenst/bzr/5.5/storage/xtradb/row/row0mysql.c:4330
            #9  0x0000000000ab6ffc in innobase_rename_table (trx=0x7f1874875678, from=0x7f189f8716c0 "./test/AA#P#p3", to=0x7f189f8718c0 "./test/#sql2-187a-9#P#p3", lock_and_commit=1) at /home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc:8839
            #10 0x0000000000ab710e in ha_innobase::rename_table (this=0x7f18755c5020, from=0x7f189f8716c0 "./test/AA#P#p3", to=0x7f189f8718c0 "./test/#sql2-187a-9#P#p3") at /home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc:8890
            #11 0x00000000007dac53 in handler::ha_rename_table (this=0x7f18755c5020, from=0x7f189f8716c0 "./test/AA#P#p3", to=0x7f189f8718c0 "./test/#sql2-187a-9#P#p3") at /home/elenst/bzr/5.5/sql/handler.cc:3704
            #12 0x0000000000cb0999 in ha_partition::del_ren_cre_table (this=0x7f18754271a8, from=0x7f189f8722c0 "./test/AA", to=0x7f189f8724d0 "./test/#sql2-187a-9", table_arg=0x0, create_info=0x0) at /home/elenst/bzr/5.5/sql/ha_partition.cc:2038
            #13 0x0000000000cad0c7 in ha_partition::rename_table (this=0x7f18754271a8, from=0x7f189f8722c0 "./test/AA", to=0x7f189f8724d0 "./test/#sql2-187a-9") at /home/elenst/bzr/5.5/sql/ha_partition.cc:507
            #14 0x00000000007dac53 in handler::ha_rename_table (this=0x7f18754271a8, from=0x7f189f8722c0 "./test/AA", to=0x7f189f8724d0 "./test/#sql2-187a-9") at /home/elenst/bzr/5.5/sql/handler.cc:3704
            #15 0x00000000006b53fb in mysql_rename_table (base=0x7f189d491c60, old_db=0x7f18754be730 "test", old_name=0x7f18754be130 "AA", new_db=0x7f18754be730 "test", new_name=0x7f189f872d90 "#sql2-187a-9", flags=2) at /home/elenst/bzr/5.5/sql/sql_table.cc:4733
            #16 0x00000000006bba66 in mysql_alter_table (thd=0x7f187b774060, new_db=0x7f18754be730 "test", new_name=0x7f18754be130 "AA", create_info=0x7f189f874510, table_list=0x7f18754be168, alter_info=0x7f189f874470, order_num=0, order=0x0, ignore=false, require_online=false) at /home/elenst/bzr/5.5/sql/sql_table.cc:7140
            #17 0x0000000000950503 in Alter_table_statement::execute (this=0x7f18754be760, thd=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_alter.cc:106
            #18 0x000000000061aeb3 in mysql_execute_command (thd=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4513
            #19 0x000000000061de85 in mysql_parse (thd=0x7f187b774060, rawbuf=0x7f18754be078 "ALTER TABLE `AA` DROP COLUMN f", length=30, parser_state=0x7f189f875620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799
            #20 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b774060, packet=0x7f187b779061 "ALTER TABLE `AA` DROP COLUMN f", packet_length=30) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079
            #21 0x0000000000610880 in do_command (thd=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793
            #22 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266
            #23 0x000000000071c40c in handle_one_connection (arg=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181
            #24 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #25 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #26 0x0000000000000000 in ?? ()
            
            Thread 27 (Thread 0x7f189de2e700 (LWP 6314)):
            #0  0x00007f189eb36ccd in write () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000d352c6 in vio_write (vio=0x7f187b6bffe0, buf=0x7f187b7b8060 "\001", size=6285) at /home/elenst/bzr/5.5/vio/viosocket.c:158
            #2  0x000000000056e18f in net_real_write (net=0x7f187b7b3370, packet=0x7f187b7b8060 "\001", len=6285) at /home/elenst/bzr/5.5/sql/net_serv.cc:643
            #3  0x000000000056d8ef in net_flush (net=0x7f187b7b3370) at /home/elenst/bzr/5.5/sql/net_serv.cc:348
            #4  0x0000000000573c14 in net_send_eof (thd=0x7f187b7b3060, server_status=34, statement_warn_count=0) at /home/elenst/bzr/5.5/sql/protocol.cc:300
            #5  0x0000000000574363 in Protocol::send_eof (this=0x7f187b7b3628, server_status=34, statement_warn_count=0) at /home/elenst/bzr/5.5/sql/protocol.cc:560
            #6  0x000000000057419a in Protocol::end_statement (this=0x7f187b7b3628) at /home/elenst/bzr/5.5/sql/protocol.cc:508
            #7  0x0000000000612ac6 in dispatch_command (command=COM_QUERY, thd=0x7f187b7b3060, packet=0x7f187b7b8061 "", packet_length=207) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1472
            #8  0x0000000000610880 in do_command (thd=0x7f187b7b3060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793
            #9  0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b7b3060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266
            #10 0x000000000071c40c in handle_one_connection (arg=0x7f187b7b3060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181
            #11 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #12 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #13 0x0000000000000000 in ?? ()
            
            Thread 26 (Thread 0x7f189df52700 (LWP 6306)):
            #0  0x00007f189eb36ccd in write () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000d352c6 in vio_write (vio=0x7f187b6bf5e0, buf=0x7f187b760060 "\001", size=1107) at /home/elenst/bzr/5.5/vio/viosocket.c:158
            #2  0x000000000056e18f in net_real_write (net=0x7f187b75b370, packet=0x7f187b760060 "\001", len=1107) at /home/elenst/bzr/5.5/sql/net_serv.cc:643
            #3  0x000000000056d8ef in net_flush (net=0x7f187b75b370) at /home/elenst/bzr/5.5/sql/net_serv.cc:348
            #4  0x0000000000573c14 in net_send_eof (thd=0x7f187b75b060, server_status=2, statement_warn_count=0) at /home/elenst/bzr/5.5/sql/protocol.cc:300
            #5  0x0000000000574363 in Protocol::send_eof (this=0x7f187b75b628, server_status=2, statement_warn_count=0) at /home/elenst/bzr/5.5/sql/protocol.cc:560
            #6  0x000000000057419a in Protocol::end_statement (this=0x7f187b75b628) at /home/elenst/bzr/5.5/sql/protocol.cc:508
            #7  0x0000000000612ac6 in dispatch_command (command=COM_QUERY, thd=0x7f187b75b060, packet=0x7f187b760061 "", packet_length=430) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1472
            #8  0x0000000000610880 in do_command (thd=0x7f187b75b060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793
            #9  0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b75b060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266
            #10 0x000000000071c40c in handle_one_connection (arg=0x7f187b75b060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181
            #11 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #12 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #13 0x0000000000000000 in ?? ()
            
            Thread 25 (Thread 0x7f187e7fa700 (LWP 6274)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff100, segment=3, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=5, message1=0x7f187e7f9e08, message2=0x7f187e7f9e10, type=0x7f187e7f9e18, space_id=0x7f187e7f9e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=5) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82b88 <n+40>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 24 (Thread 0x7f187afff700 (LWP 6280)):
            #0  0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687bb0, mp=0x7f188b687b00, abstime=0x7f187affedc0, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547
            #2  0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687bb0, mutex=0x7f188b687b00, abstime=0x7f187affedc0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171
            #3  0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687b00, time_in_usec=1000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716
            #4  0x0000000000b1153d in srv_lock_timeout_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:2808
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 23 (Thread 0x7f1879ffd700 (LWP 6282)):
            #0  0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687cb0, mp=0x7f188b687c00, abstime=0x7f1879ffcdc0, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547
            #2  0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687cb0, mutex=0x7f188b687c00, abstime=0x7f1879ffcdc0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171
            #3  0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687c00, time_in_usec=5000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716
            #4  0x0000000000b1115d in srv_monitor_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:2658
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 22 (Thread 0x7f18773fe700 (LWP 6285)):
            #0  0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687eb0, mp=0x7f188b687e00, abstime=0x7f18773fddd0, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547
            #2  0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687eb0, mutex=0x7f188b687e00, abstime=0x7f18773fddd0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171
            #3  0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687e00, time_in_usec=911000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716
            #4  0x0000000000b14134 in srv_purge_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:4201
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 21 (Thread 0x7f18797fc700 (LWP 6283)):
            #0  0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687eb0, mp=0x7f188b687e00, abstime=0x7f18797fbdf0, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547
            #2  0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687eb0, mutex=0x7f188b687e00, abstime=0x7f18797fbdf0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171
            #3  0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687e00, time_in_usec=5000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716
            #4  0x0000000000b11b0d in srv_LRU_dump_restore_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:3067
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 20 (Thread 0x7f187a7fe700 (LWP 6281)):
            #0  0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687ab0, mp=0x7f188b687a00, abstime=0x7f187a7fdd90, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547
            #2  0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687ab0, mutex=0x7f188b687a00, abstime=0x7f187a7fdd90) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171
            #3  0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687a00, time_in_usec=1000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716
            #4  0x0000000000b11a98 in srv_error_monitor_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:3021
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 19 (Thread 0x7f187dff9700 (LWP 6275)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff150, segment=0, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=6, message1=0x7f187dff8e08, message2=0x7f187dff8e10, type=0x7f187dff8e18, space_id=0x7f187dff8e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=6) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82b90 <n+48>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 18 (Thread 0x7f189f8bf700 (LWP 6290)):
            #0  0x00007f189eb36d2d in read () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000d34f57 in vio_read (vio=0x7f189d453ee0, buf=0x7f187b76f060 "\a", size=4) at /home/elenst/bzr/5.5/vio/viosocket.c:72
            #2  0x000000000056e4da in my_real_read (net=0x7f187b65b370, complen=0x7f189f8bed30) at /home/elenst/bzr/5.5/sql/net_serv.cc:840
            #3  0x000000000056eb3d in my_net_read (net=0x7f187b65b370) at /home/elenst/bzr/5.5/sql/net_serv.cc:1026
            #4  0x00000000006106b3 in do_command (thd=0x7f187b65b060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:739
            #5  0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b65b060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266
            #6  0x000000000071c40c in handle_one_connection (arg=0x7f187b65b060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181
            #7  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #8  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #9  0x0000000000000000 in ?? ()
            
            Thread 17 (Thread 0x7f187d7f8700 (LWP 6276)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff150, segment=1, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=7, message1=0x7f187d7f7e08, message2=0x7f187d7f7e10, type=0x7f187d7f7e18, space_id=0x7f187d7f7e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=7) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82b98 <n+56>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 16 (Thread 0x7f187cff7700 (LWP 6277)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff150, segment=2, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=8, message1=0x7f187cff6e08, message2=0x7f187cff6e10, type=0x7f187cff6e18, space_id=0x7f187cff6e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=8) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82ba0 <n+64>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 15 (Thread 0x7f189dec0700 (LWP 6310)):
            #0  0x00007f189e2b3a45 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
            #1  0x0000000000573460 in Protocol::net_store_data (this=0x7f187b79f628, from=0x7f189debdb50 "5454-09-03 14:19:35", length=1) at /home/elenst/bzr/5.5/sql/protocol.cc:60
            #2  0x000000000057596e in Protocol::store_string_aux (this=0x7f187b79f628, from=0x7f189debdb50 "5454-09-03 14:19:35", length=1, fromcs=0x1492e00 <my_charset_latin1>, tocs=0x1492e00 <my_charset_latin1>) at /home/elenst/bzr/5.5/sql/protocol.cc:1016
            #3  0x00000000005764f1 in Protocol_text::store (this=0x7f187b79f628, field=0x7f1874576d10) at /home/elenst/bzr/5.5/sql/protocol.cc:1175
            #4  0x00000000007f3073 in Item_field::send (this=0x7f187428f990, protocol=0x7f187b79f628, buffer=0x7f189debded0) at /home/elenst/bzr/5.5/sql/item.cc:6616
            #5  0x0000000000575576 in Protocol::send_result_set_row (this=0x7f187b79f628, row_items=0x7f187b7a2b70) at /home/elenst/bzr/5.5/sql/protocol.cc:903
            #6  0x00000000005db920 in select_send::send_data (this=0x7f1874026040, items=...) at /home/elenst/bzr/5.5/sql/sql_class.cc:2370
            #7  0x0000000000671b61 in end_send (join=0x7f187428f208, join_tab=0x7f1870c698b8, end_of_records=false) at /home/elenst/bzr/5.5/sql/sql_select.cc:17928
            #8  0x000000000066fa01 in evaluate_join_record (join=0x7f187428f208, join_tab=0x7f1870c69598, error=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:17039
            #9  0x000000000066f4f5 in sub_select (join=0x7f187428f208, join_tab=0x7f1870c69598, end_of_records=false) at /home/elenst/bzr/5.5/sql/sql_select.cc:16859
            #10 0x000000000066ebdc in do_select (join=0x7f187428f208, fields=0x7f187b7a2b70, table=0x0, procedure=0x0) at /home/elenst/bzr/5.5/sql/sql_select.cc:16482
            #11 0x000000000064c412 in JOIN::exec (this=0x7f187428f208) at /home/elenst/bzr/5.5/sql/sql_select.cc:2870
            #12 0x000000000064cc1b in mysql_select (thd=0x7f187b79f060, rref_pointer_array=0x7f187b7a2cc8, tables=0x7f18740244a0, wild_num=1, fields=..., conds=0x7f1874025e88, og_num=1, order=0x7f1874025ff8, group=0x0, having=0x0, proc_param=0x0, select_options=2147748608, result=0x7f1874026040, unit=0x7f187b7a2380, select_lex=0x7f187b7a2a58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090
            #13 0x00000000006432e3 in handle_select (thd=0x7f187b79f060, lex=0x7f187b7a22d0, result=0x7f1874026040, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319
            #14 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b79f060, all_tables=0x7f18740244a0) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688
            #15 0x0000000000614275 in mysql_execute_command (thd=0x7f187b79f060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233
            #16 0x000000000061de85 in mysql_parse (thd=0x7f187b79f060, rawbuf=0x7f1874024078 "SELECT * FROM test . `E` AS table1 WHERE  ( ( ( ( table1 . `col_varchar_nokey` != 5 AND table1 . `col_int_key` != table1 . `col_date_key`) AND table1 . `col_datetime_key` > 6) OR table1 . `col_int_nok"..., length=293, parser_state=0x7f189debf620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799
            #17 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b79f060, packet=0x7f187b7a4061 "2004-01-15 07:01:15\001j\001j\373\373\373\373\373\373\373\373\373d", packet_length=294) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079
            #18 0x0000000000610880 in do_command (thd=0x7f187b79f060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793
            #19 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b79f060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266
            #20 0x000000000071c40c in handle_one_connection (arg=0x7f187b79f060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181
            #21 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #22 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #23 0x0000000000000000 in ?? ()
            
            Thread 14 (Thread 0x7f187c7f6700 (LWP 6278)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff150, segment=3, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=9, message1=0x7f187c7f5e08, message2=0x7f187c7f5e10, type=0x7f187c7f5e18, space_id=0x7f187c7f5e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=9) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82ba8 <n+72>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 13 (Thread 0x7f187effb700 (LWP 6273)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff100, segment=2, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=4, message1=0x7f187effae08, message2=0x7f187effae10, type=0x7f187effae18, space_id=0x7f187effae20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=4) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82b80 <n+32>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 12 (Thread 0x7f189f82d700 (LWP 6304)):
            #0  0x00007f189eb33d84 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf544f in safe_cond_wait (cond=0x7f1881c698b0, mp=0x7f1881c69800, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=207) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:493
            #2  0x0000000000c411ca in os_cond_wait (cond=0x7f1881c698b0, mutex=0x7f1881c69800) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:207
            #3  0x0000000000c419e1 in os_event_wait_low (event=0x7f1881c69800, reset_sig_count=5846) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:609
            #4  0x0000000000b1a1b4 in sync_array_wait_event (arr=0x7f189d4eb2c0, index=0) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0arr.c:458
            #5  0x0000000000b1cec4 in mutex_spin_wait (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=4598) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0sync.c:631
            #6  0x0000000000ac41de in mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=4598) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:222
            #7  0x0000000000ac42a4 in pfs_mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=4598) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:251
            #8  0x0000000000acc661 in i_s_sys_columns_fill_table (thd=0x7f187b751060, tables=0x7f1875c24370, cond=0x7f1875c24b00) at /home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc:4598
            #9  0x00000000006a35c4 in get_schema_tables_result (join=0x7f1875c254b8, executed_place=PROCESSED_BY_JOIN_EXEC) at /home/elenst/bzr/5.5/sql/sql_show.cc:7766
            #10 0x000000000064a1d5 in JOIN::exec (this=0x7f1875c254b8) at /home/elenst/bzr/5.5/sql/sql_select.cc:2357
            #11 0x000000000064cc1b in mysql_select (thd=0x7f187b751060, rref_pointer_array=0x7f187b754cc8, tables=0x7f1875c24370, wild_num=1, fields=..., conds=0x7f1875c24b00, og_num=0, order=0x0, group=0x0, having=0x0, proc_param=0x0, select_options=2684619520, result=0x7f1875c25498, unit=0x7f187b754380, select_lex=0x7f187b754a58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090
            #12 0x00000000006432e3 in handle_select (thd=0x7f187b751060, lex=0x7f187b7542d0, result=0x7f1875c25498, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319
            #13 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b751060, all_tables=0x7f1875c24370) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688
            #14 0x0000000000614275 in mysql_execute_command (thd=0x7f187b751060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233
            #15 0x000000000061de85 in mysql_parse (thd=0x7f187b751060, rawbuf=0x7f1875c24078 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_SYS_COLUMNS` AS table1 WHERE  table1 . `NAME` < 3   LIMIT 5", length=102, parser_state=0x7f189f82c620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799
            #16 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b751060, packet=0x7f187b756061 " SELECT * FROM INFORMATION_SCHEMA . `INNODB_SYS_COLUMNS` AS table1 WHERE  table1 . `NAME` < 3   LIMIT 5", packet_length=103) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079
            #17 0x0000000000610880 in do_command (thd=0x7f187b751060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793
            #18 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b751060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266
            #19 0x000000000071c40c in handle_one_connection (arg=0x7f187b751060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181
            #20 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #21 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #22 0x0000000000000000 in ?? ()
            
            Thread 11 (Thread 0x7f189df09700 (LWP 6308)):
            #0  0x00007f189eb33d84 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf544f in safe_cond_wait (cond=0x7f1881c698b0, mp=0x7f1881c69800, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=207) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:493
            #2  0x0000000000c411ca in os_cond_wait (cond=0x7f1881c698b0, mutex=0x7f1881c69800) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:207
            #3  0x0000000000c419e1 in os_event_wait_low (event=0x7f1881c69800, reset_sig_count=5846) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:609
            #4  0x0000000000b1a1b4 in sync_array_wait_event (arr=0x7f189d4eb2c0, index=1) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0arr.c:458
            #5  0x0000000000b1cec4 in mutex_spin_wait (mutex=0x7f189d41f878, file_name=0xe7d020 "/home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc", line=10245) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0sync.c:631
            #6  0x0000000000aa8584 in mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe7d020 "/home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc", line=10245) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:222
            #7  0x0000000000aa864a in pfs_mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe7d020 "/home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc", line=10245) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:251
            #8  0x0000000000aba215 in ha_innobase::get_foreign_key_list (this=0x7f1871a3d078, thd=0x7f187b765060, f_key_list=0x7f189df05d50) at /home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc:10245
            #9  0x000000000069d9e9 in get_schema_key_column_usage_record (thd=0x7f187b765060, tables=0x7f187104f140, table=0x7f187101d078, res=false, db_name=0x7f187466eb08, table_name=0x7f187104d570) at /home/elenst/bzr/5.5/sql/sql_show.cc:6245
            #10 0x0000000000693a29 in fill_schema_table_by_open (thd=0x7f187b765060, is_show_fields_or_keys=false, table=0x7f187101d078, schema_table=0x140f8c0 <schema_tables+832>, orig_db_name=0x7f187466eb08, orig_table_name=0x7f187104d570, open_tables_state_backup=0x7f189df073c0, can_deadlock=true) at /home/elenst/bzr/5.5/sql/sql_show.cc:3931
            #11 0x00000000006951a2 in get_all_tables (thd=0x7f187b765060, tables=0x7f1874425468, cond=0x7f187466daa8) at /home/elenst/bzr/5.5/sql/sql_show.cc:4565
            #12 0x00000000006a35c4 in get_schema_tables_result (join=0x7f187446e910, executed_place=PROCESSED_BY_JOIN_EXEC) at /home/elenst/bzr/5.5/sql/sql_show.cc:7766
            #13 0x000000000064a1d5 in JOIN::exec (this=0x7f187446e910) at /home/elenst/bzr/5.5/sql/sql_select.cc:2357
            #14 0x000000000064cc1b in mysql_select (thd=0x7f187b765060, rref_pointer_array=0x7f187b768cc8, tables=0x7f1874424de8, wild_num=1, fields=..., conds=0x7f187445ad88, og_num=0, order=0x0, group=0x0, having=0x7f187445b7c0, proc_param=0x0, select_options=2684619520, result=0x7f187446e8f0, unit=0x7f187b768380, select_lex=0x7f187b768a58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090
            #15 0x00000000006432e3 in handle_select (thd=0x7f187b765060, lex=0x7f187b7682d0, result=0x7f187446e8f0, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319
            #16 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b765060, all_tables=0x7f1874424de8) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688
            #17 0x0000000000614275 in mysql_execute_command (thd=0x7f187b765060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233
            #18 0x000000000061de85 in mysql_parse (thd=0x7f187b765060, rawbuf=0x7f1874424078 "SELECT * FROM (test . `E` AS table1 INNER JOIN INFORMATION_SCHEMA . `KEY_COLUMN_USAGE` AS table2 ON ( table2 . `POSITION_IN_UNIQUE_CONSTRAINT` = table1 . `col_date_key` ) ) WHERE  ( (NOT ( ( ( ( ( (NO"..., length=681, parser_state=0x7f189df08620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799
            #19 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b765060, packet=0x7f187b76a061 " SELECT * FROM (test . `E` AS table1 INNER JOIN INFORMATION_SCHEMA . `KEY_COLUMN_USAGE` AS table2 ON ( table2 . `POSITION_IN_UNIQUE_CONSTRAINT` = table1 . `col_date_key` ) ) WHERE  ( (NOT ( ( ( ( ( (N"..., packet_length=682) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079
            #20 0x0000000000610880 in do_command (thd=0x7f187b765060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793
            #21 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b765060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266
            #22 0x000000000071c40c in handle_one_connection (arg=0x7f187b765060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181
            #23 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #24 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #25 0x0000000000000000 in ?? ()
            
            Thread 10 (Thread 0x7f189f908700 (LWP 6286)):
            #0  0x00007f189eb379f7 in do_sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x00007f189eb37a79 in sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0
            #2  0x0000000000563f9a in signal_hand (arg=0x0) at /home/elenst/bzr/5.5/sql/mysqld.cc:3058
            #3  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #4  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #5  0x0000000000000000 in ?? ()
            
            Thread 9 (Thread 0x7f189f9b5780 (LWP 6266)):
            #0  0x00007f189e251303 in poll () from /lib/x86_64-linux-gnu/libc.so.6
            #1  0x0000000000567fb3 in handle_connections_sockets () at /home/elenst/bzr/5.5/sql/mysqld.cc:5614
            #2  0x00000000005672fe in mysqld_main (argc=17, argv=0x7f189d44d190) at /home/elenst/bzr/5.5/sql/mysqld.cc:5063
            #3  0x000000000055f2d0 in main (argc=17, argv=0x7ffffa781d28) at /home/elenst/bzr/5.5/sql/main.cc:25
            
            Thread 8 (Thread 0x7f189de77700 (LWP 6312)):
            #0  0x00007f189eb33d84 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf544f in safe_cond_wait (cond=0x7f1881c698b0, mp=0x7f1881c69800, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=207) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:493
            #2  0x0000000000c411ca in os_cond_wait (cond=0x7f1881c698b0, mutex=0x7f1881c69800) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:207
            #3  0x0000000000c419e1 in os_event_wait_low (event=0x7f1881c69800, reset_sig_count=5846) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:609
            #4  0x0000000000b1a1b4 in sync_array_wait_event (arr=0x7f189d4eb2c0, index=2) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0arr.c:458
            #5  0x0000000000b1cec4 in mutex_spin_wait (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=3783) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0sync.c:631
            #6  0x0000000000ac41de in mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=3783) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:222
            #7  0x0000000000ac42a4 in pfs_mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=3783) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:251
            #8  0x0000000000acaf9a in i_s_sys_tables_fill_table (thd=0x7f187b7a9060, tables=0x7f18738245d0, cond=0x7f1873ae0588) at /home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc:3783
            #9  0x00000000006a35c4 in get_schema_tables_result (join=0x7f1873adc760, executed_place=PROCESSED_BY_JOIN_EXEC) at /home/elenst/bzr/5.5/sql/sql_show.cc:7766
            #10 0x000000000064a1d5 in JOIN::exec (this=0x7f1873adc760) at /home/elenst/bzr/5.5/sql/sql_select.cc:2357
            #11 0x000000000064cc1b in mysql_select (thd=0x7f187b7a9060, rref_pointer_array=0x7f187b7accc8, tables=0x7f18738245d0, wild_num=1, fields=..., conds=0x7f1873ae3d98, og_num=0, order=0x0, group=0x0, having=0x0, proc_param=0x0, select_options=2684619520, result=0x7f1873adc740, unit=0x7f187b7ac380, select_lex=0x7f187b7aca58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090
            #12 0x00000000006432e3 in handle_select (thd=0x7f187b7a9060, lex=0x7f187b7ac2d0, result=0x7f1873adc740, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319
            #13 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b7a9060, all_tables=0x7f18738245d0) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688
            #14 0x0000000000614275 in mysql_execute_command (thd=0x7f187b7a9060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233
            #15 0x000000000061de85 in mysql_parse (thd=0x7f187b7a9060, rawbuf=0x7f1873824078 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_SYS_TABLES` AS table1 WHERE  ( ( ( (NOT (NOT (NOT ( table1 . `N_COLS` <> '2006-05-16 22:28:46.012403' OR table1 . `SPACE` > table1 . `TABLE_ID`) AND table1 ."..., length=405, parser_state=0x7f189de76620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799
            #16 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b7a9060, packet=0x7f187b7ae061 " SELECT * FROM INFORMATION_SCHEMA . `INNODB_SYS_TABLES` AS table1 WHERE  ( ( ( (NOT (NOT (NOT ( table1 . `N_COLS` <> '2006-05-16 22:28:46.012403' OR table1 . `SPACE` > table1 . `TABLE_ID`) AND table1 "..., packet_length=409) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079
            #17 0x0000000000610880 in do_command (thd=0x7f187b7a9060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793
            #18 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b7a9060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266
            #19 0x000000000071c40c in handle_one_connection (arg=0x7f187b7a9060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181
            #20 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #21 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #22 0x0000000000000000 in ?? ()
            
            Thread 7 (Thread 0x7f187f7fc700 (LWP 6272)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff100, segment=1, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=3, message1=0x7f187f7fbe08, message2=0x7f187f7fbe10, type=0x7f187f7fbe18, space_id=0x7f187f7fbe20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=3) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82b78 <n+24>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 6 (Thread 0x7f18807fe700 (LWP 6270)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff0b0, segment=0, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=1, message1=0x7f18807fde08, message2=0x7f18807fde10, type=0x7f18807fde18, space_id=0x7f18807fde20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=1) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82b68 <n+8>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 5 (Thread 0x7f189d3ff700 (LWP 6268)):
            #0  0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf5749 in safe_cond_timedwait (cond=0x1d80680 <COND_checkpoint>, mp=0x1d805c0 <LOCK_checkpoint>, abstime=0x7f189d3fedb0, file=0xe69e50 "/home/elenst/bzr/5.5/storage/maria/ma_servicethread.c", line=119) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547
            #2  0x00000000009bff14 in inline_mysql_cond_timedwait (that=0x1d80680 <COND_checkpoint>, mutex=0x1d805c0 <LOCK_checkpoint>, abstime=0x7f189d3fedb0, src_file=0xe69e50 "/home/elenst/bzr/5.5/storage/maria/ma_servicethread.c", src_line=119) at /home/elenst/bzr/5.5/include/mysql/psi/mysql_thread.h:1017
            #3  0x00000000009c040c in my_service_thread_sleep (control=0x14206b0 <checkpoint_control>, sleep_time=30000000000) at /home/elenst/bzr/5.5/storage/maria/ma_servicethread.c:118
            #4  0x00000000009b414a in ma_checkpoint_background (arg=0x1e) at /home/elenst/bzr/5.5/storage/maria/ma_checkpoint.c:705
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 4 (Thread 0x7f187fffd700 (LWP 6271)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff100, segment=0, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=2, message1=0x7f187fffce08, message2=0x7f187fffce10, type=0x7f187fffce18, space_id=0x7f187fffce20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=2) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82b70 <n+16>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 3 (Thread 0x7f1880fff700 (LWP 6269)):
            #0  0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #1  0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff060, segment=0, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687
            #2  0x0000000000c3ee11 in os_aio_linux_handle (global_seg=0, message1=0x7f1880ffee08, message2=0x7f1880ffee10, type=0x7f1880ffee18, space_id=0x7f1880ffee20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833
            #3  0x0000000000bdf63a in fil_aio_wait (segment=0) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697
            #4  0x0000000000b157e6 in io_handler_thread (arg=0x1d82b60 <n>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 2 (Thread 0x7f1877bff700 (LWP 6284)):
            #0  0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687eb0, mp=0x7f188b687e00, abstime=0x7f1877bfe650, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547
            #2  0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687eb0, mutex=0x7f188b687e00, abstime=0x7f1877bfe650) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171
            #3  0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687e00, time_in_usec=1000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716
            #4  0x0000000000b1251b in srv_master_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:3509
            #5  0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #6  0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #7  0x0000000000000000 in ?? ()
            
            Thread 1 (Thread 0x7f189dde5700 (LWP 6316)):
            #0  0x00007f189eb34f8c in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0
            #1  0x0000000000ced9a0 in my_write_core (sig=6) at /home/elenst/bzr/5.5/mysys/stacktrace.c:457
            #2  0x00000000007d31af in handle_fatal_signal (sig=6) at /home/elenst/bzr/5.5/sql/signal_handler.cc:262
            #3  <signal handler called>
            #4  0x00007f189e19f425 in raise () from /lib/x86_64-linux-gnu/libc.so.6
            #5  0x00007f189e1a2b8b in abort () from /lib/x86_64-linux-gnu/libc.so.6
            #6  0x0000000000ac53e5 in page_get_data_size (page=0x7f188a6c8000 "") at /home/elenst/bzr/5.5/storage/xtradb/include/page0page.ic:934
            #7  0x0000000000acf837 in i_s_innodb_buffer_pool_pages_index_fill (thd=0x7f187b36e060, tables=0x7f188b85a5c0, cond=0x7f188b85ae10) at /home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc:6592
            #8  0x00000000006a35c4 in get_schema_tables_result (join=0x7f1871b94218, executed_place=PROCESSED_BY_JOIN_EXEC) at /home/elenst/bzr/5.5/sql/sql_show.cc:7766
            #9  0x000000000064a1d5 in JOIN::exec (this=0x7f1871b94218) at /home/elenst/bzr/5.5/sql/sql_select.cc:2357
            #10 0x000000000064cc1b in mysql_select (thd=0x7f187b36e060, rref_pointer_array=0x7f187b371cc8, tables=0x7f188b85a5c0, wild_num=1, fields=..., conds=0x7f188b85ae10, og_num=7, order=0x7f188b85b8e0, group=0x0, having=0x7f188b85b688, proc_param=0x0, select_options=2684619520, result=0x7f1871b941f8, unit=0x7f187b371380, select_lex=0x7f187b371a58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090
            #11 0x00000000006432e3 in handle_select (thd=0x7f187b36e060, lex=0x7f187b3712d0, result=0x7f1871b941f8, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319
            #12 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b36e060, all_tables=0x7f188b85a5c0) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688
            #13 0x0000000000614275 in mysql_execute_command (thd=0x7f187b36e060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233
            #14 0x000000000061de85 in mysql_parse (thd=0x7f187b36e060, rawbuf=0x7f188b85a078 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_POOL_PAGES_INDEX` AS table1 WHERE  table1 . `lru_position` < table1 . `space_id`  HAVING  (table1 . `data_size` <> 2 IS NOT NULL AND table1 . `old` <="..., length=374, parser_state=0x7f189dde4620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799
            #15 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b36e060, packet=0x7f187b386061 " SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_POOL_PAGES_INDEX` AS table1 WHERE  table1 . `lru_position` < table1 . `space_id`  HAVING  (table1 . `data_size` <> 2 IS NOT NULL AND table1 . `old` <"..., packet_length=375) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079
            #16 0x0000000000610880 in do_command (thd=0x7f187b36e060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793
            #17 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b36e060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266
            #18 0x000000000071c40c in handle_one_connection (arg=0x7f187b36e060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181
            #19 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
            #20 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
            #21 0x0000000000000000 in ?? ()
            

            Stack trace from:

            revision-id: sergii@pisem.net-20140605172551-avr6i9us81bsin83
            date: 2014-06-05 19:25:51 +0200
            build-date: 2014-06-23 13:21:41 +0300
            revno: 4214
            branch-nick: 5.5
            
            Show
            elenst Elena Stepanova added a comment - - edited Getting the assertion failure again, on current 5.5 tree (after 5.5.38), with perl runall-new.pl --no-mask --seed=1339736060 --threads=8 --duration=3600 --queries=100M --reporters=QueryTimeout,Backtrace,ErrorLog,Deadlock --grammar=conf/runtime/information_schema.yy --engine=InnoDB --mysqld=--log-output=FILE --mtr-build-thread=300 --basedir1=/home/elenst/bzr/5.5 --vardir1=/home/elenst/test_results/analyze3c But it takes long time, over 30 min, is not reliable, and I cannot reproduce it on 10.0. Given that, I'll keep observing – if it's gone in 10.0, maybe it's not worth fixing at all, otherwise we'll need a better test. 140622 20:24:36 InnoDB: Assertion failure in thread 139743704536832 in file page0page.ic line 934 InnoDB: Failing assertion: ret < srv_page_size All threads: [New LWP 6316] [New LWP 6284] [New LWP 6269] [New LWP 6271] [New LWP 6268] [New LWP 6270] [New LWP 6272] [New LWP 6312] [New LWP 6266] [New LWP 6286] [New LWP 6308] [New LWP 6304] [New LWP 6273] [New LWP 6278] [New LWP 6310] [New LWP 6277] [New LWP 6276] [New LWP 6290] [New LWP 6275] [New LWP 6281] [New LWP 6283] [New LWP 6285] [New LWP 6282] [New LWP 6280] [New LWP 6274] [New LWP 6306] [New LWP 6314] [New LWP 6302] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/home/elenst/bzr/5.5/sql/mysqld --no-defaults --basedir=/home/elenst/bzr/5.5 --'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f189eb34f8c in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0 Thread 28 (Thread 0x7f189f876700 (LWP 6302)): #0 0x00007f189e25625d in fdatasync () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x0000000000c3c191 in os_file_fsync (file=11, metadata=0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:2279 #2 0x0000000000c3c27c in os_file_flush_func (file=11, metadata=0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:2386 #3 0x0000000000bcdc8b in pfs_os_file_flush_func (file=11, metadata=0, src_file=0xeb9de8 "/home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c", src_line=5822) at /home/elenst/bzr/5.5/storage/xtradb/include/os0file.ic:385 #4 0x0000000000bdf9c1 in fil_flush (space_id=4294967280, metadata=0) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5822 #5 0x0000000000c217de in log_write_up_to (lsn=42772681, wait=92, flush_to_disk=1) at /home/elenst/bzr/5.5/storage/xtradb/log/log0log.c:1749 #6 0x0000000000b3ef89 in trx_commit_off_kernel (trx=0x7f1874875678) at /home/elenst/bzr/5.5/storage/xtradb/trx/trx0trx.c:1256 #7 0x0000000000b40a90 in trx_commit_for_mysql (trx=0x7f1874875678) at /home/elenst/bzr/5.5/storage/xtradb/trx/trx0trx.c:1931 #8 0x0000000000aea31a in row_rename_table_for_mysql (old_name=0x7f1875c6f0e0 "test/AA#P#p3", new_name=0x7f1875c6f020 "test/#sql2-187a-9#P#p3", trx=0x7f1874875678, commit=1) at /home/elenst/bzr/5.5/storage/xtradb/row/row0mysql.c:4330 #9 0x0000000000ab6ffc in innobase_rename_table (trx=0x7f1874875678, from=0x7f189f8716c0 "./test/AA#P#p3", to=0x7f189f8718c0 "./test/#sql2-187a-9#P#p3", lock_and_commit=1) at /home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc:8839 #10 0x0000000000ab710e in ha_innobase::rename_table (this=0x7f18755c5020, from=0x7f189f8716c0 "./test/AA#P#p3", to=0x7f189f8718c0 "./test/#sql2-187a-9#P#p3") at /home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc:8890 #11 0x00000000007dac53 in handler::ha_rename_table (this=0x7f18755c5020, from=0x7f189f8716c0 "./test/AA#P#p3", to=0x7f189f8718c0 "./test/#sql2-187a-9#P#p3") at /home/elenst/bzr/5.5/sql/handler.cc:3704 #12 0x0000000000cb0999 in ha_partition::del_ren_cre_table (this=0x7f18754271a8, from=0x7f189f8722c0 "./test/AA", to=0x7f189f8724d0 "./test/#sql2-187a-9", table_arg=0x0, create_info=0x0) at /home/elenst/bzr/5.5/sql/ha_partition.cc:2038 #13 0x0000000000cad0c7 in ha_partition::rename_table (this=0x7f18754271a8, from=0x7f189f8722c0 "./test/AA", to=0x7f189f8724d0 "./test/#sql2-187a-9") at /home/elenst/bzr/5.5/sql/ha_partition.cc:507 #14 0x00000000007dac53 in handler::ha_rename_table (this=0x7f18754271a8, from=0x7f189f8722c0 "./test/AA", to=0x7f189f8724d0 "./test/#sql2-187a-9") at /home/elenst/bzr/5.5/sql/handler.cc:3704 #15 0x00000000006b53fb in mysql_rename_table (base=0x7f189d491c60, old_db=0x7f18754be730 "test", old_name=0x7f18754be130 "AA", new_db=0x7f18754be730 "test", new_name=0x7f189f872d90 "#sql2-187a-9", flags=2) at /home/elenst/bzr/5.5/sql/sql_table.cc:4733 #16 0x00000000006bba66 in mysql_alter_table (thd=0x7f187b774060, new_db=0x7f18754be730 "test", new_name=0x7f18754be130 "AA", create_info=0x7f189f874510, table_list=0x7f18754be168, alter_info=0x7f189f874470, order_num=0, order=0x0, ignore=false, require_online=false) at /home/elenst/bzr/5.5/sql/sql_table.cc:7140 #17 0x0000000000950503 in Alter_table_statement::execute (this=0x7f18754be760, thd=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_alter.cc:106 #18 0x000000000061aeb3 in mysql_execute_command (thd=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4513 #19 0x000000000061de85 in mysql_parse (thd=0x7f187b774060, rawbuf=0x7f18754be078 "ALTER TABLE `AA` DROP COLUMN f", length=30, parser_state=0x7f189f875620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799 #20 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b774060, packet=0x7f187b779061 "ALTER TABLE `AA` DROP COLUMN f", packet_length=30) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079 #21 0x0000000000610880 in do_command (thd=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793 #22 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266 #23 0x000000000071c40c in handle_one_connection (arg=0x7f187b774060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181 #24 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #25 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #26 0x0000000000000000 in ?? () Thread 27 (Thread 0x7f189de2e700 (LWP 6314)): #0 0x00007f189eb36ccd in write () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000d352c6 in vio_write (vio=0x7f187b6bffe0, buf=0x7f187b7b8060 "\001", size=6285) at /home/elenst/bzr/5.5/vio/viosocket.c:158 #2 0x000000000056e18f in net_real_write (net=0x7f187b7b3370, packet=0x7f187b7b8060 "\001", len=6285) at /home/elenst/bzr/5.5/sql/net_serv.cc:643 #3 0x000000000056d8ef in net_flush (net=0x7f187b7b3370) at /home/elenst/bzr/5.5/sql/net_serv.cc:348 #4 0x0000000000573c14 in net_send_eof (thd=0x7f187b7b3060, server_status=34, statement_warn_count=0) at /home/elenst/bzr/5.5/sql/protocol.cc:300 #5 0x0000000000574363 in Protocol::send_eof (this=0x7f187b7b3628, server_status=34, statement_warn_count=0) at /home/elenst/bzr/5.5/sql/protocol.cc:560 #6 0x000000000057419a in Protocol::end_statement (this=0x7f187b7b3628) at /home/elenst/bzr/5.5/sql/protocol.cc:508 #7 0x0000000000612ac6 in dispatch_command (command=COM_QUERY, thd=0x7f187b7b3060, packet=0x7f187b7b8061 "", packet_length=207) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1472 #8 0x0000000000610880 in do_command (thd=0x7f187b7b3060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793 #9 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b7b3060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266 #10 0x000000000071c40c in handle_one_connection (arg=0x7f187b7b3060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181 #11 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #12 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #13 0x0000000000000000 in ?? () Thread 26 (Thread 0x7f189df52700 (LWP 6306)): #0 0x00007f189eb36ccd in write () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000d352c6 in vio_write (vio=0x7f187b6bf5e0, buf=0x7f187b760060 "\001", size=1107) at /home/elenst/bzr/5.5/vio/viosocket.c:158 #2 0x000000000056e18f in net_real_write (net=0x7f187b75b370, packet=0x7f187b760060 "\001", len=1107) at /home/elenst/bzr/5.5/sql/net_serv.cc:643 #3 0x000000000056d8ef in net_flush (net=0x7f187b75b370) at /home/elenst/bzr/5.5/sql/net_serv.cc:348 #4 0x0000000000573c14 in net_send_eof (thd=0x7f187b75b060, server_status=2, statement_warn_count=0) at /home/elenst/bzr/5.5/sql/protocol.cc:300 #5 0x0000000000574363 in Protocol::send_eof (this=0x7f187b75b628, server_status=2, statement_warn_count=0) at /home/elenst/bzr/5.5/sql/protocol.cc:560 #6 0x000000000057419a in Protocol::end_statement (this=0x7f187b75b628) at /home/elenst/bzr/5.5/sql/protocol.cc:508 #7 0x0000000000612ac6 in dispatch_command (command=COM_QUERY, thd=0x7f187b75b060, packet=0x7f187b760061 "", packet_length=430) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1472 #8 0x0000000000610880 in do_command (thd=0x7f187b75b060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793 #9 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b75b060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266 #10 0x000000000071c40c in handle_one_connection (arg=0x7f187b75b060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181 #11 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #12 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #13 0x0000000000000000 in ?? () Thread 25 (Thread 0x7f187e7fa700 (LWP 6274)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff100, segment=3, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=5, message1=0x7f187e7f9e08, message2=0x7f187e7f9e10, type=0x7f187e7f9e18, space_id=0x7f187e7f9e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=5) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82b88 <n+40>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 24 (Thread 0x7f187afff700 (LWP 6280)): #0 0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687bb0, mp=0x7f188b687b00, abstime=0x7f187affedc0, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547 #2 0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687bb0, mutex=0x7f188b687b00, abstime=0x7f187affedc0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171 #3 0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687b00, time_in_usec=1000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716 #4 0x0000000000b1153d in srv_lock_timeout_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:2808 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 23 (Thread 0x7f1879ffd700 (LWP 6282)): #0 0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687cb0, mp=0x7f188b687c00, abstime=0x7f1879ffcdc0, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547 #2 0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687cb0, mutex=0x7f188b687c00, abstime=0x7f1879ffcdc0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171 #3 0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687c00, time_in_usec=5000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716 #4 0x0000000000b1115d in srv_monitor_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:2658 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 22 (Thread 0x7f18773fe700 (LWP 6285)): #0 0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687eb0, mp=0x7f188b687e00, abstime=0x7f18773fddd0, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547 #2 0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687eb0, mutex=0x7f188b687e00, abstime=0x7f18773fddd0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171 #3 0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687e00, time_in_usec=911000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716 #4 0x0000000000b14134 in srv_purge_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:4201 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 21 (Thread 0x7f18797fc700 (LWP 6283)): #0 0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687eb0, mp=0x7f188b687e00, abstime=0x7f18797fbdf0, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547 #2 0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687eb0, mutex=0x7f188b687e00, abstime=0x7f18797fbdf0) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171 #3 0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687e00, time_in_usec=5000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716 #4 0x0000000000b11b0d in srv_LRU_dump_restore_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:3067 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 20 (Thread 0x7f187a7fe700 (LWP 6281)): #0 0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687ab0, mp=0x7f188b687a00, abstime=0x7f187a7fdd90, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547 #2 0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687ab0, mutex=0x7f188b687a00, abstime=0x7f187a7fdd90) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171 #3 0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687a00, time_in_usec=1000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716 #4 0x0000000000b11a98 in srv_error_monitor_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:3021 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 19 (Thread 0x7f187dff9700 (LWP 6275)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff150, segment=0, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=6, message1=0x7f187dff8e08, message2=0x7f187dff8e10, type=0x7f187dff8e18, space_id=0x7f187dff8e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=6) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82b90 <n+48>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 18 (Thread 0x7f189f8bf700 (LWP 6290)): #0 0x00007f189eb36d2d in read () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000d34f57 in vio_read (vio=0x7f189d453ee0, buf=0x7f187b76f060 "\a", size=4) at /home/elenst/bzr/5.5/vio/viosocket.c:72 #2 0x000000000056e4da in my_real_read (net=0x7f187b65b370, complen=0x7f189f8bed30) at /home/elenst/bzr/5.5/sql/net_serv.cc:840 #3 0x000000000056eb3d in my_net_read (net=0x7f187b65b370) at /home/elenst/bzr/5.5/sql/net_serv.cc:1026 #4 0x00000000006106b3 in do_command (thd=0x7f187b65b060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:739 #5 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b65b060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266 #6 0x000000000071c40c in handle_one_connection (arg=0x7f187b65b060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181 #7 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #8 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #9 0x0000000000000000 in ?? () Thread 17 (Thread 0x7f187d7f8700 (LWP 6276)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff150, segment=1, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=7, message1=0x7f187d7f7e08, message2=0x7f187d7f7e10, type=0x7f187d7f7e18, space_id=0x7f187d7f7e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=7) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82b98 <n+56>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 16 (Thread 0x7f187cff7700 (LWP 6277)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff150, segment=2, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=8, message1=0x7f187cff6e08, message2=0x7f187cff6e10, type=0x7f187cff6e18, space_id=0x7f187cff6e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=8) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82ba0 <n+64>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 15 (Thread 0x7f189dec0700 (LWP 6310)): #0 0x00007f189e2b3a45 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x0000000000573460 in Protocol::net_store_data (this=0x7f187b79f628, from=0x7f189debdb50 "5454-09-03 14:19:35", length=1) at /home/elenst/bzr/5.5/sql/protocol.cc:60 #2 0x000000000057596e in Protocol::store_string_aux (this=0x7f187b79f628, from=0x7f189debdb50 "5454-09-03 14:19:35", length=1, fromcs=0x1492e00 <my_charset_latin1>, tocs=0x1492e00 <my_charset_latin1>) at /home/elenst/bzr/5.5/sql/protocol.cc:1016 #3 0x00000000005764f1 in Protocol_text::store (this=0x7f187b79f628, field=0x7f1874576d10) at /home/elenst/bzr/5.5/sql/protocol.cc:1175 #4 0x00000000007f3073 in Item_field::send (this=0x7f187428f990, protocol=0x7f187b79f628, buffer=0x7f189debded0) at /home/elenst/bzr/5.5/sql/item.cc:6616 #5 0x0000000000575576 in Protocol::send_result_set_row (this=0x7f187b79f628, row_items=0x7f187b7a2b70) at /home/elenst/bzr/5.5/sql/protocol.cc:903 #6 0x00000000005db920 in select_send::send_data (this=0x7f1874026040, items=...) at /home/elenst/bzr/5.5/sql/sql_class.cc:2370 #7 0x0000000000671b61 in end_send (join=0x7f187428f208, join_tab=0x7f1870c698b8, end_of_records=false) at /home/elenst/bzr/5.5/sql/sql_select.cc:17928 #8 0x000000000066fa01 in evaluate_join_record (join=0x7f187428f208, join_tab=0x7f1870c69598, error=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:17039 #9 0x000000000066f4f5 in sub_select (join=0x7f187428f208, join_tab=0x7f1870c69598, end_of_records=false) at /home/elenst/bzr/5.5/sql/sql_select.cc:16859 #10 0x000000000066ebdc in do_select (join=0x7f187428f208, fields=0x7f187b7a2b70, table=0x0, procedure=0x0) at /home/elenst/bzr/5.5/sql/sql_select.cc:16482 #11 0x000000000064c412 in JOIN::exec (this=0x7f187428f208) at /home/elenst/bzr/5.5/sql/sql_select.cc:2870 #12 0x000000000064cc1b in mysql_select (thd=0x7f187b79f060, rref_pointer_array=0x7f187b7a2cc8, tables=0x7f18740244a0, wild_num=1, fields=..., conds=0x7f1874025e88, og_num=1, order=0x7f1874025ff8, group=0x0, having=0x0, proc_param=0x0, select_options=2147748608, result=0x7f1874026040, unit=0x7f187b7a2380, select_lex=0x7f187b7a2a58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090 #13 0x00000000006432e3 in handle_select (thd=0x7f187b79f060, lex=0x7f187b7a22d0, result=0x7f1874026040, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319 #14 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b79f060, all_tables=0x7f18740244a0) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688 #15 0x0000000000614275 in mysql_execute_command (thd=0x7f187b79f060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233 #16 0x000000000061de85 in mysql_parse (thd=0x7f187b79f060, rawbuf=0x7f1874024078 "SELECT * FROM test . `E` AS table1 WHERE ( ( ( ( table1 . `col_varchar_nokey` != 5 AND table1 . `col_int_key` != table1 . `col_date_key`) AND table1 . `col_datetime_key` > 6) OR table1 . `col_int_nok"..., length=293, parser_state=0x7f189debf620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799 #17 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b79f060, packet=0x7f187b7a4061 "2004-01-15 07:01:15\001j\001j\373\373\373\373\373\373\373\373\373d", packet_length=294) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079 #18 0x0000000000610880 in do_command (thd=0x7f187b79f060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793 #19 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b79f060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266 #20 0x000000000071c40c in handle_one_connection (arg=0x7f187b79f060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181 #21 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #22 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #23 0x0000000000000000 in ?? () Thread 14 (Thread 0x7f187c7f6700 (LWP 6278)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff150, segment=3, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=9, message1=0x7f187c7f5e08, message2=0x7f187c7f5e10, type=0x7f187c7f5e18, space_id=0x7f187c7f5e20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=9) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82ba8 <n+72>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 13 (Thread 0x7f187effb700 (LWP 6273)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff100, segment=2, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=4, message1=0x7f187effae08, message2=0x7f187effae10, type=0x7f187effae18, space_id=0x7f187effae20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=4) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82b80 <n+32>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 12 (Thread 0x7f189f82d700 (LWP 6304)): #0 0x00007f189eb33d84 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf544f in safe_cond_wait (cond=0x7f1881c698b0, mp=0x7f1881c69800, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=207) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:493 #2 0x0000000000c411ca in os_cond_wait (cond=0x7f1881c698b0, mutex=0x7f1881c69800) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:207 #3 0x0000000000c419e1 in os_event_wait_low (event=0x7f1881c69800, reset_sig_count=5846) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:609 #4 0x0000000000b1a1b4 in sync_array_wait_event (arr=0x7f189d4eb2c0, index=0) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0arr.c:458 #5 0x0000000000b1cec4 in mutex_spin_wait (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=4598) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0sync.c:631 #6 0x0000000000ac41de in mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=4598) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:222 #7 0x0000000000ac42a4 in pfs_mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=4598) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:251 #8 0x0000000000acc661 in i_s_sys_columns_fill_table (thd=0x7f187b751060, tables=0x7f1875c24370, cond=0x7f1875c24b00) at /home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc:4598 #9 0x00000000006a35c4 in get_schema_tables_result (join=0x7f1875c254b8, executed_place=PROCESSED_BY_JOIN_EXEC) at /home/elenst/bzr/5.5/sql/sql_show.cc:7766 #10 0x000000000064a1d5 in JOIN::exec (this=0x7f1875c254b8) at /home/elenst/bzr/5.5/sql/sql_select.cc:2357 #11 0x000000000064cc1b in mysql_select (thd=0x7f187b751060, rref_pointer_array=0x7f187b754cc8, tables=0x7f1875c24370, wild_num=1, fields=..., conds=0x7f1875c24b00, og_num=0, order=0x0, group=0x0, having=0x0, proc_param=0x0, select_options=2684619520, result=0x7f1875c25498, unit=0x7f187b754380, select_lex=0x7f187b754a58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090 #12 0x00000000006432e3 in handle_select (thd=0x7f187b751060, lex=0x7f187b7542d0, result=0x7f1875c25498, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319 #13 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b751060, all_tables=0x7f1875c24370) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688 #14 0x0000000000614275 in mysql_execute_command (thd=0x7f187b751060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233 #15 0x000000000061de85 in mysql_parse (thd=0x7f187b751060, rawbuf=0x7f1875c24078 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_SYS_COLUMNS` AS table1 WHERE table1 . `NAME` < 3 LIMIT 5", length=102, parser_state=0x7f189f82c620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799 #16 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b751060, packet=0x7f187b756061 " SELECT * FROM INFORMATION_SCHEMA . `INNODB_SYS_COLUMNS` AS table1 WHERE table1 . `NAME` < 3 LIMIT 5", packet_length=103) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079 #17 0x0000000000610880 in do_command (thd=0x7f187b751060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793 #18 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b751060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266 #19 0x000000000071c40c in handle_one_connection (arg=0x7f187b751060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181 #20 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #21 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #22 0x0000000000000000 in ?? () Thread 11 (Thread 0x7f189df09700 (LWP 6308)): #0 0x00007f189eb33d84 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf544f in safe_cond_wait (cond=0x7f1881c698b0, mp=0x7f1881c69800, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=207) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:493 #2 0x0000000000c411ca in os_cond_wait (cond=0x7f1881c698b0, mutex=0x7f1881c69800) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:207 #3 0x0000000000c419e1 in os_event_wait_low (event=0x7f1881c69800, reset_sig_count=5846) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:609 #4 0x0000000000b1a1b4 in sync_array_wait_event (arr=0x7f189d4eb2c0, index=1) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0arr.c:458 #5 0x0000000000b1cec4 in mutex_spin_wait (mutex=0x7f189d41f878, file_name=0xe7d020 "/home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc", line=10245) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0sync.c:631 #6 0x0000000000aa8584 in mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe7d020 "/home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc", line=10245) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:222 #7 0x0000000000aa864a in pfs_mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe7d020 "/home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc", line=10245) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:251 #8 0x0000000000aba215 in ha_innobase::get_foreign_key_list (this=0x7f1871a3d078, thd=0x7f187b765060, f_key_list=0x7f189df05d50) at /home/elenst/bzr/5.5/storage/xtradb/handler/ha_innodb.cc:10245 #9 0x000000000069d9e9 in get_schema_key_column_usage_record (thd=0x7f187b765060, tables=0x7f187104f140, table=0x7f187101d078, res=false, db_name=0x7f187466eb08, table_name=0x7f187104d570) at /home/elenst/bzr/5.5/sql/sql_show.cc:6245 #10 0x0000000000693a29 in fill_schema_table_by_open (thd=0x7f187b765060, is_show_fields_or_keys=false, table=0x7f187101d078, schema_table=0x140f8c0 <schema_tables+832>, orig_db_name=0x7f187466eb08, orig_table_name=0x7f187104d570, open_tables_state_backup=0x7f189df073c0, can_deadlock=true) at /home/elenst/bzr/5.5/sql/sql_show.cc:3931 #11 0x00000000006951a2 in get_all_tables (thd=0x7f187b765060, tables=0x7f1874425468, cond=0x7f187466daa8) at /home/elenst/bzr/5.5/sql/sql_show.cc:4565 #12 0x00000000006a35c4 in get_schema_tables_result (join=0x7f187446e910, executed_place=PROCESSED_BY_JOIN_EXEC) at /home/elenst/bzr/5.5/sql/sql_show.cc:7766 #13 0x000000000064a1d5 in JOIN::exec (this=0x7f187446e910) at /home/elenst/bzr/5.5/sql/sql_select.cc:2357 #14 0x000000000064cc1b in mysql_select (thd=0x7f187b765060, rref_pointer_array=0x7f187b768cc8, tables=0x7f1874424de8, wild_num=1, fields=..., conds=0x7f187445ad88, og_num=0, order=0x0, group=0x0, having=0x7f187445b7c0, proc_param=0x0, select_options=2684619520, result=0x7f187446e8f0, unit=0x7f187b768380, select_lex=0x7f187b768a58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090 #15 0x00000000006432e3 in handle_select (thd=0x7f187b765060, lex=0x7f187b7682d0, result=0x7f187446e8f0, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319 #16 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b765060, all_tables=0x7f1874424de8) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688 #17 0x0000000000614275 in mysql_execute_command (thd=0x7f187b765060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233 #18 0x000000000061de85 in mysql_parse (thd=0x7f187b765060, rawbuf=0x7f1874424078 "SELECT * FROM (test . `E` AS table1 INNER JOIN INFORMATION_SCHEMA . `KEY_COLUMN_USAGE` AS table2 ON ( table2 . `POSITION_IN_UNIQUE_CONSTRAINT` = table1 . `col_date_key` ) ) WHERE ( (NOT ( ( ( ( ( (NO"..., length=681, parser_state=0x7f189df08620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799 #19 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b765060, packet=0x7f187b76a061 " SELECT * FROM (test . `E` AS table1 INNER JOIN INFORMATION_SCHEMA . `KEY_COLUMN_USAGE` AS table2 ON ( table2 . `POSITION_IN_UNIQUE_CONSTRAINT` = table1 . `col_date_key` ) ) WHERE ( (NOT ( ( ( ( ( (N"..., packet_length=682) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079 #20 0x0000000000610880 in do_command (thd=0x7f187b765060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793 #21 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b765060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266 #22 0x000000000071c40c in handle_one_connection (arg=0x7f187b765060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181 #23 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #24 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #25 0x0000000000000000 in ?? () Thread 10 (Thread 0x7f189f908700 (LWP 6286)): #0 0x00007f189eb379f7 in do_sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x00007f189eb37a79 in sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0 #2 0x0000000000563f9a in signal_hand (arg=0x0) at /home/elenst/bzr/5.5/sql/mysqld.cc:3058 #3 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #4 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #5 0x0000000000000000 in ?? () Thread 9 (Thread 0x7f189f9b5780 (LWP 6266)): #0 0x00007f189e251303 in poll () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x0000000000567fb3 in handle_connections_sockets () at /home/elenst/bzr/5.5/sql/mysqld.cc:5614 #2 0x00000000005672fe in mysqld_main (argc=17, argv=0x7f189d44d190) at /home/elenst/bzr/5.5/sql/mysqld.cc:5063 #3 0x000000000055f2d0 in main (argc=17, argv=0x7ffffa781d28) at /home/elenst/bzr/5.5/sql/main.cc:25 Thread 8 (Thread 0x7f189de77700 (LWP 6312)): #0 0x00007f189eb33d84 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf544f in safe_cond_wait (cond=0x7f1881c698b0, mp=0x7f1881c69800, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=207) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:493 #2 0x0000000000c411ca in os_cond_wait (cond=0x7f1881c698b0, mutex=0x7f1881c69800) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:207 #3 0x0000000000c419e1 in os_event_wait_low (event=0x7f1881c69800, reset_sig_count=5846) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:609 #4 0x0000000000b1a1b4 in sync_array_wait_event (arr=0x7f189d4eb2c0, index=2) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0arr.c:458 #5 0x0000000000b1cec4 in mutex_spin_wait (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=3783) at /home/elenst/bzr/5.5/storage/xtradb/sync/sync0sync.c:631 #6 0x0000000000ac41de in mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=3783) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:222 #7 0x0000000000ac42a4 in pfs_mutex_enter_func (mutex=0x7f189d41f878, file_name=0xe86730 "/home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc", line=3783) at /home/elenst/bzr/5.5/storage/xtradb/include/sync0sync.ic:251 #8 0x0000000000acaf9a in i_s_sys_tables_fill_table (thd=0x7f187b7a9060, tables=0x7f18738245d0, cond=0x7f1873ae0588) at /home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc:3783 #9 0x00000000006a35c4 in get_schema_tables_result (join=0x7f1873adc760, executed_place=PROCESSED_BY_JOIN_EXEC) at /home/elenst/bzr/5.5/sql/sql_show.cc:7766 #10 0x000000000064a1d5 in JOIN::exec (this=0x7f1873adc760) at /home/elenst/bzr/5.5/sql/sql_select.cc:2357 #11 0x000000000064cc1b in mysql_select (thd=0x7f187b7a9060, rref_pointer_array=0x7f187b7accc8, tables=0x7f18738245d0, wild_num=1, fields=..., conds=0x7f1873ae3d98, og_num=0, order=0x0, group=0x0, having=0x0, proc_param=0x0, select_options=2684619520, result=0x7f1873adc740, unit=0x7f187b7ac380, select_lex=0x7f187b7aca58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090 #12 0x00000000006432e3 in handle_select (thd=0x7f187b7a9060, lex=0x7f187b7ac2d0, result=0x7f1873adc740, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319 #13 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b7a9060, all_tables=0x7f18738245d0) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688 #14 0x0000000000614275 in mysql_execute_command (thd=0x7f187b7a9060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233 #15 0x000000000061de85 in mysql_parse (thd=0x7f187b7a9060, rawbuf=0x7f1873824078 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_SYS_TABLES` AS table1 WHERE ( ( ( (NOT (NOT (NOT ( table1 . `N_COLS` <> '2006-05-16 22:28:46.012403' OR table1 . `SPACE` > table1 . `TABLE_ID`) AND table1 ."..., length=405, parser_state=0x7f189de76620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799 #16 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b7a9060, packet=0x7f187b7ae061 " SELECT * FROM INFORMATION_SCHEMA . `INNODB_SYS_TABLES` AS table1 WHERE ( ( ( (NOT (NOT (NOT ( table1 . `N_COLS` <> '2006-05-16 22:28:46.012403' OR table1 . `SPACE` > table1 . `TABLE_ID`) AND table1 "..., packet_length=409) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079 #17 0x0000000000610880 in do_command (thd=0x7f187b7a9060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793 #18 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b7a9060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266 #19 0x000000000071c40c in handle_one_connection (arg=0x7f187b7a9060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181 #20 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #21 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #22 0x0000000000000000 in ?? () Thread 7 (Thread 0x7f187f7fc700 (LWP 6272)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff100, segment=1, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=3, message1=0x7f187f7fbe08, message2=0x7f187f7fbe10, type=0x7f187f7fbe18, space_id=0x7f187f7fbe20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=3) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82b78 <n+24>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 6 (Thread 0x7f18807fe700 (LWP 6270)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff0b0, segment=0, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=1, message1=0x7f18807fde08, message2=0x7f18807fde10, type=0x7f18807fde18, space_id=0x7f18807fde20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=1) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82b68 <n+8>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 5 (Thread 0x7f189d3ff700 (LWP 6268)): #0 0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf5749 in safe_cond_timedwait (cond=0x1d80680 <COND_checkpoint>, mp=0x1d805c0 <LOCK_checkpoint>, abstime=0x7f189d3fedb0, file=0xe69e50 "/home/elenst/bzr/5.5/storage/maria/ma_servicethread.c", line=119) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547 #2 0x00000000009bff14 in inline_mysql_cond_timedwait (that=0x1d80680 <COND_checkpoint>, mutex=0x1d805c0 <LOCK_checkpoint>, abstime=0x7f189d3fedb0, src_file=0xe69e50 "/home/elenst/bzr/5.5/storage/maria/ma_servicethread.c", src_line=119) at /home/elenst/bzr/5.5/include/mysql/psi/mysql_thread.h:1017 #3 0x00000000009c040c in my_service_thread_sleep (control=0x14206b0 <checkpoint_control>, sleep_time=30000000000) at /home/elenst/bzr/5.5/storage/maria/ma_servicethread.c:118 #4 0x00000000009b414a in ma_checkpoint_background (arg=0x1e) at /home/elenst/bzr/5.5/storage/maria/ma_checkpoint.c:705 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 4 (Thread 0x7f187fffd700 (LWP 6271)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff100, segment=0, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=2, message1=0x7f187fffce08, message2=0x7f187fffce10, type=0x7f187fffce18, space_id=0x7f187fffce20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=2) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82b70 <n+16>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 3 (Thread 0x7f1880fff700 (LWP 6269)): #0 0x00007f189f5a1644 in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #1 0x0000000000c3ea19 in os_aio_linux_collect (array=0x7f188b7ff060, segment=0, seg_size=2048) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4687 #2 0x0000000000c3ee11 in os_aio_linux_handle (global_seg=0, message1=0x7f1880ffee08, message2=0x7f1880ffee10, type=0x7f1880ffee18, space_id=0x7f1880ffee20) at /home/elenst/bzr/5.5/storage/xtradb/os/os0file.c:4833 #3 0x0000000000bdf63a in fil_aio_wait (segment=0) at /home/elenst/bzr/5.5/storage/xtradb/fil/fil0fil.c:5697 #4 0x0000000000b157e6 in io_handler_thread (arg=0x1d82b60 <n>) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0start.c:490 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 2 (Thread 0x7f1877bff700 (LWP 6284)): #0 0x00007f189eb340fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000cf5749 in safe_cond_timedwait (cond=0x7f188b687eb0, mp=0x7f188b687e00, abstime=0x7f1877bfe650, file=0xed2800 "/home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c", line=171) at /home/elenst/bzr/5.5/mysys/thr_mutex.c:547 #2 0x0000000000c410cf in os_cond_wait_timed (cond=0x7f188b687eb0, mutex=0x7f188b687e00, abstime=0x7f1877bfe650) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:171 #3 0x0000000000c41ba0 in os_event_wait_time_low (event=0x7f188b687e00, time_in_usec=1000000, reset_sig_count=1) at /home/elenst/bzr/5.5/storage/xtradb/os/os0sync.c:716 #4 0x0000000000b1251b in srv_master_thread (arg=0x0) at /home/elenst/bzr/5.5/storage/xtradb/srv/srv0srv.c:3509 #5 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #6 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #7 0x0000000000000000 in ?? () Thread 1 (Thread 0x7f189dde5700 (LWP 6316)): #0 0x00007f189eb34f8c in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0 #1 0x0000000000ced9a0 in my_write_core (sig=6) at /home/elenst/bzr/5.5/mysys/stacktrace.c:457 #2 0x00000000007d31af in handle_fatal_signal (sig=6) at /home/elenst/bzr/5.5/sql/signal_handler.cc:262 #3 <signal handler called> #4 0x00007f189e19f425 in raise () from /lib/x86_64-linux-gnu/libc.so.6 #5 0x00007f189e1a2b8b in abort () from /lib/x86_64-linux-gnu/libc.so.6 #6 0x0000000000ac53e5 in page_get_data_size (page=0x7f188a6c8000 "") at /home/elenst/bzr/5.5/storage/xtradb/include/page0page.ic:934 #7 0x0000000000acf837 in i_s_innodb_buffer_pool_pages_index_fill (thd=0x7f187b36e060, tables=0x7f188b85a5c0, cond=0x7f188b85ae10) at /home/elenst/bzr/5.5/storage/xtradb/handler/i_s.cc:6592 #8 0x00000000006a35c4 in get_schema_tables_result (join=0x7f1871b94218, executed_place=PROCESSED_BY_JOIN_EXEC) at /home/elenst/bzr/5.5/sql/sql_show.cc:7766 #9 0x000000000064a1d5 in JOIN::exec (this=0x7f1871b94218) at /home/elenst/bzr/5.5/sql/sql_select.cc:2357 #10 0x000000000064cc1b in mysql_select (thd=0x7f187b36e060, rref_pointer_array=0x7f187b371cc8, tables=0x7f188b85a5c0, wild_num=1, fields=..., conds=0x7f188b85ae10, og_num=7, order=0x7f188b85b8e0, group=0x0, having=0x7f188b85b688, proc_param=0x0, select_options=2684619520, result=0x7f1871b941f8, unit=0x7f187b371380, select_lex=0x7f187b371a58) at /home/elenst/bzr/5.5/sql/sql_select.cc:3090 #11 0x00000000006432e3 in handle_select (thd=0x7f187b36e060, lex=0x7f187b3712d0, result=0x7f1871b941f8, setup_tables_done_option=0) at /home/elenst/bzr/5.5/sql/sql_select.cc:319 #12 0x000000000061b6b8 in execute_sqlcom_select (thd=0x7f187b36e060, all_tables=0x7f188b85a5c0) at /home/elenst/bzr/5.5/sql/sql_parse.cc:4688 #13 0x0000000000614275 in mysql_execute_command (thd=0x7f187b36e060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:2233 #14 0x000000000061de85 in mysql_parse (thd=0x7f187b36e060, rawbuf=0x7f188b85a078 "SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_POOL_PAGES_INDEX` AS table1 WHERE table1 . `lru_position` < table1 . `space_id` HAVING (table1 . `data_size` <> 2 IS NOT NULL AND table1 . `old` <="..., length=374, parser_state=0x7f189dde4620) at /home/elenst/bzr/5.5/sql/sql_parse.cc:5799 #15 0x000000000061172f in dispatch_command (command=COM_QUERY, thd=0x7f187b36e060, packet=0x7f187b386061 " SELECT * FROM INFORMATION_SCHEMA . `INNODB_BUFFER_POOL_PAGES_INDEX` AS table1 WHERE table1 . `lru_position` < table1 . `space_id` HAVING (table1 . `data_size` <> 2 IS NOT NULL AND table1 . `old` <"..., packet_length=375) at /home/elenst/bzr/5.5/sql/sql_parse.cc:1079 #16 0x0000000000610880 in do_command (thd=0x7f187b36e060) at /home/elenst/bzr/5.5/sql/sql_parse.cc:793 #17 0x000000000071c93a in do_handle_one_connection (thd_arg=0x7f187b36e060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1266 #18 0x000000000071c40c in handle_one_connection (arg=0x7f187b36e060) at /home/elenst/bzr/5.5/sql/sql_connect.cc:1181 #19 0x00007f189eb2fe9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0 #20 0x00007f189e25ccbd in clone () from /lib/x86_64-linux-gnu/libc.so.6 #21 0x0000000000000000 in ?? () Stack trace from: revision-id: sergii@pisem.net-20140605172551-avr6i9us81bsin83 date: 2014-06-05 19:25:51 +0200 build-date: 2014-06-23 13:21:41 +0300 revno: 4214 branch-nick: 5.5

              People

              • Assignee:
                elenst Elena Stepanova
                Reporter:
                elenst Elena Stepanova
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - 0 minutes
                  0m
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 2 hours
                  2h