Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Incomplete
    • Affects Version/s: 5.5.34
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Environment:

      Description

      Server keeps crashing randomly

      140113  8:52:24 [ERROR] mysqld got signal 11 ;
      Server version: 5.5.34-MariaDB-1~saucy-log
      key_buffer_size=8388608
      read_buffer_size=8388608
      max_used_connections=50
      max_threads=102
      thread_count=29
      It is possible that mysqld could use up to
      key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1054475 K  bytes of memory
      Hope that's ok; if not, decrease some variables in the equation.
      
      Thread pointer: 0x0x7fe8a2cac000
      Attempting backtrace. You can use the following information to find out
      where mysqld died. If you see no messages after this, something went
      terribly wrong...
      stack_bottom = 0x7fea5949cda0 thread_stack 0x30000
      ??:0(??)[0x7febd07b789e]
      ??:0(??)[0x7febd03ade17]
      ??:0(??)[0x7febcf45ebb0]
      ??:0(??)[0x7febd051c79d]
      ??:0(??)[0x7febd066f734]
      ??:0(??)[0x7febd0670a5c]
      ??:0(??)[0x7febd065d6ac]
      ??:0(??)[0x7febd06437b7]
      ??:0(??)[0x7febd05fe200]
      ??:0(??)[0x7febd05cefe1]
      ??:0(??)[0x7febd028f2e8]
      ??:0(??)[0x7febd029e9b3]
      ??:0(??)[0x7febd02a9b5d]
      ??:0(??)[0x7febd02bb287]
      ??:0(??)[0x7febd02bd2ed]
      ??:0(??)[0x7febd02617b9]
      ??:0(??)[0x7febd026e4c4]
      ??:0(??)[0x7febd027156a]
      ??:0(??)[0x7febd0273690]
      ??:0(??)[0x7febd032cd43]
      ??:0(??)[0x7febd032ce3a]
      ??:0(??)[0x7febd051bfd1]
      ??:0(??)[0x7febcf456f6e]
      ??:0(??)[0x7febce53f9cd]
      Trying to get some variables.
      Some pointers may be invalid and cause the dump to abort.
      Query (0x7fe8a290c018): is an invalid pointer
      Connection ID (thread ID): 35367
      Status: NOT_KILLED
      
      Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=off
      

        Gliffy Diagrams

          Attachments

            Activity

            Hide
            serg Sergei Golubchik added a comment -

            Do you know what statement caused this? Can you attach your my.cnf file to the bug report?

            Show
            serg Sergei Golubchik added a comment - Do you know what statement caused this? Can you attach your my.cnf file to the bug report?
            Hide
            rcerulli robert cerulli added a comment - - edited

            More data - this is what casuses to crash, i dont know the exact statment as its an application im using and did not write

            Error: queryDirect: SQLSTATE[HY000]: General error: 2013 Lost connection to MySQL server during query
            
            PHP Warning:  Invalid argument supplied for foreach() in /var/www/nZEDb/www/lib/framework/db.php on line 310
            PHP Fatal error:  Uncaught exception 'PDOException' with message 'SQLSTATE[HY000]: General error: 2013 Lost connection to MySQL server during query' in /var/www/nZEDb/www/lib/releases.php:1578
            Stack trace:
            #0 /var/www/nZEDb/www/lib/releases.php(1578): PDOStatement->execute()
            #1 /var/www/nZEDb/misc/update_scripts/nix_scripts/tmux/bin/update_releases.php(52): Releases->processReleasesStage7a('40', true)
            #2 {main}
              thrown in /var/www/nZEDb/www/lib/releases.php on line 1578
            
            Show
            rcerulli robert cerulli added a comment - - edited More data - this is what casuses to crash, i dont know the exact statment as its an application im using and did not write Error: queryDirect: SQLSTATE[HY000]: General error: 2013 Lost connection to MySQL server during query PHP Warning: Invalid argument supplied for foreach() in /var/www/nZEDb/www/lib/framework/db.php on line 310 PHP Fatal error: Uncaught exception 'PDOException' with message 'SQLSTATE[HY000]: General error: 2013 Lost connection to MySQL server during query' in /var/www/nZEDb/www/lib/releases.php:1578 Stack trace: #0 /var/www/nZEDb/www/lib/releases.php(1578): PDOStatement->execute() #1 /var/www/nZEDb/misc/update_scripts/nix_scripts/tmux/bin/update_releases.php(52): Releases->processReleasesStage7a('40', true) #2 {main} thrown in /var/www/nZEDb/www/lib/releases.php on line 1578
            Hide
            rcerulli robert cerulli added a comment - - edited
            [client]
            port                                                            = 3306
            socket                                                          =/var/lib/mysql/mysql.sock
            default-character-set                           = utf8
            
            [mysqld_safe]
            socket                                                          = /var/lib/mysql/mysql.sock
            nice                                                            = 0
            
            [mysqld]
            user                                                            = mysql
            pid-file                                                        = /var/lib/mysql/mysql.pid
            socket                                                          = /var/lib/mysql/mysql.sock
            port                                                            = 3306
            basedir                                                         = /usr
            datadir                                                         = /var/lib/mysql
            #tmpdir                                                         = /dev/shm
            tmpdir                                                          = /tmp
            character-set-server                            = utf8
            performance_schema                                      = on
            
            transaction-isolation                           = READ-COMMITTED
            
            lc-messages-dir                                         = /usr/share/mysql
            skip-external-locking
            
            #inndb recovery mode
            innodb_force_recovery                           = 0
            
            max-connections                                         = 100
            max_allowed_packet                                      = 32M
            thread_stack                                            = 192K
            thread_cache_size                               = 20
            group_concat_max_len                            = 8192
            
            tmp_table_size                                          = 2G
            max_heap_table_size                                     = 2G
            table_open_cache                                        = 20000
            low_priority_updates                            = 1
            concurrent_insert                                       = ALWAYS
            join_buffer_size                                        = 64M
            key_buffer_size                                         = 8M
            read_buffer_size                                        = 8M
            
            #explicit_defaults_for_timestamp        = TRUE
            
            myisam-recover-options                          = BACKUP
            #max_connections                                = 100
            #table_cache                                    = 64
            #thread_concurrency                             = 10
            
            query_cache_limit                                       = 64M
            query_cache_size                                        = 1G
            #query_cache_size                                       = 0
            
            #general_log_file                                       = /var/log/mysql/mysql.log
            #general_log                                            = 1
            log_error                                                       = /var/log/mysql/error.log
            
            slow-query-log                                          = 1
            slow_query_log_file                                     = /var/log/mysql/mysql-slow.log
            long_query_time                                         = 5
            #log-queries-not-using-indexes
            
            #innodb_ft_min_token_size                       = 1
            
            max_user_connections                            = 200
            #table_cache                                            = 4000
            
            #InnoDB specifics
            
            #Engine options
            innodb                                                          = ON
            innodb_file_format                                      = Barracuda
            innodb_file_per_table                           = 1
            
            #misc uncategorized
            innodb_table_locks                                      = false
            innodb_lock_wait_timeout                        = 240
            innodb_use_sys_malloc                           = 1
            
            #threading
            innodb_thread_concurrency                       = 0                     #or set to 0 and let mysql decide what it needs
            innodb_read_io_threads                          = 64
            innodb_write_io_threads                         = 64
            innodb_purge_threads                            = 1
            
            #buffer pool related
            innodb_buffer_pool_size                         = 4G
            innodb_buffer_pool_instances            = 4                     # each buffer pool instance should be at least 1 gigabyte
            innodb_change_buffering                         = all
            innodb_max_dirty_pages_pct                      = 90
            #innodb_page_size                               = 4k
            #innodb_flush_neighbors                         = 0
            
            #expand_fast_index_creation                     = 1
            #innodb_merge_sort_block_size           = 1G
            
            #flush related
            innodb_flush_method                             = O_DIRECT
            innodb_flush_log_at_trx_commit          = 0
            
            #transaction logs
            innodb_log_buffer_size                          = 1G
            innodb_log_files_in_group                       = 2
            innodb_log_file_size                            = 2500M #this should be 25% of innodb_buffer_pool_size
            
            [mysqldump]
            quick
            quote-names
            max_allowed_packet                                      = 32M
            
            [mysql]
            #no-auto-rehash # faster start of mysql but no tab completition
            
            [isamchk]
            key_buffer_size                                         = 16M
            
            #
            # * IMPORTANT: Additional settings that can override those from this file!
            #   The files must end with '.cnf', otherwise they'll be ignored.
            #
            !includedir /etc/mysql/conf.d/
            
            Show
            rcerulli robert cerulli added a comment - - edited [client] port = 3306 socket =/var/lib/mysql/mysql.sock default-character-set = utf8 [mysqld_safe] socket = /var/lib/mysql/mysql.sock nice = 0 [mysqld] user = mysql pid-file = /var/lib/mysql/mysql.pid socket = /var/lib/mysql/mysql.sock port = 3306 basedir = /usr datadir = /var/lib/mysql #tmpdir = /dev/shm tmpdir = /tmp character-set-server = utf8 performance_schema = on transaction-isolation = READ-COMMITTED lc-messages-dir = /usr/share/mysql skip-external-locking #inndb recovery mode innodb_force_recovery = 0 max-connections = 100 max_allowed_packet = 32M thread_stack = 192K thread_cache_size = 20 group_concat_max_len = 8192 tmp_table_size = 2G max_heap_table_size = 2G table_open_cache = 20000 low_priority_updates = 1 concurrent_insert = ALWAYS join_buffer_size = 64M key_buffer_size = 8M read_buffer_size = 8M #explicit_defaults_for_timestamp = TRUE myisam-recover-options = BACKUP #max_connections = 100 #table_cache = 64 #thread_concurrency = 10 query_cache_limit = 64M query_cache_size = 1G #query_cache_size = 0 #general_log_file = /var/log/mysql/mysql.log #general_log = 1 log_error = /var/log/mysql/error.log slow-query-log = 1 slow_query_log_file = /var/log/mysql/mysql-slow.log long_query_time = 5 #log-queries-not-using-indexes #innodb_ft_min_token_size = 1 max_user_connections = 200 #table_cache = 4000 #InnoDB specifics #Engine options innodb = ON innodb_file_format = Barracuda innodb_file_per_table = 1 #misc uncategorized innodb_table_locks = false innodb_lock_wait_timeout = 240 innodb_use_sys_malloc = 1 #threading innodb_thread_concurrency = 0 #or set to 0 and let mysql decide what it needs innodb_read_io_threads = 64 innodb_write_io_threads = 64 innodb_purge_threads = 1 #buffer pool related innodb_buffer_pool_size = 4G innodb_buffer_pool_instances = 4 # each buffer pool instance should be at least 1 gigabyte innodb_change_buffering = all innodb_max_dirty_pages_pct = 90 #innodb_page_size = 4k #innodb_flush_neighbors = 0 #expand_fast_index_creation = 1 #innodb_merge_sort_block_size = 1G #flush related innodb_flush_method = O_DIRECT innodb_flush_log_at_trx_commit = 0 #transaction logs innodb_log_buffer_size = 1G innodb_log_files_in_group = 2 innodb_log_file_size = 2500M #this should be 25% of innodb_buffer_pool_size [mysqldump] quick quote-names max_allowed_packet = 32M [mysql] #no-auto-rehash # faster start of mysql but no tab completition [isamchk] key_buffer_size = 16M # # * IMPORTANT: Additional settings that can override those from this file! # The files must end with '.cnf', otherwise they'll be ignored. # !includedir /etc/mysql/conf.d/
            Hide
            rcerulli robert cerulli added a comment -

            as a note, i moved the DB to a new set of disks and to EXT4 and its still crashing

            Show
            rcerulli robert cerulli added a comment - as a note, i moved the DB to a new set of disks and to EXT4 and its still crashing
            Hide
            serg Sergei Golubchik added a comment -

            Let's try that with 5.5.35 — you should get a better stack trace there, not just ":0()", that might help.

            Or, perhaps one of the 5.5.35 bugfixes covers your case too, and the crash will go away completely — we've fixed quite a few issues related to prepared statements in this release.

            Show
            serg Sergei Golubchik added a comment - Let's try that with 5.5.35 — you should get a better stack trace there, not just " :0( )", that might help. Or, perhaps one of the 5.5.35 bugfixes covers your case too, and the crash will go away completely — we've fixed quite a few issues related to prepared statements in this release.

              People

              • Assignee:
                Unassigned
                Reporter:
                rcerulli robert cerulli
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated:
                  Resolved: