Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-6084

memory usage does not match the OS

        Details

        • Type: Bug
        • Status: Closed
        • Priority: Major
        • Resolution: Incomplete
        • Affects Version/s: 5.5.36-galera
        • Fix Version/s: None
        • Component/s: None
        • Labels:
        • Environment:
          2.6.32-431.11.2.el6.x86_64, scientific linux

          Description

          I am using INNODB, and have assigned 48GB of large pages to the engine

          show variables like '%buffer%';
+-------------------------------------+----------------+
| Variable_name                       | Value          |
+-------------------------------------+----------------+
| aria_pagecache_buffer_size          | 1073741824     |
| aria_sort_buffer_size               | 268434432      |
| bulk_insert_buffer_size             | 94294967295    |
| innodb_buffer_pool_dump_at_shutdown | OFF            |
| innodb_buffer_pool_dump_now         | OFF            |
| innodb_buffer_pool_filename         | ib_buffer_pool |
| innodb_buffer_pool_instances        | 32             |
| innodb_buffer_pool_load_abort       | OFF            |
| innodb_buffer_pool_load_at_startup  | OFF            |
| innodb_buffer_pool_load_now         | OFF            |
| innodb_buffer_pool_size             | 48318382080    |
| innodb_change_buffer_max_size       | 25             |
| innodb_change_buffering             | all            |
| innodb_log_buffer_size              | 4294967296     |
| innodb_sort_buffer_size             | 1048576        |
| join_buffer_size                    | 4294967296     |
| join_buffer_space_limit             | 2097152        |
| key_buffer_size                     | 1585446912     |
| mrr_buffer_size                     | 262144         |
| myisam_sort_buffer_size             | 8388608        |
| net_buffer_length                   | 8192           |
| preload_buffer_size                 | 32768          |
| read_buffer_size                    | 4194304        |
| read_rnd_buffer_size                | 4194304        |
| sort_buffer_size                    | 8388608        |
| sql_buffer_result                   | OFF            |
+-------------------------------------+----------------+

          But my OS is telling me that mariadb is using 70 GB

            PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 5918 mysql     20   0 70.3g  11g 5852 S  4.0 12.6   9:00.18 mysqld

          The question is, where are the other 20 Gb being used?
          I only need to use INNODB, don´t understand exactly what aria is.

            Gliffy Diagrams

              Attachments

                Activity

                Ascending order - Click to sort in descending order
                Hide
                Permalink
                serg Sergei Golubchik added a comment -

                There are many reasons why a memory could be allocated. And show variables is not the only way to examine that. See, for example,

                Show
                serg Sergei Golubchik added a comment - There are many reasons why a memory could be allocated. And show variables is not the only way to examine that. See, for example, https://dev.mysql.com/doc/refman/5.0/en/memory-use.html https://mariadb.com/kb/en/server-status-variables/#memory_used https://mariadb.com/kb/en/show-processlist/
                Hide
                Permalink
                philip_38 Philip orleans added a comment -

                Show status output

                Show
                philip_38 Philip orleans added a comment - Show status output
                Hide
                Permalink
                philip_38 Philip orleans added a comment -

                machine out-of-memory error

                Show
                philip_38 Philip orleans added a comment - machine out-of-memory error
                Hide
                Permalink
                philip_38 Philip orleans added a comment -

                I uploaded the output of "show status". Also, the machine threw an out-of-memory error.

                Show
                philip_38 Philip orleans added a comment - I uploaded the output of "show status". Also, the machine threw an out-of-memory error.
                Hide
                Permalink
                serg Sergei Golubchik added a comment - - edited

                this doesn't help, unfortunately. Perhaps it's still InnoDB that allocates all this memory, but I cannot tell that based on the information you've provided. Try this article — innodb memory usage, you should be able to see how much memory innodb is really using in your setup.

                Show
                serg Sergei Golubchik added a comment - - edited this doesn't help, unfortunately. Perhaps it's still InnoDB that allocates all this memory, but I cannot tell that based on the information you've provided. Try this article — innodb memory usage , you should be able to see how much memory innodb is really using in your setup.

                  People

                  • Assignee:
                    Unassigned
                    Reporter:
                    philip_38 Philip orleans
                  • Votes:
                    0 Vote for this issue
                    Watchers:
                    2 Start watching this issue

                    Dates

                    • Due:
                      Created:
                      Updated:
                      Resolved: