[Info-ingres] When is a table just to damn big?

[Martin Bowes]

Hi All,

On II 10.2.0 (a64.lnx/100) + p15162.

I have a table which is a tad on the chunky side. And so we have partitioned it 32 ways...

Name:                 pidrun
Type:                 user table (partitioned)
Version:              II10.0
Number of rows:       2161795407
Storage structure:    btree with unique keys
Column Information:
                                                                          Key
Column Name                      Type               Length Nulls Defaults Seq
run_id                           integer                 4   no      no     1
encoded_id                       integer                 4   no      no     2
group_id                         integer                 2   no   value
status                           integer                 1   no      no

partition = (HASH on run_id
          32 partitions
        )

Last week it had  2145691720 rows and we were able to modify it.

This week the number of rows exceeds an int4 item.

An attempt to modify the table fails with...
E_QE0083 Error modifying a table.
    Associated error messages which provide more detailed information about
    the problem can be found in the error log (errlog.log)

And in the errlog we see:
BBA_CTSU_OX_AC_UK ::[40644             , 5706      ,  00007f48abe188c0, sc0m.c:1642           ]: Mon Nov  5 10:26:34 2018 E_SC0107_BAD_SIZE_EXPAND  Error expanding virtual size of server.
mepages.c:1587  memalign() failed with operating system error 12 (Cannot allocate memory)
BBA_CTSU_OX_AC_UK ::[40644             , 5706      ,  00007f48ac0ef740, sc0m.c:1642           ]: Mon Nov  5 10:26:34 2018 E_SC0107_BAD_SIZE_EXPAND  Error expanding virtual size of server.
mepages.c:1587  memalign() failed with operating system error 12 (Cannot allocate memory)
BBA_CTSU_OX_AC_UK ::[40644             , 5706      ,  00007f48abe188c0, scumsvc.c:306         ]: Mon Nov  5 10:26:34 2018 E_SC0107_BAD_SIZE_EXPAND  Error expanding virtual size of server.
BBA_CTSU_OX_AC_UK ::[40644             , 5706      ,  00007f48abe188c0, scumsvc.c:306         ]: Mon Nov  5 10:26:34 2018 E_SC0107_BAD_SIZE_EXPAND  Error expanding virtual size of server.
BBA_CTSU_OX_AC_UK ::[40644             , 5706      ,  00007f48ac0ef740, scumsvc.c:306         ]: Mon Nov  5 10:26:34 2018 E_SC0107_BAD_SIZE_EXPAND  Error expanding virtual size of server.
BBA_CTSU_OX_AC_UK ::[40644             , 5706      ,  00007f48abe188c0, dm0m.c:775            ]: Mon Nov  5 10:26:34 2018 E_DM9425_MEMORY_ALLOCATE  Error allocating memory for DMF operation.  Could not allocate requested memory.  Memory request was for -9756672 bytes.
BBA_CTSU_OX_AC_UK ::[40644             , 5706      ,  00007f48abe188c0, dm0m.c:775            ]: Query:   modify pidrun to btree unique on run_id, encoded_id
BBA_CTSU_OX_AC_UK ::[40644             , 5706      ,  00007f48abe188c0, dm0m.c:775            ]: LQuery: Execute uipartdesc1

And a lot more...

I plan to convert this into a vector table when Ingres11.1 is released and we can make vector tables which work in queries with regular tables.

But until then, does anyone have a suggestion?

Marty
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.planetingres.org/pipermail/info-ingres/attachments/20181105/7e571da4/attachment.html>