Redis is loading the dataset in memory

aleks73337 · February 4, 2021, 7:47am

Hello. I’m have 3 KeyDB servers with master-master replication. Sometimes when I try to write some data to one of them, I get an error “Redis is loading the dataset in memory” from my python client. Can you, pleese, tell me what is wrong?
Code of my python client:

import redis
import random

r = redis.Redis(host='127.0.0.1', port=6379, db=0, password='mypassword')

def write_data():
    data = str(random.getrandbits(128))
    r.set(data, data)

if __name__ == "__main__":
    while(True):
        write_data()

aleks73337 · February 4, 2021, 7:50am

My KeyDB config

github.com

aleks73337/code_share/blob/main/keydb.conf

# Redis configuration file example.
#
# Note that in order to read the configuration file, Redis must be
# started with the file path as first argument:
#
# ./keydb-server /path/to/redis.conf

# Note on units: when memory size is needed, it is possible to specify
# it in the usual form of 1k 5GB 4M and so forth:
#
# 1k => 1000 bytes
# 1kb => 1024 bytes
# 1m => 1000000 bytes
# 1mb => 1024*1024 bytes
# 1g => 1000000000 bytes
# 1gb => 1024*1024*1024 bytes
#
# units are case insensitive so 1GB 1Gb 1gB are all the same.

################################## INCLUDES ###################################

This file has been truncated. show original

benschermel · February 6, 2021, 6:19am

Hi @aleks73337

What is going on in the logfile? This error is typically caused when trying to write data while loading an RDB file. Seeing as you do not have save enabled, it can also happen when a full resync is occurring. You mention this is only happening on one of the 3 nodes? The logfiles should give us some insight into what may be going on