https://slatedb.io logo
Join Discord
Powered by
# general
  • c
    > that would run as a "background job" yea. > could tune the settings dynamically I am not so sure on this part. First step was just to have it spit out suggestions. Dynamic config changes are always scary in production (to me).
  • c
    Our configs are all static, so any cfg changes would involve restarting the client right now. And configs like you're talking about (scan options) are programmatic, not even config based.
  • p
    > Dynamic config changes are always scary in production (to me). Call it "AI steering" 🤞
  • p
    I think it would be great to have a tracking issue for this
  • c
    Want to open one? I can brain dump. I'd do it but dealing with ... humans in my household that are under 18 and require significant assistance 😛
  • v
    Looks like if both 
    l0_max_ssts
    and 
    max_unflushed_bytes
    are reached at the same time, then slatedb just stops responding at all. Shouldn't compaction eventually reduce number of sst files? From logs I don't see compaction hapenning.
  • c
    > Shouldn't compaction eventually reduce number of sst files? From logs I don't see compaction hapenning. Yes, compaction should clear out l0, allowing more l0's to be flushed, thus reducing unflushed_bytes to below max_unflushed_bytes.
  • c
  • c
    If you configure things such that the compactor requires more SSTs to start than are allowed by l0_max_ssts, the compactor will never run.
  • Argh, this one is a bit annoying
    p
    Argh, this one is a bit annoying
    Copy code
    retries: 1, max_retries: 10, elapsed: 689.469783ms, retry_timeout: 180s, inner: Status { status: 412, body: Some("<?xml version=\"1.0\" encoding=\"UTF-8\"?><Error><Code>PreconditionFailed</Code><Message>At least one of the pre-conditions you specified did not hold.</Message></Error>") } }) } }), panic=None]
    c
    • 2
    • 20
  • v
    I'm using slatedb 0.8.2 via golang bindings, and I'm seeing my process memory usage going up and to the right until OOM. Was there any recent issues with memory usage recently. Do you have any tips for ruling out and issue in slatedb? I've been looking at golang pprof memory usage and everything seems fine, this is what makes me think that it could be a problem with slatedb.
  • c
    There are no know memory issues in SlateDB itself.
  • c
    What are your configs set to? Let's start there.
  • c
    Also, any reason you're not using the latest 0.9.2 release?
  • c
  • I’m using s3. I cannot upgrade yet, because I will need to first upgrade rust compiler.
    c
    Also .. are you using the InMemory object store?
    v
    p
    • 3
    • 94
  • I don't know what I'm doing wrong, but I
    p
    I don't know what I'm doing wrong, but I can't get the go bindings to write anything to disk. I'm pretty sure I had this working with Minio at some point, but it doesn't work at all now with local or S3. I tried main and v0.9.2 https://gist.github.com/patrobinson/355630ac817bbd1ab7cfb8cd963e004b
    c
    v
    • 3
    • 16
  • c
    @Patrick R I ran your code locally
  • c
    Copy code
    chrisriccomini@mac slatedb-go-test-thingy % ./m 
value1
  • c
    This was with slatedb-go 0.9.2, and the slatedb target release pointing to a build of main on my local machine
  • c
    @Patrick R This is probably why you're not seeing anything on disk: https://github.com/slatedb/slatedb/blob/v0.9.2/slatedb-go/src/config.rs#L95C1-L96C1
  • c
    local
    = 
    InMemory
  • c
    Lemme see if I can get it working on 
    main
    with @Victor Ordaz 's stuff
  • i am thinking about using slatedb for
    i
    i am thinking about using slatedb for session management. would that be a good usecase?
    c
    f
    • 3
    • 5
  • c
    i was curious about how ruby bindings with [magnus](https://github.com/matsadler/magnus) / [rb_sys](https://github.com/oxidize-rb/rb-sys/tree/main) would look, so I sent off a little robot to have a bash and it actually didn't do a terrible job. https://github.com/slatedb/slatedb/compare/main...catkins:catkins/ruby-bindings (dw. I'm not going to saddle you with a PR with this code 😛 )
  • c
    @catkins Hah! Should throw it up on a personal GH repo. I bet you'd attract some PRs and users.
  • c
    We can add a 3rd party bindings section to the README, too
  • c
    @User I'm going to merge this: https://github.com/slatedb/slatedb/pull/1064
  • c
    I let it sit for a few days after Almog
  • c