A cloud native embedded storage engine built on object storage.

SlateDB

🤔 a big improvement in performance always makes me anxious haha - I don't think the iterator work would have made things more efficient

4 minutes improvement on a 14 mins run (now 10) on the CI seems massive

Might be worth multiple runs. Maybe you landed on a really nice GH action machine.

It's unlikely, all runs improved https://github.com/Barre/ZeroFS/pull/203

I don't see anything on the nightlies to indicate that either

All the jobs passed though so it's unlikely that something would be catastrophically broken

I like to do this to test things out too, 

`gh repo list microsoft --limit 7000 --json nameWithOwner --jq '.[].nameWithOwner' | parallel -j40 gh repo clone`

Pretty nice stress test

are you DDOS'ing Github!? Haha do they not rate limit you?

> are you DDOS'ing Github!?
I am not too worried about that, should be a drop of a drop of a drop in the bucket

> do they not rate limit you?
Not really!

I was surprised too by that but it seems that I can fetch as much as I want

<@839536195603922974> Wasn't this supposed to be Ok? `2025-11-07T19:37:19.718996Z  INFO slatedb::mem_table_flush: memtable flush thread exiting [result=Err(Closed)]`

Ah! It's because I haven't yet completed the shutdown/error work yet. The current "final state" for the DB is a `SlateDBError`. I need to make it a `Result<(), SlateDBError>`. The code is all set to do this, I just need to make the change. I didn't do it in the last release simply because I forgot about it 😛

Thx for reminding me. Will take a shot at it now

https://github.com/slatedb/slatedb/pull/988

eh playin with this a bit more.. might want to store a ClosedReason insetad

I'm pretty gassed (been a full day in the code, yay) but this review is gonna have to wait haha 😆

I'm just kinda throwing up low-hanging-fruit stuff today cuz yesterday's compactor work kinda drained me

@criccomini Wasn't this supposed to be

hey! excited to share our slatedb plans: https://github.com/s2-streamstore/s2?tab=readme-ov-file#s2-lite

Haven't gone in depth yet but !!! This is really exciting!

I'm curious: will you  need the CDC work?

https://github.com/slatedb/slatedb/issues/249

Would also love to see of what other features you're interested in

very exciting <@295064781910704129>!! happy to see an OSS, locally deployable version of S2 coming out

> Haven't gone in depth yet but !!!
honestly not much to go into depth yet! just some notes https://github.com/s2-streamstore/s2/blob/main/lite/docs/notes.md

slatedb feels like an amazing building block at this point, for this

i'll check out the CDC stuff, but I don't think _need_ anything new from SlateDB, from initial poking around

the main code in the repo currently is the actual types we use internally, our cloud repo has a git dep on that stuff

Also just noticed you guys are in F25 batch for YC.. nice 🙂

also like that can easily have an emulator, which we have wanted to build, simply by using an `InMemory` backend

excited to join this community 🙂 amazing, thriving project you guys have built

LMK if you have any plans to contrib and need/want to coordinate anything

will do, plan to get into the weeds this weekend

hey! excited to share our slatedb plans

All, proposing this as PR guidelines for contributors:

https://github.com/slatedb/slatedb/pull/990

LMK if you think I've missed anything or disagree.

I would also love some examples from other projects of great PR templates/guidelines/contributors.md if any come to mind.

I’ve been testing 0.9.0 extensively with zerofs

Boring is good. Though I always get nervous when things just .. work. 😛

Same! I've been noodling about where and how to start introducing it into the ecosystem 😛

Now I’ll try things with a low min age for the gc

Hmm this looks strange, doesn't it?
https://cdn.discordapp.com/attachments/1232385660946616433/1436832642690453645/image.png?ex=69110a2d&is=690fb8ad&hm=5e108739a512e2168910d0d71cfceab536f3d882f090aa8d3ee3c98ce4b0c1f4&

4 and 5 doesn't seem to get removed
https://cdn.discordapp.com/attachments/1232385660946616433/1436834133836959926/image.png?ex=69110b90&is=690fba10&hm=a6669456f92d2f4441b416f723a2e69eb8a5f953fa61779641b10171fbc9354b&