2 comments
> DbOptions::durable()<p>> Appended to the WAL without a per-write sync<p>So… it’s not durable? Durable doesn’t mean “survives a process restart”, it means “durably saved to persistent storage”. For example, this “durable” mode wouldn’t survive power loss.
I suppose the insane speed is due to this:<p>> <i>TurboKV's persisted Bloom-filter format uses hardware AES.</i><p>Also, built-in LZ4 compression.<p>I would expect SIMD to be used for scans.
I assume this is for hashing. I've seen several hashing algorithms turn to hardware AES instructions before, but I haven't seen any evidence that this technique outperforms state-of-the-art hashes like RapidHash (<a href="https://github.com/Nicoshev/rapidhash" rel="nofollow">https://github.com/Nicoshev/rapidhash</a>) in either quality or speed.
Those help but the main write speed gain is the WAL, that uses preallocated mmap segments to avoid a write(2) per durable mutation while preserving crash recovery.
AES hashing mainly helps Bloom filter point lookups and LZ4 mainly helps SSTable I/O. Scans benefit indirectly, but don’t yet use a custom SIMD merge loop.