Real-Time Batching in Go
How to convert a stream of real-time updates into efficient database batches without sacrificing latency or code clarity? A deep dive into building a transparent batching layer that just works.
How to convert a stream of real-time updates into efficient database batches without sacrificing latency or code clarity? A deep dive into building a transparent batching layer that just works.
A practical approach to tracking progress in concurrent one-off Go scripts, moving from multiple atomic counters to a clean, reusable solution. The post explores a fast lock-free implementation using copy-on-write and compare-and-swap patterns.
Sometimes the bottleneck isn't file processing — it's bucket traversal. Learn how to speed up listing of files in object storages by splitting the bucket into ranges and streaming files concurrently.