Real-Time Batching in Go
How to convert a stream of real-time updates into efficient database batches without sacrificing latency or code clarity? A deep dive into building a transparent batching layer that just works.
On-the-Fly Content Type Sniffing and Validation in Go
Using magic bytes to validate file uploads without buffering the entire file in memory. A clean, reusable solution built on top of http.DetectContentType and io.Reader from the Go standard library.
From Multiple Atomics to Clean Progress Tracking
A practical approach to tracking progress in concurrent one-off Go scripts, moving from multiple atomic counters to a clean, reusable solution. The post explores a fast lock-free implementation using copy-on-write and compare-and-swap patterns.
Parallel Streaming Pattern in Go: How to Scan Large S3 or GCS Buckets Significantly Faster
Sometimes the bottleneck isn't the file processing — it's the bucket traversal. Learn how to speed up the listing of files in S3 and other object storages by partitioning the bucket into ranges and streaming files from each of them concurrently. This approach can achieve significant speed-ups, turning hours-long operations into minutes.