Spegel - Stateless Local OCI Mirror
Visual architecture guide to Spegel, a stateless cluster-local OCI registry mirror for Kubernetes using P2P networking.
Visual architecture guide to Spegel, a stateless cluster-local OCI registry mirror for Kubernetes using P2P networking.
Exploring LLM serving optimizations including batching, quantization, paged attention, speculative decoding, and KV cache techniques.
A comprehensive overview of the infrastructure required to train 405B parameter LLMs, covering network topology, storage, compute, and fault tolerance.
Deep dive into ByteDance's Monolith framework powering TikTok's real-time recommendation system with online training.
Exploring alternatives to vector databases for LLM applications, including FAISS, PostgreSQL pgvector, and Elasticsearch.
Step-by-step guide to setting up a personal blog using Jekyll and GitHub Pages with custom domain configuration.