<p><strong>TLDR:</strong> A detailed breakdown of the April 2026 Bluesky outage reveals a nasty cascade where batch RPC calls exhausted ephemeral TCP ports against memcached, triggering a Go runtime memory spiral. Separately, a zero-day called BlueHammer chains five legitimate Windows components to escalate any low-privileged user to SYSTEM in under a minute, with full source code already public and no patch assigned. A critical pre-auth RCE in Marimo notebooks is under active exploitation, with attackers harvesting cloud secrets in under three minutes. A PyPI supply chain attack has also hit LiteLLM, a library with broad downstream reach across LLM tooling stacks.</p>
<hr>
<h2>Bluesky TCP port exhaustion postmortem</h2>
<p>The April 2026 Bluesky outage is worth reading carefully if you run Go services against memcached at any scale. Large batch RPC calls caused goroutines to open enough connections to memcached that they exhausted the ephemeral TCP port range, and TIME_WAIT state blocked port reuse. The Go runtime responded by spawning excessive OS threads, which cascaded into a memory spiral. The improvised fix was creative: randomly selecting source IPs from Linux’s full 127.0.0.0/8 loopback range to multiply available (IP, port) pairs. The analysis frames the failure patterns using David Woods’ ‘Messy 9’ resilience engineering framework, which is a useful lens for any multi-failure incident where the obvious fix isn’t obvious during the incident itself.</p>
<h2>BlueHammer zero-day chains Windows Defender to SYSTEM</h2>
<p>BlueHammer is a publicly available exploit that chains Windows Defender, Volume Shadow Copy, Cloud Files API, opportunistic locks, and Defender’s RPC interface to escalate a low-privileged user to NT AUTHORITY\SYSTEM in under a minute. The attack hijacks Defender’s signature update process to mount a shadow copy, freezes Defender with an opportunistic lock, extracts and decrypts NTLM hashes from the SAM database, spawns a SYSTEM shell, then restores the original hash to cover tracks. There is no CVE and no patch. Microsoft’s only response is a Defender signature that detects the original compiled binary but not recompiled variants, which is not a meaningful mitigation. Monitor VSS enumeration from user processes, watch for CfRegisterSyncRoot calls from unknown processes, and alert on rapid back-to-back password change events (IDs 4723/4724).</p>
<h2>Marimo pre-auth RCE under active exploitation</h2>
<p>CVE-2026-39987 (CVSS 9.3) in Marimo exposes a WebSocket terminal endpoint at <code>/terminal/ws</code> with no authentication, giving any unauthenticated client full shell access. Exploitation started less than 10 hours after public disclosure. Sysdig observed 125 IPs conducting reconnaissance within 12 hours, with attackers harvesting <code>.env</code> credentials, cloud secrets, and SSH keys in under three minutes. If you run Marimo anywhere network-accessible, upgrade to 0.23.0 immediately, firewall the endpoint, and rotate any secrets that were reachable.</p>
<h2>LiteLLM hit by PyPI supply chain attack</h2>
<p>A supply chain attack on PyPI has compromised LiteLLM, which is widely used as an abstraction layer across multiple LLM providers. The attack enables exfiltration of sensitive information from affected systems. LiteLLM’s position in the stack makes this particularly painful — it sits close to API keys and model credentials by design. Check your dependency lockfiles and audit what versions you’re running.</p>
<hr>
<h2>Also notable</h2>
<ul>
<li><strong>ReAct agent retry waste:</strong> A benchmark found 90.8% of retries in ReAct-style agents are wasted on hallucinated tool names. Moving tool routing into deterministic Python code eliminates the problem structurally and achieved 3x lower step variance and 100% task success in controlled tests versus 89.5% for naive ReAct.</li>
<li><strong>Bryan Cantrill on LLM laziness:</strong> Cantrill argues LLMs lack the programmer’s virtue of laziness — the drive to build crisp abstractions — and tend to pile on complexity instead. He uses a 37,000-lines-per-day boast as a case study in bloat over elegance.</li>
<li><strong>Meilisearch Cloud sharding and replication:</strong> Meilisearch now supports horizontal sharding and replication as composable enterprise features, with configurations like 5 shards × 2 replicas = 10 nodes. Currently requires the Meilisearch team to configure; self-serve UI is on the roadmap.</li>
<li><strong>Async logging misconceptions:</strong> Async logging redistributes cost rather than eliminating it. Formatting often dominates logging overhead, and moving it to a background thread doesn’t make it faster. A single backend thread creates a hard throughput ceiling.</li>
<li><strong>Docker pulls failing in Spain:</strong> A court-ordered IP block targeting Cloudflare IPs to stop illegal football streaming inadvertently broke <code>docker pull</code> and GitLab CI pipelines for developers in Spain during match hours, since Docker Hub uses Cloudflare R2 storage.</li>
<li><strong>OWASP CRS WAF bypass (CVE-2026-21876):</strong> A logic flaw in rule 922110 lets attackers bypass multipart charset validation by appending a valid-charset parameter at the end of a malicious request. Affects any WAF using OWASP CRS before versions 4.22.0 or 3.3.8. Now patched.</li>
<li><strong>Inference engineering overview:</strong> A solid breakdown of the five core inference optimization techniques: quantization (30-50% performance gains), speculative decoding, prefix caching, tensor/expert parallelism, and prefill/decode disaggregation. Worth reading if you’re evaluating open model deployments.</li>
<li><strong>AI agent memory architecture:</strong> Production agent memory systems need vector stores, knowledge graphs, and relational databases working together — not just a context window. At enterprise scale this becomes a database problem with GDPR, multi-tenancy, and ACID requirements.</li>
<li><strong>Helidon 4.4.0 released:</strong> The microservices framework now aligns with the OpenJDK release cadence and adds support through the Java Verified Portfolio, improving long-term compatibility guarantees.</li>
</ul>


Server-side development, system design, API patterns, and distributed architecture.

Backend Digest

A security and engineering roundup covering four major incidents: Bluesky's April 2026 outage caused by TCP port exhaustion from batch RPC calls against memcached triggering a Go runtime memory spiral (fixed by using the full 127.0.0.0/8 loopback range); a public zero-day exploit called BlueHammer that chains five Windows components to escalate any user to SYSTEM in under a minute with no patch available; active exploitation of a pre-auth RCE in Marimo notebooks (CVE-2026-39987, CVSS 9.3) harvesting cloud secrets within minutes of access; and a PyPI supply chain attack on LiteLLM affecting broad LLM tooling stacks. Also covered: ReAct agent retry inefficiency, Bryan Cantrill on LLM code bloat, Meilisearch sharding, async logging misconceptions, Docker pull failures in Spain, an OWASP CRS WAF bypass, inference optimization techniques, AI agent memory architecture, and Helidon 4.4.0.

Bluesky's TCP port exhaustion postmortem, BlueHammer chains five Windows components to SYSTEM