Top Stories

How Notion Scaled AI Q&A to Millions of Workspaces
IMAP

March 30, 2026 06:08 AM

Notion's AI Q&A platform scaled to millions of users by evolving its vector search architecture through dual ingestion, page state optimization, a serverless migration, and a switch to turbopuffer. These engineering decisions resulted in a 600x onboarding increase, 60% lower search costs, and p50 latency improving to 50–70ms, while Ray and Anyscale led to a 90%+ reduction in embeddings infrastructure costs. The system is now simpler, significantly more cost-efficient, and supports real-time, semantically rich document retrieval at enterprise scale.

Read More
Analyzing round-trip query latency
IMAP

March 30, 2026 06:08 AM

Instead of just looking at database execution time, Datadog focused on round-trip query latency with custom-built observability to break down this latency into components. This revealed hidden bottlenecks such as connection pool contention, network latency spikes, and inefficient result handling.

Read More
How to Build Traceable AI Workflows With Retry and DLQ Visibility
IMAP

March 30, 2026 06:08 AM

Implementing fine-grained, node-based tracing within multi-step extraction workflows, modeled as an append-only, serializable ledger, enables deterministic visibility into otherwise opaque LLM-powered data pipelines. Tracing each decision, retry, and DLQ routing as distinct nodes not only preserves causal chains and enables efficient, fine-grained cache invalidation but also transforms debugging and replayability, allowing teams to precisely audit and re-run extraction steps without system-wide reprocessing.

Read More
The Foundation — What A/B Infrastructure Actually Does
IMAP

March 30, 2026 06:08 AM

EloElo built a high-performance traffic routing engine that assigns users to experiment variants in real time, ensures consistent assignment (stickiness) where needed, tracks metrics, and supports gradual traffic ramp-ups. The architecture evolved from a memory-heavy V1 (Redis HashMaps) to an efficient V2 using Redis BitFields (3 bits per user, sharded for scale), and a stateless V3 for non-sticky experiments.

Read More
AI Is Here, But The Hard Parts Haven't Changed
IMAP

March 30, 2026 06:08 AM

AI adoption is now nearly universal (99.5% use AI tools, 82% daily or more), with Claude dominating. However, AI hasn't solved the real hard part: legacy systems, lack of leadership, poor requirements, and data modeling and semantic layers. AI speeds up output, but risks creating more technical debt and "production cesspools" if fundamentals like context, ownership, and architecture are skipped.

Read More
Architectural Governance at AI Speed
IMAP

March 30, 2026 06:08 AM

GenAI makes code cheap, but architecture alignment is now the bottleneck. Traditional governance doesn't scale. The solution is declarative architecture: encode decisions as machine-readable, enforceable constraints embedded in dev tooling and made available to agents (think “Architecture.md”). This shifts governance from human review to automated guardrails, enabling autonomous teams/agents while preventing drift. Make the correct path the default path, with bounded, composable “slices” for safe evolution.

Read More
Fivetran donates its SQLMesh data transformation framework to the Linux Foundation
IMAP

March 30, 2026 06:08 AM

Fivetran is donating SQLMesh (its SQL-based transformation framework acquired via Tobiko Data last September) to the Linux Foundation to push vendor-neutral governance of the transformation layer. SQLMesh brings testing, versioning, and Terraform-like plan/apply workflows to SQL pipelines. The strategic play: shape the open data infrastructure standard (alongside dbt) and drive adoption via community ownership.

Read More
Datahike
IMAP

March 30, 2026 06:08 AM

Datahike is a Datalog-based, immutable, Git-like database: every write creates a new snapshot you can query, branch, and audit. It combines time-travel, versioning, and distributed reads (no server required) with pluggable storage (S3, files, and JDBC).

Read More
Monitoring Your Feast Feature Server with Prometheus and Grafana
IMAP

March 30, 2026 06:08 AM

Feast adds built-in monitoring to the feature server using Prometheus and OpenTelemetry, making it observable like any production API. Teams can track latency, throughput, feature retrieval, and system health, enabling proper SLOs and alerting.

Read More
AI helping build better AI: How agents accelerate model experimentation
IMAP

March 30, 2026 06:08 AM

LinkedIn built AI agents to accelerate model experimentation and infrastructure work, particularly for optimizing LLM post-training and migrating large TensorFlow models to PyTorch. Its flagship agent, Autopilot for Torch, generates code/configurations, runs automated verifiers for correctness (trainability, numerical stability, and metric parity), and receives structured feedback to improve in loops.

Read More
Why UUID Primary Keys Quietly Destroy Database Performance
IMAP

March 30, 2026 06:08 AM

Random UUIDv4 primary keys hurt database performance by causing random inserts, frequent page splits, fragmentation, and poor cache efficiency in B+ tree storage engines, while time-ordered IDs (like UUIDv7/ULID) or using a sequential internal key with a UUID secondary index restore sequential writes and significantly improve efficiency.

Read More
Mermaid
IMAP

March 30, 2026 06:08 AM

Mermaid turns plain text, Markdown-style code, or natural language into diagrams like flowcharts, ERDs, and timelines in seconds.

Read More
Building a Production-Grade Multi-Node Training Pipeline with PyTorch DDP
IMAP

March 30, 2026 06:08 AM

A modular, production-ready PyTorch DDP pipeline for multi-node, multi-GPU training.

Read More
Apply here
IMAP

March 30, 2026 06:08 AM

Remi Turpaud

Read More
create your own role
IMAP

March 30, 2026 06:08 AM

Remi Turpaud

Read More
Inc.'s Best Bootstrapped businesses
IMAP

March 30, 2026 06:08 AM

Remi Turpaud

Read More