Hey there 👋, I'm

Arnav

Backend & AI Engineer · Distributed Systems at Scale

Open to part-time & full-time roles

Backend engineer, mostly working on data platforms and the systems around them. Lately that has meant a lot of AI work.

1 TB/day

data ingested & processed

100M+/day

search requests served

500K/sec

analytics throughput

Team of 10

backend & DevOps led

10+ years Python · Go Distributed systems Kubernetes · AWS 📍 London, UK

Let's connect See my work Resume →

Explore via shell — try help, projects, skills

arnav@web — bash

arnav@web:~$

My latest projects </>

CDC for Event-Driven Architecture
Streaming

Moved a data platform from batch ETL to real-time streaming using Change Data Capture on MongoDB and Postgres, with reusable Python packages that hid the integration complexity from product teams.

Search at 100M Requests a Day
Search

Four rewrites of one query on a private-markets data platform, from a database LIKE through a hand-tuned lexical engine to a hybrid retriever fusing BM25 with 768-dimension embeddings.

Standardizing 30+ Data Crawling Pipelines

Identified common patterns across 30+ crawling pipelines and automated project generation with cookiecutter templates, Helm charts, and shared CI — turning days of setup into minutes.

Latest from blog

One Index, Many Truths
Elasticsearch

How to give every customer a different version of the same document, without running a separate index for each of them.

The Altitude Ridge: India's Coffee, Plotted by Elevation
Coffee / Data

Updated

Jun 25, 2026 · updated Jul 3, 2026

Two interactive maps of India's specialty coffee: 36 estates plotted by growing elevation, and the sourcing network linking 25 roasters to the estates they name.

Hello, world, and why I built this site

A short intro: who I am, what I work on, and what I plan to write about here.

Arnav

CDC for Event-Driven Architecture Streaming

Search at 100M Requests a Day Search