Hey there 👋, I'm

Arnav

Backend & AI Engineer · Distributed Systems at Scale

I build backend systems and data platforms in Python. These days I'm deep in agentic architectures — designing systems where agents query data in-process rather than over the network, and building out the tooling around that.

1 TB/day

data ingested & processed

100M+/day

search requests served

500K/sec

analytics throughput

Team of 10

backend & DevOps led

10+ years Python · Go Distributed systems Kubernetes · AWS 📍 London, UK

Let's connect See my work Resume →

Explore via shell — try help, projects, skills

arnav@web — bash

arnav@web:~$

My latest projects </>

CDC for Event-Driven Architecture
Streaming

Moved a data platform from batch ETL to real-time streaming using Change Data Capture on MongoDB and Postgres, with reusable Python packages that hid the integration complexity from product teams.

Standardizing 30+ Data Crawling Pipelines

Identified common patterns across 30+ crawling pipelines and automated project generation with cookiecutter templates, Helm charts, and shared CI — turning days of setup into minutes.

Automated Database Deployments

Owned the setup and automation of database clusters (MongoDB, Postgres, Elasticsearch, RabbitMQ) with Ansible + Terraform, cutting provisioning from weeks to hours with health checks, backups and monitoring built in.

Latest from blog

The Altitude Ridge: India's Coffee, Plotted by Elevation
Coffee / Data

Updated

Jun 25, 2026 · updated Jul 3, 2026

Two interactive maps of India's specialty coffee: 36 estates plotted by growing elevation, and the sourcing network linking 25 roasters to the estates they name.

Hello, world, and why I built this site

A short intro: who I am, what I work on, and what I plan to write about here.

Self-Contained Data Agents
AI / Data

I watched a talk about a bank where dashboards took 8 minutes to load. The fix wasn't faster infrastructure. Here's what actually worked.