An evals engine for people who ship AI features
A small, opinionated harness for testing LLM features against real user tasks instead of leaderboard benchmarks.
Trending
Building things, breaking things, figuring things out.
I'm Rohit, a product manager who can't stop making things on the side. This is where I publish what I'm building, what I'm writing and what I'm listening to, as it happens.
Projects
Glide EV
A small electric two-wheeler rental business I run on the side: fleet ops, pricing and a lot of WhatsApp.
Rohit.Today, this newspaper
A personal publication with its own CMS, built with Next.js and Supabase. You're reading it.
A sandbox for watching AI agents fail politely
Small, scripted environments for seeing where agents go off the rails, and how they recover.
Practice Room, a music app for people who practise alone
An experiment in turning practice sessions into short loops you can actually stick with.
Editorials
A commencement speech I rewatch every year
Fifteen minutes I come back to every November. No commentary needed.
Most AI evals measure the wrong thing
Benchmarks tell you how a model does on someone else's problem. Your users only care about theirs.
What running an EV fleet taught me about product
Two scooters, one spreadsheet and the fastest feedback loop I've ever had.
Notes from a ride through the Western Ghats
Four days, one motorcycle, a lot of fog. Photographs from the road.
In brief
The best onboarding is a good default
Every tooltip tour I've shipped was an apology for a default we didn't have the nerve to choose. Pick the default. Let people change it later.
Every dashboard eventually becomes a to-do list
If a chart doesn't change what someone does on Tuesday, it's decoration. Most dashboards are a gallery.
Ship the boring version first
The clever version needs data you'll only get by shipping the boring one.
Culture
The person behind the paper
I build products for a living and build other things for fun. Most weeks that means one serious project, a few half-finished experiments, and a playlist I can't stop editing.
Product manager, builder, occasional musician.