Tanay
Tanay Vaswani

Tanay Vaswani

Founding Engineer at Confident AI, Inc. (YC W25)

New Delhi, India

ISTScaling the AI observability & evals platform at Confident AI, Inc.

I build data-intensive systems and the infrastructure underneath them.

My focus is distributed systems, observability and platform engineering.

At Confident AI, I work across LLM evaluation pipelines, Kubernetes, multi-region infrastructure on AWS, Azure and GCP, and backend services in Python and TypeScript.

Previously at TurboML, Inc. and Puch AI. Long-time open-source contributor.

01Activity

7,393 contributions on GitHub in the last year.

Active days
262
Longest streak
41d
Busiest week · Nov 1
471
Best day · Nov 12
200
DecJanFebMarAprMayJunJulAugSepOctNov0 contributions on Sun, Nov 16, 202510 contributions on Mon, Nov 17, 20253 contributions on Tue, Nov 18, 20251 contribution on Wed, Nov 19, 20253 contributions on Thu, Nov 20, 20253 contributions on Fri, Nov 21, 20251 contribution on Sat, Nov 22, 20250 contributions on Sun, Nov 23, 20250 contributions on Mon, Nov 24, 20250 contributions on Tue, Nov 25, 20253 contributions on Wed, Nov 26, 20251 contribution on Thu, Nov 27, 20250 contributions on Fri, Nov 28, 20251 contribution on Sat, Nov 29, 20250 contributions on Sun, Nov 30, 20254 contributions on Mon, Dec 1, 20257 contributions on Tue, Dec 2, 20252 contributions on Wed, Dec 3, 20254 contributions on Thu, Dec 4, 202511 contributions on Fri, Dec 5, 202513 contributions on Sat, Dec 6, 20255 contributions on Sun, Dec 7, 20255 contributions on Mon, Dec 8, 202517 contributions on Tue, Dec 9, 202511 contributions on Wed, Dec 10, 20255 contributions on Thu, Dec 11, 20253 contributions on Fri, Dec 12, 20250 contributions on Sat, Dec 13, 20250 contributions on Sun, Dec 14, 20250 contributions on Mon, Dec 15, 20250 contributions on Tue, Dec 16, 20250 contributions on Wed, Dec 17, 20250 contributions on Thu, Dec 18, 20250 contributions on Fri, Dec 19, 20250 contributions on Sat, Dec 20, 20250 contributions on Sun, Dec 21, 20250 contributions on Mon, Dec 22, 20250 contributions on Tue, Dec 23, 20250 contributions on Wed, Dec 24, 20250 contributions on Thu, Dec 25, 20250 contributions on Fri, Dec 26, 20250 contributions on Sat, Dec 27, 20250 contributions on Sun, Dec 28, 20250 contributions on Mon, Dec 29, 20250 contributions on Tue, Dec 30, 20250 contributions on Wed, Dec 31, 20250 contributions on Thu, Jan 1, 20260 contributions on Fri, Jan 2, 20260 contributions on Sat, Jan 3, 20260 contributions on Sun, Jan 4, 20260 contributions on Mon, Jan 5, 20260 contributions on Tue, Jan 6, 20261 contribution on Wed, Jan 7, 20263 contributions on Thu, Jan 8, 20260 contributions on Fri, Jan 9, 20260 contributions on Sat, Jan 10, 20260 contributions on Sun, Jan 11, 20260 contributions on Mon, Jan 12, 20260 contributions on Tue, Jan 13, 20260 contributions on Wed, Jan 14, 20260 contributions on Thu, Jan 15, 20260 contributions on Fri, Jan 16, 20260 contributions on Sat, Jan 17, 20260 contributions on Sun, Jan 18, 20260 contributions on Mon, Jan 19, 20261 contribution on Tue, Jan 20, 20260 contributions on Wed, Jan 21, 20263 contributions on Thu, Jan 22, 20260 contributions on Fri, Jan 23, 20260 contributions on Sat, Jan 24, 20260 contributions on Sun, Jan 25, 20263 contributions on Mon, Jan 26, 202611 contributions on Tue, Jan 27, 20264 contributions on Wed, Jan 28, 202624 contributions on Thu, Jan 29, 20263 contributions on Fri, Jan 30, 20260 contributions on Sat, Jan 31, 20260 contributions on Sun, Feb 1, 20262 contributions on Mon, Feb 2, 20263 contributions on Tue, Feb 3, 20260 contributions on Wed, Feb 4, 20263 contributions on Thu, Feb 5, 20260 contributions on Fri, Feb 6, 20260 contributions on Sat, Feb 7, 20268 contributions on Sun, Feb 8, 202626 contributions on Mon, Feb 9, 202643 contributions on Tue, Feb 10, 202622 contributions on Wed, Feb 11, 20261 contribution on Thu, Feb 12, 20263 contributions on Fri, Feb 13, 20260 contributions on Sat, Feb 14, 20260 contributions on Sun, Feb 15, 20260 contributions on Mon, Feb 16, 20260 contributions on Tue, Feb 17, 202637 contributions on Wed, Feb 18, 202610 contributions on Thu, Feb 19, 20260 contributions on Fri, Feb 20, 20261 contribution on Sat, Feb 21, 20260 contributions on Sun, Feb 22, 20260 contributions on Mon, Feb 23, 20261 contribution on Tue, Feb 24, 20261 contribution on Wed, Feb 25, 20266 contributions on Thu, Feb 26, 20261 contribution on Fri, Feb 27, 20260 contributions on Sat, Feb 28, 20260 contributions on Sun, Mar 1, 202618 contributions on Mon, Mar 2, 202612 contributions on Tue, Mar 3, 20268 contributions on Wed, Mar 4, 20266 contributions on Thu, Mar 5, 20260 contributions on Fri, Mar 6, 20260 contributions on Sat, Mar 7, 20260 contributions on Sun, Mar 8, 20265 contributions on Mon, Mar 9, 20260 contributions on Tue, Mar 10, 20264 contributions on Wed, Mar 11, 20260 contributions on Thu, Mar 12, 20267 contributions on Fri, Mar 13, 20261 contribution on Sat, Mar 14, 20261 contribution on Sun, Mar 15, 20260 contributions on Mon, Mar 16, 20260 contributions on Tue, Mar 17, 202613 contributions on Wed, Mar 18, 20261 contribution on Thu, Mar 19, 20268 contributions on Fri, Mar 20, 20260 contributions on Sat, Mar 21, 20260 contributions on Sun, Mar 22, 20262 contributions on Mon, Mar 23, 20260 contributions on Tue, Mar 24, 20260 contributions on Wed, Mar 25, 20261 contribution on Thu, Mar 26, 20261 contribution on Fri, Mar 27, 20260 contributions on Sat, Mar 28, 20266 contributions on Sun, Mar 29, 20261 contribution on Mon, Mar 30, 20268 contributions on Tue, Mar 31, 20260 contributions on Wed, Apr 1, 202610 contributions on Thu, Apr 2, 20268 contributions on Fri, Apr 3, 20265 contributions on Sat, Apr 4, 202611 contributions on Sun, Apr 5, 20267 contributions on Mon, Apr 6, 20264 contributions on Tue, Apr 7, 20265 contributions on Wed, Apr 8, 20263 contributions on Thu, Apr 9, 20260 contributions on Fri, Apr 10, 20260 contributions on Sat, Apr 11, 20262 contributions on Sun, Apr 12, 20260 contributions on Mon, Apr 13, 20262 contributions on Tue, Apr 14, 20263 contributions on Wed, Apr 15, 20265 contributions on Thu, Apr 16, 20262 contributions on Fri, Apr 17, 20260 contributions on Sat, Apr 18, 20260 contributions on Sun, Apr 19, 20260 contributions on Mon, Apr 20, 20260 contributions on Tue, Apr 21, 20260 contributions on Wed, Apr 22, 20261 contribution on Thu, Apr 23, 20263 contributions on Fri, Apr 24, 20260 contributions on Sat, Apr 25, 20260 contributions on Sun, Apr 26, 20260 contributions on Mon, Apr 27, 20260 contributions on Tue, Apr 28, 20260 contributions on Wed, Apr 29, 20260 contributions on Thu, Apr 30, 20260 contributions on Fri, May 1, 20262 contributions on Sat, May 2, 20260 contributions on Sun, May 3, 20266 contributions on Mon, May 4, 20268 contributions on Tue, May 5, 20260 contributions on Wed, May 6, 20260 contributions on Thu, May 7, 20260 contributions on Fri, May 8, 20260 contributions on Sat, May 9, 20263 contributions on Sun, May 10, 20262 contributions on Mon, May 11, 202623 contributions on Tue, May 12, 202631 contributions on Wed, May 13, 202618 contributions on Thu, May 14, 202615 contributions on Fri, May 15, 20260 contributions on Sat, May 16, 20260 contributions on Sun, May 17, 202611 contributions on Mon, May 18, 202619 contributions on Tue, May 19, 202614 contributions on Wed, May 20, 20268 contributions on Thu, May 21, 202619 contributions on Fri, May 22, 20264 contributions on Sat, May 23, 20260 contributions on Sun, May 24, 202611 contributions on Mon, May 25, 20265 contributions on Tue, May 26, 20261 contribution on Wed, May 27, 20261 contribution on Thu, May 28, 202612 contributions on Fri, May 29, 20260 contributions on Sat, May 30, 202610 contributions on Sun, May 31, 202610 contributions on Mon, Jun 1, 202615 contributions on Tue, Jun 2, 202622 contributions on Wed, Jun 3, 202618 contributions on Thu, Jun 4, 20268 contributions on Fri, Jun 5, 20262 contributions on Sat, Jun 6, 202617 contributions on Sun, Jun 7, 202620 contributions on Mon, Jun 8, 20268 contributions on Tue, Jun 9, 202626 contributions on Wed, Jun 10, 20262 contributions on Thu, Jun 11, 202622 contributions on Fri, Jun 12, 20262 contributions on Sat, Jun 13, 20267 contributions on Sun, Jun 14, 202623 contributions on Mon, Jun 15, 202613 contributions on Tue, Jun 16, 202617 contributions on Wed, Jun 17, 202620 contributions on Thu, Jun 18, 202627 contributions on Fri, Jun 19, 20263 contributions on Sat, Jun 20, 20266 contributions on Sun, Jun 21, 202622 contributions on Mon, Jun 22, 202614 contributions on Tue, Jun 23, 20269 contributions on Wed, Jun 24, 20260 contributions on Thu, Jun 25, 202614 contributions on Fri, Jun 26, 20262 contributions on Sat, Jun 27, 202622 contributions on Sun, Jun 28, 202625 contributions on Mon, Jun 29, 202625 contributions on Tue, Jun 30, 202646 contributions on Wed, Jul 1, 202627 contributions on Thu, Jul 2, 202632 contributions on Fri, Jul 3, 202644 contributions on Sat, Jul 4, 20260 contributions on Sun, Jul 5, 202642 contributions on Mon, Jul 6, 20264 contributions on Tue, Jul 7, 202686 contributions on Wed, Jul 8, 20260 contributions on Thu, Jul 9, 202621 contributions on Fri, Jul 10, 202625 contributions on Sat, Jul 11, 202625 contributions on Sun, Jul 12, 202639 contributions on Mon, Jul 13, 202652 contributions on Tue, Jul 14, 202610 contributions on Wed, Jul 15, 202630 contributions on Thu, Jul 16, 202614 contributions on Fri, Jul 17, 20267 contributions on Sat, Jul 18, 202631 contributions on Sun, Jul 19, 202616 contributions on Mon, Jul 20, 202629 contributions on Tue, Jul 21, 202648 contributions on Wed, Jul 22, 202627 contributions on Thu, Jul 23, 202636 contributions on Fri, Jul 24, 20264 contributions on Sat, Jul 25, 202627 contributions on Sun, Jul 26, 202693 contributions on Mon, Jul 27, 202637 contributions on Tue, Jul 28, 202672 contributions on Wed, Jul 29, 202646 contributions on Thu, Jul 30, 202657 contributions on Fri, Jul 31, 20263 contributions on Sat, Aug 1, 202620 contributions on Sun, Aug 2, 202636 contributions on Mon, Aug 3, 202638 contributions on Tue, Aug 4, 202629 contributions on Wed, Aug 5, 202660 contributions on Thu, Aug 6, 202670 contributions on Fri, Aug 7, 20260 contributions on Sat, Aug 8, 202612 contributions on Sun, Aug 9, 202655 contributions on Mon, Aug 10, 202661 contributions on Tue, Aug 11, 202674 contributions on Wed, Aug 12, 202641 contributions on Thu, Aug 13, 202699 contributions on Fri, Aug 14, 20264 contributions on Sat, Aug 15, 20265 contributions on Sun, Aug 16, 202629 contributions on Mon, Aug 17, 202663 contributions on Tue, Aug 18, 202669 contributions on Wed, Aug 19, 202640 contributions on Thu, Aug 20, 202678 contributions on Fri, Aug 21, 202613 contributions on Sat, Aug 22, 202668 contributions on Sun, Aug 23, 202666 contributions on Mon, Aug 24, 202653 contributions on Tue, Aug 25, 202657 contributions on Wed, Aug 26, 202615 contributions on Thu, Aug 27, 202672 contributions on Fri, Aug 28, 20265 contributions on Sat, Aug 29, 202627 contributions on Sun, Aug 30, 202628 contributions on Mon, Aug 31, 202668 contributions on Tue, Sep 1, 202644 contributions on Wed, Sep 2, 202666 contributions on Thu, Sep 3, 2026112 contributions on Fri, Sep 4, 20264 contributions on Sat, Sep 5, 202640 contributions on Sun, Sep 6, 202651 contributions on Mon, Sep 7, 202613 contributions on Tue, Sep 8, 202665 contributions on Wed, Sep 9, 2026102 contributions on Thu, Sep 10, 202611 contributions on Fri, Sep 11, 202620 contributions on Sat, Sep 12, 202618 contributions on Sun, Sep 13, 20265 contributions on Mon, Sep 14, 202653 contributions on Tue, Sep 15, 202624 contributions on Wed, Sep 16, 202686 contributions on Thu, Sep 17, 202642 contributions on Fri, Sep 18, 20260 contributions on Sat, Sep 19, 202621 contributions on Sun, Sep 20, 202625 contributions on Mon, Sep 21, 202665 contributions on Tue, Sep 22, 2026110 contributions on Wed, Sep 23, 202617 contributions on Thu, Sep 24, 202674 contributions on Fri, Sep 25, 20260 contributions on Sat, Sep 26, 202611 contributions on Sun, Sep 27, 202611 contributions on Mon, Sep 28, 20268 contributions on Tue, Sep 29, 20268 contributions on Wed, Sep 30, 202628 contributions on Thu, Oct 1, 202647 contributions on Fri, Oct 2, 20268 contributions on Sat, Oct 3, 202617 contributions on Sun, Oct 4, 202674 contributions on Mon, Oct 5, 202649 contributions on Tue, Oct 6, 2026137 contributions on Wed, Oct 7, 20266 contributions on Thu, Oct 8, 202643 contributions on Fri, Oct 9, 20260 contributions on Sat, Oct 10, 202696 contributions on Sun, Oct 11, 202642 contributions on Mon, Oct 12, 202670 contributions on Tue, Oct 13, 202677 contributions on Wed, Oct 14, 202646 contributions on Thu, Oct 15, 202670 contributions on Fri, Oct 16, 20260 contributions on Sat, Oct 17, 202610 contributions on Sun, Oct 18, 202624 contributions on Mon, Oct 19, 20260 contributions on Tue, Oct 20, 202653 contributions on Wed, Oct 21, 2026124 contributions on Thu, Oct 22, 2026151 contributions on Fri, Oct 23, 20262 contributions on Sat, Oct 24, 202634 contributions on Sun, Oct 25, 202662 contributions on Mon, Oct 26, 2026113 contributions on Tue, Oct 27, 2026120 contributions on Wed, Oct 28, 202610 contributions on Thu, Oct 29, 202612 contributions on Fri, Oct 30, 202615 contributions on Sat, Oct 31, 202658 contributions on Sun, Nov 1, 202645 contributions on Mon, Nov 2, 202684 contributions on Tue, Nov 3, 202679 contributions on Wed, Nov 4, 202667 contributions on Thu, Nov 5, 202687 contributions on Fri, Nov 6, 202651 contributions on Sat, Nov 7, 202610 contributions on Sun, Nov 8, 202625 contributions on Mon, Nov 9, 202616 contributions on Tue, Nov 10, 202673 contributions on Wed, Nov 11, 2026200 contributions on Thu, Nov 12, 202684 contributions on Fri, Nov 13, 202612 contributions on Sat, Nov 14, 202680 contributions on Sun, Nov 15, 2026116 contributions on Mon, Nov 16, 2026101 contributions on Tue, Nov 17, 202622 contributions on Wed, Nov 18, 2026

02Experience

Where I have worked and what I built there, most recent first.

  1. Confident AI, Inc. (YC W25)
    1. Founding Engineer · Full-timeOct 2025 – Present
      Throughput
      240% more on online evaluations, with the peak error rate down from ~50% to under 0.1% at 5x the load.
      Migration
      US and EU production moved from Railway to AWS EKS overnight, with no downtime at cutover.
      Open source
      AWS, GCP and Azure Terraform modules published on HashiCorp's Terraform Registry.
      All 24 highlights

      First full-time founding engineer hire.

      • Migrated online evaluations to a delegation-based asynchronous architecture: 240% more throughput and peak error rate down from ~50% to under 0.1% at 5x the previous peak load.
      • Migrated US and EU production and the staging deployment pipeline from Railway to AWS (EKS) overnight, with no downtime at cutover.
      • Placed servers next to their databases in each region to cut latency.
      • Set up autoscaling with Karpenter and KEDA, so capacity follows real traffic and queue load.
      • Moved every infrastructure change to pull requests with ArgoCD, approvals and nightly drift checks.
      • Tightened security: no static cloud keys, encrypted secrets, private networking and fixed IPs for database allow-lists.
      • Set up full observability with Datadog and CloudWatch alarms across every node and service.
      • Built Anthropic, LangChain and OpenAI integrations for the DeepEval Python and TypeScript SDKs.
      • Manage multi-region AWS, Azure and GCP infrastructure with Docker, Kubernetes, Terraform, CI/CD and ArgoCD.
      • Built Terraform modules for VPC, EKS/ECS, RDS, ALB/NLB, NAT, S3, networking and IAM across multi-AZ deployments, and published AWS, GCP and Azure modules on HashiCorp's Terraform Registry.
      • Designed production Kubernetes workloads, RBAC, storage, networking and secrets management with ArgoCD sync waves.
      • Built asynchronous systems for alerts and monitors, and a centralised streaming gateway for the LLM Playground, Arena, Experiments and Evals.
      • Extended LLM support across Bedrock, Vertex AI, Azure OpenAI, Portkey, OpenRouter, TrueFoundry and LiteLLM.
      • Built cloud-agnostic storage across S3, GCP Storage, Azure Blob and MinIO with secure pre-signed URL delivery.
      • Built a secure code sandbox for executing code-based evaluation metrics on serverless functions (AWS Lambda, Azure Functions).
      • Built Confident AI's relay agent for private-subnet tunnelling without exposing AI Connections, with Azure AD authentication.
      • Added MCP server context to AI Connections and the evaluation pipeline, with MCP OAuth 2.0 client credentials.
      • Built Public Dashboards for securely sharing graphs, tables and widgets.
      • Built metered billing with Stripe invoicing, platform licensing, API key rotation and expiry, and AWS Marketplace licensing.
      • Built code vulnerability scanning with DeepTeam, GitHub repository integration and CI security with Harness integration.
      • Built weekly release CI/CD, Helm charts, ClickHouse export pipelines, multipart S3 uploads with gzip compression and secure public pre-signed URLs.
      • Added IAM role and Mantle API support for Bedrock integrations, and real-time audit log streaming to Datadog.
      • Consolidated APIs and schemas for scheduled tasks, models and configuration, graphs and widgets, and SSE.
      • Built multi-user edit activity.
    • AWS
    • Azure
    • GCP
    • Kubernetes
    • Karpenter
    • KEDA
    • Helm
    • Terraform
    • ArgoCD
    • Python
    • TypeScript
    • PostgreSQL
    • ClickHouse
    • Redis
    • Datadog
  2. Puch AI
    1. Software Engineer · Part-timeJun 2025 – Oct 2025
      Agent
      Built the tool-calling router and integrations that power the agent.
      Data
      Moved the primary database from PostgreSQL to MongoDB with minimal downtime.
      All 5 highlights
      • Built the tool-calling router and integration abstractions that power the agent, in Python.
      • Implemented message debouncing on top of a task queue and worker setup.
      • Designed output parsing that turns LLM responses into WhatsApp-compatible message structures.
      • Migrated the primary database from PostgreSQL to MongoDB with minimal downtime.
      • Set up the LLMOps lifecycle: tracing, prompt management, session tracking, memory, evaluations and datasets.
    • Python
    • MongoDB
    • PostgreSQL
    • Task Queues
    • LLMOps
  3. TurboML, Inc.
    1. Software Engineer · ContractJun 2024 – Oct 2025
      Queries
      ~40% faster with a purpose-built PostgreSQL access layer replacing the ORM.
      Latency
      ~30% lower response times with Redis caching and asynchronous processing on Kafka.
      All 6 highlights
      • Worked across the LLMOps platform: backend services, dashboard and Python SDK.
      • Maintained the observability SDK for distributed LLM systems with OpenTelemetry instrumentation.
      • Improved query performance by ~40% with a purpose-built PostgreSQL access layer replacing the ORM.
      • Designed storage for metrics, prompts and span datasets on PostgreSQL and ClickHouse.
      • Cut response times by ~30% with Redis caching and asynchronous processing on Kafka.
      • Added API key and project namespaces to the SDK, enabling integration in under five lines of code.
    2. Software Engineer Intern · InternshipDec 2023 – May 2024
      Requests
      ~60% fewer redundant requests through client-side caching with TanStack Query.
      All 3 highlights
      • Migrated the MLOps and LLMOps dashboard from Streamlit to Next.js with richer data visualisation.
      • Reduced redundant requests by ~60% through client-side caching with TanStack Query.
      • Built a careers portal with resume parsing, candidate filtering and admin tooling on Hono.
    • Python
    • FastAPI
    • TypeScript
    • Next.js
    • PostgreSQL
    • ClickHouse
    • Kafka
    • Redis

05Stack

Tools I reach for day to day.

Languages
Python, TypeScript, Go, SQL
Infrastructure
AWS, Azure, GCP, Kubernetes, Helm, Terraform, Docker, ArgoCD
Data
PostgreSQL, ClickHouse, Redis, Kafka, MongoDB
Backend
FastAPI, Node.js, Hono, gRPC, OpenTelemetry

06Contact

Building infrastructure for LLM systems. If you are working on something similar, I would like to hear about it.

Built with
Next.js 16, Tailwind CSS, Geist
Deployed
Nov 18, 2026fe4bac1
Revision
2026.11
Quote of the day№ 01To be insanely hopeful even after all that, you call it madness, I call it strength.