Open to Senior SWE / AI Engineer roles

Harsh Aathavale

Senior Software Engineer · AI Platforms

I build scalable distributed systems, microservices, and production ML platforms across AWS, Azure, and GCP — from model-serving pipelines on Kubernetes to agentic RAG systems and full-stack GenAI apps.

50K+
Daily inferences served
4x
GPU throughput gain
8.69
BTech CGPA
2+ yrs
Shipping production systems

01 — Experience

Where I've worked

  1. Senior AI Engineer @ Fulcrum Digital

    Jun 2025 - May 2026
    • Architected production ML serving infrastructure on AKS and Kubernetes, processing 50K+ inference requests daily with sub-200ms latency.
    • Built full-stack GenAI apps with React, FastAPI, LangGraph agentic workflows, and RAG pipelines, reducing manual document processing by 70%.
    • Designed event-driven microservices with Kafka and RabbitMQ for real-time data ingestion across distributed systems.
    • Implemented observability with Grafana and Prometheus; optimized pipelines with Numba/CUDA for 4x throughput improvement.
  2. Software Engineer @ Pertsol

    Nov 2024 - Jun 2025
    • Engineered a real-time target proximity prediction system via REST APIs, reducing location lookup latency by 60%.
    • Built a speaker diarization pipeline and optimized ingestion scripts for audio processing at scale.
  3. Software Engineer Intern @ Dyma.ai

    Jul - Nov 2024
    • Built a production agentic RAG system for document retrieval, improving retrieval accuracy by 35% through systematic benchmarking.
  4. Research Intern @ Ernst & Young (EY)

    Jan - Jul 2024
    • Developed ML-based document retrieval and fraud detection systems, reducing the false-positive rate by 40%.

Education

BTech, Electronics & Telecommunications

Vishwakarma Institute of Information Technology (SPPU, Pune)

2020 - 2024

CGPA 8.69

02 — Stack

Tools I reach for

Languages

PythonJavaJavaScriptTypeScriptSQL

Backend

FastAPISpring BootNode.jsgRPCREST APIsNginx

Frontend

ReactNext.jsHTML/CSS

Cloud & DevOps

AWSAzureGCPAKSDockerKubernetesTerraformGitHub ActionsCI/CD

Data & Messaging

PostgreSQLMongoDBRedisKafkaRabbitMQ

AI / ML

PyTorchHugging FaceLangGraphRAGCUDANumba

Observability

GrafanaPrometheusELK Stack

Tools

GitLinuxDocker ComposeJiraAgile/Scrum

03 — Projects

Selected work

Systems I've architected — ML infrastructure, RAG pipelines, and event-driven services.

Distributed ML Training & Inference Platform

End-to-end ML training pipeline with LoRA fine-tuning, 8-bit quantization, and Kubernetes orchestration for GPU scaling. Designed for cost-efficient model iteration.

PythonPyTorchKubernetesDockerLoRAQuantization

Real-Time Issue Processing System

Event-driven full-stack system with real-time WebSocket streaming, agentic workflows, and Docker Compose plus Nginx architecture built for high availability.

ReactTypeScriptFastAPIWebSocketsDocker ComposeNginx

Production ML Serving Infrastructure

AKS and Kubernetes serving stack processing 50K+ inference requests daily with sub-200ms latency. Instrumented with Grafana and Prometheus observability.

KubernetesAKSFastAPIGrafanaPrometheus

Agentic RAG Document Retrieval

Production RAG system for enterprise document retrieval, improving retrieval accuracy by 35% through systematic benchmarking of chunking and embedding strategies.

LangGraphRAGPythonVector DB

Event-Driven Microservices

Real-time data ingestion pipeline across distributed systems using Kafka and RabbitMQ. Handles high-throughput streams with backpressure and DLQs.

KafkaRabbitMQFastAPINode.js

GPU-Accelerated Pipelines

Optimized data pipelines using Numba and CUDA, achieving 4x throughput improvement over the CPU baseline for numerical and inference workloads.

CUDANumbaPythonPyTorch

04 — Writing

Latest from the blog

All posts

05 — Contact

Let's build something.

Hiring, collaborating, or just want to talk ML infra? My inbox is open.

Download full CV (PDF)