Skip to content
View harshadkhetpal's full-sized avatar

Block or report harshadkhetpal

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
harshadkhetpal/README.md

Harshad Khetpal

AI Engineer — production LLM systems, MLOps, multi-cloud platform engineering

LinkedIn Portfolio Email

Close to 8 years building AI and platform systems that businesses run on — currently delivering production LLM, RAG and agent systems for enterprise clients including Boeing, T-Mobile and BCG. Open to relocation (UK, Europe, UAE).


Projects

Each is a small, complete, tested system — clone any of them and it runs offline in one command, no API keys, CI green.

AI / LLM Serving

  • llm-gateway — one API over many LLM providers: cheapest-first routing, caching, failover with circuit breaking, cost ledger
  • llm-batch-sim — discrete-event simulation quantifying why continuous batching beats naive serving (6x throughput, 9x lower p95 on the demo workload)

AI Quality & Machine Learning

  • rag-eval-gate — golden-set RAG evaluation as a deterministic CI gate; a change that degrades answers fails the build and names the case
  • ml-train-gate — reproducible training (logistic regression from first principles), metric-regression gates on AUC/recall, generated model cards

MLOps

  • drift-watch — input drift detection as a pipeline gate: PSI with baseline-quantile bins + KS distance, unseen categories treated as maximum signal

DevOps / IaC

  • tf-plan-guard — policy gate over terraform plan: blocks destroys and replaces of protected resources before the apply

SRE / Observability

  • slo-burn — error-budget arithmetic + generated multiwindow burn-rate Prometheus alerts (Google SRE Workbook policy, auto-scaled to your window)
  • gpu-cost-exporter — NVIDIA DCGM metrics re-exported as money: burn, waste (the idle share, in dollars), cost per 1k inferences

Each README has a "Design decisions worth arguing with" section — the trade-offs I'd defend in a review, written down.


Day to day

AI / LLM — Python, FastAPI, LangChain, LangGraph, RAG, prompt engineering, golden-set evaluation; Amazon Bedrock, Anthropic Claude, OpenAI; vLLM-style serving concerns: continuous batching, KV-cache, quantization

MLOps & Data — MLflow, Databricks, Airflow, PySpark, Kafka, dbt, BigQuery

Platform — Kubernetes (AKS/EKS/GKE), Docker, Helm, Terraform, Ansible, GitOps (ArgoCD/Flux), Azure DevOps, GitHub Actions

Observability & Reliability — Prometheus, Grafana, OpenTelemetry, SLOs, on-call, incident response; GDPR / ISO 27001 audit experience


📫 khetpalharsh@gmail.com · Open to AI Engineer / MLOps / Platform roles with visa sponsorship (UK · Europe · UAE)

Popular repositories Loading

  1. northbay-test northbay-test Public

    HCL 1

  2. kafka-cluster-on-premise kafka-cluster-on-premise Public

  3. c5i.a-Mlops-test c5i.a-Mlops-test Public

    For the interview test project

    Python

  4. himanshu-bitbucket-time-lines himanshu-bitbucket-time-lines Public

    Python

  5. audio-mike-mass audio-mike-mass Public

  6. mlops-template mlops-template Public

    MLOps Template - Modified by Harshad Khetpal, India

    Python