Madhukar – LLM, Golang, Kubernetes

Technology services firm specializing in cloud-native architecture, Kubernetes consulting, Site Reliability Engineering and observability, with a focus on open-source tools.

• Built a custom vertical pod autoscaling strategy for an MLOps product based on Kubernetes.
• Built an AI PaaS involving architecture, design, and implementation on the Kubernetes platform on bare metal.
• Set up telemetry data using Prometheus, Grafana, and Loki.
• Set up log analytics for B2B e-commerce to ingest logs from hundreds of AWS Lambda functions into ClickHouse for analysis.
• Built a cloud-native control plane for onboarding and bootstrapping BYOC customers for a database product.

AI company building generative audio and video products for creators.

• Set up observability for an AI production using OpenTelemetry and Grafana with custom alert sinks for Rust and Python applications.
• Set up a Kubernetes-based hybrid cloud deployment that generated 10 days of audiovisual data daily using about 1200 GPU-hours per day and served and hosted 200 terabytes of user-generated content and models.
• Wrote performant backend AI inference workloads for generative audio and video that maximized GPU utilization.
• Implemented autoscaling for GPU workloads to save 30% costs.

Indonesian commerce-enablement platform that helps small and medium businesses sell online.

• Migrated infrastructure from Heroku to GKE and managed cloud infrastructure on GCP.
• Set up observability practices using Grafana, Prometheus, Datadog, and Sentry, and defined and monitored SLOs and SLIs.
• Set up CI/CD and release practices.
• Set up incident response and management practices.
• Led capacity planning and load testing.
• Performed infrastructure cost estimation, forecasting, and cost optimization.
• Made build-versus-buy decisions on infrastructure and supporting tools.
• Extended Kubernetes using controllers to fill gaps from off-the-shelf components for operational needs.
• Maintained libraries and tooling for the development team to own operations via the internal developer platform.
• Documented and trained developers on platform capabilities and enabled self-service.
• Collaborated on team OKRs and long-term backlog with relevant stakeholders.
• Led a team of engineers and coached the team on Agile methodologies and Scrum.

Indian quick-commerce company delivering groceries and everyday essentials to customers within minutes.

• Led release engineering initiatives for the microservices ecosystem, decoupling the backend from app releases and enabling multiple daily backend releases with confidence.
• Decoupled backend and front-end releases by developing proof of concepts and coaching the development team on feature toggles and contract testing.
• Enabled canary releases on Kubernetes.
• Brought together development and QA to work on test automation initiatives and enable integration tests in fungible environments.
• Scaled the system to about 5000 runs a day at 5 minutes per build.
• Maintained Python libraries used by developers to manage microservices on Kubernetes in fungible environments, staging, and production.
• Maintained CI/CD infrastructure and libraries.

Indian quick-commerce company delivering groceries and everyday essentials to customers within minutes.

• Led the development of the Marketplace Platform in a 3-person team that allowed merchants to self-onboard and manage their stores, inventory, and catalog.
• Maintained the catalog and inventory management system used to manage products, prices, and stock by internal teams.
• Maintained the inventory service used to manage warehouse inventory and integrations with vendors.
• Maintained the Promotions and Merchandising system that allowed marketing teams to run scheduled and duration-bound banner promotions and boost products in the search and catalog APIs.
• Maintained search and catalog APIs used for full-text and attribute search for products.
• Contributed features to the Cart service to enable schedules for store serviceability and delivery and validate the cart’s coupon, prices, and inventory availability before checkout.
• Developed the RBAC system for quality assurance, quality check, approvals, and scoped access by role, and extended it for the marketplace ecosystem.

Prototype of a smart card based public health record system.

• Developed the RESTful web service for a prototype of a smart card based public health record system.
• Developed the admin dashboard for the prototype.