Principal Consultant / Individual Contributor

    Building distributed systems with precision & purpose

    I'm Gaurav Agarwal, a passionate developer focused on creating intuitive and impactful distributed systems that solve real-world problems with elegant solutions.

    Scroll

    About Me

    Problem Solver
    Detail-Oriented
    Adaptable
    Team Player
    Fast Learner

    I am a generalist software engineer who has worked across the stack and is equally comfortable with scaling up services as well as creating beautiful 2D and 3D visualizations.

    I'm a full-stack developer who started his career in 2012 gaining experience building robust web applications and digital experiences that prioritize user needs and business objectives.

    My approach to development is centered around creating clean, maintainable code that scales well and provides intuitive user experiences. I believe in the power of simplicity and the importance of attention to detail.

    When I'm not coding, you'll find me hiking in nature, exploring music, or diving into a good book about technology and innovation.

    What drives me

    • Building products that make a positive impact
    • Solving complex problems with elegant solutions
    • Continuous learning and sharing knowledge
    Professional portrait

    Work Experience

    Aug 2020 - Present

    Director of Engineering

    CoderMana Technologies Pvt Ltd

    Technical consulting for clients across the world, corporate trainings and product development

    Key Achievements

    • Performance optimizations at the DB and backend level on existing and new code being built
    • Moved from a manually managed infra to a IaC based solution while meeting SLAs to reduce downtime
    • Managing and transforming teams into a agile process
    • Delivered world-class training on multiple technologies to varied audiences
    Notable Projects
    Roll

    Member of the core technical team. Led the backend and SRE team. Worked closely with stake holders to build and deploy new features.

    Technologies
    GoKubernetesHelmRDSTerraformElasticSearchDataDogVaultAWSORY HydraCircleCIGitHub ActionsTwilioOIDC
    CB App, MantaSolutions

    Building graphQL based APIs to power the frontend. Working closely with stakeholders for feature development. Managing and transforming the team to a agile process.

    Technologies
    GoGraphQLApollo.jsPostgres
    Trainings

    Delivered world-class training on Go, Rust, Elixir, C++, Data Engineering, Distributed Systems Design, Docker, Kubernetes, Terraform, Cloud - AWS, GCP & Azure, Ruby, Python, Java, Cilium, and more for multiple clients all over Asia, America, Europe, Africa & Australia.

    Technologies
    GoRustElixirC++Data EngineeringDistributed Systems DesignDockerKubernetesTerraformAWSGCPRubyPythonJavaCiliumDataDog
    Products

    Building SaaS products in the space of near-realtime monitoring, data ingestion and content publishing.

    Technologies
    PythonReactRubyGoJavaScript
    Apr 2018 - Present

    Founder & Principal Consultant

    Agarwal Consulting

    Technical consulting for clients across the world & corporate trainings

    Key Achievements

    • Led the re-architecture of infrastructure and moved away from Heroku to AWS while containerizing the micro-services
    • Integrating an oauth 2 server implementation to allow third-party developers to interact and build on top of backend APIs
    Notable Projects
    Roll

    Member of the core technical team. Led the re-architecture of infrastructure and moving away from Heroku to AWS. Re-designed the existing application to be cloud-native running on AWS managed Kubernetes service. Setting up monitoring systems using EFK stack. Building and deploying new features. Integrating an oauth 2 server implementation to allow third-party developers to interact and build on top of our backend APIs.

    Technologies
    GoKubernetesHelmRDSTerraformElastic SearchAWSORY HydraCircleCITwilio
    Digisense, Autosense

    Building a data processing pipeline to ingest 10K packets/s from Pubsub into Google BigQuery and Google BigTable. Designed and architected the pipeline on GCP using Dataflow, which is built on top of Apache Beam. Designing the codebase easy to configure and scale.

    Technologies
    JavaApache BeamCloud DataFlowGoogle BigQueryGoogle BigTableGsonGoogle Pubsub
    Oshi

    Building a world-class react app to help patients record their own health metrics and keep a track of their diets and routine. Designed, built and iterated over several features of the app

    Technologies
    ReactReduxCordovaSVG
    Trainings

    Delivered world-class training on Go, Docker, Kubernetes, Ruby, Python & Java for multiple clients across India, US & Singapore.

    Technologies
    GoDockerKubernetesRubyPythonJava
    Oct 2016 - Oct 2018

    Lead Technical Consultant

    Tarka Labs

    Working across multiple domains from teleinformatics to mining to enterprise asset management to manufacturing.

    Key Achievements

    • Leading a team of developers to deliver consistently and working closely with clients and their development teams to ensure timely delivery
    • Solving hard technical problems in a fast-changing landscape
    • Working across the stack - including hardware, mobile and web apps
    Notable Projects
    HRIS, Auzmor

    Mentoring and leading a team on TypeScript/React. Designing the Web app from the ground up to be bug-free and scalable code-wise. Building entire backend using Ruby on Rails. Architecting deployment on GCP using Docker containers onto a Kubernetes cluster.

    Technologies
    Ruby on RailsReact.jsReduxGCPKubernetesDocker
    Datacloud

    Using OpenCV to stitch images taken inside of a mine. Consuming sensor data and visualizing the regions where the ores are concentrated. Creating, running and managing containers using Docker on Azure instances. Designed and built apps using Vue.js and 3D visualisations using VTK.js. Built ReSTful APIs using Go programming language.

    Technologies
    Vue.jsDockerAzureGoOpenCVPythonClickHouseVTK.jsSinatraRedis
    Fankave

    Building React.js based visualisations using live data from API. Designed and iterated on 2D visualisations using D3.js and pure SVG components.

    Technologies
    React.jsD3.jsSVGAWS
    Smart Crib

    Leading the IoT-based proof of concept product. Designed circuits using KiCAD, interfaced with MFRC-522 nfc reader & ble bluetooth devices using python. Built a self-updating dashboard using Node.js running on Raspberry Pi.

    Technologies
    PythonRaspberry PiBLE BluetoothMFRC-522Node.jsBash
    EAM360 Application

    Leading the iOS team using Swift programming language. Ensured the mobile app is offline accessible. Setting up the CI/CD pipelines using Fastlane, Jenkins and CircleCI for both Android and iOS. Built FaaS apps using Go, deployed on AWS lambda using serverless.js.

    Technologies
    SwiftiOS 11+CoreDataGCD and dispatch queuesFastlaneJenkinsCircleCIGoserverless.jsAndroid
    Nov 2015 - Sep 2016

    Lead Technical Developer

    Tarka Labs

    Led teams and built scalable web applications

    Key Achievements

    • Built realtime map based dashboards with smooth frame rates
    • Built concurrent and fault-tolerant scrapers using elixir and OTP framework
    Notable Projects
    Zephyr, Mod.us

    Been a part of this long running project since the beginning. Later went on to lead a remote distributed team. Built realtime apps using websockets, React.js. Used immstruct and immutable.js for state management. Used RxJS to reduce thrashing and jank in the app. Built interactive visualisations using Google maps and SVG + React.js based components.

    Technologies
    React.jsElixirRxJSSVGImmutable / ImmstructWebpack
    Betting LeadIn

    Worked on building a app using Elm on the frontend and used Elixir and Phoenix for the backend.

    Technologies
    ElixirPhoenixErlang OTPElm
    Dec 2014 - Nov 2015

    Senior Technical Consultant

    Tarka Labs

    Worked on interactive dashboards and legacy RoR applications

    Key Achievements

    • Optimised and tuned postgreSQL workload and queries
    • Built highly interactive 3D visual apps
    • Stabilized legacy systems, decreasing downtime and improved developer experience
    Notable Projects
    DMP, Mod.us

    Developing new features on their existing vehicle tracking system built using Ruby on Rails.

    Technologies
    Ruby on RailsPostgres
    Lifelogger

    Built interactive app using Elm. This was a highly interactive 3D visual app using reddit API as proof of concept. Deployed on heroku.

    Technologies
    ElmHeroku
    Sep 2013 - Oct 2014

    Software Engineer

    BrowserStack

    Worked on Automate product and Internal tools

    Key Achievements

    • Managing internal servers to the satisfaction of internal stake holders
    • Analyzing and cleaning up billing data
    • Building dashboards for internal metrics
    • Stabilizing systems dealing with payments and customer-facing near real-time dashboard for automation logs
    Notable Projects
    Automate

    I have been the main rails developer on the Automate team, which is the product which allows you to run Selenium/JS Tests across multiple Browsers/OS combination. Here I have been working hard to stabilise their application, over the course of 2 months.

    Technologies
    Ruby on RailsNode.jsSelenium WebdriverSphinxMySQLJavascriptjQuery
    Infrastructure

    Managing their internal test environments using a combination of capistrano, bash and adhoc scripts. Error recovery and ran diagnostics to bring failing systems up and running.

    Technologies
    AWSCapistranoBashNagiosNewrelic
    Zombie

    Developing an internal usage dashboard, for understanding usage patterns across multiple metrics and dimensions. Fast iteration and feedback cycle. Designed the raw SQL queries and built a custom query builder to run on MySQL

    Technologies
    Ruby on RailsjQueryTwitter BootstrapMySQL
    May 2012 - Sep 2013

    Consultant

    ThoughtWorks

    Worked with Senior Developers - practising agile, TDD, pair programming and extreme programming methodologies.

    Key Achievements

    • Learnt a lot of coding techniques, including refactoring and writing clean readable code
    • Built an extensive set of visualizations, including map based ones, to chart sales distribution across a country

    Skills & Expertise

    Programming Languages
    Go

    Go

    Fast, concurrent systems programming

    Rust

    Rust

    Memory-safe, high-performance language

    Elixir

    Elixir

    Scalable, fault-tolerant functional programming

    Ruby

    Ruby

    Elegant, dynamic scripting language

    Erlang

    Erlang

    Distributed, fault-tolerant systems

    JavaScript

    JavaScript

    Web's core scripting language

    Python

    Python

    Versatile, readable programming language

    HTML5

    HTML5

    Markup for modern web pages

    CSS3

    CSS3

    Styling for responsive web design

    Bash

    Bash

    Scripting for Linux and automation

    Swift

    Swift

    Apple's modern app development language

    Elm

    Elm

    Functional language for web UI

    TypeScript

    TypeScript

    Typed JavaScript for large apps

    Java

    Java

    Enterprise-grade, cross-platform language

    Tools & Frameworks
    Gorilla

    Gorilla

    Go web toolkit for robust APIs

    Rails

    Rails

    Ruby web framework for rapid development

    Sinatra

    Sinatra

    Lightweight Ruby web framework

    Phoenix

    Phoenix

    Elixir web framework for real-time apps

    React

    React

    Declarative UI library for web apps

    Vue

    Vue

    Progressive JavaScript framework for UI

    Lodash

    Lodash

    Utility library for JavaScript

    Bootstrap

    Bootstrap

    CSS framework for responsive design

    Webpack

    Webpack

    JavaScript bundler and module loader

    Babel

    Babel

    JavaScript compiler for modern features

    Node.js

    Node.js

    JavaScript runtime for server-side apps

    Less

    Less

    CSS preprocessor for maintainable styles

    SASS

    SASS

    CSS extension with variables & nesting

    D3.js

    D3.js

    Data visualization library for web

    VTK.js

    VTK.js

    3D visualization library for the web

    Infrastructure & Data
    Kafka

    Kafka

    Distributed event streaming platform

    Postgres

    Postgres

    Advanced open-source relational database

    MySQL

    MySQL

    Popular open-source relational database

    Redis

    Redis

    In-memory key-value data store

    Sqlite

    Sqlite

    Lightweight embedded SQL database

    Apache Beam

    Apache Beam

    Unified batch and stream processing

    Docker

    Docker

    Containerization platform for applications

    Kubernetes

    Kubernetes

    Container orchestration for scalability

    Nginx

    Nginx

    High-performance web server

    Git

    Git

    Version control for source code

    Fastlane

    Fastlane

    Automates mobile app deployments

    CircleCI

    CircleCI

    Continuous integration and deployment

    Jenkins

    Jenkins

    Automation server for CI/CD

    Terraform

    Terraform

    Infrastructure as code tool

    Elasticsearch

    Elasticsearch

    Search and analytics engine

    Fluentd

    Fluentd

    Log collection and aggregation

    Kibana

    Kibana

    Data visualization for Elasticsearch

    DataDog

    DataDog

    Cloud monitoring and security platform

    Platforms
    Linux

    Linux

    Open-source operating system

    Debian

    Debian

    Stable Linux distribution

    Raspberry Pi

    Raspberry Pi

    Single-board computer for projects

    Ubuntu

    Ubuntu

    User-friendly Linux distribution

    iOS

    iOS

    Apple's mobile operating system

    AWS

    AWS

    Cloud computing by Amazon

    Google Cloud Platform

    Google Cloud Platform

    Google's cloud computing services

    Azure

    Azure

    Microsoft's cloud computing platform

    Heroku

    Heroku

    PaaS for deploying apps

    Digital Ocean

    Digital Ocean

    Cloud computing for developers

    Education & Certifications

    2008 - 2012

    Bachelor of Technology in Information Technology

    Anna University, Chennai

    Specialized in Data Warehousing, Mining and Computer Networking

    Highlights

    • GPA: 7.71
    • Won Intra department Paper Presentation Competitions
    2006 - 2008

    State Board

    Doveton Matriculation Higher Secondary School

    Physics, Chemistry, Maths and Computer Science

    Highlights

    • Marks: 934
    • Taken part in Endurance Running

    Get In Touch

    Have a project in mind or want to discuss potential opportunities? I'd love to hear from you.