Rudransh Shekhar

Rudransh Shekhar

Founder @ KaptaanLM Research Labs Founder @ mySphere
Former AI/ML Intern @ IMD

B.Tech Computer Science student at VIT Chennai, Founder at KaptaanLM Research Labs & mySphere, and Former AI/ML Intern at the India Meteorological Department (IMD).

My work spans foundation language models, distributed training, cloud infrastructure, and systems engineering. I am building KaptaanLM Research Labs (kaptaanlm.tech) as a platform to conduct, develop, and openly document my independent AI/ML research, focusing on the architecture and distributed pre-training of high-parameter-density small language models (the KaptaanLM family and the Qwen3.5-adapted QaptaanLM-0.75B), large-scale dataset engineering (KapCode-1B, KapInstruct-100M), and local LLM operating systems (InferenceOS).

In parallel, through mySphere (mysphere.co.in), I architect and ship scalable distributed cloud infrastructure, autonomous agentic platforms, and developer tooling serving 170K+ monthly edge requests and 94K+ page views across live portals. Key systems include myCloud (a distributed personal cloud decoupling metadata from storage nodes with CLI, SDK, and multi-platform clients), myTrade (an autonomous multi-agent market intelligence platform powered by a 40+ LLM consensus jury), low-power edge server infrastructure (Mobile VPS), developer subdomain & DNS management (myDomain), real-time WebRTC mesh sync (mySync), and computer vision streaming systems (myCam).

At IMD, I worked on AI-driven weather forecasting systems, contributing to the fine-tuning, distributed scaling, and optimization of deep learning models trained on large-scale atmospheric datasets, alongside developing Agentic AI weather assistants with RAG.

Beyond research and venture development, I actively build open-source machine learning systems, multimodal sensor fusion interfaces (Sign Language Interpreter), and high-performance computing pipelines. My goal is to bridge the gap between frontier AI research and reliable, production-grade applications.

Work Experience

Aug 2026 - Present

KaptaanLM Research Labs

Independent AI Research Lab · Foundation Model Development | Available at: kaptaanlm.tech

Founder & Independent AI Researcher | Building & Research | Remote | Aug 2026 - Present
Aug 2025 - Present

mySphere

Udyam Registered MSME Enterprise · Startup | Available at: mysphere.co.in

Founder & Lead Developer | Full-time | Remote | Aug 2025 - Present
Aug 2025 - Present

India Meteorological Department (IMD)

Ministry of Earth Sciences, Government of India

AI/ML Intern | Internship | Mausam Bhawan, New Delhi, India | May 2026 - June 2026
AI/ML Research Collaborator | Part-time | Remote | August 2025 - April 2026

Projects

AI/ML Projects

KaptaanLM KaptaanLM Research Labs Aug 2026 - Present Scout-10M (5.0B Tok) & Vanguard-25M (5.6B Tok) · Scaling Fleet

High-Parameter-Density Conversational & Reasoning Small Language Models (10M – 100M Dense Fleet → Post-100M Sparse MoE)

PyTorch 2.1+ JAX / Flax 10M–100M → Sparse MoE 16k BPE & Tied Weights QK-Norm & Soft-Capping Hybrid GQA + SWA Google TPU v5e-8 & RTX 6000 Reasoning SFT & CoT
10M & 25MScout & Vanguard Foundation
40B+ TokPre-Training Across Tiers
0.5042 CRIVanguard-Omni-DPO Champion

Project Overview

A family of high-density small language models engineered from scratch for multi-turn dialogue and reasoning, serving 15K+ monthly requests across open research portals (kaptaanlm.tech). Spanning dense architectures (Scout 10M, Vanguard 25M, Navigator 50M) and sparse MoE fleets, completing 40B+ token pre-training across Google TPU pods and NVIDIA GPUs with verified loss convergence and zero repetition loops.

Architectural Innovations & Engineering

  • Tied Embeddings + 16k BPE: Custom 16,384 BPE vocabulary paired with tied weights (W_embed = W_lm_head^T) halves embedding footprint, preserving 57.9% (at 10M) up to 90.1% (at 100M) of parameters purely for Transformer reasoning and self-attention layers.
  • QK-Norm (Head-Level RMSNorm): Normalizes query and key head vectors (Q_norm = RMSNorm(Q), K_norm = RMSNorm(K)) prior to scaled dot-product attention, bounding cross-head logits and stabilizing bfloat16 training dynamics under high learning rates.
  • Dual Logit Soft-Capping (Gemma 2 Style): Caps attention scores at 50.0 and output projection logits at 30.0 via tanh scaling, permanently extinguishing degenerative repetition loops, overconfidence spikes, and mode collapse.
  • Hybrid GQA + 512-Token SWA: Combines Grouped-Query Attention with alternating 512-token local sliding window layers across a fixed 2,048-token context window, minimizing KV-cache memory bandwidth for real-time edge generation.
  • Multi-Engine Distributed Training: High-MFU JAX/Flax implementation optimized for Google TPU v5e-8 pods (PJRT runtime, async Orbax checkpointing) alongside native PyTorch + SDPA on NVIDIA RTX 6000 Ada (48 GB VRAM).
  • Dual-Branch Reasoning & Omni Paradigm: Ablated post-training pathways showing Branch A wins at 10M while Direct Base → Reasoning (Branch B) wins at 25M (CRI 0.4167). Engineered the Universal Scratchpad Omni paradigm (<|thought|> on 100% data) and Schema DPO, producing grand champion Vanguard-Omni-DPO (50% math, 25% logic, 33% code, 0.000 repetition).
  • 11,858-Question EleutherAI Benchmark: Evaluated models across GSM8K, PIQA, ARC-Easy, ARC-Challenge, and LAMBADA, demonstrating exceptional parameter-efficiency and surpassing SmolLM-135M on core reasoning benchmarks.
  • Production Verification & Edge Export: 15/15 unit test suite passing (run_tests.py) with turnkey GGUF export (FP16 / Q8_0 / Q4_K_M) for edge acceleration via the InferenceOS Vulkan runtime.

Links & Resources

QaptaanLM-0.75B & Dataset Ecosystem KaptaanLM Research Labs Aug 2026 - Sept 2026 Stage 1 CPT & Stage 2 SFT Completed

Qwen3.5-0.8B Stripped & Adapted (752M Text-Only) · Two-Stage CPT & SFT · Curated 1.1B Token Ecosystem

Base: Qwen3.5-0.8B 752M Text-Only CPT & SFT Fine-Tuning Google TPU v5e-8 PyTorch / JAX GGUF / BnB / ONNX
752MDense Parameters (ViT Stripped)
1.1B Tokens1.0B CPT + 100M SFT Curated
8 Hub ReposSafetensors, GGUF, BnB, ONNX

Project Overview

A lightweight code generation and reasoning model adapted from Alibaba\'s Qwen3.5-0.8B. Stripped down to a lean 752M text-only causal LM, it was trained on Google TPU v5e across 1.0B tokens of KapCode-1B and 100M tokens of KapInstruct-100M, packaged with turnkey GGUF, CUDA, and ONNX runtimes.

Model Adaptation, Training & Dataset Engineering

  • Architecture Stripping & Adaptation: Adapted from Qwen/Qwen3.5-0.8B-Base by stripping the vision encoder to isolate a 752M text-only causal model with tied embeddings, preserving the 24-layer hybrid linear attention backbone (18 Gated DeltaNet + 6 GQA layers, 256K native context).
  • Custom HF Modeling & Recurrent Caching: Authored custom configuration_qaptaan.py and modeling_qaptaan.py with fast $O(1)$ single-token recurrent caching for DeltaNet linear attention and PyTorch Safetensors export.
  • Stage 1 CPT (KapCode-1B, 1.0B Tokens): Full-parameter continued pre-training on Google TPU v5e-8 across 13 programming languages, docs, and STEM math with 50% Fill-in-the-Middle (PSM FIM), converging loss from 12.80 → 2.44 over 61k steps.
  • Stage 2 SFT (KapInstruct-100M, 100M Tokens): Multi-task instruction tuning across 12 upstream sources in Qwen ChatML with token-level assistant-only loss masking (labels = -100).
  • Turnkey 8-Repository Suite: Distributed across 8 Hugging Face repositories spanning BF16 Safetensors, 13 GGUF quantization tiers (with Ollama Modelfiles), BitsAndBytes 4-bit NF4 / 8-bit Int8 CUDA, and in-browser ONNX WebGPU runtimes.

Links & Resources

Pangu-Weather Fine-Tuning IMD Aug 2025 - May 2026 Completed

Regional Weather Forecasting

Deep Learning PyTorch Weather Modelling Machine Learning Model Inference Distributed Training
20 mins -> 8 mins Reduced Training Time
3.5 YearsTrained on IMD GFS Data
10 DaysAutoregressive Forecast

Project Overview

Fine-tuned Huawei\'s 3D Earth-Specific Transformer on ~3.5 years of IMD GFS atmospheric data (2023–2026) for regional forecasting over the Indian subcontinent. Built end-to-end preprocessing, 10-day autoregressive rollouts, distributed GPU acceleration, and GIS station validation.

Key Engineering & Methodologies

  • Regional Model Adaptation: Fine-tuned Huawei's 3D Earth-Specific Transformer architecture on 3.5 years of IMD GFS data, tailoring pre-trained global representations to Indian regional meteorological dynamics.
  • Large-Scale Data Preprocessing: Engineered automated GRIB-to-NetCDF conversion, humidity parameter derivations, variable normalization, and spatial quality-assurance pipelines for multi-terabyte atmospheric grids.
  • Training & Inference Optimization: Accelerated epoch training time from 20 minutes down to 8 minutes through optimized PyTorch data loaders, mixed precision, and distributed GPU training optimizations.
  • Autoregressive Multi-Day Rollout: Built recursive forecasting pipelines that feed predictions back as sequential inputs to produce stable 10-day autoregressive forecasts across 13 atmospheric pressure levels.
  • Model Verification & Evaluation: Benchmarked predictions against observed ground-station weather data and operational numerical forecast baselines across geopotential height, temperature, humidity, and wind vectors.
  • Geospatial GIS Visualization: Developed automated visualization pipelines mapping meteorological forecast fields to GIS coordinate systems for operational forecasting analysis.

Links & Resources

Pangu-Lite IMDMay 2026 - June 2026 Completed

Distributed AI Weather Forecasting Model

Distributed Computing Deep Learning HPC NCCL Model Training ERA5 Data Forecasting
32 hours -> 5 hours Reduced Training Time
40+ YearsTrained on ERA5 Data
Multi-GPU Multi-Nodal DDP Setup

Project Overview

A lightweight deep learning weather forecasting model trained on 40+ years of ECMWF ERA5 reanalysis data (1979–2024). Engineered a unified production pipeline, implemented multi-GPU multi-node DDP training on IMD\'s Arunika HPC cluster, and explored patch embeddings with cross-attention.

Key Innovations & Distributed Training

  • Lightweight Deep Learning Model: Co-developed a lightweight atmospheric forecasting model trained across 40+ years of ERA5 reanalysis grids, delivering fast regional weather predictions with reduced compute footprint.
  • Codebase Refactoring & Pipeline Unification: Resolved critical legacy training bugs and refactored disparate scripts into modular, production-ready training, validation, checkpointing, and logging pipelines.
  • Multi-Node DDP on Arunika HPC: Engineered PyTorch Distributed Data Parallel (DDP) workflows with NCCL backends and authored custom PBS job scripts for scalable multi-GPU, multi-node execution on IMD's Arunika cluster.
  • 6.4x Training Acceleration: Reduced epoch training duration from 32 hours to 5 hours per epoch through optimized NCCL distributed communication, pinned-memory data loading, and kernel execution tuning.
  • End-to-End MLOps Workflows: Built resilient checkpointing, automated experiment logging, loss monitoring, and autoregressive multi-step inference pipelines for systematic model iteration.
  • Architectural Experimentation: Researched and benchmarked 3D patch embedding variants, variable-level cross-attention mechanisms, ensemble inference strategies, and post-hoc error correction.

Links & Resources

InferenceOS KaptaanLM Research Labs July 2026 - Oct 2026 Completed · Production

Hardware-Agnostic Adaptive Operating System for Local LLM Inference

Python 3.10+ C++20 CUDA & ROCm Vulkan & Metal Multi-Format Engine System 1 & 2 Symbiosis FastAPI (OpenAI & Ollama) Modern TUI & CLI
System 1 & 2Kahneman Hybrid Symbiosis
Multi-FormatGGUF, ONNX, PyTorch, OpenVINO
Zero OOMDynamic Microbatch & Migration

Project Overview

An open-source, hardware-aware adaptive OS and control plane for local LLM inference. Forked from llama.cpp with a multi-format engine, it features a <150ms System 1 reflex engine, System 1+2 hybrid gating, dynamic VRAM layer placement, KV cache compression, dual REST APIs, and a modern TUI.

Features

  • System 1 Non-Autoregressive Reflex Engine: Sub-150ms instant encoder classification (Laya mmBERT, Kev pointer heads) with zero KV cache footprint for sub-second decision making.
  • Kahneman Fast/Slow Hybrid Symbiosis: Dynamic cognitive loop combining sub-second reflexes with generative deep-reasoning LLMs, calibrated confidence gating (τ), automatic System 2 escalation, and DAgger distillation logging.
  • Universal Multi-Format Execution: Polymorphic engine with magic-byte format autodetection supporting GGUF, SafeTensors, ONNX, PyTorch, Intel OpenVINO, Keras 3, TFLite, and dynamic INT8 quantization.
  • Hardware Auto-Profiler & Cost Optimizer: Multi-vendor detection engine profiling CPU, NVIDIA CUDA, AMD ROCm, Apple Metal, Intel Arc, and integrated GPUs to auto-generate optimal execution and placement plans.
  • Dynamic Microbatch Scheduler & Zero OOM: Real-time prefill batching using multi-heuristic scoring (VRAM headroom, prompt TPS, GPU occupancy, PCIe bandwidth) to eliminate out-of-memory crashes.
  • Live Hysteresis Layer Migration: Dynamic offload coordinator that shifts layers in real-time between dGPU, iGPU, and CPU under memory pressure during active inference.
  • KV Cache Compression & Eviction: Memory optimizer supporting FP16/Q8_0/Q4_0 cache quantization and attention-sink eviction policies (H2O Heavy-Hitter Oracle, StreamingLLM, LRU, FIFO).
  • Modern Interactive TUI & Unified CLI: Terminal UI featuring floating slash autocompletion (/model, /mode, /tau), modal split-view model picker (Ctrl+O), persistent status ribbon, and rich deliberation flowcards across a 27-command CLI suite.
  • Dual REST API Server: High-throughput FastAPI HTTP server supporting full OpenAI (/v1/*), Ollama (/api/*), and System 1 (/v1/system1/*) endpoints with streaming SSE.

Links & Resources

myTrade mySphere May 2026 - Aug 2026 Completed

Autonomous AI Market Intelligence & Trading Platform

Multi-LLM Consensus ChromaDB (RAG) SQLite Upstox API Streamlit UI Telegram Bot AsyncIO
Multi-LLM Jury40+ Models Consensus
Quant EngineMath Risk Veto
HITL & AutoTelegram Control

Project Overview

An autonomous, multi-agent AI market intelligence and trading system for Indian equity markets (NSE/BSE). Combines quantitative indicators, a 40+ LLM jury consensus, local vector RAG memory, and strict risk guardrails with a remote Human-in-the-Loop (HITL) control interface.

Features

  • Multi-Model Consensus Engine: Queries a configurable pool of independent LLMs concurrently (40+ model roster across Groq, Nvidia, Mistral, Google, Cerebras) with dynamic multi-key API cycling to benchmark qualitative sentiment without single-model hallucinations.
  • Mathematical Risk Veto Layer: Deterministic quantitative rules evaluating macro market regimes, price action, and momentum to serve as a pre-AI guardrail layer that can veto qualitative entries.
  • Hybrid Data & RAG Memory System: Combines SQLite structured price storage with ChromaDB vector embeddings for corporate disclosures, regulatory filings, and market news.
  • Google OKF Context Assembly: Synthesizes price metrics, technical indicators, and vector RAG context into standardized Open Knowledge Format (OKF) payloads for model evaluation.
  • Friction & Tax Modeling Engine: Calculates transaction friction costs including STT, GST, SEBI charges, brokerage, and stamp duty to verify net capital deployment efficiency.
  • Interactive HITL & Telegram Control: Secure 4-message Telegram dashboard allowing real-time monitoring of AI juror votes, news context, and tax breakdowns with interactive trade approval, rejection, or veto override buttons.
  • Execution & Broker Integration: Features a local SQLite paper ledger for shadow portfolio tracking alongside Upstox API integration and configurable auto-approval switches.

Links & Resources

Agentic AI Weather Assistant IMD May 2026 - June 2026 Completed

LLM-Powered Meteorological Query System

Retrieval-Augmented Generation (RAG) Large Language Models (LLM) Natural Language Processing (NLP)
RAGArchitecture
Zephyr/GemmaLocal & Cloud LLMs
MausamgramWeather Data

Project Overview

An Agentic RAG meteorological assistant developed at IMD to translate numerical weather forecasts into accessible insights. Synthesizes observation feeds and Mausamgram data with local (Zephyr) and cloud (Gemma) models for location-aware querying and automated alert generation.

Key Architecture & Features

  • Agentic RAG Meteorological Pipeline: Engineered an intelligent conversational agent that orchestrates multi-step information retrieval across real-time IMD numerical forecast systems and structured meteorological tables.
  • Location-Aware Data Retrieval: Developed ingestion pipelines parsing localized Mausamgram observation datasets to answer station-specific temperature, precipitation, and storm alert queries.
  • Hybrid Local & Cloud LLM Inference: Implemented dual inference runtimes integrating local quantized Zephyr models for air-gapped on-premise inference and cloud-hosted Gemma models via Hugging Face endpoints.
  • Context Engineering & Query Synthesis: Built automated context-assembly pipelines that normalize numerical weather tables into formatted LLM prompts for hallucination-resistant domain responses.
  • Pipeline Hardening & Optimization: Refactored and optimized the core RAG retrieval flow, mitigating latency bottlenecks and significantly improving response reliability during peak forecast query loads.
  • Conversational Forecast Generation: Enabled conversational explanation of severe weather bulletins, regional climate trends, and daily forecasts in clear, actionable natural language for public advisories.

Links & Resources

Development & Product Projects

myCloud mySphere Aug 2025 - March 2026 Live Production

Distributed Personal Cloud Platform

Flask MySQL Socket.IO Python SDK CLI (mycloudctl) CustomTkinter Oracle OCI Nginx & Gunicorn
Cross-PlatformWeb, Desktop, Android, CLI, Python-SDK
Real-TimeSocket.IO Sync
DistributedStorage Nodes

Project Overview

A full-stack distributed personal cloud platform engineered for the mySphere ecosystem. Decouples file metadata from physical storage, enabling personal devices to act as distributed "Smart Relay" nodes with centralized control, real-time sync, enterprise encryption, and CLI/SDK/GUI access.

Features

  • Multi-Client Access: Responsive Web PWA, CustomTkinter Desktop Node GUI, Python CLI (mycloudctl), official Python SDK (mycloud-sdk), and cross-platform Electron/Capacitor wrappers.
  • Distributed Storage Nodes: Connect private PCs or servers as storage nodes over WebSockets ("Smart Relay") with MySQL node routing.
  • Advanced Sharing Suite: Direct user invites with RBAC permissions, public token link generation, and batch share links grouping disparate files/folders.
  • Stash Lifecycle: Temporary file isolation workflow with scheduled auto-cleanup (10m, 1h, 1d, or custom intervals).
  • Authentication & Security: Google/GitHub OAuth, 2FA challenge flows, CSRF protection, HttpOnly/SameSite session security, and bcrypt hashing.
  • Observability & Monitoring: Built-in internal dashboards monitoring system CPU/RAM, Nginx/Gunicorn service health daemons, and product analytics.
  • Infrastructure & Hosting: Production-grade deployment on Oracle Cloud Infrastructure (OCI) using Nginx reverse proxy and Gunicorn Eventlet async worker processes.

Links & Resources

myDomain mySphere Oct 2026 - Present In Development

Developer Subdomain & Cloudflare DNS Management Platform

React 18 TypeScript Vite Express 5 Cloudflare DNS API Supabase / PostgreSQL Dynamic DNS (DDNS) Tailwind CSS OAuth 2.0
46K+ Requests27K+ Monthly Page Views
Cloudflare APIAutomated DNS Sync
DDNS & PresetsMulti-Record & 1-Click Hosting

Project Overview

A full-stack developer platform providing free custom subdomains under configured parent domains with real-time DNS management. Built with React, Vite, TypeScript, Express 5, and Cloudflare, featuring Dynamic DNS (DDNS) automation for homelabs, 1-click deployment presets, and global propagation diagnostics.

Features

  • Developer Subdomain Provisioning: Instant self-service registration and lifecycle management of subdomains under parent domains with reserved keyword filtering and abuse prevention.
  • Full-Spectrum DNS Record Control: Real-time management of standard DNS records (A, AAAA, CNAME, TXT, MX, NS, SRV, CAA) and 301/302 URL redirects.
  • 1-Click Hosting Integration Presets: Pre-built DNS templates for Vercel, GitHub Pages, Netlify, Render, and Cloudflare Pages for friction-free developer deployments.
  • Dynamic DNS (DDNS) Update Endpoint: Dedicated HTTP token endpoints enabling self-hosters and home-lab servers on dynamic public IPs to synchronize DNS records automatically.
  • Cloudflare DNS Integration & Proxying: Bidirectional synchronization with Cloudflare API, automated zone updates, configurable TTLs, and instant proxy toggle (orange-cloud).
  • Global Propagation Inspector: Diagnostic resolver suite querying worldwide authoritative DNS servers in real time to verify propagation status and health.

Links & Resources

myCam mySphere VIT/College In Development

Real-Time WebRTC Security & Surveillance Platform

React 19 Vite 7 Express 5 Socket.IO WebRTC MySQL Tailwind CSS Canvas API AI Motion Detection Two-Way Audio

mySync mySphere In Development

Cross-Device Notification & Clipboard Sync Platform

Node.js / Express Socket.IO WebRTC React Native React + Vite Groq / Llama 3 AI Clipboard Sync

myTune mySphere Jan 2026 - Present Completed

Cosmic Glass Cross-Platform & Desktop Music Streaming Application

Electron 33 JavaScript / Node.js Vite Web Audio API SQLite / sql.js Motion music-metadata Custom Streaming Protocol Cross-Platform

Integrated Systems Projects

Mobile VPS & Edge AI Server mySphere Nov 2026 - Present Operational Homelab Node

Dual-Boot Headless Edge Cloud · Virtual UPS Power Management, Hybrid Storage Tiering & Local AI Inference Node

Ubuntu 24.04 LTS Linux Kernel Tuning Docker & Compose Cloudflare Argo Tunnels Tailscale WireGuard Caddy 2 Reverse Proxy systemd Automation llama.cpp / InferenceOS NVIDIA CUDA (sm_50)
0 µs TransferVirtual Hardware UPS (48 Wh)
< 3W PowerHeadless Clamshell Idle
Zero Open PortsArgo & Tailscale Mesh

Project Overview

Engineered an always-on, low-power, zero-cost Mobile VPS and Edge AI Server by repurposing dual-boot consumer laptop hardware. Designed to eliminate commercial cloud memory and cost bottlenecks for mySphere services (myDomain, myCam, myCloud), the node provides bare-metal resilience, automated battery-backed power protection, zero-trust remote access, and an experimental testbed for local foundation model serving.

Architecture & Engineering Highlights

  • Integrated Virtual UPS & Clamshell Power Management: Configured headless clamshell operation (multi-user.target) powering down display panels to drop idle consumption to <3W at 38°C with passive fanless cooling. Harnessed the internal 48 Wh Li-ion battery as an instant 0 µs hardware UPS, pairing ACPI hardware DC-passthrough telemetry (CURRENT_NOW=0) with UPower daemon hooks for safe, automated system shutdown at 8% battery to guarantee zero filesystem corruption during extended grid failures.
  • Zero-USB Online Live Root Migration & NVMe Expansion: Faced with a 99% root space lockup and leftward partition sector geometry unexpandable by conventional tools without a live USB, designed and executed a zero-downtime live filesystem mirror via rsync -aHAXxv to a newly carved partition (/dev/nvme0n1p6), re-targeted UUIDs and GRUB, booted into the clone, absorbed the legacy partition, and expanded root online from 30 GB to 91 GB (64 GB free).
  • Windows LDM Dynamic Disk Mounting & Storage Tiering: Engineered custom early-boot systemd units (ldmtool.service) to map proprietary Windows Dynamic Disk partitions under Linux ntfs3, exposing 773 GB of secondary storage. Implemented hybrid storage tiering: fast NVMe SSD for OS kernels, containerd, and Docker layer IOPS, paired with 1 TB secondary SATA for persistent Docker volumes, media, and GGUF model weights.
  • Kernel Crash Immunization & Headless Recovery: Neutralized proprietary NVIDIA driver suspend kernel panics (nv_pmops_suspend -5) upon power-disconnect by masking systemd sleep targets. Patched headless GRUB boot loops (recordfail=1) with fail-safe timeouts to ensure unattended, reliable reboots after unclean shutdowns.
  • Zero-Trust Mesh Networking & Sub-2ms Ingress: Mitigated Intel CNVi Wi-Fi latency jitter by disabling 802.11 power saving (wifi.powersave=2), configured dynamic metric-based Ethernet/Wi-Fi failover routing, and deployed Tailscale WireGuard mesh with MagicDNS alongside Cloudflare Argo Tunnels (cloudflared) to securely expose production services with zero open router ports.
  • Host-Mode Reverse Proxy & Container Orchestration: Deployed rootless Docker Compose managed via Dockge, eliminating double-NAT bridge latency by binding Caddy 2 reverse proxy to host network mode with HTTP stream compression (gzip/zstd), internal TLS termination, Glances system telemetry, and Uptime Kuma heartbeat alerting.
  • Local Edge AI Inference & Agent Testbed: Configured a dedicated on-device serving environment comparing Maxwell-compiled llama.cpp (sm_50) against the custom InferenceOS engine across compact quantized SLMs (MiniCPM5-1B Q6_K in dGPU VRAM and K2-Horizon-3.7B Q4_K_M hybrid layer split) and autonomous agent frameworks.

Links & Resources

Sign Language Interpreter VIT/College Aug 2026 - Oct 2026 Live Production Web Suite

Sign Language Studio · Real-Time ASL Vision Suite, Text-to-Sign Synthesis, Windows OS Automation & WebRTC

MediaPipe Hands TensorFlow.js WebRTC (PeerJS) Windows OS Automation WebSocket Bridge GPT-4o Vision Assistant ESP32 & BLE (Optional) 14-Language Speech Synthesis Netlify Production
Web ProductionSign Language Studio Suite
Neural VisionMediaPipe & On-Device DNN
OS AutomationTouchless Windows Control

Project Overview

A production-grade American Sign Language (ASL) recognition and assistive communication web suite deployed at sign-language-studio.webdomain.live. Fuses 21-landmark browser computer vision with an interactive practice academy, bidirectional Text & Speech-to-Sign telecommunication, touchless Windows OS gesture automation, and multimodal AI diagnostics.

Features & Technical Highlights

  • Full Production Web Suite (Sign Language Studio): Deployed web platform featuring specialized interconnected studios for real-time camera detection, gamified speed quizzes, multimodal AI chat, two-way telecommunications, and an interactive 46-sign visual dictionary.
  • 21-Landmark Vision Tracking & On-Device DNN: Client-side tracking using Google MediaPipe Hands capturing 21 3D hand keypoints at 30–60 FPS, normalized and classified into the 26 ASL alphabet letters via a 4-layer Sequential DNN cached in IndexedDB.
  • Windows OS Gesture Automation & Companion Bridge: Fully operational companion bridge (python run_os_control.py / standalone executable) over WebSocket (ws://127.0.0.1:8765) for touchless Windows automation: smoothed cursor steering, pinch click/drag, scrolling, volume dial, brightness, snipping tool, and desktop virtual typing injection.
  • Interactive Practice Academy & Speed Quiz: Gamified learning laboratory featuring pose hold-and-verify SVG progress rings, streak multiplier scoring, and a 60-second speed-run evaluation engine.
  • Bidirectional Text & Speech-to-Sign Synthesis: Full-duplex assistive engine converting typed text prompts and spoken voice into animated ASL sequences, paired with WebRTC P2P communication and real-time sign-to-speech translation.
  • Multilingual Vocalization & Predictive Text: Offline Trie and bigram language model for fast sentence autocomplete, coupled with real-time SpeechSynthesis vocalization and cloud translation across 14 languages.
  • Multimodal AI Assistant & Active Learning: Puter.js GPT-4o Vision assistant for analyzing uploaded sign photos, paired with instant k-NN calibration for user-specific hand shapes without model retraining.
  • Hardware Disambiguation & Smart Glove Telemetry: 100% functional with standard webcams alone; includes optional research extension fusing an ESP32 + MPU-6050 BLE glove streaming 6-axis kinematics at 50 Hz for dynamic motion gestures ('J', 'Z', 'YES').

Links & Resources

EMG Controlled Music System VIT/College Oct 2025 - March 2026 Completed

Bio-Signal Interface Project (Arduino)

Arduino Embedded Systems EMG Signals C/C++ DFPlayer Mini Ultrasonic Sensing OLED Interface

Other Projects

Open Source & Community Contributions Open Source 2026 Active Contributor

Upstream Foundation ML, Systems Emulation & Developer Tooling Contributions

CPython Core Python Standard Library Hugging Face Transformers Audio ML / CLAP C++ / Win32 Winsock API Systems Emulation Node.js CLI Google Antigravity Git / GitHub PRs C# / .NET Electron
Python (cpython)ftplib CLI Tests (78k★)
TransformersCLAP Extractor Fix (168k★)
+5 OthersJellyfin, Electron, +3 More

Contribution Overview

Beyond authoring independent open-source research and engineering systems, actively contributing upstream bug fixes, kernel emulation patches, and platform integrations to premier open-source machine learning frameworks, emulation engines, and developer tooling (ordered descending by repository popularity).

Featured Upstream Contributions

  • Python / CPython (~78k★) - Standard Library ftplib CLI Tests & StringIO Fix (PR #161080 & PR #161135 · Merged):
    • Contributed comprehensive unit test coverage in Lib/test/test_ftplib.py for the ftplib CLI (python -m ftplib), validating commands (-l, -d, -p, RETR), docstrings, and netrc handling (PR #161080; issue #131178).
    • Followed up by diagnosing and patching test_cli_retrieve_file failures when sys.stdout is an io.StringIO buffer (PR #161135), ensuring cross-platform test stability across buildbots; merged upstream into python/cpython:main by core developers.
  • Hugging Face Transformers (~168k★) - CLAP Feature Extractor Boolean Padding Fix (PR #49960 · Merged):
    • Resolved issue #23648 in ClapFeatureExtractor.__call__ where passing boolean padding=True failed string equality checks ("repeat" / "repeatpad") in _get_input_mel, causing audio inputs to erroneously fall through to zero padding.
    • Implemented automatic resolution mapping boolean padding=True to self.padding, updated method signatures and docstrings with boolean type annotations, and contributed the test_padding_boolean regression suite in test_feature_extraction_clap.py; reviewed and merged upstream.
  • Jellyfin (~59k★) - Model Enum XML Documentation & CS1591 Cleanups (PR #18574 · Merged):
    • Contributed comprehensive XML documentation comments across 6 core model enums in MediaBrowser.Model (ExtraType, TrailerType, Video3DFormat, MediaProtocol, RecommendationType, ChannelMediaType) as part of issue #2149.
    • Cleaned up legacy #pragma warning disable CS1591 compiler warning suppressions, aligning shared media model types with strict repository API documentation standards; reviewed and merged into master.
  • Electron (~124k★) - Windows Native Toast XML Notification Modernization (PR #55321 · Merged):
    • Modernized the official Windows notifications developer tutorial in docs/tutorial/notifications.md, replacing deprecated third-party native addon dependencies with native toastXml payloads.
    • Documented structured XML schemas for input actions, inline images, and quick-reply textboxes, eliminating obsolete C++ build requirements and preventing runtime breaks on modern Windows 10/11 shells; reviewed and merged upstream into main.
  • KyTy PS5 Emulator (~10k★) - Win32 Network Socket & Linker Fix ([PR #751 · Credited]:
    • Diagnosed Windows test failures and linker issues in KernelFileSystemTests (exit code 0xc0000409), decoupling SDL_MAIN_HANDLED ahead of header inclusion to prevent lld-link undefined symbol collisions.
    • Resolved Winsock WSAEOPNOTSUPP flag incompatibilities by architecting a custom polling-based MSG_WAITALL emulation layer with WSAPoll and ioctlsocket(FIONREAD) to preserve POSIX socket behavior; resolved issue #505 and earned GitHub Pair Extraordinaire.
  • Career-Ops (~78k★) - CLI Help Flag Argument Parsing Fix (PR #5822 · Merged):
    • Diagnosed CLI argument parsing in the AI job search agent where fetch-jd.mjs and seed-fixture.mjs failed on --help / -h, erroneously exiting on stderr before target path or URL validation.
    • Implemented structured help flag handling to cleanly display usage instructions and exit code 0, adding regression test coverage in tests/help-flag-handled.test.mjs and updating repository allowlists; reviewed and merged upstream.
  • Latent Spaces Brag Skill (~19k★) - Google Antigravity Integration (PR #15 · Merged):
    • Extended the /brag video composition skill to natively support Google Antigravity (AGY) alongside CLI workflows, configuring agent discovery pathways, workspace customizations root mapping, and asset resolution rules.
    • Standardized deterministic invocation parameters and runtime schema validation to ensure reliable execution across subagents; reviewed and merged into upstream main.

Links & Resources

Renewable Energy DB Simulator VIT/College Aug 2026 - Oct 2026 Completed

Relational Database Simulator & Streaming IoT Telemetry Platform

React 19 TypeScript Vite Relational DBMS Interactive ER Canvas Streaming IoT Telemetry Motion Lucide Icons

Shor's Algorithm Implementation VIT/College Feb 2026 - April 2026 Completed

Quantum Computing Project (Qiskit)

Qiskit Quantum Algorithms Python QFT Modular Exponentiation Classical Post-Processing Circuit Optimization Beauregard Architecture RSA Crypto Analysis Web Simulation (HTML/CSS)

Education

Vellore Institute of Technology | 2029

Bachelor of Technology - BTech, Computer Science | 2025 - 2029

Grade: CGPA: 9.44

  • Achieved a CGPA of 9.60 in Semester 1 and a cumulative CGPA of 9.44 after completion of the first year.
  • Secured 3rd rank in the branch during Semester 1 and maintained strong academic performance throughout the first year.
  • Coursework: C/C++, Java, Python, Shell/Bash, Linux, SQL, R, MATLAB, Data Structures & Algorithms, Digital Electronics, Computer Architecture, SolidWorks, LTSpice.

Senior Secondary Education (Class 12th) | 2025

R.N. Public School, Prayagraj (CBSE Board)

Grade: 91.6%

  • Secured 91.6% overall in the Class 12th CBSE Board examinations.
  • Demonstrated academic excellence with strong and consistent performance in technical and analytical subjects.
  • Highlights: Scored 95/100 in Computer Science, 98/100 in English and 90/100 in Physics.

Senior Secondary Education (Class 11th) | 2024

R.N. Public School, Prayagraj (CBSE Board)

Grade: 91.1%

  • Secured 91.1% overall in the Class 11th CBSE examinations.
  • Demonstrated strong academic foundation in Computer Science and Mathematics.
  • Highlights: Scored 93/100 in Computer Science and 92/100 in Mathematics.

Secondary Education (Class 10th) | 2023

St. Joseph's College, Prayagraj (ICSE Board)

Grade: 96.8%

  • Secured 96.8% overall in the Class 10th ICSE Board examinations.
  • Achieved a perfect score of 100/100 in Computer Applications.
  • Scored 97/100 in English, 96/100 in Mathematics, 95/100 in Science, and 96/100 in History, Civics and Geography.

Certifications & Courses

Machine Learning for Earth Systems Modelling | ECMWF

Comprehensive training on ML foundations for weather and climate science, neural architectures for atmospheric dynamics, deterministic AI forecasting systems (AIFS), and data-driven forecasting frameworks.

View Foundations Certificate View Architectures & Prediction Certificate

Advanced Features in Java | Infosys Springboard

Professional certification covering core enterprise Java capabilities, focusing on the Java Collections Framework, working with Sets, stream processing, lambdas, and object-oriented architectural patterns.

Issued: October 2026 Verify ↗
View Certificate

Fundamentals of Remote Sensing & Air Quality | NASA ARSET

Core principles of remote sensing, sensor types, data resolution, satellite imagery interpretation, and satellite data applications for atmospheric air quality monitoring.

Codes: 4794012384RS | 3979347422RS
View Fundamentals Certificate View Air Quality Certificate

Hyperspectral Data for Land and Coastal Systems | NASA ARSET

Advanced techniques for processing and analyzing imaging spectroscopy datasets, exploring airborne and spaceborne hyperspectral sensors (EMIT, PRISMA, PACE), spectral signature extraction, and monitoring vegetation health, aquatic habitats, and coastal water quality.

Verification Code: 2804106189RS Verify ↗
View Certificate

Understanding climate data: From analysis of the past to future projections | ECMWF

Comprehensive training on climate data analysis workflows, ERA5 reanalysis and historical observational baselines, future projection methodology (CMIP6), climate impact indicators, and assessing uncertainty in long-term atmospheric trends.

View Certificate

Understanding satellite data to monitor dust | EUMETSAT

Practical application of geostationary and polar satellite imagery (Meteosat SEVIRI Dust RGB, Sentinel, Metop) to detect, track, and forecast airborne dust storms, evaluate aerosol optical depth (AOD), and analyze transboundary atmospheric transport.

View Certificate

H SAF Products (Snow, Soil Moisture, Precipitation) | EUMETSAT

Comprehensive training on H SAF satellite products focusing on snow cover, soil moisture monitoring, and precipitation measurements for meteorological and hydrological applications.

View Snow Certificate View Soil Moisture Certificate View Precipitation Certificate

Honours & Rewards

Certificate of Merit - Branch Rank 3 | 2026

Vellore Institute of Technology (VIT), Chennai

  • Awarded for securing 3rd rank in the CSE branch.
  • Award was presented by Mr.Binod Kumar, MD & CEO of Indian Bank.
  • Award included a certificate.
View Certificate

Academic Excellence Scholarship | 2025

Indian Farmers Fertilizer Cooperative Limited (IFFCO)

  • Awarded by Indian Farmers Fertilizer Cooperative Limited (IFFCO) for securing 91.6% in the CBSE Class 12th Board Examination in 2025.
  • Award included a certificate, medal and a scholarship reward of Rs. 3,28,000

Academic Excellence Scholarship | 2023

Indian Farmers Fertilizer Cooperative Limited (IFFCO)

  • Awarded by Indian Farmers Fertilizer Cooperative Limited (IFFCO) for securing 96.8% in the ICSE Class 10th Board Examination in 2023.
  • Award included a certificate, medal and a scholarship reward of Rs. 24,000
View Certificate

Certificate of Excellence in Computer Applications | 2023

St. Joseph's College, Prayagraj

  • Awarded by St. Joseph's College for scoring a perfect 100/100 in Computer Applications in the ICSE Class 10th Board Examinations in 2023.
  • Award included a certificate and a trophy.
View Certificate

Featured in Amar Ujala for Board Results | 2023 & 2025

Amar Ujala Newspaper

  • Mentioned for securing 96.8% in Class 10th (ICSE).
  • Mentioned again for securing 91.6% in Class 12th (CBSE).
  • Recognized in merit-focused board result coverage for consistent academic achievement.
View Article Mention

Featured in CollegeDekho VITEEE Toppers List | 2025

CollegeDekho.com

  • Recognized in the VITEEE toppers list feature.
  • Included in the published ranking highlights among notable VITEEE performers.
View Feature Highlight

Skills & Technologies

Artificial Intelligence & ML

PyTorch, JAX / Flax, Distributed Training, Model Inference, RAG, LLMs, Agentic AI, ChromaDB, TensorFlow.js, MediaPipe Hands, NLP, CPT, SFT, SLMs

Backend & Systems Engineering

Python, C / C++, Java, Node.js / ExpressJS, Flask, REST APIs, WebSockets (Socket.IO), WebRTC P2P, llama.cpp Engine

Cloud, GPU & Infrastructure

HPC, Distributed Computing (NCCL, DDP), CUDA, ROCm, Vulkan, Metal, Cloudflare Tunnels, Tailscale WireGuard, Caddy 2, systemd, OCI

Data & Storage Systems

Apache Arrow & Parquet, Dataset Curation & Sharding, SHA-256 Deduplication, SQL, MySQL, SQLite, ChromaDB Vector DB, GRIB/NetCDF, Geospatial GIS

Frontend & App Development

React, React Native, Vite, CustomTkinter, HTML, CSS, JavaScript, UI/UX, Electron, Capacitor, PyQt6, Canvas API

Security & Systems Architecture

OAuth 2.0, 2FA, System Design, Virtual UPS Failsafe, Live Root Migration, Distributed Storage

DevOps & Open Source Publishing

Git, GitHub, Hugging Face Hub / Datasets, Kaggle Datasets, CI/CD, Docker, Linux Kernel Tuning & Administration, PyPI Publishing (mycloudctl, mycloud-sdk, inferenceos)

Hardware & Embedded Systems

ESP32, MPU-6050 6-Axis IMU, Web Bluetooth (BLE), Sensor Fusion, Arduino C++, Bio-signals (EMG), Ultrasonic Sensing, DFPlayer Mini, OLED Displays, Serial Protocols

Languages

English (Fluent), Hindi (Native), German (Elementary)

Contact/Socials

Resume & Profile

Master Technical

Foundation AI & Research Resume

Typeset in LaTeX with an ATS-calibrated, 2-page format. Comprehensive overview of foundation model pre-training at KaptaanLM Labs, atmospheric deep learning HPC scaling at IMD, distributed mySphere systems, and academic honours.

Foundation Models (SLMs) TPU Pod Pre-training (5B Tokens) Pangu Atmospheric HPC Scaling Agentic RAG & LangModels KapCode-1B Dataset

9.44

B.Tech CGPA

3rd

Branch Rank

5.0B

Pretrained Tokens

1.1B+

Open Dataset

170K+

Monthly Requests

AI/ML

Core Focus

Download PDF
About
Experience
Projects
Education
Certifications
Honours
Skills
Contact
Resume