Skip to content
back to the cosmos

Ansh Singhal

AI/ML & Backend Engineer

India+91-8929554991anshsinghal3107@gmail.comgithub.com/AnshSinghallinkedin.com/in/anshhh-singhalanshsinghal.dev

Summary

AI/ML and backend engineer specializing in production large language model (LLM) systems, retrieval-augmented generation (RAG), and low-latency, high-throughput infrastructure. Sole owner of an AI security gateway scaled with async concurrency to 100k+ RPS across 500+ endpoints at a 99% reduction in unsafe LLM behavior; lead of an independent zero-day discovery engine at 100% recall and 93% precision across four package ecosystems; builder of an agentic RAG engine over 10,000+ legal documents at 97% retrieval accuracy and sub-500ms P95, and a real-time voice-streaming backend holding sub-200ms across 100+ concurrent sessions. Proficient in Python, FastAPI, PyTorch, LangChain, LangGraph, Kafka, vector search, and cloud infrastructure (Docker, Kubernetes, AWS, GCP, Azure). B.Tech Computer Science (AI Specialization), Bennett University, CGPA 9.47/10.

Experience

CyberUltronAI/ML EngineerFeb 2026 - Present · Remote
  • Architected and shipped a production-grade AI security gateway as sole owner across backend, frontend, DevOps, cloud deployment, and scaling — centralized pre/post-LLM security (SHA-256 auth, PII detection, prompt-injection mitigation) across 500+ endpoints, scaled with async concurrency to 100k+ RPS at a 99% reduction in unsafe LLM behavior.
  • Drove critical feature expansion on an application-security (DevSecOps) platform — introduced CBOM scanning coverage, shipped AI-powered vulnerability remediations that cut manual triage time by 60%+, and optimized platform performance by 40%+.
  • Engineered core features on an endpoint AI-governance solution guarding against sensitive-data exfiltration across 5+ widely-used enterprise AI tools — a lightweight agent + local-proxy architecture serving 1000+ enterprise endpoints.
IntelOwlOpen Source DeveloperJan 2025 - Apr 2026 · Remote
  • Contributed 4 production security analyzers to IntelOwl, an open-source threat-intelligence platform used by security teams worldwide, expanding automated threat-detection coverage by 23% across IP addresses, file hashes, and URLs.
  • Added pytest-based validation suites to improve analyzer reliability and regression protection.
  • Fixed Django migration and data-consistency issues, improving migration success to 99.9%.
  • Resolved Docker networking and caching issues to improve deployment stability and analyzer execution.

Projects

AI Security GatewayProduction AI security gateway (sole owner)
  • Architected and shipped a production AI security gateway as sole owner across backend, frontend, DevOps, cloud, and scaling — pre/post-LLM security (SHA-256 auth, PII detection, prompt-injection mitigation) fronting 500+ endpoints.
  • Scaled with async concurrency from 100 to 100k+ RPS at a 99% reduction in unsafe LLM behavior.

FastAPI, ASGI/Uvicorn, Redis, PostgreSQL, LiteLLM, Presidio, Docker, AWS

ZeroDayShieldOSS zero-day discovery engine (lead)
  • Leading and building from scratch an independent zero-day research engine across 4 ecosystems (npm, MCP servers, Docker images, Hugging Face models), with 50+ custom static-analysis engines (zero open-source libraries) mining 49,522 signals from live registry traffic against 228,020 known-malicious packages.
  • Designed a multi-stage LLM triage pipeline at 100% recall and 93% precision, zero false positives on the OSSF malicious-packages corpus, at a 15x cost reduction over baseline.

FastAPI, Next.js, PostgreSQL, Docker, Python

DHARAAgentic RAG legal-research enginegithub.com/AnshSinghal/DHARA
  • Built an agentic RAG engine over 10,000+ legal documents at 97% retrieval accuracy, with multi-agent query decomposition, reranking, and deterministic grounding.
  • Served citation-traced answers at sub-500ms P95 on AWS containerized microservices.

FastAPI, LangGraph, LangChain, Vector Search, AWS

VoiceOps AIRealtime voice-streaming backend
  • Built a real-time voice-streaming backend holding sub-200ms latency for 100+ concurrent sessions, with Kafka consumer groups and Kubernetes HPA backed by PostgreSQL, MongoDB, and Redis.
  • Tracked consumer lag and P95 latency to monitor performance across the distributed streaming pipeline.

Kafka, WebSockets, Kubernetes, FastAPI, PostgreSQL, MongoDB, Redis

Flood-GANSAR-to-optical flood mapping (published research)github.com/AnshSinghal/Flood-Monitoring
  • Designed a dual-head U-Net translating all-weather SAR radar to optical flood imagery at 1024x1024, using NDWI water-index supervision so flood boundaries are learned as water, not texture.
  • Reached FID 28.4 / PSNR 31.25 / SSIM 0.94 with EMA-stabilized adversarial training over ~200 GPU-hours, every run tracked in Weights & Biases.

PyTorch, PyTorch Lightning, CUDA, Docker, Weights & Biases

Skills

Languages
Python, Java, C++, SQL, JavaScript
AI / ML
LLMs, Agentic RAG, LangChain, LangGraph, LlamaIndex, Hugging Face, PyTorch, TensorFlow, spaCy, NLP Pipelines
Backend
FastAPI, Django, DRF, Flask, Spring Boot, Celery, Django Channels, WebSockets, REST APIs, JWT Auth
Security
Presidio, llm-guard, OWASP LLM Top 10, Prompt-injection mitigation, PII detection, CBOM/SBOM, OPA, Envoy
Infrastructure
Docker, Kubernetes, Kafka, RabbitMQ, Nginx, CI/CD, Prometheus, Grafana
Cloud
AWS, GCP, Azure
Data
PostgreSQL, Redis, MongoDB, SQLite, Pinecone, Chroma, Milvus
Tools
Git, Linux, LiteLLM, Uvicorn, ASGI

Education

Bennett UniversityB.Tech (Bachelor of Technology) in Computer Science - AI SpecializationAug 2023 - May 2027

CGPA 9.47/10, Greater Noida, India

Leadership & Activities