- Architected and shipped a production-grade AI security gateway as sole owner across backend, frontend, DevOps, cloud deployment, and scaling — centralized pre/post-LLM security (SHA-256 auth, PII detection, prompt-injection mitigation) across 500+ endpoints, scaled with async concurrency to 100k+ RPS at a 99% reduction in unsafe LLM behavior.
- Drove critical feature expansion on an application-security (DevSecOps) platform — introduced CBOM scanning coverage, shipped AI-powered vulnerability remediations that cut manual triage time by 60%+, and optimized platform performance by 40%+.
- Engineered core features on an endpoint AI-governance solution guarding against sensitive-data exfiltration across 5+ widely-used enterprise AI tools — a lightweight agent + local-proxy architecture serving 1000+ enterprise endpoints.
Ansh Singhal
AI/ML & Backend Engineer
India+91-8929554991anshsinghal3107@gmail.comgithub.com/AnshSinghallinkedin.com/in/anshhh-singhalanshsinghal.dev
Summary
AI/ML and backend engineer specializing in production large language model (LLM) systems, retrieval-augmented generation (RAG), and low-latency, high-throughput infrastructure. Sole owner of an AI security gateway scaled with async concurrency to 100k+ RPS across 500+ endpoints at a 99% reduction in unsafe LLM behavior; lead of an independent zero-day discovery engine at 100% recall and 93% precision across four package ecosystems; builder of an agentic RAG engine over 10,000+ legal documents at 97% retrieval accuracy and sub-500ms P95, and a real-time voice-streaming backend holding sub-200ms across 100+ concurrent sessions. Proficient in Python, FastAPI, PyTorch, LangChain, LangGraph, Kafka, vector search, and cloud infrastructure (Docker, Kubernetes, AWS, GCP, Azure). B.Tech Computer Science (AI Specialization), Bennett University, CGPA 9.47/10.
Experience
- Contributed 4 production security analyzers to IntelOwl, an open-source threat-intelligence platform used by security teams worldwide, expanding automated threat-detection coverage by 23% across IP addresses, file hashes, and URLs.
- Added pytest-based validation suites to improve analyzer reliability and regression protection.
- Fixed Django migration and data-consistency issues, improving migration success to 99.9%.
- Resolved Docker networking and caching issues to improve deployment stability and analyzer execution.
Projects
- Architected and shipped a production AI security gateway as sole owner across backend, frontend, DevOps, cloud, and scaling — pre/post-LLM security (SHA-256 auth, PII detection, prompt-injection mitigation) fronting 500+ endpoints.
- Scaled with async concurrency from 100 to 100k+ RPS at a 99% reduction in unsafe LLM behavior.
- Leading and building from scratch an independent zero-day research engine across 4 ecosystems (npm, MCP servers, Docker images, Hugging Face models), with 50+ custom static-analysis engines (zero open-source libraries) mining 49,522 signals from live registry traffic against 228,020 known-malicious packages.
- Designed a multi-stage LLM triage pipeline at 100% recall and 93% precision, zero false positives on the OSSF malicious-packages corpus, at a 15x cost reduction over baseline.
- Built an agentic RAG engine over 10,000+ legal documents at 97% retrieval accuracy, with multi-agent query decomposition, reranking, and deterministic grounding.
- Served citation-traced answers at sub-500ms P95 on AWS containerized microservices.
- Built a real-time voice-streaming backend holding sub-200ms latency for 100+ concurrent sessions, with Kafka consumer groups and Kubernetes HPA backed by PostgreSQL, MongoDB, and Redis.
- Tracked consumer lag and P95 latency to monitor performance across the distributed streaming pipeline.
- Designed a dual-head U-Net translating all-weather SAR radar to optical flood imagery at 1024x1024, using NDWI water-index supervision so flood boundaries are learned as water, not texture.
- Reached FID 28.4 / PSNR 31.25 / SSIM 0.94 with EMA-stabilized adversarial training over ~200 GPU-hours, every run tracked in Weights & Biases.
Skills
- Languages
- Python, Java, C++, SQL, JavaScript
- AI / ML
- LLMs, Agentic RAG, LangChain, LangGraph, LlamaIndex, Hugging Face, PyTorch, TensorFlow, spaCy, NLP Pipelines
- Backend
- FastAPI, Django, DRF, Flask, Spring Boot, Celery, Django Channels, WebSockets, REST APIs, JWT Auth
- Security
- Presidio, llm-guard, OWASP LLM Top 10, Prompt-injection mitigation, PII detection, CBOM/SBOM, OPA, Envoy
- Infrastructure
- Docker, Kubernetes, Kafka, RabbitMQ, Nginx, CI/CD, Prometheus, Grafana
- Cloud
- AWS, GCP, Azure
- Data
- PostgreSQL, Redis, MongoDB, SQLite, Pinecone, Chroma, Milvus
- Tools
- Git, Linux, LiteLLM, Uvicorn, ASGI
Education
CGPA 9.47/10, Greater Noida, India
Leadership & Activities
- GDG Bennett University — Co-organizer · 12+ events, 4,000+ participants
- Rotary International Youth Advisory Council — Member · sole Asia representative
- Entrepreneurship Cell — Joint Secretary · 15+ student startups supported