Toronto, Canada · AI & Agent Systems

I build AI agents that finish the job.

Senior engineer working across agent architecture, subagent orchestration, custom models, memory, context, skills, and tool execution—turning ambiguous product ideas into reliable production systems.

Portrait of Soumil Chugh
15filed and granted patents
7peer-reviewed publications
5 yrsat Huawei Research
10+ yrsacross AI, software, and devices
Engineering profile

I work where probabilistic AI meets dependable software: deciding what an agent should reason about, what the system should control, and how the whole loop stays observable, efficient, and useful.

My recent work centers on long-running, context-aware agents that understand intent, delegate work, interact with tools, maintain state, and complete creative or research workflows autonomously.

My foundation is broader: multimodal AI and computer vision at Huawei Research, healthcare ML and wearable sensing, and regulated robotic medical systems.

01
Own the system, not just the model.Architecture, state, tools, evaluation, observability, latency, cost, and user experience.
02
Use agents where uncertainty earns them.Keep deterministic control around open-ended reasoning and make failure recoverable.
03
Measure realistic behavior.Build evals from production-shaped conversations, tasks, and failure modes.
Engineering work / 01—10

Systems I’ve built and the engineering behind them.

Selected company, research, and open-source work across agent infrastructure, long-context memory, multimodal AI, and intelligent products.

02 · Long-context memory

Hierarchical memory that scales with the conversation

Designed a tiered summary tree that indexes older turns. The agent navigates summaries and drills into original turns for evidence instead of carrying one ever-growing transcript.

1000sof turns supported through hierarchical memory

The architecture is designed for conversations spanning thousands of turns while still recovering original source details through multiple summary levels.

Memory architectureRetrievalContext efficiencyEval design
03 · Agent infrastructure

A virtual filesystem as agent working memory

Designed file-backed workspaces that let agents move information out of the prompt without losing access to it. Large tool outputs are written to files and represented in context by compact references, so the agent can search or read only the relevant portion when needed.

The same workspace gives an agent a durable place to track plans and completed work, pass artifacts and findings between subagents and the main agent, and accumulate user or brand knowledge as structured notes rather than repeatedly rebuilding context.

Agents receive explicit file tools for reading, writing, listing, and searching. Because execution happens inside a sandbox, permissions define which paths and operations are allowed, which are blocked, and when broader access requires approval.

Virtual filesystemContext managementSubagent communicationDurable knowledgeSandbox permissions
04 · Distributed agent runtime

Stateless workers with durable execution

Designed agent services so compute workers remain stateless and can scale horizontally. Conversation state, task progress, tool results, and checkpoints are persisted outside the worker at every meaningful execution transition, allowing another worker to safely continue the task.

Jobs are claimed atomically through queue leases and coordination locks so two workers do not execute the same task. Idempotent steps protect against duplicate effects when leases expire or work is retried after a failure.

An in-memory coordination store handles fast locks, heartbeats, and interrupt or cancellation signals, while persistent cloud storage remains the durable source of truth. This makes it possible to resume work after a restart, move execution between workers, or respond when a user changes an ongoing task.

Stateless workersDurable checkpointsQueues & leasesIdempotencyInterrupt & resume
05 · Agent evaluation

Evals that explain why an agent failed

An outcome score says whether a run looked good, but it rarely identifies the cause. I center evaluation on LLM and VLM judges that compare candidate behavior and artifacts against validated reference packages across output quality, tool correctness, execution traces, context, reliability, cost, and latency.

The framework grounds real scenarios into reviewed synthetic references, uses blinded relative grading before absolute scores, and calibrates judge decisions against human preferences before those signals become regression gates.

LLM/VLM judgesReference dataRelative gradingJudge calibrationRegression gates
06 · Agent efficiency

CLI-first tools for lower cost and latency

Compared MCP-style tool integrations with CLI-based execution on equivalent agent tasks. For workflows suited to command-line tools, the CLI approach reduced schema and result payloads, bringing context use and operating cost to roughly one-quarter while improving end-to-end latency by a similar factor.

≈4×lower cost and latency on comparable tasks

A CLI also lets the model compose several commands in one reasoning pass. Complex workflows can often run as one compound execution instead of requiring repeated model-to-tool round trips, intermediate context, and another reasoning step after every action.

CLI toolsMCP comparisonContext efficiencyCost optimizationLatency
07 · Research and workflow agents

Agents that research, browse, and act

At Huawei Research, led work on deep-research RAG, browser workflow automation, intelligent image editing, function calling, and domain-adapted models—combining models, tools, retrieval, and application context.

Deep researchBrowser automationRAGPEFT / LoRA
08 · Vision and healthcare

Research translated into deployable systems

Led gaze-tracking work across VR, mobile, and desktop, improving accuracy by 25% and reducing latency by 50%. Built healthcare ML around smartwatch biomarkers and biological-sample quality, alongside smartphone-controlled robotic blood-testing systems.

Computer visionEye trackingHealthcare MLEmbedded systems
09 · Agent runtime migration

Changing the agent engine without changing the product

Planned the migration of a production co-creator from the Claude Agent SDK to LangChain Deep Agents by making ten product contracts explicit: turns, history, usage, runtime limits, vision, documents, user context, subagents, evaluation, and cutover.

The architecture reused a transport-neutral tool pipeline, removed runtime-specific filesystem assumptions, pinned one runtime per conversation, and made test observability the first dependency.

Deep AgentsRuntime contractsFeature flagsIntegration testingSafe cutover
10 · Open source · Product engineering

AI Interview

A full-stack, multi-agent interview platform I built in 2025 with real-time WebSockets, specialist panelists, live coding analysis, hierarchical interview memory, and evidence-based evaluation.

Experience

Agents, applied research, healthcare, and physical systems.

Senior AI Agent Engineer

Built production creative agents across orchestration, subagents, models, memory, context, skills, tools, multimodal generation, evaluations, reliability, latency, and cost.

Senior AI/ML Research Engineer

Huawei · HMI Lab

Led agent, multimodal, and computer-vision programs spanning browser automation, deep research, image editing, fine-tuning, gesture interaction, and gaze tracking.

Machine Learning Consultant

General Prognostics

Developed healthcare ML pipelines for wearable-data risk prediction and computer-vision quality control.

Senior Software Engineer

Jana Care

Built smartphone-controlled robotic blood-testing systems, including Android BLE and ARM Cortex-M4 software.

Research record
15

Filed and granted patents across agent interaction, gaze tracking, healthcare ML, and computer vision—alongside seven peer-reviewed publications.

MAScComputer Engineering · University of TorontoVR eye tracking
ETRAContrastive self-attention for pupil segmentationPaper ↗
ICPRCorneal-reflection detection and matchingPaper ↗
ThesisAn Eye Tracking System for a Virtual Reality HeadsetDetails ↗
WorkAgent, healthcare, and vision engineering workExplore ↗
Build what comes next

Hard AI systems are usually systems problems.

I’m interested in ambitious agent products where architecture, model behavior, reliability, and product judgment all matter.