Work & Research

AI agents, healthcare ML, and computer vision systems with evidence beside the work.

A curated view of public projects, selected private case studies, collaboration work, publications, and patent-backed applied systems.

Public flagshipHopeLoom
Research venuesETRA / ICPR
Applied IP8 patents
FocusAgents + ML
Featured AI Products

Public projects and product case studies.

AI systems spanning real-time interaction, agent orchestration, multimodal understanding, and practical user workflows.

Private projectAI educationLearning tools

ByteMentor

An AI education platform focused on personalized technical learning support, structured practice, and mentor-style guidance for programming concepts.

Private case studyRAGMultimodal AI

AI Agent Platform for Creative Workflows

At Kyoso, developing an AI agent platform for designers and creators that combines brand context, market research, OCR, multimodal LLMs, Graph RAG, tool use, memory, and deep-research workflows to support creative ideation and on-brand visual concepting.

CollaborationPublic repoPresentations

Slideo AI

A collaborative AI presentation-generation project that turns documents into slide decks with document parsing, AI content planning, real-time collaboration, and PowerPoint export workflows.

Agent Systems

LLM agents from applied research environments.

Selected proprietary work is presented as case studies, with technical scope described at a public-safe level.

PrivateLLM agentsPatent-linked

System-Level LLM Agents

Led LLM agent development for system applications such as intelligent image editing and color recommendation tools, combining open models, tool use, and user-context understanding.

PrivateDeep researchRAG

Deep Research Agent

Designed a RAG-based research agent for report creation with smart editing, multi-source merging, automated visualization, and model routing across reasoning and generation models.

PrivateBrowser automationWorkflow agents

Workflow Automation Agent

Built an LLM-based browser automation agent that interprets recorded workflows, reasons over HTML, identifies target elements, and executes actions across websites.

PrivateFunction callingPatent-linked

Gesture Recognition With LLM Function Calling

Integrated gesture recognition models with LLM function calling to interpret stylus gestures and map them to application actions in creative tablet workflows.

Healthcare ML And Devices

Applied machine learning for medical and wearable systems.

Healthcare work includes wearable biomarker modeling, medical imaging, firmware-adjacent systems, and patent-backed device pipelines.

PrivatePatent-linkedWearables

Cardioid Algorithm ML

Machine learning work for heart-risk and renal-risk monitoring using smartwatch biomarker data at General Prognostics.

PrivateSampling algorithmsHealthcare

Smart Sampling

Algorithm work for efficient sampling strategies in medical and wearable data pipelines.

PrivateFirmwareWearables

Watch Firmware

Firmware-adjacent work supporting smartwatch-based sensing and health-data collection workflows.

Public repoMedical imagingCNN

RetiSpec Project

CNN-based binary classification using RGB and near-infrared image inputs, with YACS configuration, TensorBoard logging, and evaluation artifacts.

Case studyPatent-linkedMedical devices

IoT-Enabled HbA1c Medical Device

Robotic and IoT-enabled medical device work for remote HbA1c testing from finger-prick blood samples, including embedded and mobile integration.

Public repoPaper-linkedRetinal imaging

Diabetic Retinopathy

Code related to exudate segmentation in retinal fundus images for diabetic retinopathy detection.

Computer Vision And HCI

Eye tracking, gaze estimation, and visual perception projects.

Computer vision work spanning VR eye tracking, pupil estimation, retinal imaging, scene perception, and human-computer interaction.

Publication-linkedPatent-linkedEye tracking

Advanced Computer Vision for Gaze Tracking

Research and deployment of gaze tracking methods for VR, desktop, and mobile settings, including RGB/IR camera pipelines and accuracy improvements.

Public repoPupil centerCNN

Pupil Center Estimation

CNN architecture for estimating pupil centers from infrared smartphone eye images, including image enhancement experiments and mean pixel error analysis.

Public repoLane detectionSegmentation

Lane Detection

Semantic-segmentation approach to lane detection using BDD100K images, generated labels, model outputs, and feature-map visualizations.

Public repoComputer visionClassification

Emotion Classification

Computer-vision project for emotion classification experiments and model evaluation.

Formal Evidence

Papers, thesis, and patents.

Selected publications and patent-backed systems connected to the project areas above.

Conference
CSA-CNN: A Contrastive Self-Attention Neural Network for Pupil Segmentation in Eye Gaze Tracking
Soumil Chugh, Juntao Ye, Yuqi Fu, Moshe Eizenman | Symposium on Eye Tracking Research and Applications
View paper
Conference
Detection and Correspondence Matching of Corneal Reflections for Eye Tracking Using Deep Learning
S. Chugh, B. Brousseau, J. Rose, M. Eizenman | ICPR 2021
View paper
Thesis
An Eye Tracking System for a Virtual Reality Headset
MASc thesis | University of Toronto | 2020
View thesis
Journal
Exudates Segmentation in Retinal Fundus Images for the Detection of Diabetic Retinopathy
Soumil Chugh, Jaskirat Kaur, Deepti Mittal | IJERT | 2014
View paper
Conference
Low Cost Calibration Free Pulse Oximeter
Soumil Chugh, Jaskirat Kaur | IEEE INDICON | 2015
View paper
Conference
Non-invasive Hemoglobin Monitoring Device
Soumil Chugh, Jaskirat Kaur | ICCC India | 2015
View paper
Conference
Effect of Different Signal Processing Techniques on a Calibration-Free Pulse Oximeter
S. Chugh, A. Akula | I2CT | 2018
View paper
Patent
Multi-modal interaction for selecting semantic regions in agent-based image editing
Yu Zhao, Abby Lu, Soumil Chugh, Che Yan, Yuan Deng | Submitted
Submitted
Patent
Methods for cross-media configuration on virtual keyboard theme
Yu Zhao, Yuan Deng, Soumil Chugh, Che Yan, Wei Li | Submitted
Submitted
Patent
A method for cursor positioning with gaze-assisted pen interaction
Juntao Ye, Shuyang Teng, Soumil Chugh, Andy Chow, Yu Zhao | Submitted
Submitted
Patent
Methods and systems for multi-camera corneal reflection gaze system
Soumil Chugh, Juntao Ye, Moshe Eizenman | Submitted
Submitted
Patent
Methods and Systems for Gaze Tracking using One Corneal Reflection
Soumil Chugh, Juntao Ye, Moshe Eizenman | 92023266PCT01
Patent
Patent
Methods and Systems for Gaze Tracking and Gaze Tracking calibration
Soumil Chugh, Juntao Ye, Moshe Eizenman | 92023211US01
Patent
Patent
Prediction of blood renal diseases using digital biomarkers
Mike, Soumil, Javi, Sean | WO2025106664A1
Patent
Patent
Methods and Systems for Gaze Estimation
Soumil Chugh, Juntao Ye | 92005506US01
Patent
Patent
Methods and systems for gaze-assisted interaction
Soumil Chugh, Juntao Ye, Manpreet Singh | 92026995US01
Patent
Patent
Quality control of user-generated biological sample cards
Michal Depa, Soumil Chugh, Javi, Sean, Sidhant, Theressa | WO2023091455A1
Patent