SWASTIK MAHAMUNIsoftware × AI
All Work
[02] // CASE STUDY
Edge AI & Computer Vision[ Prototyped ]

AUMByte

Edge AI Crop Disease Detection System

1st Place Winner — Indian Electronics & Innovation League (IEIL)

An offline-first edge AI system engineered for agricultural micro-plots where persistent internet connectivity cannot be assumed. Combines on-device camera inference with automated cellular SMS advisories.

Core Competencies & Focus
Edge AIComputer VisionAgricultural TechEmbedded SystemsCellular SMS
BOTANICAL GEOMETRY // 16:10
OPTICAL CANOPY ROI
[01] //SECTIONProblem Definition

The Agricultural Connectivity Gap

Timely foliar diagnosis constrained by rural telecom deserts

Early visual identification of plant pathogens is critical to containing crop diseases before localized foliar infections devastate entire yields. However, smallholder farms, orchards, and rural micro-plots frequently exist in connectivity deserts with intermittent or absent broadband.

Standard precision agriculture platforms rely on sending raw images to cloud-hosted machine learning endpoints. In rural agricultural settings, this dependency creates a brittle point of failure: when connectivity drops, diagnostic capabilities halt entirely.

01 // Cloud Dependency Fragility

Rural 2G/3G networks struggle to transmit high-resolution camera images offsite, introducing delays or complete upload timeouts during critical inspection windows.

02 // Adoption Friction

Solutions requiring complex smartphone apps, account logins, and constant data plans create significant operational barriers for smallholder growers.

[02] //SECTIONCore Pipeline

Moving Intelligence to the Field

Camera acquisition to automated alert execution chain

Conventional precision agriculture solutions frequently depend on cloud computer vision backends, requiring high-bandwidth cellular links to stream images. In rural micro-plots and orchards, connectivity deserts cause these systems to fail during critical infection windows.

// Design Principle: Shift computational intelligence directly to the physical field device.

// ON-DEVICE COMPUTATION FLOWSequential Processing Chain
Edge AI InferenceModel Execution
Host: On-Device Model

Evaluates the normalized crop image directly on localized compute without external cloud roundtrips.

Engineering Rationale: Guarantees evaluation even when rural telecom towers are unreachable or offline.

[03] //SECTIONEdge AI Architecture

Edge-First Computation Topology

Localized inference over remote cloud roundtrips

AUMByte was architected around the core engineering hypothesis that agricultural intelligence must operate reliably at the point of capture. Instead of treating field hardware as a dumb camera streaming frames across the internet, the local edge unit houses the trained detection model directly.

Zero Cloud Dependency

Leaf evaluation occurs locally in device memory, unaffected by external server outages, API rate limits, or network downtime.

Immediate Local Feedback

Processing occurs in real time at the plant canopy level, removing roundtrip network latency from the diagnostic cycle.

Minimal Energy Overhead

Evaluating a frame locally consumes far less power than maintaining continuous high-bandwidth wireless video transmitters in the field.

[04] //SECTIONVision System

Computer Vision Foliage Inspection

Canopy viewfinder framing and symptom region localization

// COMPUTER VISION INTERFACE VIEW

Foliage camera viewfinder layout with localized symptom bounding

[ PROTOTYPE INTERFACE · NO FABRICATED CONFIDENCE VALUES ]
AUMByte computer vision leaf canopy analysis viewfinder
ROI // PATHOGEN_DETECT
OPTICAL INSPECTION VIEW // HUDFILTER: Pathogen ROI Bounding
Active Diagnostic Layer: Pathogen ROI Bounding

Localized bounding box isolating foliar lesions (e.g. Cercospora leaf spot symptoms).

[05] //SECTIONAlert Channel

Offline Resilience & Cellular SMS

Lightweight advisory channel engineered for universal access

Agricultural micro-plots and orchards frequently exist in fringe reception areas where heavy cloud apps and video feeds are unusable. AUMByte was designed to reduce dependence on continuous broadband internet connectivity by isolating the heavy vision computation locally and using SMS as a lightweight alert vector.

// Plain-text SMS operates over minimal cellular signal thresholds, enabling automated alerts without smartphone prerequisites.

01 // On-Device EvaluationLocal Silicon

Model runs directly on local edge hardware immediately following camera trigger, eliminating external transmission dependencies.

02 // Payload SerializationMicrocontroller Bridge

Detection classification is compressed into a compact, plain-text advisory payload formatted for standard cellular modems.

03 // Cellular Modem TransmissionGSM / AT Commands

Dispatched through embedded cellular hardware using standard serial AT command handshakes over available base station links.

04 // Direct Grower ReceiptUniversal Reach

Delivered directly to the grower's handset as a standard text message, functioning equally well on basic feature phones.

CELLULAR SMS ADVISORY
PLAIN TEXT
SENDER: AUMBYTE ADVISORYPRIORITY: ALERT

“AUMByte Advisory: Foliar inspection in Plot B indicates localized Cercospora leaf spot symptoms on upper canopy foliage. Recommend visual confirmation and targeted intervention before next irrigation cycle.”

DELIVERY: CELLULAR SMSSTATUS: DELIVERED
[ CONCEPTUAL ADVISORY MESSAGE · NO PII / NO FAKE PHONES ]
[06] //SECTIONEmbedded Hardware

Physical Hardware Integration

Coupling optical sensors, edge compute, and cellular modems

AUMByte integrates software intelligence directly with field-deployable embedded hardware. The physical architecture is structured to maintain clear operational boundaries between optical acquisition, localized inference computation, system orchestration, and cellular dispatch.

01 // SUBSYSTEM

Optical Camera Unit

Perception & Acquisition

Frames and acquires leaf canopy surfaces under ambient field illumination.

Hardware Interfaces
MIPI-CSI / USB InterfaceDirect Frame Capture
02 // SUBSYSTEM

Edge Compute Unit

Inference Engine

Hosts local computer vision models to perform on-device foliar classification without cloud roundtrips.

Hardware Interfaces
Local Model MemorySerial Inter-Process Bridge
03 // SUBSYSTEM

ESP32 Controller

Hardware Orchestration

Manages system triggering, power states, sensor scheduling, and serial modem handshakes.

Hardware Interfaces
UART Serial ProtocolGPIO Triggers
04 // SUBSYSTEM

Cellular GSM Modem

Communication Channel

Executes AT command sequences to transmit plain-text advisory SMS over available cellular base stations.

Hardware Interfaces
Standard SIM SlotAT Command Interface
[07] //SECTIONVerified Stack

Engineered Technology Stack

Strictly verified technologies utilized in the AUMByte prototype

[01] // DOMAIN

Vision

Computer VisionYOLO

Optical frame processing and foliar symptom bounding.

[02] // DOMAIN

Edge AI

Edge AILocal Inference

On-device model evaluation bypassing external cloud dependencies.

[03] // DOMAIN

Hardware

ESP32Camera Unit

Microcontroller coordination, image acquisition, and peripheral control.

[04] // DOMAIN

Comms & Core

SMS AlertsPython

Serial AT-command cellular alert dispatch and core scripting runtime.

[08] //SECTIONEngineering Role

Personal Contribution & Engineering Role

Direct technical ownership across architecture, vision, and hardware integration

As the technical lead on the AUMByte project, my contributions spanned system architecture definition, computer vision prototyping, and physical embedded integration:

01 // System Architecture[ Architecture Design ]

Designed the overall edge-first architectural topology, establishing the decoupled interfaces between camera intake, local inference compute, and modem notification.

02 // Computer Vision Workflow[ Vision Engineering ]

Developed the camera-to-inference pipeline, calibrating region-of-interest extraction and foliar symptom bounding for variable field lighting conditions.

03 // Edge Hardware Integration[ Embedded Systems ]

Contributed to interfacing the optical camera sensor, local compute module, and ESP32 microcontroller to enable cohesive on-device triggering.

04 // Alert Workflow & Modem Logic[ Cellular Alerting ]

Engineered the inference-to-SMS alert sequence, implementing serial AT command routines to format and transmit concise diagnostic advisories over cellular networks.

05 // Field Prototype Demonstration[ Competition Defense ]

Assembled the integrated working prototype unit and delivered the live technical defense at the Indian Electronics & Innovation League (IEIL).

[09] //SECTIONAchievement

Competition Validation

National recognition at the Indian Electronics & Innovation League

COMPETITION VALIDATION // NATIONAL RECOGNITION

1st Place Winner — Indian Electronics & Innovation League (IEIL)

Awarded first prize at the national IEIL competition for demonstrating a working embedded prototype capable of on-device foliage diagnostics and automated SMS dispatch, proving the viability of offline edge AI in connectivity-constrained agricultural environments.

Standing1st PlaceIEIL National
[10] //SECTIONStatus Verification

Current Project Status

Factual position within the engineering lifecycle

LIFECYCLE STATE:[ PROTOTYPED ]
Field Prototype Stage

AUMByte was successfully prototyped and validated at the competition level, confirming the feasibility of offline edge foliage classification and automatic cellular SMS alert dispatch.

The project remains a working hardware-software prototype. It is not currently deployed commercially, nor operates as an active large-scale farm network.

STAGE 01Concept FormulationCompleted
STAGE 02Vision PrototypeValidated
STAGE 03Hardware IntegrationPrototyped (IEIL)
STAGE 04Commercial ScaleNot Commenced
// NEXT SYSTEM CASE STUDY
Robotics & Embedded Systems

VYOM

Autonomous Industrial Mobile Robot