Case study

2024Academic project (multi-month)Full-Stack Developer & IoT ContributorCompleted

Computer Vision

An IoT-powered computer vision system that sees, analyzes, and identifies its environment using AWS machine learning services.

Problem

The challenge was to build a system that could visually perceive its environment, process images from hardware devices, and intelligently identify objects—bridging the gap between physical hardware and cloud-based machine learning systems.

Solution

We built an end-to-end IoT computer vision system where an ESP32-CAM captures images, sends them to a backend server, and leverages AWS Rekognition to analyze and identify objects. The system includes a full web interface for testing image analysis, viewing results, and managing stored data.

Responsibilities

  • Built the full web interface for interacting with the computer vision system
  • Developed the backend server to handle requests from both hardware devices and the web client
  • Integrated AWS Rekognition for image analysis and object identification
  • Connected ESP32-CAM hardware to cloud-based ML services
  • Worked hands-on with Arduino boards, ESP32s, Raspberry Pi, and sensors
  • Collaborated on circuit connections and hardware setup with team members
  • Integrated MongoDB for storing analyzed images and results
  • Deployed the frontend and backend to cloud services

Tech stack

ReactTailwind CSSAWS AmplifyNode.jsExpressAWS RekognitionAWS PollyMongoDBESP32-CAMArduinoRaspberry PiSensorsHeroku

Key features

  • Real-time image capture using ESP32-CAM
  • Cloud-based image analysis and object identification
  • Web interface to upload and analyze images manually
  • Database view of all captured and analyzed images
  • Hardware display of captured images and analysis results
  • End-to-end communication between hardware, backend, and web client

Challenges

—

Visuals

Computer Vision web interface
Web interface
Computer Vision image analysis results
Image analysis results
Computer Vision hardware setup
Hardware setup

Notes

Team size: 5. All team members worked on circuit building, sensor integration, and hardware setup; I led the full web interface and backend development. Highlights: integration of physical hardware with cloud-based machine learning, AWS Rekognition custom models for object detection, and hands-on IoT + embedded systems experience.