Communication
without barriers.

A wearable system that connects visually impaired and speech-impaired individuals through gesture, speech, and touch — running entirely offline.

See how it works View source
Visora — Smart Glasses
Glove A — Gesture to Speech
Glove B — Speech to Braille
0
People with vision impairment
0
People with hearing impairment
0
With speech difficulties
0
Integrated modules
0
Offline operation
0
Communication

Global Need for Assistive Technology

Millions of people need accessible communication solutions

0 1B 2B 3B 2019 2021 2023 2025 2026 Vision Impairment Hearing Impairment Speech Difficulty
Source: WHO Global Report on Vision & Hearing; World Health Organization
The Problem

Millions struggle to
communicate daily.

285 million people worldwide live with visual impairment. Millions more face speech and hearing challenges. Existing assistive devices are often expensive, limited, or need constant internet.


Gesture Link is built to work differently — it's wearable, offline, and enables real-time two-way communication between users through gesture, speech, and tactile feedback.

✋

Gesture Input

Flex sensors detect finger bends and hand orientation

🔊

Speech Output

Gestures are matched to pre-recorded audio phrases

⟿

Braille Vibration

Speech is converted to tactile Braille patterns on the hand

System Modules

Three modules, one system.

👓

Visora

ESP32-S3 Sense

AI-powered smart glasses that detect objects, recognize colours, and give audio feedback to visually impaired users.

Real-time object detection via camera
Colour recognition (OpenCV + webcolors)
I2S audio output through MAX98357A
1.8" TFT display for status and data
Heart rate and SpO2 monitoring
✋

Glove A

ESP32-C6 · Gesture to Speech

Converts hand gestures into spoken phrases using flex sensors and a 6-axis IMU. Audio plays through DFPlayer Mini — no internet required.

4 flex sensors for finger bend detection
6-axis IMU for hand orientation
Offline audio via DFPlayer Mini
OLED display with health graphs
Wi-Fi dashboard for remote data
🤚

Glove B

ESP32 Dev · Speech to Braille

Captures speech through an I2S microphone and converts it to tactile Braille vibration patterns using 12 vibration motors.

INMP441 microphone at 16kHz mono
12 vibration motors in Braille layout
6-dot Braille binary pattern mapping
Push-to-record button interface
OLED with real-time Braille output
Interactive Demos

See each module in action.

Click a tab below and hit play to watch an animated walkthrough of how each module works.

Idle
IMU
Index
0
Middle
0
Ring
0
Little
0
IMU
X: 0.0 Y: 0.0 Z: 9.8
🔊
☕
Cup — 94%
🔑
Keys — 89%
⬤
Colour: Red
MODE: DETECT
24 FPS
Redrgb(255, 107, 107)
Tealrgb(78, 205, 196)
Yellowrgb(255, 230, 109)
🎤
Tap to speak
➜
Waiting for speech...
➜
⟿
Braille output
12 Vibration Motors — 4 Fingers × 3 each
IndexMiddle
RingLittle
💡
Web Speech API: If you get a "Network error" (especially on Brave Browser), make sure "Use Google Services for speech recognition" is enabled in your settings, or try standard Google Chrome / Safari.
Capabilities

Built for real use.

🔌

Fully Offline

No internet, no cloud, no delays. Everything processes on-device for privacy and instant response.

🔃

Two-Way Communication

Gesture to speech and speech to Braille — connecting speech-impaired and visually impaired users both ways.

🎨

Colour Recognition

Camera-based colour detection using OpenCV that maps RGB values to human-readable colour names in real time.

🩹

Health Monitoring

Continuous heart rate and SpO2 tracking through the MAXREFDES117 bio-sensor across all modules.

🌐

Multilingual

Language selection interface supports multiple languages for broader accessibility and global reach.

📡

Remote Dashboard

Glove A serves live sensor data as JSON over Wi-Fi, enabling remote health monitoring from any device.

Technical Specs

What's inside.

Component Qty Module Purpose
ESP32-S3 Sense 1 Visora Main controller with camera
ESP32-C6 1 Glove A Gesture processing controller
ESP32 Dev Module 1 Glove B Speech and Braille controller
ST7735 TFT (1.8") 1 Visora Status and visual feedback display
OLED Displays 2 Gloves Health data and sensor readings
Flex Sensors 4 Glove A Finger bend detection
6-Axis IMU 1 Glove A Hand orientation tracking
INMP441 Microphone 1 Glove B I2S speech capture at 16kHz
Vibration Motors 12 Glove B Braille tactile output matrix
MAX98357A Amplifier 1 Visora I2S audio output
DFPlayer Mini 1 Glove A Offline MP3 audio playback
MAXREFDES117 1 All Heart rate and SpO2 monitoring
DHT11 Sensor 2 All Temperature and humidity
Circuit Design

Detailed schematics for each module.

Complete circuit diagrams showing component connections, pin assignments, and signal flow.

Visora

Smart Glasses Circuit

VISORA circuit diagram

Main Controller: ESP32-S3 Sense

Key Connections: Camera → Object detection, TFT display, I2S audio amplifier, DHT11 sensor, MAXREFDES117 bio-sensor

Glove A

Gesture to Speech Circuit

GLOVE-A circuit diagram

Main Controller: ESP32-C6 Xiao

Key Connections: Flex sensors (4×), 6-axis IMU, DFPlayer Mini, OLED display, bio-sensor

Glove B

Speech to Braille Circuit

GLOVE-B circuit diagram

Main Controller: ESP32 Dev Module

Key Connections: INMP441 microphone, 12 vibration motors (Braille matrix), OLED display, bio-sensor

Bill of Materials

Complete component reference guide.

Bill of Materials - Components used
3
Microcontroller Units
15+
Individual Components
100%
Open-Source Friendly