Local time—
Back to the room

ML & ImpactAndroid app · Accessibility

Drishti 2.0

A voice-first Android assistant for blind and low-vision users

Status
Prototype
Year
2026
Rooms
ML & Impact
Drishti 2.0 app icon

Drishti 2.0

  • On-device object detection
  • Scene question answering
  • OSRM outdoor navigation
  • SOS with GPS via Firestore & email

Problem

Screen readers make phones usable, but they don't describe the room, the obstacle ahead or the bus stop across the road.

Approach

A native Android app with a conversational, screen-reader-free dashboard: on-device object detection, questions about the camera feed, outdoor routing, and an SOS that shares GPS location.

Engineering decisions

  • Object detection runs on-device (MediaPipe EfficientDet-Lite0), so the core feature works offline.
  • Voice first: every feature is reachable without looking at the screen.
  • Earlier React prototypes (drishti-web-app, drishti-ai-frontend) are kept as history, not counted as separate projects.

What it does

  • On-device object detection
  • Scene question answering
  • OSRM outdoor navigation
  • SOS with GPS via Firestore & email

Stack

  • Kotlin
  • Jetpack Compose
  • MediaPipe Tasks Vision
  • Room
  • Firebase
  • Retrofit

My part

Repository owner; all commits in the Android repository are mine.

Limits, stated plainly

  • Assistive technology prototype — not a guarantee of safe navigation.
  • Scene Q&A needs a network connection and an API key.

Evidence

  • Drishti-2.0-app README
  • drishti-web-app README (earlier prototype)