An app feature that uses AI and OCR to help over 75 million students

An app feature that uses AI and OCR to help over 75 million students

Role

Product Designer

Team

Sooraj Premkumar, UX Lead

Nitin, Product Designer

Skills

Visual Design

Interaction Design

Prototyping

Timeline

2 months

Overview

Overview

Instant answers from a photo

Instant answers from a photo

Ask a Doubt feature enabled over 75M BYJU’S learners to get instant answers to academic questions by taking a photo. Using OCR + AI, the feature identified the question, surfaced accurate solutions, and linked them to the exact chapter and topic.

My work focused on refining this experience to make the journey from question to answer faster, clearer, and more reliable for students.

Ask a Doubt feature enabled over 75M BYJU’S learners to get instant answers to academic questions by taking a photo. Using OCR + AI, the feature identified the question, surfaced accurate solutions, and linked them to the exact chapter and topic.

My work focused on refining this experience to make the journey from question to answer faster, clearer, and more reliable for students.

Problem

Problem

Students struggled to get fast, accurate academic answers.

Students struggled to get fast, accurate academic answers.

User feedback from app reviews, Slack threads, and community discussions showed couple of core issues:

User feedback from app reviews, Slack threads, and community discussions showed couple of core issues:

IRRELEVANT RESULTS

Search answers were outdated or mismatched, causing confusion and wasted study time.

HIGH INPUT EFFORT

Typing complex questions led to errors, slow submissions, and repeated attempts.

Target users

Target users

Who we designed for

Who we designed for

Our primary users were students across middle school to senior secondary levels who relied on digital platforms for homework, concept revision, and exam preparation.

Our primary users were students across middle school to senior secondary levels who relied on digital platforms for homework, concept revision, and exam preparation.

Meet John, our primary user

GOALS

Kiran wants fast, reliable explanations that help them understand concepts deeply and score higher in exams.

FRUSTRATIONS

Kiran gets frustrated when answers are slow, unclear, or irrelevant, causing wasted time and lost study focus.

Discovery insights

Discovery insights

What we learned from research

What we learned from research

We wanted to understand why students struggled to get the answers they needed, and what slowed them down during study or homework. To do that, we gathered input from interviews, surveys, competitive audits, and real user feedback.

We wanted to understand why students struggled to get the answers they needed, and what slowed them down during study or homework. To do that, we gathered input from interviews, surveys, competitive audits, and real user feedback.

User interviews

Students struggled to format questions correctly, leading to irrelevant or missing answers.

IMPACT

We prioritised image-based input and OCR accuracy to reduce effort and improve relevance.

Survey analysis

Most students wanted instant answers while studying or doing homework, not long explanations or links.

IMPACT

We focused on fast, chapter-linked answers to support efficient studying and homework.

Competitive analysis

Apps like Photomath and Brainly set strong expectations for camera-based answers, but lacked depth beyond math.

IMPACT

We saw opportunity to differentiate through multi-subject precision and stronger contextual relevance.

Customer feedback

Reviews showed frustration with irrelevant results, outdated content, and difficulty using screenshots or diagrams.

IMPACT

We improved accuracy, visual clarity, and support for complex question formats and diagrams.

What data revealed at scale

Strategy and key decisions

Strategy and key decisions

Making question capture fast, intuitive, and error-proof

Making question capture fast, intuitive, and error-proof

Research showed that students needed faster access to answers, clearer guidance while submitting questions, and flexibility beyond image-only input.

Research showed that students needed faster access to answers, clearer guidance while submitting questions, and flexibility beyond image-only input.

Ideations

Ideations

Exploring paths before committing to the final direction

Exploring paths before committing to the final direction

We tested multiple design directions to remove friction, increase clarity, and make asking a doubt effortless.

We tested multiple design directions to remove friction, increase clarity, and make asking a doubt effortless.

Concept 1: Original flow (Baseline idea)

The first approach introduced a camera-based query system that allowed students to upload images of questions and receive answers directly.

The first approach introduced a camera-based query system that allowed students to upload images of questions and receive answers directly.

WHY THIS WAS VIABLE

It offered a simple one-step image capture flow, reducing typing effort and aligning naturally with how students share questions offline.

OBSERVED LIMITATIONS

The non-fixed button placement made it difficult to access while scrolling, no guidance was available during input, and typing was not supported.

~30% usability readiness

Concept 2: Improved usability

The second concept focused on improving clarity, access, and flexibility by introducing button persistence, onboarding guidance, and multiple input options.

The second concept focused on improving clarity, access, and flexibility by introducing button persistence, onboarding guidance, and multiple input options.

WHY THIS WAS VIABLE

Students could now locate the button easily, understand how to start, and choose between taking a photo or typing.

OBSERVED LIMITATIONS

The scanner flow still required refinement for accuracy and speed, and students needed clearer feedback during capture and submission.

~65% usability readiness

Solutions

Solutions

Problem-solving, simplified and accelerated

Problem-solving, simplified and accelerated

Each solution removes barriers in the journey, helping students move from doubt to understanding with less effort and more confidence.

Each solution removes barriers in the journey, helping students move from doubt to understanding with less effort and more confidence.

Guided first-time onboarding

Guided first-time onboarding

A short FTUE walkthrough removes confusion, teaching students how to scan, solve, and navigate the feature confidently.

A short FTUE walkthrough removes confusion, teaching students how to scan, solve, and navigate the feature confidently.

Instant step-based answers

Instant step-based answers

Students snap a question and receive clear, structured steps, helping them understand how to solve problems independently.

Students snap a question and receive clear, structured steps, helping them understand how to solve problems independently.

Typed input + smart tagging

Typed input + smart tagging

Students can type questions and pick subjects and tags, improving relevance and accuracy when images fail.

Students can type questions and pick subjects and tags, improving relevance and accuracy when images fail.

Built-in content feedback loop

Built-in content feedback loop

Thumb ratings and issue reports help refine solutions continuously, increasing answer reliability and trust over time.

Thumb ratings and issue reports help refine solutions continuously, increasing answer reliability and trust over time.

Seamless tutor escalation

Seamless tutor escalation

When automated answers aren’t enough, students can switch to live expert chat without losing context or progress.

When automated answers aren’t enough, students can switch to live expert chat without losing context or progress.

Impact

Impact

Learnings

Learnings

DESIGNING WITH AGILE

Frequent iteration cycles helped me adapt quickly, validate decisions with real feedback, and move forward confidently amid shifting requirements.

WORKING WITH AI IN 2021

Early AI experimentation required designing clarity, trust, and usability into unfamiliar interactions for students using new technology.

You can connect with me through

Made with ♡ & coffee chai.

Get in touch on

© Gaurav Singh

4:12:29 AM

You can connect with me through

Get in touch on

© Gaurav Singh

4:12:29 AM

Made with ♡ & coffee chai.

You can connect with me through

Made with ♡ & coffee chai.

Get in touch on

© Gaurav Singh

4:12:29 AM