Non-Visual Interaction with Touchscreen
[Project funded by the British Council, UK]
Aim: To examine whether the UK blind user(student) can interact with touch screen courseware applications along with the sighted user.
Scope: Visually impaired client(Blind by birth)
Problem:
When the blind students search for a particular section in touch screen based course text material application using a Voice-over, the search returns the voluminous list which students are not able to access the required information quickly.
The blind students are not able to control the course content such as listening to the sentence or section repeatedly using a screen reader.
Solution :
1. Examine the psychological model of the visually impaired client while interfacing with the touch screen textbook item
2. Propose the new products which can speedup to access required information.
Approach:
1. Information about existing product was collected using qualitative analysis such as literature review. Then survey was conducted with special educators and analysed thematically based on their input. Afterwards, based on the themes, the interview questions were framed and conducted one-to-one interview(unstructured). Finally, the trial was conducted to observe their interaction with the touchscreen using think-aloud protocol.
2.The research plan was drafted.
3. Low Fidelity prototype was designed using above mentioned qualitative analysis
4. Visual design was shown to sighted people who has a good understanding of the needs of the blind user
5. Formative experiments was directed before the usability testing of high fidelity prototype.
6. Discoveries were made based on quantitative analysis such as task completion time & number of click, and qualitative analysis interview and feedback about the proposed products
Result :
The proposed product was liked over than existing traditional(voice-over) model by visually impaired client.
My Role:
Involved in all the phase of the development.
Introduction
Presently, the visually impaired client access the item implied for the touchscreen with assistive technology, for example, a screen reader. The screen reader assists them with reading the substance of the page. Albeit, how the page was designed, the visually impaired client can't get to the necessary data most quickly yet stand by until the screen reader peruses the necessary data. Moreover, the designers can't see how mentally daze clients identified with the item.
So, How would I be able to begin?
Toward the beginning of the undertaking, I confronted two difficulties to devise the inventive interaction particularly identified with how they cooperate with the touch screen item:
1. What are the segments needed to build up the clairvoyant model of the visually impaired client utilizing touch screen gadgets?
2. What are the issues relating to ease of use that can be gotten from recognized segments which contrast from the customary convenience?
To investigate the appropriate response, I have conducted an experiment to reach the target name with 10 visually impaired clients utilizing the Samsung Galaxy S2 device.
Research Method used: Observation during Task Performance - Thinking Aloud is encouraged .
My Initial Findings....
Incredibly, I tracked down that the psychological model is impacted by three segments:
1. Interaction
2. Listening and
3. Error Occurred
Figure 1. The different process undergone by the blind user while listening to the information
In view of these three components, I attempted to determine the other ease of use(usability) highlights. Figure 1 shows diverse action of the segments and Figure 2 shows the diverse usability features to be adopted for each segments.
Figure 2. Other usability features which affects when blind user interact with touch screen through identified segments - Listening, interaction and Error.
What investigation suggests?
The experiment throw the light that the blind user not able to reach the target information quickly designed for sighted user. The alternative way of interaction and content management according to the interaction will solve the crisis.
Gradually I move towards discovering the solution...
I set out to plan two creative ways for interacting with the touch screen item to guarantee [Product] envelops top-tier ease of use and feel across all edges of the application.
I drove the venture and chipped away at all parts of the plan thinking measure incorporating empathizing to the client, characterize & ideate, prototype, and testing by blended methodology(Quantitative and Qualitative).
In light of the above input, I attempted to devise two interaction techniques that will improve to navigate the target section most rapidly in text material application since it contains numerous chapters with a ton of subheadings under.
To execute the course reading route, I proposed two products:
1. Linear route (control-based) and
2. Tree–like navigation(Finger based).
In this way, How I will play out the design?
To design the interactive technique,
1. I have made the paper model based on the earlier experiment and got an endorsement from the special educator.
2. Afterward, a low fidelity model (see Figure 3a and 3b) was made. Upon fulfillment from the located special educator, I have made the high-fidelity model(see Figure 3c).
3. Usability testing was directed with the 20 visually impaired clients for 3 models (control, Finger, and Voice-over). The research plan strategy appeared in Figure 4.
Figure 3A. Tree Structure to be implemented with Chapter A and Chapter B with subsequent headings. [b] Linear Structure of [a]. [c] Actual implemented Tree Structure in Touch Screen Through Two Buttons namely A and B. The Number in the Square Bracket indicates the depth of navigation.Tree Structure to be implemented with Chapter A and Chapter B with subsequent headings. [b] Linear Structure of [a]. [c] Actual implemented Tree Structure in Touch Screen Through Two Buttons namely A and B. The Number in the Square Bracket indicates the depth of navigation.
Figure 3B. Control Design
Figure 3C. High fidelity during initial stage
Figure 4. Research Design Plan
What information I gathered in usability testing?
I have collected the data both qualitatively and quantitatively. I likewise performed measurable testing to comprehend the degree of learnability, understand-ability, and operability of the visually impaired client to receive the new communication strategies. Figure 5a shows which quantitative data was collected and Figure 5b explains how the capture data was statistically analysed using IBM SPSS software.
Figure 5a. Usability Metrics
Figure 5b. Step-wise procedure for analyzing the captured data
I'm stunned to see the outcome of the usability testing...
My finding tossed a goliath spanner underway. I understood my presumption—that voice-over method will be a lot simpler than proposed strategy—was dead wrong(see Figure 6a). The stunning outcome shows that utilizing finger procedure the visually impaired client had the option to achieve the undertaking a lot of operable, understandable and learnable contrasted with control and voice-over strategy(see Figure 6b).
Figure 6a. Statistical analysis about the user performance during task execution [TAT - Target Acquisition Time, NAC - Number of Click] using p-value analysis.
Figure 6b. Figure shows what extend the new user can learn, understand and operate the new product.
What does the client say about the new interaction method with the customary voice-over strategy?
Additionally, I took client input subsequent to testing the model and determined the position genuinely utilizing Shapiro-Wilkson technique. The clients inclination was blended among finger and control method(see Figure 7).
Figure 7. User Feedback about the new products
What I'm attempting to uncover to society by this task?
At long last, I was eager to the point that I have taken in something from the extraordinary client through the design thinking measure, ready to disperse my work by publication(see Figure 8a), and has added to society fundamentally through this undertaking(see Figure 8b).
Figure 8a. Details of Publications
Figure 8b. Contribution to the society
Still more to be explored ...
