Accesibility challenges, tools and applications Spanish accessibility workshop in Madrid 28/09/2011 AEGIS project - www.aegis-project.eu ACCESSIBLE project - www.accessible-project.eu

1. active ageing
Design4U MOBILISING SOCIAL CHANGE
SUPER MOBILE
TRUST SPEED
mobile ABILITY communication ABILITY INTERACTION
TO YOU
POWER
SUPER MOBILE mobile CUSTOMER OBSESSED
The
SIMPLICITY
accessibility ABILITY INNOVATION HUNGRY mobile
Independent Living
Vodafone Design4All
Difference
POWER PEOPLE
communication
World of
TO YOU PERSONA
Responsability Way AMBITIOUS AND COMPETITIVE
CAPACITY
ABILITY ONE COMPANY, LOCAL ROOTS
FOR ABILITY
RESPONSE Mobiles for Good accessibility Telecoms for Good
Accessibility challenges, tools and
application
Madrid, 28th September 2011
1 28th September 2011

2. Overview
• Motivation
• Accessibility Requirements
• Accessibility support in the Android Platform
• Try it yourself
• Assisstive Technologies
• Screen reader
• Alternate text entry systems
• Accessible application
• Simulation tools
• More developer resources
2 28th September 2011

3. Motivation
• There are more users that are looking to use your
applications!
• Make a difference to your users:
• Applications “mostly” work out of the box for blind /
low- vision users
• Make Android applications usable in more user
contexts
3 28th September 2011

4. Changing how we use the technology
• Mobile devices can sense the user’s environment
• Can provide feedback via a multiplicity of modalities
• Has a profound impact on independent living
• People with special needs are usually early adopters of
technology
• Don’t think only of users with disabilities, think of the
elderly
4 28th September 2011

5. Accessibility support in the Android Framework
• Accessibility is built into the platform
• Framework and API provides out of the box accessibility
support to applications that use standard Android view
elements
• Text-to-Speech engine built-in
• No impact in terms of performance. Nothing happens
until the accessibility is enabled
• Accessibility Events can be delivered as voice output,
haptic feedback, Braille,…
5 28th September 2011

6. Still have to do a few things
• Allow Navigation with a Directional Controller
• Controlling focus order
• Clicking with a directional controller
• Virtual D-pad where there is no physical d-pad
• Label the Input Widgets
• Images (ImageButton)
• Editable text (EditText)
• Use the platform's built-in widgets and layouts
whenever possible
• If the application requires to create custom components,
you may need to do some additional work
6 28th September 2011

7. Features of an Accessible Android View
• Respond consistently to D-Pad / trackball interaction
• Sets focus correctly as selection changes
• Raises Accessibility Events during user interaction
7 28th September 2011

8. SET UP – JUST BEFORE STARTING
TalkBack: settings – accessibility . On
Tekla: settings – language and keyboard – tecla keyboard settings –
Fullscreen switch mode (ON) + Enable self scanning (ON)
Send an SMS with Have you finished? to all the android terminals
Ideal Web Reader – accessible web browser for the
Medicamento Accesible: go to the up left corner and drag down the top
bar. Select Ideal Web Reader as default browser
Contact Manager: add demo contact only once
8 28th September 2011

9. TalkBack
HOW
• TalkBack: move the focus to the right
Move the joystick to the right right direction
9 28th September 2011

10. TalkBack
HOW
• TalkBack: move the focus to the right with virtual d-pad
A flick in the right direction
10 28th September 2011

11. TalkBack
HOW
• TalkBack: Select an item
Press the joystick
Tap on the d-pad
11 28th September 2011

12. Challenge One: TALKBACK NAVIGATION
WHO
• You are a blind person, how to navigate with the mobile device?
• You recive the information mainly with the speech output
THE CHALLENGE
1. In groups of approx 5 people
2. Go to settings
2. Select sounds
3. Activate the silent mode
12 28th September 2011

13. Challenge Two: DAILY LIFE
WHO
• Many people can’t get the information written on their medication leaflets. This is a serious concern,
since some of these people’s health rely on these medicines.
• Among the reasons for this inability we can find:
 Visual impairment
 Physical disabilities
 The elderly
THE CHALLENGE
1. Open the Medicamento Accesible application (*).
2. Capture the QR code printed on the package
3. Get the information
4. Capture the barcode – are there any differences?
(*) Project developed by the Vodafone Spain Foundation
13 28th September 2011

14. For the Accessible Contact Manager
>TalkBack: settings – accessibility . Off
14 28th September 2011

15. AEGIS Project
• Duration: 48 months (Sep. 08 – Sep. 12)
• Budget: 12.6 M €
• Coordinator: Center for Research & Technology
Hellas
• Technical leader: Oracle
• Parteners: The ACE Centre Advisory Trust, Adaptive
Technology Resource Centre of the University of
Toronto, AOL, Blue Point IT Solutions S.R.L., Catholic
University at Leuven, the University of Cambridge,
Conncept Swiss, Czech Technical University,
European Platform for Rehabilitation, Vodafone Spain
Foundation, Fraunhofer Institute for Industrial
Engineering, ONCE Foundation, P50, Polytechnic
University of Madrid, Research In Motion Limited
(RIM), Royal National Institute for the Blind,
SingularLogic S.A., Spanish National Organization of
the Blind, Sahlgrenska University DART
• Web: www.aegis-project.eu
15 28th September 2011

16. Challenge Three: ACCESSIBLE CONTACT MANAGER
WHO
• For many of us it’s easy to find and call a contact of our phone agenda. But what if this process
became much more difficult? The phone would lose much of its functionality and usability.
• There are groups of people for which this task is not so easy:
• Visual impairment
• Cognitive impairment and intellectual disabilities
• The elderly
• The introduction of the Smartphones has pushed more information and possibilities to the phone
agenda, including social networks synchronization, messaging applications and more. This fact has
increased the complexity and difficultness of the agendas and its management.
THE CHALLENGE
1. Find and open the Accessible Contact Manager application (*).
2. If it’s not already set, choose the most appropriate setting for you.
3. Once you can navigate through contacts, lookup for the following contacts: Mother, Dentist.
(*) Application developed by the Polytechnic University of Madrid
16 28th September 2011

17. Pre- Challenge Four: Tekla introduction
WHO
• For people with dexterity impairment, it’s difficult to use a mobile phone because the keys are
very small and in case of touch screens they are very sensitive, the surface is small and requires a
high degree of precision.
• Depending on disability you can find different solutions
WHAT
• For Smartphones with a touch screen, we can find Tekla, which reduces the
interaction with the mobile device to “just one tap”.
• Tekla is an on-screen scanning keyboard with two usage modes:
1. Navigation: For a general use of the phone and its applications.
2. Keyboard input: When a text input is needed (i.e. SMS).
• You can either tap on the screen or plug a joystick for wheelchair users.
• As you get used to Tekla, you can increase the speed of the “selector”
(*) Application developed by the International Development Research Centre
17 28th September 2011

18. Pre- Challenge Four: Tekla introduction
HOW
Tekla Navigation Mode Tekla Keyboard Mode
(*) Application developed by the International Development Research Centre
18 28th September 2011

19. Pre- Challenge Four: Tekla introduction
HOW
• Tekla: Activate Tekla keyboard
Tekla Keyboard
Press and hold where you Select Tekla Keyboard
want to type. Select Input
method
(*) Application developed by the International Development Research Centre
19 28th September 2011

20. Pre- Challenge Four: Tekla introduction
HOW
• Tekla: Typing a letter
Wait Tap anywhere on Wait Tap anywhere on
the screen the screen (In this
case the letter s is
typed)
(*) Application developed by the International Development Research Centre
20 28th September 2011

21. Pre- Challenge Four: Tekla introduction
HOW
• Tekla: Navigation mode: Move to the element on the left
Wait Wait Wait The focus
Tap anywhere on has moved
the screen to the left
(*) Application developed by the International Development Research Centre
21 28th September 2011

22. Challenge Four: LET’S TYPE “DONE!”
THE CHALLENGE
1. Find and open the messaging application.
2. Find the message from Mari Satur “Have you finished?”
3. Open the conversation by clicking on the message.
4. Press and hold on the “Type to compose” box and select Tekla
Keyboard
5. Tap anywhere on the screen with your fist to stop the scan and type
“done”
Tekla Keyboard
6. Close the keyboard selecting the key
7. Go to Send using the scan navigation and select OK
(*) Application developed by the International Development Research Centre
22 28th September 2011

23. ACCESSIBLE Project
• Project Name: Accessibility
Assessment Simulation Environment
for New Applications Design and
Development
• Programme: 7th Framework-
Programme
• Duration: 42 Months
• Starting date: 01 September 2008
• Coordinator: Centre for Research and
Technology Hellas (CERTH)
• Web: www.accessible-eu.org
23 28th September 2011

24. Developer support: Impairment simulator
• Simulates the following effects
• Physical environment effects: static reflection,
display tremor, finger occlusion
• Visual impairments effects: Tunnel vision, blurred
vision, colour blindness
Reflection on the display and occlusion of the display with finger
(*) Application developed by the Czech Technical University
24 28th September 2011

25. More developer resources
• Smart Accessibility Awards:
http://developer.vodafone.com/smartaccess2011/
• Android: Designing for Accessibility:
http://developer.android.com/guide/practices/design/acc
essibility.html
• Android Accessibility API:
http://developer.android.com/reference/android/view/acc
essibility/package-summary.html
• DroidDraw UI Designer: http://www.droiddraw.org/
25 28th September 2011

26. active ageing
Design4U MOBILISING SOCIAL CHANGE
SUPER MOBILE
TRUST SPEED
mobile ABILITY communication ABILITY INTERACTION
TO YOU
POWER
SUPER MOBILE mobile CUSTOMER OBSESSED
The
SIMPLICITY
accessibility ABILITY INNOVATION HUNGRY mobile
Independent Living
Vodafone Design4All
Difference
POWER PEOPLE
communication
World of
TO YOU PERSONA
Responsability Way AMBITIOUS AND COMPETITIVE
CAPACITY
ABILITY ONE COMPANY, LOCAL ROOTS
FOR ABILITY
RESPONSE Mobiles for Good accessibility Telecoms for Good
Thanks for your collaboration!
Madrid, 28th September 2011
26 28th September 2011