Authors: María González, Lourdes Moreno, Paloma Martínez Interacción 2014: XV International Conference on Human Computer Interaction (September 2014, Puerto de la Cruz, Tenerife, Spain). Proceedings of the XV International Conference on Human Computer Interaction (INTERACCIÓN 2014), ACM, New York, ISBN: 978-1-4503-2, Número: 5 Adaptation Rules for Accessible Media Player Interface

1. Adaptation rules for Accessible Media
Player Interface
María González
María González, Lourdes Moreno and Paloma Martínez
LaBDA Group, Computer Science Department
Universidad Carlos III de Madrid, Spain
{mgonza1, lmoreno, pmf}@inf.uc3m.es
XV Internatinal Conference on Human Computer Interaction
10-12 September 2014, Puerto de la Cruz, Tenerife

2. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• Motivation
• Proposal
• Overview
• Previous Work
1. Design Solution of a Media Player
2. Lessons Learned
• Integrating Adaptation Rules
1. New Architecture
2. Final Model-Based Design
• Conclusions
• Future Work
• References
Content

3. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• The constant increase of multimedia content on the Web
does not entail an equitable increase of its accessibility
Motivation
Exclusion of elderly people and people with disabilities

4. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• Therefore, the access to alternative content should be
assured to the user with disabilities in accordance with
their access needs
=> the user agent or media player must be accessible
Motivation
Play, Pause, Stop enable/disablecaption
Alternativo content ACCESS TO alternative content

5. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• The aim is to offer a design solution of media players
which delivers video content fulfilling the necessary
accessibility requirements following standards
 A design solution that includes accessibility requirements
in user agents using Model Driven Development (MDD) is
proposed (Previous Work)
• In this work:
PROPOSAL
Provide a model-based design solution which includes
adaptation rules for accessible media player following
accessibility standards

6. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• Web content:
– WCAG 2.0 [W3C, 2008]: Guideline 1.2 [Moreno et al, 2008]
– Section 508, BITV 2, RGAA, AODA and UNE 139803
• User agents:
– UAAG 2.0 [W3C, 2014]
– ISO: 9241(Ergonomics of human-system interaction) [ISO,
2008]: Guidance on software accessibility (part 171)
• HTML5 [W3C, 2011]: <video> and <audio>
• Twenty-First Century Communications and Video Accessibility
Act of 2010 [CVAA , 2010]
• European Standard EN 301 549 V1.1.1 [ETSI, 2014]
Overview:
1. Accessibility Regulations and Standards

7. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• Accessibility requirements
– Analysis of accessibility standards
• Modeling:
– Model Driven Development (MDD)
– Model-based design
• Adaptation
– Introduction of adaptation rules
Overview:
2. Related Work
Two
approximations

8. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• Conceptual architecture
Previous Work:
1. Design solution of a Media Player (I)
1.1 Review of accessibility standards
1.2 Group of requirements by categories
1.3 Modelling of requirements using
UIDL
UAAG 2.0 ISO 9241-171
Abstract
user
interface
Task &
Domain
Concrete
user
interface
Final
user
interface
Transformationrules
Graphical
editorRequirements

9. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
1.1 Review of accessibility standards
• UAAG 2.0 and ISO 9241-171
− Render alternative content
− Provide text configuration
− Text search
− etc
Previous Work:
1. Design solution of a Media Player (II)

10. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
1.2 Groups of requirements by categories
Previous Work:
1. Design solution of a Media Player (III)
Code Name Description Group Subgroup Source
ISO UAAG 2.0
NP01 Play Play the video content Native Playback 10.8.2 2.11.6
NP02 Stop Stop the video content Native Playback 10.8.2 2.11.6
NP03 Pause Pause the video content Native Playback 10.8.2 2.11.6
NS01 Resize Resize the viewports Native Size 10.5.8 1.8.3
NV01 Mute Enable or disable the audio content Native Volume 10.6.2 1.5.1
NV02 Volume Adjust the volume Native Volume 10.6.2 1.5.1
AP01 Rewind Delay seconds within a playback Additional Playback 10.8.3 2.11.7
AP02 Forward Forward seconds within a playback Additional Playback 10.8.3 2.11.7
AA01 Caption Enable or disable captions Additional Alternatives 10.1.3, 10.7.2 1.1.2
AA02 Audio Description Enable or disable audio description Additional Alternatives 10.1.3 1.1.2
AA03 Size Change the size of the captions Additional Alternatives 10.7.3 1.4.1
AA04 Font Change the font of the captions Additional Alternatives 10.7.3 1.4.1
AA05 Colour Change the colour of the captions Additional Alternatives 10.7.3 1.4.1
AA06 Language Caption Change the language of the captions Additional Alternatives 8.2.1 2.7.1
AA07 Language Audio Change the language of the audio
description
Additional Alternatives 8.2.1 2.7.1
AH01 Help Help documentation about accessibility
features
Additional Help 11.1.5 3.3.2
AF01 Find Search within playback captions Additional Find 2.4.5
(González-García et al, 2011)
INTERACCIÓN 2011, INTERACT 2011

11. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
1.3 Modelling of requirements using UIDL (I)
• UsiXML [UsiXMl, 2012] and Cameleon Reference
Framework [Calvari et al, 2003]
• Task model: Interaction between a user and a user agent
Previous Work:
1. Design solution of a Media Player (IV)
(González-García et al, 2012)
DSAI’2012

12. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
1.3 Modelling of requirements using UIDL (II)
• UsiXML and Cameleon Reference Framework
– AUI: Interaction elements structure
• Abstract Container (AC)
• Abstract Individual Components (AIC): input, output,
navigation and control
• AUI Relationships
– CUI: Concretize an AUI for a given context of use
Graphical editor: facilitates the design process and provides
support to designers new to the area of accessibility
– FUI: Operational user interface on a particular computing
platform
• Supported by a programming language or markup language
Previous Work:
1. Design solution of a Media Player (V)
(González-García et al, 2015)
UAIS (Universal Access in the
Information Society)
(González-García et al, 2013)
JUCS (Journal of Universal Computer Science)

13. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• To create simpliflied user interfaces Adaptation rules
Previous Work:
2. Lessons learned
Facilitate the design of a media player by user with
especial needs and preferences avoiding include
unnecessary buttons that the user will not need

14. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• Objective:
Integrating adaptation rules
Benefit the final users of the proposed
technology and the final users of the player

15. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
Integrating adaptation rules:
1. New Architecture
Facilitate the interaction
between the user and the
media player avoiding
buttons that could be
unnecessary
UAAG 2.0 ISO 9241-171
Abstract
user
interface
Task &
Domain
Concrete
user
interface
Final
user
interface
Adaptationrules
Transformationrules
Graphical
editor
FUI_adaptation_rule_1
FUI_adaptation_rule_2
FUI_adaptation_rule_3
FUI_adaptation_rule_4
Requirements

16. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
2.1 Previous levels of Cameleon (I)
– MARIA [MARIA, 2010] instead of UsiXML
– CTTE [CTTE, 2010] and MARIAE [MARIAE, 2010]
– Same Task Model
– AUI uses Presentation Task Model (PTS)
• PTS1: {Resize, Mute, Volume, AudioDescription,
Caption, Help, Play}
• PTS2: {LanguageAudio}
• PTS3: {Find, Size, Color, Font, LanguageCaption}
• PTS4: {Stop, Rewind, Forward}
Integrating adaptation rules:
2. Final Model-Based Design (I)

17. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
2.1 Previous levels of Cameleon (II)
− AUI design primitives
• Interactors (selection, edit, only output and control)
– Represents every type of user interaction object
• Interactor Compositions (grouping, relation, composite
description and repeater)
− Groups together design primitives that have a logical
relationship
Integrating adaptation rules:
2. Final Model-Based Design (II)
Selection
Single
Choice
Edit
Numerical
Control
Navigator
Control
Activator
Language Audio,
Size, Color, Font and
Language Caption
Volume Find and Help Play, Stop, Rewind,
Forward, Resize, Mute,
AudioDescription and
Caption

18. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
2.2 Integrating adaptations rules (I)
• Analysis of the types of access and user groups with
disabilities
Integrating adaptation rules:
2. Final Model-Based Design (III)
Types of access /
groups with disabilities
Resources necessary
to access
Required accessibility elements Rule
Code
Access visual and
auditory / simplified user
interface
(essential)
Playback and volume
elements
Buttons: Play, Stop, Rewind, Forward and Mute
Slider: Volume
1
Access visual /
Auditory impairment
Playback, help, volume
and caption elements
Buttons: Play, Stop, Rewind, Forward, Mute and Caption
Select menu: Font, Color, Size and LanguageCaption
Navigator: Find and Help
Slider: Volume
2
Access Auditory /
Visual impairment
Playback, help, volume
and audio description
elements
Buttons: Play, Stop, Rewind, Forward, Mute and
AudioDescription
Select menu: LanguageAudio
Navigator: Help
Slider: Volume
3
Access visual and
auditory / user interface
with all the elements
Playback, help, volume,
caption* and audio
description** elements
Buttons: Play, Stop, Rewind, Forward, Mute, Caption* and
AudioDescription**
Select menu: Font*, Color*, Size*, LanguageCaption* and
LanguageAudio**
Navigator: Find* and Help
Slider: Volume
4/5

19. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
2.2 Integrating adaptations rules (II)
• Use of Event-Condition-Action (ECA) rules
– Syntaxis: on event if condition do actions
• Rules:
Integrating adaptation rules:
2. Final Model-Based Design (IV)
• Rule 1
Event The UI is activated
Condition The user does not have any kind of disability
Action All menus except the playback menu and the volume are disabled
Description The rule is triggered when the UI is activated; then, it checks if the user wants to use a basic
media player; finally, only the playback menu and the volume are shown
Rule 2
Event The UI is activated
Condition The user has any kind of visual impairment
Action The menu related to captions is disabled
Description The rule is triggered when the UI is activated; then, it checks if the user has any kind of visual
impairment; finally, the caption menu is disabled

20. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
2.2 Integrating adaptations rules (III)
– Rules (continuation):
Integrating adaptation rules:
2. Final Model-Based Design (V)
Rule 3
Event The UI is activated
Condition The user has any kind of auditory impairment
Action The menu related to audio description is disabled
Description The rule is triggered when the UI is activated; then, it checks if the user has any kind of auditory
impairment; finally, the audio description menu is disabled
Rule 4
Event The UI is activated
Condition The user does not have any kind of disability
Action The menu related to captions is disabled depending on the user preferences
Description The rule is triggered when the UI is activated; then, it checks if the user wants to disable the menu;
finally, the caption menu is disabled on user request
Rule 5
Event The UI is activated
Condition The user does not have any kind of disability
Action The menu related to audio description is disabled depending on the user preferences
Description The rule is triggered when the UI is activated; then, it checks if the user wants to disable the menu;
finally, the audio description menu is disabled on user request

21. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
2.3 Last levels of Cameleon
• CUI
− Models are platform-dependent and language independent
− Concrete design primitives depend on the AUI interactors
− Add additional design primitives: progress bar, video element
− Adaptation rules from AUI
• FUI
− Using a programming language
Integrating adaptation rules:
2. Final Model-Based Design (VI)
Model-based graphical editor

22. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• Multimedia content and software that provides it have to
be accessible
• First approximation: guide designers of accessible media
player through a graphical editor
• Final approximation: adaptation of the FUI depending on
the kind of disability and preferences of the final user
• Apart from that, the use of an UIDL provides flexibility
and independency
Conclusions

23. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
• This research belongs to the Doctoral Thesis which has
as main contribution a workspace oriented to designers
which follows a methodological approach to develop an
accessible media player.
• This workspace included:
Future Work
•

24. [W3C, 2008] W3C, Web Content Accessibility Guidelines 2.0, 2008, http://www.w3.org/TR/WCAG20/
[Moreno et al, 2008] L. Moreno, P. Martínez, B. Ruíz-Mezcua. Disability Standards for Multimedia on the Web. IEEE MultiMedia 15(4): 52-54, 2008
[W3C, 2014] User Agent Accessibility Guidelines 2.0. http://www.w3.org/WAI/UA/UAAG20/
[ISO, 2008] International Organization for Standardization, ISO 9241-171:2008, Ergonomics of human-system interaction (Guidance on software accessibility).
http://www.iso.org/iso/catalogue_detail.htm?csnumber=39080
[W3C, 2011] W3C, HTML5, A vocabulary and associated APIs for HTML and XHTML, 2011, http://www.w3.org/TR/html5
[CVAA, 2010] Federal Communications Commission, Twenty-First Century Communications and Video Accessibility Act. http://www.fcc.gov/guides/21st-
century-communications-and-video-accessibility-act-2010
[ETSI, 2014] EN 301 549 V11.1, Accessibility requirements suitable for public procurement of ICT products and services in Europe.
http://www.etsi.org/deliver/etsi_en/301500_301599/301549/01.01.01_60/en_301549v010101p.pdf
[González-García et al , 2011] González-García, M., Moreno, L., Martínez, P., and Iglesias, A. 2011. Web accessibility requirements for media players,
INTERACT 2011. 13th IFIP TC13 Conference on Human-Computer Interaction, Lisboa, Portugal, September, 2011, LNCS, Springer, Volume: 6949, pp. 669-
674
[UsiXML, 2012] User Interface Extensible Markup Language (UsiXML), http://www.usixml.eu
[Calvary et al, 2003] G. Calvary, J. Coutaz, D. Thevenin, Q. Limbourg, L. Bouillon, J. Vanderdonckt. A Unifying Reference Framework for Multi-Target User
Interfaces. Interacting with Computers. Vol. 15, No. 3, June 2003, pp. 289-308
[González-García et al , 2012] González-García, M., Moreno, L., and Martínez, P. 2012. An approach to User Interface Design of an accessible user agent.
4th International Conference on Software Development for Enhancing Accessibility and Fighting Info-exclusion, DSAI 2012, Douro Region, Portugal, July,
Elsevier, Volume: 14, pp. 254-262.
[MARIA, 2010] Model-based language for interactive applications. http://giove.isti.cnr.it/tools/MARIA/home
[CTTE, 2010] ConcurTaskTrees Environment. http://giove.isti.cnr.it/tools/CTTE/home
[MARIAE, 2010] Model-based language for interactive applications environment. http://giove.isti.cnr.it/tools/MARIAE/home
[González-García et al , 2015] González-García, M., Moreno, L., and Martínez, P. 2015. Approach design of an accessible media player. Universal Access in
the Information Society, in press
[González-García et al , 2013] González-García, M., Miñon, R., Moreno, L., Martínez, P., and Abascal, J. 2013. A model-based graphical editor to design
accessible media players. Journal of Universal Computer Science, Volume19, Nº 18, pp. 2656-2676
References
María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain

25. María González, ‘Adaptation rules for Accessible Media Player Interface’ , Universidad Carlos III de Madrid, Spain
‘‘Adaptation rules for Accessible Media Player
Interface’’
María González
mgonza1@inf.uc3m.es
Thank you for your attention