1. http://bit.ly/autismtech
http://bit.ly/appsforlearning
Katharina Boser, Ph.D.
Autism Apps Technologies:
Learning, Motivation and Engagement
ISTE Lecture
San Diego, California
June 28, 2012 http://bit.ly/appsforautism
http://Todaysmeet.com/iste12autismapps
5. Best Practices: Behavioral Treatment
Applied Behavioral Analysis (ABA)
◦ Discrete Trial Training (DTT, Lovaas, Smith)
Pivotal Response Training (PRT, Koegel, Schreibman )
Treatment and Education of Autistic and related
Communication handicapped Children (TEACCH, Mesibov,
Schopler)
Developmental Denver Model (Dawson, Rogers)
Developmental Individual Relationship-based. (DIR, Greenspan)
Picture Exchange Communication System (PECS, Bondy &
Frost)
(see Myers et al. AAP paper for research citations and Autism
6. What do all good treatment practices have
in common?
● Early and intensive intervention, with active engagement (at least 25
hrs/week in planned, appropriate activities w/ identified educational
objectives);
● Low student-to-teacher ratio (1-on-1 time and small-group)
● Family component (including parent training as indicated)
● Interaction with typically developing peers
● Ongoing measurement and documentation (adjust when indicated)
● Incorporation of a high degree of structure (e.g. ,predictable routine,
visual activity schedules, and minimized distractions )
● Strategies to apply learned skills to new environments and
situations (generalization) and to maintain functional use of these skills
● Assessment-based curricula that address:
1) functional, spontaneous communication 2) social skills, including joint
attention, imitation, reciprocal interaction, initiation, and self-management;
3) functional adaptive skills that prepare responsibility and independence;
4) reduce of disruptive or maladaptive behavior (use functional
assessment) 5) cognitive skills, such as symbolic play and perspective taking;
6) traditional readiness skills and academic skills
7. Why Technology?
Assessment and Data sharing
◦ More objective assessment; reduced “observer effects”
◦ Allows observation in more natural settings
◦ Increases amount and therefore validity of data
◦ Cloud technology/internet allows all team members to view data
Multimedia Components;
◦ Visuals reduce anxiety, allow choice, schedule, timers
◦ Audio, video increase understanding through symbols/pictures
Bridge to interaction, attention and social engagement
◦ Students more comfortable with structure of computing/tech (Moore
& Calvert, 2002, Bernard-Opitz, et al 2001)
◦ Development of generalization and opportunity to ‘practice’
interactions with normal peers ‘virtually’.
Motivation: Very engaging--fun factor
◦ 21st century skill development
8. The “What/Who” of Technology
For the Student:
◦ Language/Communication
◦ Cognition and Memory; Skill Acquisition
◦ Emotion Recognition and Regulation
◦ Social Skills, e.g., joint attention, turn taking
For the Clinician, Parent or Teacher:
◦ Data collection, analysis
◦ Explicit Teaching methods
◦ Ease and cost of presentation of stimuli and re-creation of
environments
Optimize: What does the autistic brain do
well? Vs. What does the computer do well?
10. Learning Networks
Input Output
UDL
Engagement
All work simultaneously.
National Technology Integration Plan 2010
http://www.cast.org/publications/UDLguidelines/version1.html
11. http://www.fdlrs.org/docs/ent2010web.pdf
Connecting Brain Research and
Universal Design for Learning (UDL)
The WHAT of The HOW of The WHY of
Learning Learning Learning
Expression/
Recognition Network Strategic Network Affective Network
Student: Making Student: Planning, Student: Connecting
Connections, Long Term Regulating and Executing Emotionally,
Memory, Ideas Action for Output Providing Purpose
Teacher: Uses Multiple Teacher: Allows Multiple Teacher: Uses Multiple
and Flexible Means of and Flexible Means of and Flexible Means of
Presenting what is Demonstrating what Engaging the learner
to be Learned e.g., language was Learned, e.g., physical, in what is to be Learned, eg
Or concepts Building, creating Self-regulation, reward interest.
INPUT OUTPUT ENGAGEMENT
12. Universal Design
Traditional For Learning
Human Supports Teaching UDL Environmental
(accommodation & Modifications Modifications
remediation) (accommodation) (accommodation)
Reduce Barriers
Dependence Independence
Independence
Overcome Barriers
Therapies
(remediation) Assistive Technology
(accommodation)
Assistive Technology is uniquely designed for the individual;
IEP and special services will still be needed under UDL curriculum
Design by S. Wayland & K. Boser
13. The archeology of human learning.
Learning requires:
Movement
Challenge and frustration--exploration
Emotional arousal
Resource state access (to remember and have
confidence for the journey)
Repetition
Adequate sleep
A sense of being in control
Multisensory stimulation
Lots of pictures
Dr. John Medina “Brain Rules”
14. Accommodations must be
Individualized and Personalized
Each person has unique set of weaknesses
Each person has unique set of strengths
Everyone has personal motivators..
Obligation to create technology that people will
use..it must be Personal!
◦ E.g., Alphasmart, Dynavox vs.
◦ Ipad or tablet with visual/audio
15. Cloud Based Technology
Connecting the Educator, Student and Parent!
• Global access by all involved
• Teacher, Coach or Parent can share, view, and
collaborate on document—personalizing
learning for student
• Access to different levels of engagement with
data/activities (teacher, parent, student, etc.)
• Check secure Data protection on server (e.g.,
Google is FERPA compliant)
• Student has time to compose and think
• Learning at unconventional times
16. The Cloud
Best Apps and services for storing information ‘free’ :
Dropbox, Evernote, Google Drive
17. WHY THE IPAD (OR
IPOD)?
Mobile apps for apple are much more prevalent.
Some are available cross platform (Android) Mostly read
books and a few autism apps
21. What makes the iPad a good learning
tool?
Multimedia components: Highly
Visual, links with auditory
Tactile stimulation, ease of use
and touch
Movement and ‘construction’
Engaging and Fun;
motivation/reward
http://bit.ly/appsforautism
22. Know your iPad
Ipad Users Guide (free ibook on apple.com)
App start (ipad 101) or Autism Apps
Understand itunes and itunesU
Know your app developers:
◦ Be sure they are connected with the community
and not just creating a ‘one-off ’ app
◦ Connect with (itaalk.org, momswithapps, snapps, etc)
where developers give ‘freebies’ and listen to feedback,
changes are made
Often better apps result from originally App start
designed tool for desktop
◦ components are converted for mobile use
◦ E.g,Vizzle, nuance, starfall,
Autism apps
26. TOOLS THAT SUPPORT
DATA AND BEHAVIOR
MANAGEMENT/ SHARING
Vizzle
Symtrend
Behavior Tracker
ABC
27. Discrete Trial Training Therapy
Team of therapists teach basic life skills
e.g. , Word pronunciation
One-on-one setting with one therapist and child
Many repeated trials with a specific protocol:
◦ Each trial starts with an exact, spoken command
e.g. , “Say school bus”
◦ Each trial ends with a written grade
e.g. , Grade “I” means child said “school bus” independently
Very data-intensive
◦ Current system is paper-based and time consuming
31. Symtrend: for CBT intervention
In collaboration with MGH Youth Care program, Lucci, McLeod et al IMFAR 2010
32. Graphing Emotion Regulation
After training, students and teacher converge more on ability to
record expression and interaction; More in synch with coaching
and viewing graphs together
33. Visual Language
http://vizzle.com
Research studies by Howard Shane & Kevin Kearns (Boston
Children’s Hospital) and Monarch school demonstrate
efficacy-unpublished
Access to web based moderated curricula
Includes video, audio, text insertion
See also Teaching Language Concepts at BCH
34. Drag and Drop
Visual
Templates:
• Matching
• Build-A-Book
• Game
• Sorting
• Phonics +
• Pix2Go
• Scheduler
• Token-Board
• Timer
• First Then
37. • Dealing with short attention span
o Tasks are broken down into smaller pieces
o Rewards for performance
• Instruction is clear and consistent, simple and
concrete
• Information is represented visually
40. Apps to Manage and Track
Behavior
Behavior Trackers
• Symtrend, Behavior Tracker Pro, eCove, ABC data
• ABA Apps
• Built in feedback, intense structure learning and rewards to
increase positive behaviors from one situation to another
42. Areas for Instruction Matched
with Apps
Behavior Management
Organization/ Writing
Apps
Sensory and Motor
Development
Language and
Communication
Functional and Social
Skills
Books and Literacy
Word Learning
Math and Number
Concepts
43. SOCIAL STORIES,
ADAPTED BOOKS AND
LITERACY TOOLS
Story book creators, Play and imitation to facilitate word
learning, social language tools,
Speech to text
45. Customize a Story aid with sequencing
VizZle 'Build-a-Book'
with option for multi-lingual
natural audio and interactivity, use
hotspots to create differentiated
activities
46. Create Social Sequence stories
e.g., prepare for or describe a trip
Book Creation Apps Construct your own iBook with familiar voice,
video & images
Record
speech, insert
images, video,
Allows
chapters
headers,
organization.
Looks like a
real book
across many Pictello, Speech Journal, ibook
ibook readers creator, Stories2learn, CBB,
and platforms Storypatch, Storyjumper many more
48. Reading Software
Read to Go Vibookz PDF
http://www.kurzweiledu.com/
Learn more by downloading Dan Herlihy and
Pati de Baun’s ISTE 2012 handouts (Spoke
Tues at 10:30)
http://www.donjohnston.com/products/start_to_finish/
53. Communication through Storytelling:
Learning Story Structure skills
• Listen and watch others 'tell' their
story.
• Encourage students to tell their
own.
• Reinforce digital story telling skills “http://Smories.com”
• Pow!, Toontastic, StoryKit,
StoryRobe, SonicPics, Idea
Sketch
• Find these under “books/literacy”
category on the wikisite
Toontastic
54. Simulations of Real Activities
Encourage language Skills by reinforcing steps with verbal production
• Cookie or Cake Doodle
• Magnetic Alphabet, Scene Speak
o allows 'play' on the iPod/iPad
o word learning occurs in context
o hear known voices
Scene Speak: Good Karma apps
55. Play/ Imitation Simulation apps
• See “Books/literacy” section on wiki
• Encourages ‘storytelling’ ability’
• E.g., myplayhome and playtheatre
• Interact with virtual characters
• Simulate multi-step activities
57. Facilitating Socialization, Interaction with Peers
• VizZle game board
o Plays on Interactive Whiteboard,
computer or Android or iPad tablet
• Math and Word Bingo
o Rewards built in
o Leveled activities
• Eye Gaze and Social cue apps
• Talking Tom Cat and characters
o Imitation and play
o Try Mobile Education apps
o Combines language comprehension with reading and grammar
learning (e.g. text, audio, color cueing, token rewards, etc.)
o Use a force collaboration model where sentence isn’t completed
unless both students manipulate at least one part of the sentence
(or do it sentence by sentence)
o Turn taking can be adapted to many of these.
61. Tools to Aid Thinking and Writing
(“cause my head’s going to explode with ideas”)
In Writing
view,
pictures are
Converted
into
hierarchical
http://www.inspiration.com/Kidspiration outline
62. Social Games: Secret Agent
See Social Express App
Secret Agent Society
Randomized controlled trial showed
greater improvements in social and
emotional skills for Tx of control
group (N=23 per group) after two
month intervention.
Social skills improved across contexts
76% improving from having clinically
significant delays in social functioning
to within the range of TD.
Maintained gains five months
after the program ended
www.sst-institute.net Beaumont & Sofronoff, 2008
63. Addressing Sensory Issues
• See wiki site for more in this domain
• Dexteria (see Binary Labs)
• Koi Pond (pocket pond)
• Fluidity, Spawn, Pyromania
• Relax Melodies, Nature Sound
Consider Block puzzles, virtual legos
Minecraft and other visual puzzle games
64. UDL & Technology
Hotspots can :
• Pop up a movie providing more
information
• Playback a voice recording, directions,
explanations and more
• Provide a way to communicate and so
much more!
Scene & Heard
Vizzle books
65. Accessibility Features
Zoom Magnification
White on Black Display
Mono Audio
Large Fonts
Closed-Captioned Support
VoiceOver Screen Reader
Audio & Visual Support for Instruction
External Add-Ons
(Stands, Switches, Bluetooth Keyboards, Earpieces, Styluses,
Projectors)
SpEd Apps
(Proloquo2Go, Sign4Me, Dragon Dictation & so many more...)
66. What you (really) need to know.
Lawrence Summers (NYTimes, Jan 20, 2012)
1. Education will be more about how to
process and use information and less
about imparting it.
2. An inevitable consequence of the
knowledge explosion is that tasks will be
carried out with far more
collaboration.
3. New technologies will profoundly alter
the way knowledge is conveyed.
67. It’s not too soon..
“A good rule of thumb for many things
in life holds that things take longer to
happen than you think they will, and
then happen faster than you thought
they could. “
71. Facial and Emotion Recognition
Several studies now show improvement in
face and/or emotion recognition using
computer or DVD based training
Difficulty in generalization to real settings.
Often only limited generalization found
◦ (LaCava et al 2007, 2010, Boelte et al 2002,
Golan, Baron Cohen, 2006,2010)
72. For video of Face Say go to:
http://www.youtube.com/watch?v=UX-
Face Say _ri7QBzo
Amazing Gazing
Band Aid Clinic Follow the Leader
Hopkins, Gower et al JADD 201
73. Thanks!
Contact me via my Wikisite
Http://bit.ly/appsforautism
Keep learning and exploring!
Be sure to communicate with bloggers,
and app developers
Make your needs known!
Katharina Boser : @kiboser (on twitter)
