SlideShare uma empresa Scribd logo
1 de 19
Baixar para ler offline
Click to edit Master title style




Application-oriented IT
Research:
Challenges & Trends for Next-
generation Smartphone Apps


FRANK ALLAN HANSEN
PRODUCT MANAGER ALEXANDRA MOBILE APPS
RESEARCH AND INNOVATION SCIENTIST,
PHD
INTERACTIVE SPACES LAB
THE ALEXANDRA
INSTITUTE LTD.
frank.allan.hansen@alexandra.dk
Agenda
Click to edit Master title style

Challenges & Trends for Next-generation smartphone apps

• Introduction
• The current app paradigm
• Three perspectives on next generation smartphone apps
       – Overlaying the world
       – Interacting with objects and controlling the environment
       – Apps as glue for digital activities
• Wrap up and conclusion




October 8, 2012   Page 2
Click Alexandra Institute
The to edit Master title style

• Private research institute founded in 1999
• Part of the GTS network (Godkendt teknologisk service)
• Focus on applied, research-based innovation in pervasive
  computing
       – Pervasive Healthcare, Interactive Spaces, Advanced visualization,
         New Ways of Working, Software, Pervasive Positioning, It-security
         and Business and processes
• Non-profit company that works with application-oriented IT
  research and development and sells IT services and products
  to the Danish industry.
• Bridge-builder between research, private corporations, public
  institutions and citizens.

• Based in the IT-city Katrinebjerg in Aarhus and the IT-University
  in Copenhagen.

October 8, 2012   Page 3
Click to edit Masterparadigm
The current app title style

• Social networking, games,
  photography,…
• Simple focused apps
• Rich in detail
• Rich interaction
       – Touch and gesture based
• Lot of attention to design and detail

• However, apps are often monolithic
• Developed for their own digital niche
• Not much integration with the user’s
  world
October 8, 2012   Page 4
Click to edit Master “smart” devices
Smartphones as title style




October 8, 2012   Page 5
Click to edit Master “smart” devices
Smartphones as title style
• Very powerful devices
       – Quad core CPUs, Dedicated GPUs, etc

• Many physical sensors:
       –     Camera (ID, Object tracking, light levels)
       –     Microphone (audio levels, voice commands)
       –     3G/4G (location, proximity)
       –     Bluetooth (location, proximity)
       –     Wi-Fi (location, proximity)
       –     Accelerometer (movement)
       –     Compass (direction)
       –     GPS (location)
       –     Gyroscope (movement)
       –     NFC/RFID (identification)
       –     …


October 8, 2012   Page 6
Digital-physical apps
Click to edit Master title style

• Next generation apps should utilize this technology

• Apps should be aware of the user’s context
       – Adapt functionality and application behavior
       – Present and filter relevant information
       – Allow the user to control and interact with the surroundings

• Not an “easy” task of course…
• So new software tools and ideas are needed




October 8, 2012   Page 7
1. Overlaying the world
Click to edit Master title style




October 8, 2012   Page 8
                                   Minority Report (2002)
Location-based AR
Click to edit Master title style

• Digital Threads (Digitale Tråde)
• Location-based augmented reality
       – GPS, Accelerometer, Compass

• Developed with Museum
  Midtjylland
• Displays excavation sites and
  historical buildings in the landscape

• Challenge:
       – Turned out to be “complex” to
         implement
       – Accuracy depends on the
         smartphone sensors

October 8, 2012   Page 9
Vision based AR
Click to edit Master title style
                     Storm P Museum   • Storm P Museum
                                      • Skovgaard Museum
                                      • Developed for Redia
                                         – http://www.redia.dk/


                                      • Vision based
                                      • Based on feature models
                  Skovgaard Museum    • Overlays graphics, animation
                                        and control over the camera
                                        image.

                                      • Challenge:
                                         – Very dependent on light conditions
October 8, 2012     Page 10              – Scalability: hard to model everything
Challenges for mobile augmented reality
Click to edit Master title style

• AR is “complex” to implement
       – Sensor fusion
       – Advanced tracking
• Location based augmented reality is only as
  good as the accuracy of the mobile phone's
  sensors
• Vision based augmented reality requires
  models and a lot of computation
       – (i.e. you can’t model the entire world)

• But, when you combine the two:
       – You can filter the models based on the user’s
         location and orientation!
       – Can potentially make it much easier to create
         advanced digital-physical visualization apps!
October 8, 2012   Page 11
2. Interacting with objects and
Click to edit Master title style
controlling the environment

• Idea: using the smartphone as a information and control
  device for the environment.

       – Smartphones can be used to identify physical objects
       – Using the camera, GPS, NFC, etc

       – Apps can present relevant information to the user


       – Smartphones can adapt to the environment,
       – eg. as an advanced and dynamic remote control




October 8, 2012   Page 12
Interacting with objects –
 Click to edit Master title style tagging




App: Rød rute, Aarhus Festuge
 October 8, 2012   Page 13
Interacting with objects –
Click to edit Master title style next generation

•        RFID (Radio Frequence Identifier)
•        Radio based tag
•        Can be hidden inside object
           – No camera needed
• Support simple “swipe”-based
  interaction
• Killer app: mobile payment

• App: AudioMove.org
• Developed for Katapult and KMD
• Audio-based theater for system
  developers
• User scans props to hear the story
    October 8, 2012   Page 14
Controlling the environment
Click to edit Master title style

• Car controller, Mercedes and B&O
• Mercedes-Benz Viano Vision Diamond

• Standard iPhone / iPad is used as
  control device
       – Television, audio system, lights, …
       – Different scenes:
                  • Office,
                    cinema,
                    concert,
                    internet,
                    live or relax




October 8, 2012       Page 15
Click to edit Master title style activities
3. Apps as glue for digital

• Not all interaction has to go through the smartphone
• Other forms of interaction:
       – Interactive installations in the city
       – Installations in the home (heat control)
       – Fitness or life style equipment

• But smartphone apps may be the glue or hub that
  connects it all…




October 8, 2012   Page 16
Health monitors
Click to edit Master title style

• Jawbone UP
       – “Use the UP wristband
         and iPhone app to track
         your steps, distance,
         calories burned, pace,
         intensity level, active vs
         inactive time, GPS routes
         and more.
       – http://jawbone.com/up
• Nike+ Fuel Band
       – http://nikeplus.nike.com/plus/prod
         ucts/fuelband




October 8, 2012   Page 17
Click to edit Master title style activities
3. Apps as glue for digital

• Not all interaction has to go through the smartphone
• Other forms of interaction:
       – Interactive installations in the city
       – Installations in the home (heat control)
       – Fitness or life style equipment

• But smartphone apps may be the glue or hub that
  connects it all…

• All interaction is through a more natural interface but
  heavy lifting and data communication is handled by the
  smartphone apps
October 8, 2012   Page 18
Click toup Master title style
Wrap edit

More information:

       – MarketIT article:
         Next generation smartphone apps: sensor-based interaction
       –     http://www.marketit.dk/Forside/Indhold/Artikler/6---Tablets-smartphones--APPs/N%C3%A6ste-generation-
             smartphones--Sensorbaseret-interaktion

       – Bedre Innovation:
         Næste generations SmartPhone Apps til professionelle
         anvendelser
       –     http://www.bedreinnovation.dk/aktivitet/n%C3%A6ste-generations-smartphone-apps-til-professionelle-
             anvendelser

       – The Alexandra Institute
         Pending research application about professional smartphone apps
             http://alexandra.dk/




October 8, 2012     Page 19

Mais conteúdo relacionado

Destaque

Innovation & it i turisterhvervet "Præsentation Alexandra Instituttet"
Innovation & it i turisterhvervet "Præsentation Alexandra Instituttet"Innovation & it i turisterhvervet "Præsentation Alexandra Instituttet"
Innovation & it i turisterhvervet "Præsentation Alexandra Instituttet"Alexandra Instituttet
 
2010 Sorø "Fra spæd idé til Discovery Channel"
2010 Sorø "Fra spæd idé til Discovery Channel"2010 Sorø "Fra spæd idé til Discovery Channel"
2010 Sorø "Fra spæd idé til Discovery Channel"Alexandra Instituttet
 
2010 Sorø "Kontekst-sensitiv teknologi – GPS er kun begyndelsen"
2010 Sorø "Kontekst-sensitiv teknologi – GPS er kun begyndelsen"2010 Sorø "Kontekst-sensitiv teknologi – GPS er kun begyndelsen"
2010 Sorø "Kontekst-sensitiv teknologi – GPS er kun begyndelsen"Alexandra Instituttet
 
2010 Sorø "Velkommen i evv’s univers"
2010 Sorø "Velkommen i evv’s univers"2010 Sorø "Velkommen i evv’s univers"
2010 Sorø "Velkommen i evv’s univers"Alexandra Instituttet
 
2010 Sorø "Internet of Things, Cloud Computing & Sikkerhed"
2010 Sorø "Internet of Things, Cloud Computing & Sikkerhed"2010 Sorø "Internet of Things, Cloud Computing & Sikkerhed"
2010 Sorø "Internet of Things, Cloud Computing & Sikkerhed"Alexandra Instituttet
 
øLmave eller bare insulinresistent
øLmave   eller bare insulinresistentøLmave   eller bare insulinresistent
øLmave eller bare insulinresistentEdb Huset a/s
 
2010 Sorø "Det der med innovation i danske virksomheder"
2010 Sorø "Det der med innovation i danske virksomheder"2010 Sorø "Det der med innovation i danske virksomheder"
2010 Sorø "Det der med innovation i danske virksomheder"Alexandra Instituttet
 
Kontekst-sensitiv teknologi – GPS er kun begyndelsen
Kontekst-sensitiv teknologi – GPS er kun begyndelsenKontekst-sensitiv teknologi – GPS er kun begyndelsen
Kontekst-sensitiv teknologi – GPS er kun begyndelsenAlexandra Instituttet
 
Customer Experience Maturity Assessment
Customer Experience Maturity AssessmentCustomer Experience Maturity Assessment
Customer Experience Maturity AssessmentMac Wheeler
 
Gartner for Product Management and Marketing Clients
Gartner for Product Management and Marketing ClientsGartner for Product Management and Marketing Clients
Gartner for Product Management and Marketing Clientsfranzel77
 
Product and UX - are the roles blurring?
Product and UX - are the roles blurring?Product and UX - are the roles blurring?
Product and UX - are the roles blurring?Jesse Gant
 
Top 10 utilities interview questions with answers
Top 10 utilities interview questions with answersTop 10 utilities interview questions with answers
Top 10 utilities interview questions with answerslibbygray000
 
Defining product marketing
Defining product marketingDefining product marketing
Defining product marketingGerardo A Dada
 

Destaque (17)

Teknologikaravanen - katalog
Teknologikaravanen - katalogTeknologikaravanen - katalog
Teknologikaravanen - katalog
 
Innovation & it i turisterhvervet "Præsentation Alexandra Instituttet"
Innovation & it i turisterhvervet "Præsentation Alexandra Instituttet"Innovation & it i turisterhvervet "Præsentation Alexandra Instituttet"
Innovation & it i turisterhvervet "Præsentation Alexandra Instituttet"
 
2010 Sorø "Fra spæd idé til Discovery Channel"
2010 Sorø "Fra spæd idé til Discovery Channel"2010 Sorø "Fra spæd idé til Discovery Channel"
2010 Sorø "Fra spæd idé til Discovery Channel"
 
2010 Sorø "Kontekst-sensitiv teknologi – GPS er kun begyndelsen"
2010 Sorø "Kontekst-sensitiv teknologi – GPS er kun begyndelsen"2010 Sorø "Kontekst-sensitiv teknologi – GPS er kun begyndelsen"
2010 Sorø "Kontekst-sensitiv teknologi – GPS er kun begyndelsen"
 
2010 Sorø "Velkommen i evv’s univers"
2010 Sorø "Velkommen i evv’s univers"2010 Sorø "Velkommen i evv’s univers"
2010 Sorø "Velkommen i evv’s univers"
 
Sund Innovation i Randers
Sund Innovation i RandersSund Innovation i Randers
Sund Innovation i Randers
 
2010 Sorø "Internet of Things, Cloud Computing & Sikkerhed"
2010 Sorø "Internet of Things, Cloud Computing & Sikkerhed"2010 Sorø "Internet of Things, Cloud Computing & Sikkerhed"
2010 Sorø "Internet of Things, Cloud Computing & Sikkerhed"
 
øLmave eller bare insulinresistent
øLmave   eller bare insulinresistentøLmave   eller bare insulinresistent
øLmave eller bare insulinresistent
 
2010 Sorø "Det der med innovation i danske virksomheder"
2010 Sorø "Det der med innovation i danske virksomheder"2010 Sorø "Det der med innovation i danske virksomheder"
2010 Sorø "Det der med innovation i danske virksomheder"
 
Forretningsudvikling og Innovation
Forretningsudvikling og InnovationForretningsudvikling og Innovation
Forretningsudvikling og Innovation
 
Kontekst-sensitiv teknologi – GPS er kun begyndelsen
Kontekst-sensitiv teknologi – GPS er kun begyndelsenKontekst-sensitiv teknologi – GPS er kun begyndelsen
Kontekst-sensitiv teknologi – GPS er kun begyndelsen
 
Customer Experience Maturity Assessment
Customer Experience Maturity AssessmentCustomer Experience Maturity Assessment
Customer Experience Maturity Assessment
 
Gartner for Product Management and Marketing Clients
Gartner for Product Management and Marketing ClientsGartner for Product Management and Marketing Clients
Gartner for Product Management and Marketing Clients
 
Product and UX - are the roles blurring?
Product and UX - are the roles blurring?Product and UX - are the roles blurring?
Product and UX - are the roles blurring?
 
Top 10 utilities interview questions with answers
Top 10 utilities interview questions with answersTop 10 utilities interview questions with answers
Top 10 utilities interview questions with answers
 
Defining product marketing
Defining product marketingDefining product marketing
Defining product marketing
 
Strategic Role - Product Management
Strategic Role - Product ManagementStrategic Role - Product Management
Strategic Role - Product Management
 

Semelhante a Mobileappdev fah

Application-oriented IT Research af Frank Allan Hansen, Alexandra Instituttet
Application-oriented IT Research af Frank Allan Hansen, Alexandra InstituttetApplication-oriented IT Research af Frank Allan Hansen, Alexandra Instituttet
Application-oriented IT Research af Frank Allan Hansen, Alexandra InstituttetInfinIT - Innovationsnetværket for it
 
Workshop: AR Glasses and their Peculiarities
Workshop: AR Glasses and their PeculiaritiesWorkshop: AR Glasses and their Peculiarities
Workshop: AR Glasses and their PeculiaritiesMartin Lechner
 
Augmented Reality - Connecting Physical and Virtual Worlds
Augmented Reality - Connecting Physical and Virtual WorldsAugmented Reality - Connecting Physical and Virtual Worlds
Augmented Reality - Connecting Physical and Virtual WorldsDunavNET
 
Creating Large-Scale Responsive Websites
Creating Large-Scale Responsive WebsitesCreating Large-Scale Responsive Websites
Creating Large-Scale Responsive WebsitesKeith Doyle
 
Future Mobile Learning (29 August 2011)
Future Mobile Learning (29 August 2011)Future Mobile Learning (29 August 2011)
Future Mobile Learning (29 August 2011)Judy Brown
 
What is the Internet of Things and How it Impacts You
What is the Internet of Things and How it Impacts YouWhat is the Internet of Things and How it Impacts You
What is the Internet of Things and How it Impacts YouEduardo Pelegri-Llopart
 
Human Interface Guidlines for Mobile Applications
Human Interface Guidlines for Mobile ApplicationsHuman Interface Guidlines for Mobile Applications
Human Interface Guidlines for Mobile ApplicationsMartin Ebner
 
Mobile Device Management (MDM) & BYOD
Mobile Device Management (MDM) & BYOD  Mobile Device Management (MDM) & BYOD
Mobile Device Management (MDM) & BYOD juliannacole
 
Mobile CMS - CMSExpo 2010
Mobile CMS - CMSExpo 2010Mobile CMS - CMSExpo 2010
Mobile CMS - CMSExpo 2010Tom Deryckere
 
Google Glass
Google GlassGoogle Glass
Google Glasssie92
 
A research on i pad device & experience design
A research on i pad   device & experience designA research on i pad   device & experience design
A research on i pad device & experience designVinny Wu
 
Understanding the Complex Mobile Landscape
Understanding the Complex Mobile Landscape Understanding the Complex Mobile Landscape
Understanding the Complex Mobile Landscape R2integrated
 
Mobile development intro
Mobile development introMobile development intro
Mobile development introKhaled Annajar
 
Project glass(Googleglass)
Project glass(Googleglass)Project glass(Googleglass)
Project glass(Googleglass)aparna kukkadapu
 

Semelhante a Mobileappdev fah (20)

Application-oriented IT Research af Frank Allan Hansen, Alexandra Instituttet
Application-oriented IT Research af Frank Allan Hansen, Alexandra InstituttetApplication-oriented IT Research af Frank Allan Hansen, Alexandra Instituttet
Application-oriented IT Research af Frank Allan Hansen, Alexandra Instituttet
 
Workshop: AR Glasses and their Peculiarities
Workshop: AR Glasses and their PeculiaritiesWorkshop: AR Glasses and their Peculiarities
Workshop: AR Glasses and their Peculiarities
 
Augmented Reality - Connecting Physical and Virtual Worlds
Augmented Reality - Connecting Physical and Virtual WorldsAugmented Reality - Connecting Physical and Virtual Worlds
Augmented Reality - Connecting Physical and Virtual Worlds
 
Creating Large-Scale Responsive Websites
Creating Large-Scale Responsive WebsitesCreating Large-Scale Responsive Websites
Creating Large-Scale Responsive Websites
 
Nearby Notify
Nearby NotifyNearby Notify
Nearby Notify
 
Future Mobile Learning (29 August 2011)
Future Mobile Learning (29 August 2011)Future Mobile Learning (29 August 2011)
Future Mobile Learning (29 August 2011)
 
What is the Internet of Things and How it Impacts You
What is the Internet of Things and How it Impacts YouWhat is the Internet of Things and How it Impacts You
What is the Internet of Things and How it Impacts You
 
Human Interface Guidlines for Mobile Applications
Human Interface Guidlines for Mobile ApplicationsHuman Interface Guidlines for Mobile Applications
Human Interface Guidlines for Mobile Applications
 
Mobile Device Management (MDM) & BYOD
Mobile Device Management (MDM) & BYOD  Mobile Device Management (MDM) & BYOD
Mobile Device Management (MDM) & BYOD
 
Mobile CMS - CMSExpo 2010
Mobile CMS - CMSExpo 2010Mobile CMS - CMSExpo 2010
Mobile CMS - CMSExpo 2010
 
Google Glass
Google GlassGoogle Glass
Google Glass
 
Mobile development
Mobile developmentMobile development
Mobile development
 
Mt114 mobileapps
Mt114 mobileappsMt114 mobileapps
Mt114 mobileapps
 
A research on i pad device & experience design
A research on i pad   device & experience designA research on i pad   device & experience design
A research on i pad device & experience design
 
Mt114 mobileapps
Mt114 mobileappsMt114 mobileapps
Mt114 mobileapps
 
Understanding the Complex Mobile Landscape
Understanding the Complex Mobile Landscape Understanding the Complex Mobile Landscape
Understanding the Complex Mobile Landscape
 
Optimized mobile apps
Optimized mobile appsOptimized mobile apps
Optimized mobile apps
 
Mobile development intro
Mobile development introMobile development intro
Mobile development intro
 
Project glass
Project glassProject glass
Project glass
 
Project glass(Googleglass)
Project glass(Googleglass)Project glass(Googleglass)
Project glass(Googleglass)
 

Mais de Alexandra Instituttet

2010 Sorø "Erhvervsudvikling og Alexandra Instituttet i Region Sjælland"
2010 Sorø "Erhvervsudvikling og Alexandra Instituttet i Region Sjælland"2010 Sorø "Erhvervsudvikling og Alexandra Instituttet i Region Sjælland"
2010 Sorø "Erhvervsudvikling og Alexandra Instituttet i Region Sjælland"Alexandra Instituttet
 
2010 Sorø "Innovative alliancer flytter grænser – skal din virksomhed være med?"
2010 Sorø "Innovative alliancer flytter grænser – skal din virksomhed være med?"2010 Sorø "Innovative alliancer flytter grænser – skal din virksomhed være med?"
2010 Sorø "Innovative alliancer flytter grænser – skal din virksomhed være med?"Alexandra Instituttet
 
Midt- og vestjysk it-satsning – oplæg til vendepunkt
Midt- og vestjysk it-satsning – oplæg til vendepunktMidt- og vestjysk it-satsning – oplæg til vendepunkt
Midt- og vestjysk it-satsning – oplæg til vendepunktAlexandra Instituttet
 
Perspektiverne i den lokale erhvervsudvikling
Perspektiverne i den lokale erhvervsudvikling Perspektiverne i den lokale erhvervsudvikling
Perspektiverne i den lokale erhvervsudvikling Alexandra Instituttet
 
Alexandra Instituttet som samarbejdspartner i udviklingsprojekter
Alexandra Instituttet som samarbejdspartner i udviklingsprojekterAlexandra Instituttet som samarbejdspartner i udviklingsprojekter
Alexandra Instituttet som samarbejdspartner i udviklingsprojekterAlexandra Instituttet
 
Find nye forretningsmuligheder med IT-I-ALTING
Find nye forretningsmuligheder med IT-I-ALTINGFind nye forretningsmuligheder med IT-I-ALTING
Find nye forretningsmuligheder med IT-I-ALTINGAlexandra Instituttet
 
Sund Innovation i Randers Sundhedscenter
Sund Innovation i Randers SundhedscenterSund Innovation i Randers Sundhedscenter
Sund Innovation i Randers SundhedscenterAlexandra Instituttet
 

Mais de Alexandra Instituttet (11)

2010 Sorø "Ekko af byen"
2010 Sorø "Ekko af byen"2010 Sorø "Ekko af byen"
2010 Sorø "Ekko af byen"
 
2010 Sorø "Erhvervsudvikling og Alexandra Instituttet i Region Sjælland"
2010 Sorø "Erhvervsudvikling og Alexandra Instituttet i Region Sjælland"2010 Sorø "Erhvervsudvikling og Alexandra Instituttet i Region Sjælland"
2010 Sorø "Erhvervsudvikling og Alexandra Instituttet i Region Sjælland"
 
2010 Sorø "Åbning i Sorø"
2010 Sorø "Åbning i Sorø"2010 Sorø "Åbning i Sorø"
2010 Sorø "Åbning i Sorø"
 
2010 Sorø "Innovative alliancer flytter grænser – skal din virksomhed være med?"
2010 Sorø "Innovative alliancer flytter grænser – skal din virksomhed være med?"2010 Sorø "Innovative alliancer flytter grænser – skal din virksomhed være med?"
2010 Sorø "Innovative alliancer flytter grænser – skal din virksomhed være med?"
 
Midt- og vestjysk it-satsning – oplæg til vendepunkt
Midt- og vestjysk it-satsning – oplæg til vendepunktMidt- og vestjysk it-satsning – oplæg til vendepunkt
Midt- og vestjysk it-satsning – oplæg til vendepunkt
 
Perspektiverne i den lokale erhvervsudvikling
Perspektiverne i den lokale erhvervsudvikling Perspektiverne i den lokale erhvervsudvikling
Perspektiverne i den lokale erhvervsudvikling
 
Alexandra Instituttet som samarbejdspartner i udviklingsprojekter
Alexandra Instituttet som samarbejdspartner i udviklingsprojekterAlexandra Instituttet som samarbejdspartner i udviklingsprojekter
Alexandra Instituttet som samarbejdspartner i udviklingsprojekter
 
Massive Data
Massive DataMassive Data
Massive Data
 
Internet of Things
Internet of ThingsInternet of Things
Internet of Things
 
Find nye forretningsmuligheder med IT-I-ALTING
Find nye forretningsmuligheder med IT-I-ALTINGFind nye forretningsmuligheder med IT-I-ALTING
Find nye forretningsmuligheder med IT-I-ALTING
 
Sund Innovation i Randers Sundhedscenter
Sund Innovation i Randers SundhedscenterSund Innovation i Randers Sundhedscenter
Sund Innovation i Randers Sundhedscenter
 

Mobileappdev fah

  • 1. Click to edit Master title style Application-oriented IT Research: Challenges & Trends for Next- generation Smartphone Apps FRANK ALLAN HANSEN PRODUCT MANAGER ALEXANDRA MOBILE APPS RESEARCH AND INNOVATION SCIENTIST, PHD
INTERACTIVE SPACES LAB
THE ALEXANDRA INSTITUTE LTD. frank.allan.hansen@alexandra.dk
  • 2. Agenda Click to edit Master title style Challenges & Trends for Next-generation smartphone apps • Introduction • The current app paradigm • Three perspectives on next generation smartphone apps – Overlaying the world – Interacting with objects and controlling the environment – Apps as glue for digital activities • Wrap up and conclusion October 8, 2012 Page 2
  • 3. Click Alexandra Institute The to edit Master title style • Private research institute founded in 1999 • Part of the GTS network (Godkendt teknologisk service) • Focus on applied, research-based innovation in pervasive computing – Pervasive Healthcare, Interactive Spaces, Advanced visualization, New Ways of Working, Software, Pervasive Positioning, It-security and Business and processes • Non-profit company that works with application-oriented IT research and development and sells IT services and products to the Danish industry. • Bridge-builder between research, private corporations, public institutions and citizens. • Based in the IT-city Katrinebjerg in Aarhus and the IT-University in Copenhagen. October 8, 2012 Page 3
  • 4. Click to edit Masterparadigm The current app title style • Social networking, games, photography,… • Simple focused apps • Rich in detail • Rich interaction – Touch and gesture based • Lot of attention to design and detail • However, apps are often monolithic • Developed for their own digital niche • Not much integration with the user’s world October 8, 2012 Page 4
  • 5. Click to edit Master “smart” devices Smartphones as title style October 8, 2012 Page 5
  • 6. Click to edit Master “smart” devices Smartphones as title style • Very powerful devices – Quad core CPUs, Dedicated GPUs, etc • Many physical sensors: – Camera (ID, Object tracking, light levels) – Microphone (audio levels, voice commands) – 3G/4G (location, proximity) – Bluetooth (location, proximity) – Wi-Fi (location, proximity) – Accelerometer (movement) – Compass (direction) – GPS (location) – Gyroscope (movement) – NFC/RFID (identification) – … October 8, 2012 Page 6
  • 7. Digital-physical apps Click to edit Master title style • Next generation apps should utilize this technology • Apps should be aware of the user’s context – Adapt functionality and application behavior – Present and filter relevant information – Allow the user to control and interact with the surroundings • Not an “easy” task of course… • So new software tools and ideas are needed October 8, 2012 Page 7
  • 8. 1. Overlaying the world Click to edit Master title style October 8, 2012 Page 8 Minority Report (2002)
  • 9. Location-based AR Click to edit Master title style • Digital Threads (Digitale Tråde) • Location-based augmented reality – GPS, Accelerometer, Compass • Developed with Museum Midtjylland • Displays excavation sites and historical buildings in the landscape • Challenge: – Turned out to be “complex” to implement – Accuracy depends on the smartphone sensors October 8, 2012 Page 9
  • 10. Vision based AR Click to edit Master title style Storm P Museum • Storm P Museum • Skovgaard Museum • Developed for Redia – http://www.redia.dk/ • Vision based • Based on feature models Skovgaard Museum • Overlays graphics, animation and control over the camera image. • Challenge: – Very dependent on light conditions October 8, 2012 Page 10 – Scalability: hard to model everything
  • 11. Challenges for mobile augmented reality Click to edit Master title style • AR is “complex” to implement – Sensor fusion – Advanced tracking • Location based augmented reality is only as good as the accuracy of the mobile phone's sensors • Vision based augmented reality requires models and a lot of computation – (i.e. you can’t model the entire world) • But, when you combine the two: – You can filter the models based on the user’s location and orientation! – Can potentially make it much easier to create advanced digital-physical visualization apps! October 8, 2012 Page 11
  • 12. 2. Interacting with objects and Click to edit Master title style controlling the environment • Idea: using the smartphone as a information and control device for the environment. – Smartphones can be used to identify physical objects – Using the camera, GPS, NFC, etc – Apps can present relevant information to the user – Smartphones can adapt to the environment, – eg. as an advanced and dynamic remote control October 8, 2012 Page 12
  • 13. Interacting with objects – Click to edit Master title style tagging App: Rød rute, Aarhus Festuge October 8, 2012 Page 13
  • 14. Interacting with objects – Click to edit Master title style next generation • RFID (Radio Frequence Identifier) • Radio based tag • Can be hidden inside object – No camera needed • Support simple “swipe”-based interaction • Killer app: mobile payment • App: AudioMove.org • Developed for Katapult and KMD • Audio-based theater for system developers • User scans props to hear the story October 8, 2012 Page 14
  • 15. Controlling the environment Click to edit Master title style • Car controller, Mercedes and B&O • Mercedes-Benz Viano Vision Diamond • Standard iPhone / iPad is used as control device – Television, audio system, lights, … – Different scenes: • Office, cinema, concert, internet, live or relax October 8, 2012 Page 15
  • 16. Click to edit Master title style activities 3. Apps as glue for digital • Not all interaction has to go through the smartphone • Other forms of interaction: – Interactive installations in the city – Installations in the home (heat control) – Fitness or life style equipment • But smartphone apps may be the glue or hub that connects it all… October 8, 2012 Page 16
  • 17. Health monitors Click to edit Master title style • Jawbone UP – “Use the UP wristband and iPhone app to track your steps, distance, calories burned, pace, intensity level, active vs inactive time, GPS routes and more. – http://jawbone.com/up • Nike+ Fuel Band – http://nikeplus.nike.com/plus/prod ucts/fuelband October 8, 2012 Page 17
  • 18. Click to edit Master title style activities 3. Apps as glue for digital • Not all interaction has to go through the smartphone • Other forms of interaction: – Interactive installations in the city – Installations in the home (heat control) – Fitness or life style equipment • But smartphone apps may be the glue or hub that connects it all… • All interaction is through a more natural interface but heavy lifting and data communication is handled by the smartphone apps October 8, 2012 Page 18
  • 19. Click toup Master title style Wrap edit More information: – MarketIT article: Next generation smartphone apps: sensor-based interaction – http://www.marketit.dk/Forside/Indhold/Artikler/6---Tablets-smartphones--APPs/N%C3%A6ste-generation- smartphones--Sensorbaseret-interaktion – Bedre Innovation: Næste generations SmartPhone Apps til professionelle anvendelser – http://www.bedreinnovation.dk/aktivitet/n%C3%A6ste-generations-smartphone-apps-til-professionelle- anvendelser – The Alexandra Institute Pending research application about professional smartphone apps http://alexandra.dk/ October 8, 2012 Page 19

Notas do Editor

  1. Pervasive Healthcare, Interactive Spaces, AvanceretVisualiseringogInteraktion, New Ways of Working, Software, Pervasive Positioning, It-sikkerhedogForretningsforståelse for pervasive computing.Instituttetharhovedkontori IT-byenKatrinebjergiÅrhus med en afdelingpå It-universitetetiØrestaden.
  2. Think of it as a Livestrong bracelet that keeps track of your body’s inner goings-on while you wear it. Working in conjunction with your iPhone, Up tracks your daily physical activity, monitors your sleep habits and quality, and also acts as a meal tracking aide. All of the data is stored within the app on your phone, synced by plugging Up’s 3.5mm jack into the iPhone earbud port.