Personal Stylist App for Men Using AI Image Processing
1. Personal Stylist Application for Men
Utilizing Image Processing and
Artificial Intelligence
Presenter: Rene C. Toyer
Project Supervisor: Dr. Akash Pooransingh
Project Type: IV
Date: 14th April 2015
Slide 1 of 12
3. Project Objectives
Investigate: Image Classifications Methods
Artificial Intelligence Techniques
Develop: Chosen Classification Method to classify
uploaded apparel
Chosen AI Technique to match clothing
Implement: Android Application that does the following:
1. Access Device Camera, and External Storage
2. Reads QR Code data
3. Classify or Describe Apparel
4. Use AI System to select appropriate apparel
for the option selected
5. Enable text-to-speech on application
responses
Slide 3 of 12
4. Project Scope
INCLUDES
• Text-to-Speech on activity start and
activity results
• QR Code Reader
• General Detection of 15 Colours
• Links to Shopping Websites (Limited
amount hardcoded)
• Image Storage and Retrieval (Limited
to Device Storage)
• Apparel Data Dictionary (Limited to
torso, pants and shoes by Western
Standards)
• Case Based AI System for Outfit
Selection (done on PC)
• Western Standards of outfits and
Dress Code stored as the Cases
EXCLUDES
• Settings to turn-off the TTS Feature
• Database for storing QR Codes read
by Scanner
• Detection of Multiple Colours in one
image
• Detection of Patterns and Prints
• Detection of Textures
• Apparel Recognition or Classification
• Deleting of Images within the App
once it has be added
• Data Dictionary of Accessories
• AI Cases that include Accessories
• Styling of Female Users
Slide 4 of 12
5. System Features
Feature Purpose
Add to Closet To allow the user to add their clothing to digital folder
Colour Detector (15 Colours) To help a visually impaired user identify a key attribute
of the apparel item
My Closet To keep an image data log of all the user’s apparel
QR Code Reader To help a visually impaired user read the data encoded
within the QR Code attached to their clothing
Style Me To help the user select and match clothing
appropriately for specific events and settings
Online Shopping To guide the user to best shopping sites for the most
popularly trending clothing items
Apparel Guide To give the user instant access to an apparel image
data dictionary
Application Personality To voice all activity initiation and activity responses
Slide 5 of 12
8. System Performance
Slide 8 of 12
Colour Detector
• Detects 15 colours with 80% accuracy based on 6 scene
mode states
• Matusiak’s detected 7 colours with 85% accuracy based on
2 scene mode states
• My Stylist Colour Detector uses RGB Averaging then
conversion
• Matusiak uses conversion then histogram bin maximum
AI CBR System
• Case Retrieval – Retrieves the most similar case(s) with a
maximum of 91% and an average of 60% weighting
• No adaptation as the tool does not allow this
• Lin’s System retrieves the most similar case(s) with a
maximum of 95% and an average of 65% weighting
• Lin’s System use a Genetic Algorithm for adaptation
Lin 2007
Matusiak 2013
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
PrecisionRate
Colour
Precision Rate/Colour
(Formulation [number of states detected on/number of total states])
9. Future Work
Slide 9 of 12
Feature Recommended Development
Add to Closet Addition of the Apparel Classifier
Colour Detector Add more colours and improve the performance
My Closet Allow the user to delete items within the app, have
images grouped by type
QR Code Reader Add automatic scanning independent of device
camera app
Style Me Integrate into the app after thorough refining, develop
feedback method to facilitate adaptation
Online Shopping Populate a grid view with several items from the
various shopping sites for simultaneous shopping
Apparel Guide Add data and improve (image and text list)
Application Personality Add voice recognition and change TTS to AI
11. Conclusion
This application falls under the Lifestyle category
on the Google Play Store
The objectives were satisfied with a basis for
further research and development
Slide 11of 12
12. References
Bach, Kerstin, and Klaus-Dieter Althoff. "Developing case-based reasoning applications using mycbr 3."
In Case-Based Reasoning Research and Development, pp. 17-31. Springer Berlin Heidelberg, 2012.
Bahls, Daniel, and Thomas Roth-Berghofer. "Explanation support for the case-based reasoning tool
mycbr." In AAAI, vol. 7, pp. 1844-1845. 2007.
Jerpi, Laura. "Defining Dress Codes – What to Wear for Every Occasion." The Art Institutes Blog. July 19,
2014. Accessed February 7, 2015.
Lin, Jeng-Jong. “A Case-Based Apparel Styling Classification Approach Using Genetic Algorithm.”
Tamkang Journal of Science and Engineering, Vol. 10, No. 3, pp. 243 252 (2007).
Markets and Markets. "World Mobile Applications Market - Advanced Technologies, Global Forecast
(2010 - 2015)." MarketsandMarkets.com. August 1, 2010. Accessed January 26, 2015.
Matusiak, K., P. Skulimowski, and P. Strumillo. "Object recognition in a mobile phone application for
visually impaired users." In Human System Interaction (HSI), 2013 The 6th International Conference on,
pp. 479-484. IEEE, 2013.
Slide 12 of 12
Notas do Editor
Introduce self and project – 15 secs
Very very briefly run through what to expect in this presentation –15 to 20 secs
State that the project objectives can be broken up into 3 categorizes Investigate, Develop and Implement
Show table, briefly go through
20 secs
30 secs
30 secs, should finish here before 2 mins has passed
Highlight the visually impaired stuff
Should finish here by 5-6 mins in
DFD on page 117 – should finish here before 12 mins has passed
P1. HSV Colour Space, 29% saturation is more or less a grayscale, 0-100% Brightness defined black to white, angles 0-360 are hues …Show method used from android graphics library
P2. Using the android Manifest to get permission to access the device external storage (pictures folder created – My Closet)
P3. Done using the Zxing Library, all images had to be converted to bitmaps before any processing can be done…
P4. Android Manifest Permission to use internet access
P5. Data Library within the application memory allocated once installed
P6. Requests P7
P7. Sends Data to the AI System …event per dress code, taxomony set up,
* Based on the data entered and how they are associated to each other you can get a higher weighting, in other cases the weighting is weaker when the alternative has to be found.
>> Remember this is based on 140 stored cases (5 per DressCode_Event)
*Scene mode states = None (Flash On and Off), Indoor (Flash On and Off), Candle Light and Dawn
*Matusiak = None (Flash On and Off)
Show precision rates (order = Red,Pink,Purple,Blue,LightBlue,Green,LightGreen,Yellow,Orange,Brown,Khaki,White,LightGrey,DarkGrey,Black)
(Formulation [number of states detected on/number of total states])
Should be done by 13mins
Recap and conclude
Concluding that the artistic world and the technological one can indeed in fact form a relationship in each artistic field
Life has no substance without art, life cannot evolve without technology so why not marry the two?
This project started as a vision, and altho there is room for improvement…I now one step closer to achieving that vision.
At this moment I will facilitate questions from the examiners