As multimedia are being used to facilitate and enhance teaching and creative learning, making rich media including images and videos searchable are critical in today and future elearning platform and management system. Traditionally, it's a difficult challenge. Some of the team members have invented an interdisciplinary framework which integrates the state-of-the-art image recognition technology and brain science research from MIT, intelligent cluster algorithm and patentable digital “tagging” technology

1. OMNIMEDIA “Intelligent Rich Media Search Platform”

6. Why better? Accuracy Hand inserted metadata Cost effectiveness Machine learning / Computer Vision OMNIMedia Platform

8. Example: MLB.com

9. Object detection Cardeal.com Bookmark the Info without Leaving the video

10. Youtube Video NYC Tiffany Bookmark the Info without Leaving the video

11. Object detection Great Sushi from Porter Sq, Cambridge Bookmark the Info without Leaving the video

12. Technology & Product

13. Image Recognition Input image Texture Based Classification Tree / Not-Tree Classification Feature Vector Decision Input Image Shape Based Classification car car ped Biological Model Feature Extraction Car / Not-Car Classification Feature Vector Decision

14. Image Recognition Performance Biological Model

16. Tagging assist

17. Clustering – add contextual info http://eigencluster.csail.mit.edu/

18. Interdisciplinary framework (hybrid solution) OMNIMedia Cluster Algorithm OMNIMedia platform Auto-generate Initial Metadata Add contextual Info to further enhance metadata User enriched Media content Metadata – fine Tune the image Recognition engine Computer Vision (Image recognition)

19. Online Content Delivery Stack MySpace Operating System Browser ??? MLB.com YouTube etc G o o g l e WWW Internet

20. Online Content Delivery Stack Semantic Web / Metadata layer Internet OS (Browser and OS converge) Search www Internet G o o g l e OMNIMedia MySpace MLB.com YouTube etc ?

21. Technology Diffusion Web 2.0 services -> applications on InternetOS Data-driven G o o g l e OMNIMedia

22. Value Chain