Improving your vision with Azure Cognitive Services - /dev/070

•Transferir como PPTX, PDF•

1 gostou•434 visualizações

Slides of the presentation I gave at the /dev/070 meetup on Dec 13th 2017. The repository with source code is located at: https://github.com/marcduiker/demos-azure-cognitive-services. In order to run execute the requests in the .http files you need VS Code with the Rest Client extension.

Tecnologia

Improving your vision with Azure Cognitive Services - MixUG 1
Improving your vision with Azure Cognitive Services
13 December – /dev/070

About me:
Marc Duiker
mduiker@xpirit.comwww.xpirit.com
blog.marcduiker.nl
@marcduiker
‘13-’16
www.youtube.com/user/marcduiker

Agenda
• What is Azure Cognitive Services
• Computer Vision API
• Azure Portal, VS Code & Visual Studio
• Custom Vision API
• Custom Vision portal
Improving your vision with Azure Cognitive Services - /dev/070 3

ML & AI is hot!
Improving your vision with Azure Cognitive Services - /dev/070 4

Improving your vision with Azure Cognitive Services - /dev/070 5

Improving your vision with Azure Cognitive Services - /dev/070 6

Cortana Intelligence Suite
Improving your vision with Azure Cognitive Services - /dev/070 7

Microsoft
Cognitive
Services
Give your apps
a human side
From faces to feelings, allow your
apps to understand images and video
Hear and speak to your users by filtering noise,
identifying speakers, and understanding intent
Process text and learn how to
recognize what users want
Tap into rich knowledge amassed from
the web, academia, or your own data
Access billions of web pages, images, videos,
and news with the power of Bing APIs

Improving your vision with Azure Cognitive Services - /dev/070 9

Improving your vision with Azure Cognitive Services - /dev/070 10

Improving your vision with Azure Cognitive Services - /dev/070 11

Improving your vision with Azure Cognitive Services - /dev/070 12

Improving your vision with Azure Cognitive Services - /dev/070 13

Improving your vision with Azure Cognitive Services - /dev/070 14
Cognitive Services Labs
https://labs.cognitive.microsoft.com/

Microsoft Cognitive Services Docs
Improving your vision with Azure Cognitive Services - /dev/070 15

How did we end up here?
Improving your vision with Azure Cognitive Services - /dev/070 16
Microsoft Cognitive
Services
Bing Search
Project Oxford
Microsoft CognitiveToolkit
(CNTK)
MicrosoftTechnology & Research
2015
2009 2016

Improving your vision with Azure Cognitive Services - MixUG 17
Computer Vision API

Computer Vision API
• Recognize and understand information from images
Improving your vision with Azure Cognitive Services - /dev/070 18
Tags
Descriptions
Faces
Colors
Domain models
ImageType
Cognitive Services
Computer Vision API

Computer Vision API examples
• API Reference
• https://westeurope.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf23d8e
c6739/operations/56f91f2e778daf14a499e1fa
• Perform API calls from VS Code
Improving your vision with Azure Cognitive Services - /dev/070 19

What do we need to get started?
• Create Computer Vision API endpoint in Azure
• Subscription key
• Create an application to
• Select an image
• Do a post to the Computer Vision API endpoint
Improving your vision with Azure Cognitive Services - /dev/070 20

Improving your vision with Azure Cognitive Services - MixUG 21

Demo: HelloCV
• Provide a local image
• Do a request to Analyze endpoint
• Get analysis results back as json
Improving your vision with Azure Cognitive Services - /dev/070 22
Tags
Descriptions
Faces
Colors
ImageTypeCognitive Services
Computer Vision API

Demo: Analyze images on website
Improving your vision with Azure Cognitive Services - /dev/070 23
http://...
<img>
<img>
<img>
File
Scrape images Analyze Save results
Cognitive Services
uri
uri
uri
Get sources
Goal: Analyze images on a website

Cognitive Services Demo App
• Computer Vision API
• Analyze image
• Describe image
• OCR (optical character recognition)
• Domain model detection: Landmarks
• Emotion API
• Emotion analysis
Improving your vision with Azure Cognitive Services - /dev/070 24
https://github.com/marcduiker/demos-azure-cognitive-services

Improving your vision with Azure Cognitive Services - MixUG 25
Custom Vision API (preview)

Custom Vision API
• Image classification
Improving your vision with Azure Cognitive Services - /dev/070 26
Cognitive Services
Custom Vision API
Train
#A #B
? #A

Custom Vision Demo
Improving your vision with Azure Cognitive Services - /dev/070 27
Ferrari 250 GT SWB Aston Martin DB4

To sum it up
• Ever growing collection of ‘intelligent’ APIs
• Easy to get started
• Choose carefully which API best suits your need
• Think about confidence levels
• When dealing with faces or handwriting:
Personally identifiable information (PII) -> Privacy
Improving your vision with Azure Cognitive Services - /dev/070 28

Improving your vision with Azure Cognitive Services - MixUG 29
Thanks! See you next time!

Marc Duiker
mduiker@xpirit.com
@marcduiker
Xpirit
Laapersveld 27
Hilversum
www.xpirit.com

Cognitive Services Related Resources
• https://azure.microsoft.com/en-us/services/cognitive-services/
• https://docs.microsoft.com/en-us/azure/cognitive-services/
• https://channel9.msdn.com/Search?term=Cognitive%20Services
• https://www.microsoft.com/en-us/seeing-ai/
• https://www.microsoft.com/en-us/research/research-area/computer-vision/
• https://www.customvision.ai/
• https://github.com/marcduiker/demos-azure-cognitive-services
Improving your vision with Azure Cognitive Services - /dev/070 31

Mais conteúdo relacionado

Mais procurados

Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...

Windows Developer

Azure Custom Vision allows you to create powerful image classifiers in minutes to without having to be an AI expert. You feed the service with images -so the service adapts to your own needs-, tag them and train a model that can be published to an endpoint URL for further requests. You can also use the Custom Vision SDK to automatize the process. Furthermore, this model can also be exported for offline, real-time classification experiences. For instance, you can embed the classifier into a mobile application, or a website. In this session, the Custom Vision service will be described. An image classifier will be created by using the .portal. The output model will be exported to both Tensorflow and CoreML to integrate it into an Android and iOS mobile applications, respectively.

Building real time image classifiers for mobile apps with azure custom vision

Luis Beltran

Create real value in your business process by automated data and form extraction

Marvin Heng

SQLDay 2021 PL AI Enrichment Azure Search.pptx

Luis Beltran

Global Azure2021 Verona.pptx

Luis Beltran

The web platform is more powerful than ever, and we’re on the cusp of a revolution in what web sites and web apps are capable of. In this session, we take a quick tour of what’s new in Microsoft Edge and the Windows web platform, and then chart our course for the year ahead: New capabilities that make next-generation web experiences virtually indistinguishable from native apps, and new features and improvements that will raise the bar for what a browser can do.

Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...

Windows Developer

Mais procurados (6)

Build 2017 - B8090 - How Microsoft Cognitive Services can help your apps comm...

Building real time image classifiers for mobile apps with azure custom vision

Create real value in your business process by automated data and form extraction

SQLDay 2021 PL AI Enrichment Azure Search.pptx

Global Azure2021 Verona.pptx

Build 2017 - B8041 - Microsoft Edge: What’s new and what’s next for the web a...

Semelhante a Improving your vision with Azure Cognitive Services - /dev/070

Improving your vision with Azure Cognitive Services - MixUG

Marc Duiker

Biometric Systems - Automate Video Streaming Analysis with Azure and AWS

Roberto Falconi

Computer Vision and Text Analytics Using Azure Cognitive Services

Umme Rubaiyat Chowdhury

Azure Cognitive Services로 똑똑한 서비스 만들

Hong Min Kim

With recent innovations in technology, AI has left the realms of science fiction and is becoming increasingly mainstream. Whether you’re interested in building games or apps, a sound understanding of the practical applications of AI will give you the edge needed to stand out from the crowd and will set you up for success. Through this workshop, you’ll gain hands-on experience in adding AI elements into games and apps built with Unity. Using Microsoft Cognitive Services, a cloud-based AI platform, you’ll get exposure to AI features including computer vision and language recognition. Assets and starting files will be provided for you to work with during the practical components of this 2-hour workshop. This workshop will be taught by Pablo Farias Navarro, founder of Zenva - a leading education platform to learn coding and game making. Since 2012, Pablo has been developing professional-grade courses that have helped over 1 million learners worldwide.

Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop

Pablo Farías Navarro

Getting started with microsoft cognitive services api

Jasjit Chopra

In this workshop, you will be introduced to the Microsoft Azure Cognitive Services, a range of offerings you can use to infuse intelligence and machine learning into your applications without needing to build the code from scratch. We will cover pre-trained AI APIs, such as computer vision and text analytics, that is accessed by REST protocol. Next, we will dive into Custom AI that uses transfer learning - Microsoft Azure Custom Vision. This enables you to provide a small amount of your own data to train an image classification model. Wrapping the workshop up by building our custom trained AI into an application - using Logic Apps, this technology is ideal for building data pipeline processes that work with your machine learning models.Title: Creating applications that can see, hear, speak or understand - using Microsoft Cognitive Services Workshop Description: In this workshop, you will be introduced to the Microsoft Azure Cognitive Services, a range of offerings you can use to infuse intelligence and machine learning into your applications without needing to build the code from scratch. We will cover pre-trained AI APIs, such as computer vision and text analytics, that is accessed by REST protocol. Next, we will dive into Custom AI that uses transfer learning - Microsoft Azure Custom Vision. This enables you to provide a small amount of your own data to train an image classification model. Wrapping the workshop up by building our custom trained AI into an application - using Logic Apps, this technology is ideal for building data pipeline processes that work with your machine learning models.

Creating applications that can see, hear, speak or understand using microso...

Radu Vunvulea

Slides from my talk at Big Data Conference 2018 in Vilnius Doing data science today is far more difficult than it will be in the next 5-10 years. Sharing, collaborating on data science workflows in painful, pushing models into production is challenging. Let’s explore what Azure provides to ease Data Scientists’ pains. What tools and services can we choose based on a problem definition, skillset or infrastructure requirements? In this talk, you will learn about Azure Machine Learning Studio, Azure Databricks, Data Science Virtual Machines and Cognitive Services, with all the perks and limitations.

Making Data Scientists Productive in Azure

Valdas Maksimavičius

A talk from the Design Track at AWE EU 2018 - the World's #1 XR Conference & Expo in Munich, Germany 18 -19, October, 2018. Adiel Gur (Waking App Ltd) Matan Libis (Waking App Ltd) Waking App Ltd: Next Gen AR Toolset As we all know, Augmented Reality is not only an exciting new technology but a business enabler with numerous possibilities. In this presentation, Matan Libis, CEO and Adiel Gur, CTO and co-founder will demonstrate how WakingApp’s AR Toolset, ENTiTi 3.0, enables app designers, architects and construction professionals to create fabulous AR projects. Adiel will present the unique functionalities and features of ENTiTi 3.0. This will include how to integrate your AR creations into an existing mobile app and also how to create your own white label solution with our online wizard. http://AugmentedWorldExpo.com

Waking App Ltd: Next Gen AR Toolset

AugmentedWorldExpo

The Wikitude SDK and the Wikitude Studio

Martin Lechner

Hyf project ideas_02

KatoK1

Microsoft Azure - The Best Platform for AI

Mayur Tendulkar

Hyf azure ml_1

KatoK1

For more information about embedded vision, please visit: http://www.embedded-vision.com Thanks to improvements in processors, image sensors, and algorithms, more and more of our devices now -- for the first time -- are gaining the ability to see and understand the world around them. In this talk from the June 2015 Augmented World Expo, Jeff Bier (Founder of the Embedded Vision Alliance) highlights the opportunities for creating more intelligent, interactive and insightful apps and products by harnessing embedded vision technology. From consumer electronics to smartphones to smart glasses to retail and industrial applications, vision technology enables new types of interactivity, new types of insights (for example, assessing the emotional state of users) and new types of experiences. Jeff highlights some of the coolest new products and apps leveraging vision technology, and explores some of the key trends and challenges associated with this technology.

"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...

Edge AI and Vision Alliance

Custom vision

Pushkar Saraf

Cognitive services in Business applications

Michele Aponte

How to build a serverless helmet detection system

Mandar Dharmadhikari

Microsoft Azure Power BI

Experfy

Microsoft azure

pushkar baviskar

Progettatto per gli sviluppatori, il servizio di database NoSQL CosmosDB completamente gestito per lo sviluppo di app moderne con tempi di risposta garantiti inferiori a unità di millisecondi e disponibilità al 99,999% supportata da contratti di servizio, scalabilità automatica e immediata e API open source per MongoDB e Cassandra. In questa sessione illustreremo le ultime novità che riguardano la modalità Serverless, le integrazioni con il mondo AI/Cognitive Services, l’unificazione con il mondo analytics (Azure Synapse), e gli aggiornamenti sui vari SDK che lo rendono uno strumento potente e facile da usare. Speaker: Michele Arpaia (Microsoft) Video: https://youtu.be/5L_6miK9w4Y

Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services

dotnetcode

Semelhante a Improving your vision with Azure Cognitive Services - /dev/070 (20)

Improving your vision with Azure Cognitive Services - MixUG

Biometric Systems - Automate Video Streaming Analysis with Azure and AWS

Computer Vision and Text Analytics Using Azure Cognitive Services

Azure Cognitive Services로 똑똑한 서비스 만들

Unity and Microsoft Azure Cognitive Services - DIGITREK21 Workshop

Getting started with microsoft cognitive services api

Creating applications that can see, hear, speak or understand using microso...

Making Data Scientists Productive in Azure

Waking App Ltd: Next Gen AR Toolset

The Wikitude SDK and the Wikitude Studio

Hyf project ideas_02

Microsoft Azure - The Best Platform for AI

Hyf azure ml_1

"Creating Smarter, More Interactive Apps and Systems with Computer Vision," a...

Custom vision

Cognitive services in Business applications

How to build a serverless helmet detection system

Microsoft Azure Power BI

Microsoft azure

Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services

Mais de Marc Duiker

Take your Azure Functions to the next level with Durable Functions - Serverle...

Marc Duiker

Take your Azure Functions to the next level with Durable Functions - WAZUG

Marc Duiker

Slides of my presentation at DUUGFest 2018 in Utrecht, NL. Abstract: Have you fed your (CMS based) web application with too much responsibility? Is the application still testable? Scalable? Resilient? Consider putting your web application on a diet by moving responsibilities outside the web app. In this talk, I'll show how you can use Azure Functions in combination with your web app. I'll demonstrate various function triggers & bindings, local development & debugging and deployment to the cloud.

Put Your Web App on a Diet with Azure Functions

Marc Duiker

Take your azure functions to the next level with durable functions @ Experts ...

Marc Duiker

Managing and querying large data sets using Data Factory, Cosmos DB and Azure...

Marc Duiker

Orchestrate your Azure Functions with Durable Functions - AzureThursday Meetup

Marc Duiker

Getting Started with Serverless Architectures using Azure Functions

Marc Duiker

Mais de Marc Duiker (7)

Take your Azure Functions to the next level with Durable Functions - Serverle...

Take your Azure Functions to the next level with Durable Functions - WAZUG

Put Your Web App on a Diet with Azure Functions

Take your azure functions to the next level with durable functions @ Experts ...

Managing and querying large data sets using Data Factory, Cosmos DB and Azure...

Orchestrate your Azure Functions with Durable Functions - AzureThursday Meetup

Getting Started with Serverless Architectures using Azure Functions

Último

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

[BuildWithAI] Introduction to Gemini.pdf

Sandro Moreira

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

ICT role in 21st century education and its challenges

rafiqahmad00786416

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

MINDCTI Revenue Release Quarter One 2024

MIND CTI

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Vector Search -An Introduction in Oracle Database 23ai.pptx

Remote DBA Services

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Angeliki Cooney has spent over twenty years at the forefront of the life sciences industry, working out of Wynantskill, NY. She is highly regarded for her dedication to advancing the development and accessibility of innovative treatments for chronic diseases, rare disorders, and cancer. Her professional journey has centered on strategic consulting for biopharmaceutical companies, facilitating digital transformation, enhancing omnichannel engagement, and refining strategic commercial practices. Angeliki's innovative contributions include pioneering several software-as-a-service (SaaS) products for the life sciences sector, earning her three patents. As the Senior Vice President of Life Sciences at Avenga, Angeliki orchestrated the firm's strategic entry into the U.S. market. Avenga, a renowned digital engineering and consulting firm, partners with significant entities in the pharmaceutical and biotechnology fields. Her leadership was instrumental in expanding Avenga's client base and establishing its presence in the competitive U.S. market.

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Angeliki Cooney

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Tracing the root cause of a performance issue requires a lot of patience, experience, and focus. It’s so hard that we sometimes attempt to guess by trying out tentative fixes, but that usually results in frustration, messy code, and a considerable waste of time and money. This talk explains how to correctly zoom in on a performance bottleneck using three levels of profiling: distributed tracing, metrics, and method profiling. After we learn to read the JVM profiler output as a flame graph, we explore a series of bottlenecks typical for backend systems, like connection/thread pool starvation, invisible aspects, blocking code, hot CPU methods, lock contention, and Virtual Thread pinning, and we learn to trace them even if they occur in library code you are not familiar with. Attend this talk and prepare for the performance issues that will eventually hit any successful system. About authorWith two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.

Finding Java's Hidden Performance Traps @ DevoxxUK 2024

Victor Rentea

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

Improving your vision with Azure Cognitive Services - /dev/070

1. Improving your vision with Azure Cognitive Services - MixUG 1 Improving your vision with Azure Cognitive Services 13 December – /dev/070

2. About me: Marc Duiker mduiker@xpirit.comwww.xpirit.com blog.marcduiker.nl @marcduiker ‘13-’16 www.youtube.com/user/marcduiker

3. Agenda • What is Azure Cognitive Services • Computer Vision API • Azure Portal, VS Code & Visual Studio • Custom Vision API • Custom Vision portal Improving your vision with Azure Cognitive Services - /dev/070 3

4. ML & AI is hot! Improving your vision with Azure Cognitive Services - /dev/070 4

5. Improving your vision with Azure Cognitive Services - /dev/070 5

6. Improving your vision with Azure Cognitive Services - /dev/070 6

7. Cortana Intelligence Suite Improving your vision with Azure Cognitive Services - /dev/070 7

8. Microsoft Cognitive Services Give your apps a human side From faces to feelings, allow your apps to understand images and video Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Process text and learn how to recognize what users want Tap into rich knowledge amassed from the web, academia, or your own data Access billions of web pages, images, videos, and news with the power of Bing APIs

9. Improving your vision with Azure Cognitive Services - /dev/070 9

10. Improving your vision with Azure Cognitive Services - /dev/070 10

11. Improving your vision with Azure Cognitive Services - /dev/070 11

12. Improving your vision with Azure Cognitive Services - /dev/070 12

13. Improving your vision with Azure Cognitive Services - /dev/070 13

14. Improving your vision with Azure Cognitive Services - /dev/070 14 Cognitive Services Labs https://labs.cognitive.microsoft.com/

15. Microsoft Cognitive Services Docs Improving your vision with Azure Cognitive Services - /dev/070 15

16. How did we end up here? Improving your vision with Azure Cognitive Services - /dev/070 16 Microsoft Cognitive Services Bing Search Project Oxford Microsoft CognitiveToolkit (CNTK) MicrosoftTechnology & Research 2015 2009 2016

17. Improving your vision with Azure Cognitive Services - MixUG 17 Computer Vision API

18. Computer Vision API • Recognize and understand information from images Improving your vision with Azure Cognitive Services - /dev/070 18 Tags Descriptions Faces Colors Domain models ImageType Cognitive Services Computer Vision API

19. Computer Vision API examples • API Reference • https://westeurope.dev.cognitive.microsoft.com/docs/services/56f91f2d778daf23d8e c6739/operations/56f91f2e778daf14a499e1fa • Perform API calls from VS Code Improving your vision with Azure Cognitive Services - /dev/070 19

20. What do we need to get started? • Create Computer Vision API endpoint in Azure • Subscription key • Create an application to • Select an image • Do a post to the Computer Vision API endpoint Improving your vision with Azure Cognitive Services - /dev/070 20

21. Improving your vision with Azure Cognitive Services - MixUG 21

22. Demo: HelloCV • Provide a local image • Do a request to Analyze endpoint • Get analysis results back as json Improving your vision with Azure Cognitive Services - /dev/070 22 Tags Descriptions Faces Colors ImageTypeCognitive Services Computer Vision API

23. Demo: Analyze images on website Improving your vision with Azure Cognitive Services - /dev/070 23 http://... <img> <img> <img> File Scrape images Analyze Save results Cognitive Services uri uri uri Get sources Goal: Analyze images on a website

24. Cognitive Services Demo App • Computer Vision API • Analyze image • Describe image • OCR (optical character recognition) • Domain model detection: Landmarks • Emotion API • Emotion analysis Improving your vision with Azure Cognitive Services - /dev/070 24 https://github.com/marcduiker/demos-azure-cognitive-services

25. Improving your vision with Azure Cognitive Services - MixUG 25 Custom Vision API (preview)

26. Custom Vision API • Image classification Improving your vision with Azure Cognitive Services - /dev/070 26 Cognitive Services Custom Vision API Train #A #B ? #A

27. Custom Vision Demo Improving your vision with Azure Cognitive Services - /dev/070 27 Ferrari 250 GT SWB Aston Martin DB4

28. To sum it up • Ever growing collection of ‘intelligent’ APIs • Easy to get started • Choose carefully which API best suits your need • Think about confidence levels • When dealing with faces or handwriting: Personally identifiable information (PII) -> Privacy Improving your vision with Azure Cognitive Services - /dev/070 28

29. Improving your vision with Azure Cognitive Services - MixUG 29 Thanks! See you next time!

30. Marc Duiker mduiker@xpirit.com @marcduiker Xpirit Laapersveld 27 Hilversum www.xpirit.com

31. Cognitive Services Related Resources • https://azure.microsoft.com/en-us/services/cognitive-services/ • https://docs.microsoft.com/en-us/azure/cognitive-services/ • https://channel9.msdn.com/Search?term=Cognitive%20Services • https://www.microsoft.com/en-us/seeing-ai/ • https://www.microsoft.com/en-us/research/research-area/computer-vision/ • https://www.customvision.ai/ • https://github.com/marcduiker/demos-azure-cognitive-services Improving your vision with Azure Cognitive Services - /dev/070 31

Notas do Editor

Logical progression after ‘big data’. https://www.forbes.com/sites/moorinsights/2017/01/06/five-things-to-watch-in-ai-and-machine-learning-in-2017/ https://blogs.sap.com/2017/01/30/machine-learning-will-be-2017s-top-trend-and-will-help-solve-iots-big-data-challenge/ https://www.ibm.com/blogs/think/2017/02/machine-learning/
Azure Machine Learning: Create model Train model Score & test model Publish as a webservice
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
Set of APIs which allows developers to do analysis on various types of content: images, text, audio and video.
No control over training the model. Black box.
No control over training the model. Black box.
Create Computer Vision Endpoint through: - Cognitive Services and select an API - Computer Vision API
Perform demo with sites: www.nos.nl www.bbc.com/news http://designlike.com/100-most-famous-landmarks-around-the-world/
You need to train the model yourself. There are categories: food,

Improving your vision with Azure Cognitive Services - /dev/070

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (6)

Semelhante a Improving your vision with Azure Cognitive Services - /dev/070

Semelhante a Improving your vision with Azure Cognitive Services - /dev/070 (20)

Mais de Marc Duiker

Mais de Marc Duiker (7)

Último

Último (20)

Improving your vision with Azure Cognitive Services - /dev/070

Notas do Editor