SlideShare a Scribd company logo
1 of 17
1
Werner Bailer, Cathal Gurrin, Jakub Lokoč, Klaus Schoeffmann
 Video search competition (annually at MMM)
 Demonstrates and evaluates state-of-the-art
interactive video retrieval tools
 Participating teams solve retrieval tasks
 Systems are connected to the VBS Server
 Presents tasks in live manner
 Evaluates submitted results of teams (penalty for false submissions)
 HTW: Kai Uwe Barthel, Nico Hezel and Klaus Jung. “Fusing
keyword search and visual exploration for untagged videos“
 ITEC1: Manfred Jürgen Primus, Bernd Münzer, Andreas
Leibetseder and Klaus Schoeffmann. “The ITEC Collaborative
Video Search System at the VBS 2018“
 ITEC2: Andreas Leibetseder, Sabrina Kletz and Klaus
Schoeffmann. “Sketch-based Similarity Search for Collaborative
Feature Maps“
 NECTEC: Sitapa Rujikietgumjorn, Nattachai Watcharapinchai
and Sanparith Marukatat. “Sloth Search System“
 SIRET: Jakub Lokoc, Gregor Kovalcik andTomas Soucek.
“Revisiting SIRETVideo RetrievalTool“
3Video browser showdown 2018, Bangkok
 VERGE: Anastasia Moumtzidou, Stelios Andreadis, Foteini
Markatopoulou, Damianos Galanopoulos, Ilias Gialampoukidis,
StefanosVrochidis,Vasileios Mezaris, Ioannis Kompatsiaris and
Ioannis Patras. “VERGE inVBS 2018“
 VIREO: Phuong Anh Nguyen,Yi-Jie Lu, Hao Zhang, Chong-Wah
Ngo. “Enhanced VIREO KIS atVBS 2018“
 VITRIVR: Luca Rossetto, Ivan Giangreco, Ralph Gasser, Heiko
Schuldt. “Competitive Video Retrieval with vitrivr“
 VNU:Thanh-DatTruong,Vinh-Tiep Nguyen, Minh-Triet Tran,Van-
Tien Do,Trang-VinhTrieu,Thanh Duc Ngo and Duy-Dinh Le.
“Video Search Based On Semantic Extraction And Locally
Regional Object Proposal“
4Video browser showdown 2018, Bangkok
 IACC.3 -TRECVID (2016-2017)
 144 GB
 4593 video files
 Low visual quality
 600 hours of content
 Each ~6-10 minutes
 > 300.000 shots
Single target (20 secs)
“Steve’s cutting a drawing into his block of wood.You can see
his hands, a cutter, and flower symbols.”
Single target (20 secs)
“A person playing guitar outdoors”
8Video browser showdown 2018, Bangkok
Multiple targets (shots)
 Expert Run
 5 textual KIS tasks
 5 visual KIS tasks
 5 AVS tasks
 Novice Run
 5 visual KIS tasks
 5 AVS tasks
9Video browser showdown 2018, Bangkok
Winner gets 100 points
Winner gets 100 points
Winner gets 100 points
Winner gets 100 points
Winner gets 100 points
 Overall score = AVERAGE
10Video browser showdown 2018, Bangkok
Textual KIS
11Video browser showdown 2018, Bangkok
AVS
12Video browser showdown 2018, Bangkok
 VISUAL KIS
 Video scene in the loop –VBS participant knows the known-item
 Problem – photographic memory not realistic
-> THE SCENE GETS BLURRED
 TEXTUAL KIS
 Difficult task - only 3 solved in 2017
-> more text appears in time
 AVSTASKS
 The same settings
13Video browser showdown 2018, Bangkok
previous new
14Video browser showdown 2018, Bangkok
Time
penalty
Wrong
submission
penalty
𝑇𝑃
max(1, |𝑊𝑆| − 1) 𝑇𝑃 − 𝑊𝑆 ∗ 𝑐
Time limit for visual tasks 5 minutes and textual KIS 7 minutes
No wrong submission for free
 Precision/recall based measure, time limit 5 minutes
 Normalization
 Novice RUNS
 Each team can select and train a bit some novice user
 Novice runs only for visual KIS andAVS (existingTRECVid ones)
15Video browser showdown 2018, Bangkok
 Let‘s thank the local organizers of MMM for making this
session happen!
17Video browser showdown 2018, Bangkok

More Related Content

Recently uploaded

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docxPoojaSen20
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...christianmathematics
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docxPoojaSen20
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxVishalSingh1417
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterMateoGardella
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Shubhangi Sonawane
 

Recently uploaded (20)

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 

Featured

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Video Browser Showdown 2018

  • 1. 1 Werner Bailer, Cathal Gurrin, Jakub Lokoč, Klaus Schoeffmann
  • 2.  Video search competition (annually at MMM)  Demonstrates and evaluates state-of-the-art interactive video retrieval tools  Participating teams solve retrieval tasks  Systems are connected to the VBS Server  Presents tasks in live manner  Evaluates submitted results of teams (penalty for false submissions)
  • 3.  HTW: Kai Uwe Barthel, Nico Hezel and Klaus Jung. “Fusing keyword search and visual exploration for untagged videos“  ITEC1: Manfred Jürgen Primus, Bernd Münzer, Andreas Leibetseder and Klaus Schoeffmann. “The ITEC Collaborative Video Search System at the VBS 2018“  ITEC2: Andreas Leibetseder, Sabrina Kletz and Klaus Schoeffmann. “Sketch-based Similarity Search for Collaborative Feature Maps“  NECTEC: Sitapa Rujikietgumjorn, Nattachai Watcharapinchai and Sanparith Marukatat. “Sloth Search System“  SIRET: Jakub Lokoc, Gregor Kovalcik andTomas Soucek. “Revisiting SIRETVideo RetrievalTool“ 3Video browser showdown 2018, Bangkok
  • 4.  VERGE: Anastasia Moumtzidou, Stelios Andreadis, Foteini Markatopoulou, Damianos Galanopoulos, Ilias Gialampoukidis, StefanosVrochidis,Vasileios Mezaris, Ioannis Kompatsiaris and Ioannis Patras. “VERGE inVBS 2018“  VIREO: Phuong Anh Nguyen,Yi-Jie Lu, Hao Zhang, Chong-Wah Ngo. “Enhanced VIREO KIS atVBS 2018“  VITRIVR: Luca Rossetto, Ivan Giangreco, Ralph Gasser, Heiko Schuldt. “Competitive Video Retrieval with vitrivr“  VNU:Thanh-DatTruong,Vinh-Tiep Nguyen, Minh-Triet Tran,Van- Tien Do,Trang-VinhTrieu,Thanh Duc Ngo and Duy-Dinh Le. “Video Search Based On Semantic Extraction And Locally Regional Object Proposal“ 4Video browser showdown 2018, Bangkok
  • 5.  IACC.3 -TRECVID (2016-2017)  144 GB  4593 video files  Low visual quality  600 hours of content  Each ~6-10 minutes  > 300.000 shots
  • 7. “Steve’s cutting a drawing into his block of wood.You can see his hands, a cutter, and flower symbols.” Single target (20 secs)
  • 8. “A person playing guitar outdoors” 8Video browser showdown 2018, Bangkok Multiple targets (shots)
  • 9.  Expert Run  5 textual KIS tasks  5 visual KIS tasks  5 AVS tasks  Novice Run  5 visual KIS tasks  5 AVS tasks 9Video browser showdown 2018, Bangkok Winner gets 100 points Winner gets 100 points Winner gets 100 points Winner gets 100 points Winner gets 100 points  Overall score = AVERAGE
  • 10. 10Video browser showdown 2018, Bangkok Textual KIS
  • 11. 11Video browser showdown 2018, Bangkok AVS
  • 12. 12Video browser showdown 2018, Bangkok
  • 13.  VISUAL KIS  Video scene in the loop –VBS participant knows the known-item  Problem – photographic memory not realistic -> THE SCENE GETS BLURRED  TEXTUAL KIS  Difficult task - only 3 solved in 2017 -> more text appears in time  AVSTASKS  The same settings 13Video browser showdown 2018, Bangkok
  • 14. previous new 14Video browser showdown 2018, Bangkok Time penalty Wrong submission penalty 𝑇𝑃 max(1, |𝑊𝑆| − 1) 𝑇𝑃 − 𝑊𝑆 ∗ 𝑐 Time limit for visual tasks 5 minutes and textual KIS 7 minutes No wrong submission for free
  • 15.  Precision/recall based measure, time limit 5 minutes  Normalization  Novice RUNS  Each team can select and train a bit some novice user  Novice runs only for visual KIS andAVS (existingTRECVid ones) 15Video browser showdown 2018, Bangkok
  • 16.
  • 17.  Let‘s thank the local organizers of MMM for making this session happen! 17Video browser showdown 2018, Bangkok