O slideshow foi denunciado.
Seu SlideShare está sendo baixado. ×

Video Complexity Analyzer (VCA).pdf

Anúncio
Anúncio
Anúncio
Anúncio
Anúncio
Anúncio
Anúncio
Anúncio
Anúncio
Anúncio
Anúncio
Anúncio

Confira estes a seguir

1 de 25 Anúncio
Anúncio

Mais Conteúdo rRelacionado

Semelhante a Video Complexity Analyzer (VCA).pdf (20)

Anúncio

Mais recentes (20)

Video Complexity Analyzer (VCA).pdf

  1. 1. All rights reserved. ©2020 All rights reserved. ©2021 Video Complexity Analyzer (VCA) Hadi Amirpour, Vignesh V Menon, Christian Feldmann, and Christian Timmerer 1
  2. 2. All rights reserved. ©2020 All rights reserved. ©2021 2 Motivation for VCA Features Experimental Results Applications Conclusion Table of Contents
  3. 3. 3 Motivation The (spatial and temporal) complexity of videos is used to aid the encoding process. The framework for streaming applications.
  4. 4. 4 Motivation The state-of-the-art spatial and temporal complexity feature is SI-TI [1,2]. Time taken to compute SI-TI features is very high! o 0.2 seconds per frame for 2160p (5 fps) o Not suitable for live applications o Higher computational cost in VoD applications The correlation with encoding bitrate and encoding time is low! [1] ITU-T P910 Subjective video quality assessment methods for multimedia applications. [2] SITI source code: https://github.com/Telecommunication-Telemedia-Assessment/SITI
  5. 5. 5 Motivation Video Complexity Analyzer (VCA) can be realized as a fast preprocessor which determines the spatial and temporal complexity of videos (segments) to aid the encoding process. The proposed framework for streaming applications.
  6. 6. All rights reserved. ©2020 Features All rights reserved. ©2021 6
  7. 7. 7 Spatial Complexity Feature Tim e p p k w w
  8. 8. 8 Spatial Complexity Feature Where C represents the number of blocks per frame.
  9. 9. 9 Temporal Complexity Feature Tim e p k p-1 p w w p-1 k w w k
  10. 10. 10 Spatial and Temporal Complexity Features V. V. Menon, C. Feldmann, H. Amirpour, M. Ghanbari, and C. Timmerer,“VCA: Video Complexity Analyzer,” in MMSys 2022. Spatial Complexity (E) Temporal Complexity (h)
  11. 11. All rights reserved. ©2020 Experimental Results All rights reserved. ©2021 11
  12. 12. 12 Results [Time Complexity] Average time to compute E-h for 2160p (with x86 SIMD and multi-threading).
  13. 13. 13 Results [Correlation with Encoding Bitrate] x264 x265 PCC between the spatial complexity features (SI and E) and encoding bitrate in All Intra configuration for the VCD dataset. H. Amirpour, V. V. Menon, M. Ghanbari, and C. Timmerer,“VCD: Video Complexity Dataset,” in MMSys 2022.
  14. 14. 14 Results [Correlation with Encoding Bitrate] PCC between the spatial complexity features (SI and E) and temporal features (TI and h) with encoding bitrate in the Low Delay Picture (LDP) configuration for the VCD dataset. veryslow medium ultrafast H. Amirpour, V. V. Menon, M. Ghanbari, and C. Timmerer,“VCD: Video Complexity Dataset,” in MMSys 2022.
  15. 15. 15 Results [Correlation with Encoding Time] PCC between the spatial complexity features (SI and E) and temporal features (TI and h) with encoding time in the Low Delay Picture (LDP) configuration for the VCD dataset. veryslow medium ultrafast H. Amirpour, V. V. Menon, M. Ghanbari, and C. Timmerer,“VCD: Video Complexity Dataset,” in MMSys 2022.
  16. 16. 16 Results [Correlation across Resolution] PCC between the spatial complexity features SI and E across multiple resolutions for the VCD dataset. SI E H. Amirpour, V. V. Menon, M. Ghanbari, and C. Timmerer,“VCD: Video Complexity Dataset,” in MMSys 2022.
  17. 17. All rights reserved. ©2020 Applications All rights reserved. ©2021 17
  18. 18. 18 Shot Detection The gradient of temporal complexity. V. V. Menon, H. Amirpour, M. Ghanbari, and C. Timmerer,“Efficient Content-Adaptive Feature-Based Shot Detection for HTTP Adaptive Streaming,” in ICIP 2021.
  19. 19. 19 Online Per-Title Encoding V. V. Menon, H. Amirpour, M. Ghanbari, and C. Timmerer,“OPTE: Online Per-Title Encoding for live video encoding,” in ICASSP 2022.
  20. 20. 20 Online Per-Title Encoding V. V. Menon, H. Amirpour, M. Ghanbari, and C. Timmerer,“OPTE: Online Per-Title Encoding for live video encoding,” in ICASSP 2022.
  21. 21. 21 Online Per-Title Encoding V. V. Menon, H. Amirpour, M. Ghanbari, and C. Timmerer,“OPTE: Online Per-Title Encoding for live video encoding,” in ICASSP 2022.
  22. 22. 22 Online Per-Title Encoding V. V. Menon, H. Amirpour, M. Ghanbari, and C. Timmerer,“OPTE: Online Per-Title Encoding for live video encoding,” in ICASSP 2022.
  23. 23. 23 Online Per-Title Encoding V. V. Menon, H. Amirpour, M. Ghanbari, and C. Timmerer,“OPTE: Online Per-Title Encoding for live video encoding,” in ICASSP 2022.
  24. 24. 24 VCA is a fast preprocessor that determines the spatial and temporal complexity of videos (segments) These features show higher correlations with encoding bitrate and time They can aid the encoding process in various applications Conclusion
  25. 25. 25 Open-source with GNU GPLv3 license Website: https://vca.itec.aau.at Source code: https://github.com/cd-athena/VCA Online documentation: https://cd-athena.github.io/VCA/

×