Sandbox all the pipelines! (GUADEC 2012)

•

0 gostou•739 visualizações

By Guillaume Emont. Playing a digital media is something complex, that requires non-trivial code. Such code is likely to have unknown security issues. It is therefore unwise to trust such code to handle untrusted data, such as a cat video[1] from the internet. One solution that could be applied to GStreamer is to run the non-trivial code inside a sandbox. Gillaume has experimented a bit[2] with the idea and would like to expose his preliminary results. [1] or a hippo video [2] http://guij.emont.org/blog/2012/05/08/video-decoding-in-a-sandbox/

Guillaume Emont
Igalia

Internets = cute videos of [insert favourite animal]

Trustworthy?

Complex software written by
human beings can have bugs.

sandboxeddecodebin

Biggest limitations so far:
• no upstream communication => no seeking
• overhead: 720p ogg/theora on my i5: 20-30% -> 30-40% cpu

Potential solutions:
• better wrapper around the sandboxed part
of the pipeline (with upstream communication)
• put the whole pipeline in the sandbox

Thank You

guijemont@igalia.com
http://guij.emont.org/blog/
https://github.com/guijemont/Sandboxed-Player

Image Credits:
Sandbox: Public Domain by Hyena http://en.wikipedia.org/wiki/File:Sandpit.jpg
beer: CC BY-NC-SA 2.0 Martin Ibert http://www.ﬂickr.com/photos/mar_ibert/

Mais conteúdo relacionado

Mais de Igalia

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

The Web engine is the most important component of a Web Browser, enabling developers to harness the power of the Web Platform to build their applications. However, Web Browsers are not the only type of applications that can be built with Web Engines, which can also be used to develop other types of applications using the same Web-based technologies, but for a different type of use cases other than "browsing the Web". These use cases can cover a wide range of situations outside of the traditional desktop or mobile environments, such as the ones embedded systems are usually used for (e.g. set-top-boxes, smart home appliances, GPS navigation devices, or in-car/in-flight infotainment systems, to name a few). And in those situations it is very common to be running on boards with SoCs and a particular set of HW capabilities that make it crucial for the Web Engine to be able to tightly integrate with them. In this session we will focus on how WPE, a fully Open Source port of the WebKit Web engine for Linux-based embedded devices, can be used to adapt to the different challenges that embedded devices pose to develop end-user applications, using the power of the Web Platform underneath. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://eoss24.sched.com/event/1aNTr/building-end-user-applications-on-embedded-devices-with-wpe-mario-sanchez-prada-igalia

Building End-user Applications on Embedded Devices with WPE

Building End-user Applications on Embedded Devices with WPE

Building End-user Applications on Embedded Devices with WPE

The Raspberry Pi 5 was announced on October 2023. This new version of the popular embedded device comes with a new iteration of Broadcom’s VideoCore GPU platform, and was released with a fully open source driver stack, developed by Igalia. The presentation will discuss some of the major changes required to support this new Video Core iteration, the challenges we faced in the process and the solutions we provided in order to deliver conformant OpenGL ES and Vulkan drivers. The talk will also cover the next steps for the open source Raspberry Pi 5 graphics stack. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://eoss24.sched.com/event/1aBEx

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Every day, embedded devices are becoming more powerful and capable of running more elaborate applications. Among these applications are Web-based ones, enabling to leverage features from the Web APIs to the embedded context, either through a generic browser running a traditional Web application or through a customized Web engine tightly integrated within the system. But such capabilities usually bring new challenges, like testing user interactions with the application using the embedded device's specific I/O methods, such as gestures, or inspecting Web application internals with JavaScript. In this context, using a browser automation framework such as WebDriver, which is a W3C standard supported by WebKit Web engine, allows testing Web-based applications on such devices as if the user were actually using it, alongside running custom JS code. In this session, we will cover why we need browser automation for testing on certain types of embedded devices, with a focus on WebDriver as the proposed tool to achieve that goal. We will also discuss WebDriver's main features and limitations, as well as other possible approaches and frameworks that could be considered for this kind of task. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://eoss24.sched.com/event/1aeSx/automated-testing-for-web-based-systems-on-embedded-devices-lauro-moura-igalia

Automated Testing for Web-based Systems on Embedded Devices

Automated Testing for Web-based Systems on Embedded Devices

Automated Testing for Web-based Systems on Embedded Devices

Embedded devices have become powerful enough to run Web content a decade ago, and any modern SoC that can run Linux and includes a GPU is a potential candidate to hide a Web engine under the surface. How did it made it there? Does it only show Web content? What else can it do? The talk will cover bring-up tips to build and get WPE WebKit working on your custom embedded device and make your own simple Web browser, as well as the best practices for keeping the system up to date. No less important is integration with the rest of the system: this session will detail the possibilities that WebKit brings to the table, including how to add new JavaScript APIs which call into native code to provide tight, performant access to platform functionality. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://eoss24.sched.com/event/1aBFQ/embedding-wpe-webkit-from-bring-up-to-maintenance-adrian-perez-de-castro-igalia

Embedding WPE WebKit - from Bring-up to Maintenance

Embedding WPE WebKit - from Bring-up to Maintenance

Embedding WPE WebKit - from Bring-up to Maintenance

This talk dives into how the scheduler impacts your gameplay on Linux and unveils our journey to smoother gameplay. How does task scheduling impact Linux gaming? Suboptimal task scheduling can cause stuttering while playing games on the Steam Deck game console. First, we nail down the enemy. What exactly is "stuttering," and how can we measure its impact on your gameplay? Next, we extensively analyzed the characteristics of game tasks from the scheduler’s point of view. Characterizing task behavior in Linux gaming helps to understand why some schedulers create much stuttering and others create less and to unveil the secrets behind smooth vs. choppy performance. Lastly, we will share our progress on the optimized scheduler for reducing the stuttering problems in Linux gaming, especially Steam Deck. We implemented the scheduling policy based on sched_ext, a BPF-based extensible scheduling framework. (c) Open Source Summit North America 2024 April 16-18, 2024 Seatle, Washington (US) https://events.linuxfoundation.org/open-source-summit-north-america/ https://ossna2024.sched.com/event/1aBOT/optimizing-scheduler-for-linux-gaming-changwoo-min-igalia

Optimizing Scheduler for Linux Gaming.pdf

Optimizing Scheduler for Linux Gaming.pdf

Optimizing Scheduler for Linux Gaming.pdf

So, we are adding a backend for the SpiderMonkey’s codegen to enable JIT support for JavaScript running through Wasm. Sounds a bit cryptic so let’s divide it into parts. SpiderMonkey is a JavaScript engine which is used for running JavaScript inside the Firefox browser. SpiderMonkey is written in C++ and supports compilation into the Wasm module, see live demo - https://mozilla-spidermonkey.github.io/sm-wasi-demo/. However, SpiderMonkey compiled into the Wasm module supports execution of JavaScript only in the interpreter-only mode and it doesn’t support just-in-time compilation because there is no Wasm backend for that. There are backends for Arm, X86, X64 etc but there is none for Wasm. Why do we want to add support for JIT? Well, because we want speed. Right now there is no solution to run JS scripts via Wasm fast, there are only interpreters. Why does JIT improve performance? The reasons are the same for why an interpreter is slower than a compiler - because it eliminates the interpreter loop, uses a more efficient ABI and, more importantly, it can specialize polymorphic operations in JavaScript. So, we not only enable the JIT tier in SpiderMonkey for Wasm but we also provide support for inline caches. Inline caches is a mechanism for specializing the behavior of particular operations like plus or a call to specific arguments provided at runtime. With all that we can generate Wasm modules on the fly, instantiate them, and link them to provide from ~2x to ~11x speedup over the interpreter. In the talks we will cover how the whole scheme works with SpiderMonkey: 1. How to link modules on the fly into SpiderMonkey.wasm 2. How to add an exotic Wasm backend into SpiderMonkey’s supported backend line - X64, X86, Arm, Wasm 3. How to use the whole solution in the cloud instead of QuickJS 4. How to get a speedup of your JS over wasm with test data. Wasm I/O 2024 14 - 15 Mar, 2024 Barcelona https://2024.wasmio.tech/

Running JS via WASM faster with JIT

Running JS via WASM faster with JIT

Running JS via WASM faster with JIT

What could be possibly worse that an almost unbeatable boss in a game or a tough maze that consume hours of gameplay with not much progress? How about a Linux kernel crash that makes you lose all the game progress with no apparent reason or feedback? Though rare, it is a real possibility that would make gamers quite annoyed, given that Linux is used more and more as a platform for playing games. Some technologies are available to collect logs and feedback the user in case such disastrous events happen, mostly related with kernel crashes handling mechanisms. The main ones available are kdump and pstore, but still there are work to be done in this area... In this talk we're going to present the basics about kernel crash handling, like how a kernel panic might happen, how to deal with that (with an overall discussion about kdump and pstore techs) and the kdumpst tool, developed specially to deal with this situation on Steam Deck (and generically on Arch Linux); also we're gonna discuss some missing pieces / ideas to make it even less likely gamers need to complain that their device just got hang for no reason! FOSForums 2023 Aug 26 - Aug 27, 2023 Institute of Computing, State University of Campinas (Unicamp) Campinas, São Paulo, Brazil https://www.fosforums.org/

To crash or not to crash: if you do, at least recover fast!

To crash or not to crash: if you do, at least recover fast!

To crash or not to crash: if you do, at least recover fast!

Implementing a Vulkan Video Encoder From Mesa to GStreamer

Implementing a Vulkan Video Encoder From Mesa to GStreamer

Implementing a Vulkan Video Encoder From Mesa to GStreamer

8 Years of Open Drivers, including the State of Vulkan in Mesa

8 Years of Open Drivers, including the State of Vulkan in Mesa

8 Years of Open Drivers, including the State of Vulkan in Mesa

Nesta charla impartida por Alejandro Piñeiro de Igalia, darase unha introdución a Mesa, librería open-source para o desenvolvemento de drivers gráficos. Explicarase a súa historia, os seus compoñentes máis importantes, que utilidades proporcionan aos desenvolvedores e unha lista de hardware ás que dan soporte. Finalmente explicarase o caso concreto do soporte proporcionado para as GPUs dos dispositivos da serie Raspberry Pi, centrándonos nas Raspberry Pi 4 e Raspberry Pi 5 Igalia é unha empresa galega, con sede na Coruña, especializada en servizos de consultoría, e que desenvolve solucións innovadoras de código aberto para un gran conxunto de plataformas de software e hardware. En Igalia traballan nas áreas máis interesantes do software de código aberto, incluídos navegadores, gráficos e multimedia. Igalia desenvolveu os controladores OpenGL ES 3.1 e Vulkan 1.2 conformes para a GPU VideoCore VII Broadcom que se fornece coa nova Raspberry Pi 5. Alejandro Piñeiro é enxeñeiro de Software e socio en Igalia, é desenvolvedor de Software Libre desde 2004. A súa experiencia inclúe unha variedade de proxectos de GNOME e freedesktop.org, enfocándose desde 2015 en Mesa, especificamente os drivers Intel e Broadcom. É un dos responsables do desenvolvemento do controlador Broadcom Vulkan para Raspberry Pi 4 & 5. Máis información en https://aindustriosa.org/Mesa/ Esta actividade está patrocinada pola Xunta de Galicia e pola Axencia Para a Modernización Tecnolóxica (AMTEGA). (c) A Industriosa https://aindustriosa.org 28 de Outubro (Vigo)

Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia

Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia

Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia

Chimera Linux is a novel Linux distribution built around FreeBSD core tools and the LLVM toolchain. Since its initial launch in 2021, it has made a lot of progress and is now in alpha stage. The system can be deployed on a wide array of hardware and many people are using it as their desktop system; it works on x86_64, AArch64, POWER (little and big endian) as well as RISC-V and by now comes with thousands of packages. While trying to be practical, Chimera is also highly hardened, partly thanks to the LLVM toolchain, rendering it immune to various security issues other distros are vulnerable to. It has transparent and robust infrastructure, ensuring smooth deployment of packages. We are also developing various new tooling that the whole ecosystem can benefit from, including the Turnstile session tracker. Service management is based around Dinit, a modern, supervising system; we maintain and create a variety of tooling around it, trying to break the existing status quo with systemd, while abandoning legacy approaches. 2023 has seen several major milestones, so I will focus on these, while also giving a short overview so that people unfamiliar with the system don't feel lost. I will also explain how our work benefits the entire Linux ecosystem, as well as beyond. (c) FOSDEM 2024 3 & 4 February 2024 https://fosdem.org/2024/schedule/event/fosdem-2024-2524-2023-in-chimera-linux/

2023 in Chimera Linux

2023 in Chimera Linux

2023 in Chimera Linux

For the last 3 years, I've been building a complete Linux distribution, Chimera Linux (https://chimera-linux.org) using solely LLVM as its system toolchain - that means Clang, compiler-rt, and libc++, alongside its other tooling. Right now, it is a complete desktop system that is already used by many, with a familiar GNOME interface and thousands of packages, targeting 5 CPU architectures. In this talk I would like to focus on my experiences using the toolchain, what obstacles got in the way, how I dealt with them, the issues that are still left and I would like to see addressed, the many benefits using LLVM gave the project, and overall give the audience an insight into practical deployment of LLVM in a project where it isn't simply a drop-in alternative to GCC. (c) FOSDEM 2024 3 & 4 February 2024 https://fosdem.org/2024/schedule/event/fosdem-2024-2555-building-a-linux-distro-with-llvm/

Building a Linux distro with LLVM

Building a Linux distro with LLVM

Building a Linux distro with LLVM

turnip: Update on Open Source Vulkan Driver for Adreno GPUs

turnip: Update on Open Source Vulkan Driver for Adreno GPUs

turnip: Update on Open Source Vulkan Driver for Adreno GPUs

This talk will show the efforts done in the Open-Source graphics stack for supporting Raspberry Pi devices. Although the talk will focus on the recently launched new Raspberry Pi 5, we will show the improvements done for previous generations of the Raspberry Pi hardware. Raspberry Pi 5 has available FLOSS GPU drivers on product launch, exposing OpenGL-ES 3.1 and Vulkan 1.2. We'll go through the changes needed to enable desktop OpenGL 3.1 on RPi4/5. We will also review the changes done to the kernel driver to expose the RPi5 capabilities and the new GPU stats support for RPi4/5. Finally, we will show the work done to use Wayfire as the default Wayland compositor on the Raspberry Pi OS. - https://www.mesa3d.org/ - https://www.raspberrypi.com/ - https://wayfire.org/ (c) FOSDEM 2024 3 & 4 February 2024 https://fosdem.org/2024/schedule/event/fosdem-2024-2841-graphics-stack-updates-for-raspberry-pi-devices/

Graphics stack updates for Raspberry Pi devices

Graphics stack updates for Raspberry Pi devices

Graphics stack updates for Raspberry Pi devices

This talk will cover our experience in utilizing Wayland subsurfaces and implementing delegated compositing for Chromium on ChromeOS. Several concepts will be covered - from overlay making decision in Chromium/Viz to design and implementation of custom Wayland protocols, which were required to pass frame data as overlays via Wayland and reconstruct that frame on the Wayland server side. (c) FOSDEM 2024 3 & 4 February 2024 https://fosdem.org/2024/schedule/event/fosdem-2024-3177-delegated-compositing-utilizing-wayland-protocols-for-chromium-on-chromeos/

Delegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOS

Delegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOS

Delegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOS

Internationalization in JavaScript and on the web platform is very complicated, but also vastly important for us developers in order to build accessible and intelligible interfaces. Thankfully, Unicode Consortium's MessageFormat working group and TC39 have been hard at work standardizing the next generation of i18n tooling that aims to unify analogous non-standard tools in use today while approaching this problem from a fresh perspective. Join me along this tour of i18n in JavaScript, discover some of the newest additions to the toolkit and learn about the ongoing MessageFormat proposal and how it aims to radically improve the developer experience. (c) FOSDEM 2024 3 & 4 February 2024 https://fosdem.org/2024/schedule/event/fosdem-2024-2832-messageformat-the-future-of-i18n-on-the-web/

MessageFormat: The future of i18n on the web

MessageFormat: The future of i18n on the web

MessageFormat: The future of i18n on the web

This talk will discuss the problems with the traditional vertex processing pipeline and present how mesh shading solves these problems. Instead of processing a fixed set of input vertices, mesh shaders can create an arbitrary topology of vertices and primitives. Mesh shading also includes a new solution for geometry amplification: task shaders. The talk should be scheduled before Timur's talk about implementing mesh shaders in the RADV Mesa driver. (c) X.Org Developer Conference (XDC) 2022 October 4-6, 2022 Minneapolis, Minnesota, USA https://indico.freedesktop.org/event/2/

Replacing the geometry pipeline with mesh shaders

Replacing the geometry pipeline with mesh shaders

Replacing the geometry pipeline with mesh shaders

Let's talk about developing AMD display drivers in the DRM subsystem as an external contributor. Part of this work is a trail of breadcrumbs to build documentation. What are those breadcrumbs? How do they help to review, fix, improve and enable features of AMD drivers? How would both sides benefit if those pieces of information were already documented? We are gathering information from anywhere and also bothering experts for input. Ultimately, this presentation focuses on AMD driver development but may fit DRM drivers of any GPU vendors. (c) X.Org Developer Conference (XDC) 2022 October 4-6, 2022 Minneapolis, Minnesota, USA https://indico.freedesktop.org/event/2/

I'm not an AMD expert, but...

I'm not an AMD expert, but...

I'm not an AMD expert, but...

There has been a lot of activity in V3DV, the Vulkan driver for Raspberry Pi 4, over the last year: we have significantly reworked our synchronization code, obtained Vulkan 1.1 conformance, implemented Vulkan 1.2 support, continued to work on compiler optimizations and more. In this talk I would like to go through the main development milestones and changes we implemented in the driver as well as discussing some limitations of the underlying hardware platform that have discouraged us from implementing features such as scalar block layout or fp16. (c) X.Org Developer Conference (XDC) 2022 October 4-6, 2022 Minneapolis, Minnesota, USA https://indico.freedesktop.org/event/2/

Status of Vulkan on Raspberry

Status of Vulkan on Raspberry

Status of Vulkan on Raspberry

Mais de Igalia (20)

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

A Year of the Servo Reboot: Where Are We Now?

Building End-user Applications on Embedded Devices with WPE

Building End-user Applications on Embedded Devices with WPE

Building End-user Applications on Embedded Devices with WPE

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Automated Testing for Web-based Systems on Embedded Devices

Automated Testing for Web-based Systems on Embedded Devices

Automated Testing for Web-based Systems on Embedded Devices

Embedding WPE WebKit - from Bring-up to Maintenance

Embedding WPE WebKit - from Bring-up to Maintenance

Embedding WPE WebKit - from Bring-up to Maintenance

Optimizing Scheduler for Linux Gaming.pdf

Optimizing Scheduler for Linux Gaming.pdf

Optimizing Scheduler for Linux Gaming.pdf

Running JS via WASM faster with JIT

Running JS via WASM faster with JIT

Running JS via WASM faster with JIT

To crash or not to crash: if you do, at least recover fast!

To crash or not to crash: if you do, at least recover fast!

To crash or not to crash: if you do, at least recover fast!

Implementing a Vulkan Video Encoder From Mesa to GStreamer

Implementing a Vulkan Video Encoder From Mesa to GStreamer

Implementing a Vulkan Video Encoder From Mesa to GStreamer

8 Years of Open Drivers, including the State of Vulkan in Mesa

8 Years of Open Drivers, including the State of Vulkan in Mesa

8 Years of Open Drivers, including the State of Vulkan in Mesa

Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia

Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia

Introducción a Mesa. Caso específico dos dispositivos Raspberry Pi por Igalia

2023 in Chimera Linux

2023 in Chimera Linux

2023 in Chimera Linux

Building a Linux distro with LLVM

Building a Linux distro with LLVM

Building a Linux distro with LLVM

turnip: Update on Open Source Vulkan Driver for Adreno GPUs

turnip: Update on Open Source Vulkan Driver for Adreno GPUs

turnip: Update on Open Source Vulkan Driver for Adreno GPUs

Graphics stack updates for Raspberry Pi devices

Graphics stack updates for Raspberry Pi devices

Graphics stack updates for Raspberry Pi devices

Delegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOS

Delegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOS

Delegated Compositing - Utilizing Wayland Protocols for Chromium on ChromeOS

MessageFormat: The future of i18n on the web

MessageFormat: The future of i18n on the web

MessageFormat: The future of i18n on the web

Replacing the geometry pipeline with mesh shaders

Replacing the geometry pipeline with mesh shaders

Replacing the geometry pipeline with mesh shaders

I'm not an AMD expert, but...

I'm not an AMD expert, but...

I'm not an AMD expert, but...

Status of Vulkan on Raspberry

Status of Vulkan on Raspberry

Status of Vulkan on Raspberry

Último

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

MS Copilot expands with MS Graph connectors

MS Copilot expands with MS Graph connectors

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Discover the innovative features and strategic vision that keep WSO2 an industry leader. Explore the exciting 2024 roadmap of WSO2 API management, showcasing innovations, unified APIM/APK control plane, natural language API interaction, and cloud native agility. Discover how open source solutions, microservices architecture, and cloud native technologies unlock seamless API management in today's dynamic landscapes. Leave with a clear blueprint to revolutionize your API journey and achieve industry success!

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2's API Vision: Unifying Control, Empowering Developers

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Mcleodganj Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Mcleodganj Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Mcleodganj Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

FWD Group - Insurer Innovation Award 2024

FWD Group - Insurer Innovation Award 2024

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

Último (20)

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Architecting Cloud Native Applications

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

MS Copilot expands with MS Graph connectors

MS Copilot expands with MS Graph connectors

MS Copilot expands with MS Graph connectors

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Exploring Multimodal Embeddings with Milvus

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2's API Vision: Unifying Control, Empowering Developers

WSO2's API Vision: Unifying Control, Empowering Developers

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

[BuildWithAI] Introduction to Gemini.pdf

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Artificial Intelligence Chap.5 : Uncertainty

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

Boost Fertility New Invention Ups Success Rates.pdf

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

MINDCTI Revenue Release Quarter One 2024

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

FWD Group - Insurer Innovation Award 2024

FWD Group - Insurer Innovation Award 2024

FWD Group - Insurer Innovation Award 2024

Sandbox all the pipelines! (GUADEC 2012)

1. Guillaume Emont Igalia

2.

3. Internets = cute videos of [insert favourite animal]

4. Trustworthy?

5. Complex software written by human beings can have bugs.

6.

7.

8. sandboxeddecodebin

9. Biggest limitations so far: • no upstream communication => no seeking • overhead: 720p ogg/theora on my i5: 20-30% -> 30-40% cpu

10. Potential solutions: • better wrapper around the sandboxed part of the pipeline (with upstream communication) • put the whole pipeline in the sandbox

11. Thank You guijemont@igalia.com http://guij.emont.org/blog/ https://github.com/guijemont/Sandboxed-Player Image Credits: Sandbox: Public Domain by Hyena http://en.wikipedia.org/wiki/File:Sandpit.jpg beer: CC BY-NC-SA 2.0 Martin Ibert http://www.ﬂickr.com/photos/mar_ibert/