Submit Search
Upload
Python User Group November 2013, SQL(alchemy) and transient detection
•
1 like
•
762 views
Gijs Molenaar
Follow
Technology
Slideshow view
Report
Share
Slideshow view
Report
Share
1 of 22
Download now
Download to read offline
Recommended
Pygrunn 2013
Pygrunn 2013
Gijs Molenaar
My presentation from the NLUUG event on 26-05-2016 on Open Source Operations. Describing tools and processes we use at Inuits to manage customer and internal operations with local and remote teams.
Open Source Operations
Open Source Operations
Daniel Paulus
Michael Laing New York Times - Systems Architect Tuesday, Oct 20th 10:30 am - Back-End Dev
The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
All Things Open
Elasticsearch ATL meetup. Predictive analytics in big data, using Apache Spark and Elasticsearch.
Elasticsearch Atlanta Meetup 3/15/16
Elasticsearch Atlanta Meetup 3/15/16
Roy Russo
Slides demo for my data engineering project Artmosphere.
Artmosphere Demo
Artmosphere Demo
Keira Zhou
Talk from FOSS4G NA 2018
Working with OpenStreetMap using Apache Spark and Geotrellis
Working with OpenStreetMap using Apache Spark and Geotrellis
Rob Emanuele
Some naive comparisons of two graph processing tools: Dato vs Spark GraphX.
Dato vs GraphX
Dato vs GraphX
Keira Zhou
Weston Jossey describes how Tapjoy leverages OpenStack and AWS to deliver billions of daily requests all over the world. This presentation was originally delivered at OpenStack Summit Paris.
Tapjoy OpenStack Summit Paris Breakout Session
Tapjoy OpenStack Summit Paris Breakout Session
Weston Jossey
Recommended
Pygrunn 2013
Pygrunn 2013
Gijs Molenaar
My presentation from the NLUUG event on 26-05-2016 on Open Source Operations. Describing tools and processes we use at Inuits to manage customer and internal operations with local and remote teams.
Open Source Operations
Open Source Operations
Daniel Paulus
Michael Laing New York Times - Systems Architect Tuesday, Oct 20th 10:30 am - Back-End Dev
The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
All Things Open
Elasticsearch ATL meetup. Predictive analytics in big data, using Apache Spark and Elasticsearch.
Elasticsearch Atlanta Meetup 3/15/16
Elasticsearch Atlanta Meetup 3/15/16
Roy Russo
Slides demo for my data engineering project Artmosphere.
Artmosphere Demo
Artmosphere Demo
Keira Zhou
Talk from FOSS4G NA 2018
Working with OpenStreetMap using Apache Spark and Geotrellis
Working with OpenStreetMap using Apache Spark and Geotrellis
Rob Emanuele
Some naive comparisons of two graph processing tools: Dato vs Spark GraphX.
Dato vs GraphX
Dato vs GraphX
Keira Zhou
Weston Jossey describes how Tapjoy leverages OpenStack and AWS to deliver billions of daily requests all over the world. This presentation was originally delivered at OpenStack Summit Paris.
Tapjoy OpenStack Summit Paris Breakout Session
Tapjoy OpenStack Summit Paris Breakout Session
Weston Jossey
Presented at the Second openCypher Implementers Meeting in London, UK, May 2017 @ http://www.opencypher.org/blog/2017/06/13/ocim2-blog/
Cypher for Apache Spark
Cypher for Apache Spark
openCypher
In this video from PASC18, Alexander Nitz from the Max Planck Institute for Gravitational Physics in Germany presents: The Search for Gravitational Waves. "The LIGO and Virgo detectors have completed a prolific observation run. We are now observing gravitational waves from both the mergers of binary black holes and neutron stars. We’ll discuss how these discoveries were made and look into what the near future of searching for gravitational waves from compact binary mergers will look like." Watch the video: https://wp.me/p3RLHQ-iTv Learn more: github.com/gwastro/pycbc and https://pasc18.pasc-conference.org/ Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
The Search for Gravitational Waves
The Search for Gravitational Waves
inside-BigData.com
The deck for the talk about InfluxDb
InfluxDb and Grafana fighting with data
InfluxDb and Grafana fighting with data
Ivan Vaskevych
Stream Processing is emerging as a popular paradigm for data processing architectures, because it handles the continuous nature of most data and computation and gets rid of artificial boundaries and delays. The fact that stream processing is gaining rapid adoption is also due to more powerful and maturing technology (much of it open source at the ASF) that has solved many of the hard technical challenges. We discuss Apache Flink's approach to high performance stream processing with state, strong consistency, low latency, and sophisticated handling of time. With such building blocks, Apache Flink can handle classes of problems previously considered out of reach for stream processing. We also take a sneak preview at the next steps for Flink.
Keynote: Stephan Ewen - Stream Processing as a Foundational Paradigm and Apac...
Keynote: Stephan Ewen - Stream Processing as a Foundational Paradigm and Apac...
Ververica
Alexey Zinoviev presented this paper on the Highload++ conference http://www.highload.ru/2014/abstracts/1516.html This paper covers next topics: Pregel, Graph Theory, Giraph, Okapi, GraphX, GraphChi, Spark, Shrotest Path Problem, Road Network, Road Graph
Thorny path to the Large-Scale Graph Processing (Highload++, 2014)
Thorny path to the Large-Scale Graph Processing (Highload++, 2014)
Alexey Zinoviev
Introduction to gravitational waves and how the LIGO-Virgo collaborations use Python software at all stages in the scientific process. Delivered at PyConUK-2017.
Detecting gravitational waves in Python
Detecting gravitational waves in Python
Duncan Macleod
An earthquake occurs in the Sea of Japan. A tsunami is likely to hit the coast. The population must be warned by SMS. A datacenter has been dammaged by the earthquake. Will the alerting system still work ? Building this simple alerting system is a great way to start with Cassandra, as we discovered teaching a bigdata hands-on class in a french university. What were the reasons that made a majority of students to choose Cassandra to implement a fast, resiliant and high availability bigdata system to be deployed on AWS ? What were the common pitfalls, the modelling alternatives and their performance impact ? Project description(in French): https://github.com/lesfurets/bigdata-paristech-project-2014
Tsunami alerting with Cassandra (From 0 to Cassandra on AWS in 30 days)
Tsunami alerting with Cassandra (From 0 to Cassandra on AWS in 30 days)
andrei.arion
Batch Indexing & Near Real Time, keeping things fast
Batch Indexing & Near Real Time, keeping things fast
Marc Sturlese
European XFEL are the creators of the strongest x-ray beam in the world. Their 3.4-km long X-ray free-electron laser underground tunnel is used by researchers from around the world. Scientists use their facilities to map atomic details of viruses, film chemical reactions, and study the processes in the interior of planets. Discover how European XFEL uses InfluxDB to monitor their scientific experiments and research. In this webinar, Alessandro Silenzi will dive into: European XFEL’s approach to empowering the worldwide community to push the boundaries of science The evolution of their data management solution — from homegrown to InfluxDB How a time series platform is used to analyze and validate experiment data
How a Particle Accelerator Monitors Scientific Experiments Using InfluxDB
How a Particle Accelerator Monitors Scientific Experiments Using InfluxDB
InfluxData
Казак Т.В.
награды Казак Т.В.
награды Казак Т.В.
Марина Степаняк
Награды
презентация
презентация
Марина Степаняк
методички
издания
издания
Марина Степаняк
Мир увлечений семьи Казак
мир увлечений семьи казак
мир увлечений семьи казак
Марина Степаняк
For January 10th and 17th of 2013
WHO yuta aikawa
WHO yuta aikawa
Yuta Aikawa
Учитель-дефектолог
Анна Ивановна
Анна Ивановна
Марина Степаняк
Give back
Give back
Marc Garofalo
Папа, мама, я - педагогическая семья
папа, мама, я педагогическая семья (казак)
папа, мама, я педагогическая семья (казак)
Марина Степаняк
These are the slides from the talk I gave at the 'Radio Transients with SKA Pathfinders and Precursors' conference at Kruger Park, South Africa. 9-12 July 2013
TRAP (transient detection pipeline) status update
TRAP (transient detection pipeline) status update
Gijs Molenaar
LOFAR - finding transients in the radio spectrum
LOFAR - finding transients in the radio spectrum
Gijs Molenaar
Лагерь "Солнышко" Зима 2012- 2013
Лагерь "Солнышко" Зима 2012- 2013
Марина Степаняк
1.lineamientos avances dra.calle
1.lineamientos avances dra.calle
seni Mestas
Avance 1
Avance 1
claudiamilenarangelsanchez
More Related Content
What's hot
Presented at the Second openCypher Implementers Meeting in London, UK, May 2017 @ http://www.opencypher.org/blog/2017/06/13/ocim2-blog/
Cypher for Apache Spark
Cypher for Apache Spark
openCypher
In this video from PASC18, Alexander Nitz from the Max Planck Institute for Gravitational Physics in Germany presents: The Search for Gravitational Waves. "The LIGO and Virgo detectors have completed a prolific observation run. We are now observing gravitational waves from both the mergers of binary black holes and neutron stars. We’ll discuss how these discoveries were made and look into what the near future of searching for gravitational waves from compact binary mergers will look like." Watch the video: https://wp.me/p3RLHQ-iTv Learn more: github.com/gwastro/pycbc and https://pasc18.pasc-conference.org/ Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
The Search for Gravitational Waves
The Search for Gravitational Waves
inside-BigData.com
The deck for the talk about InfluxDb
InfluxDb and Grafana fighting with data
InfluxDb and Grafana fighting with data
Ivan Vaskevych
Stream Processing is emerging as a popular paradigm for data processing architectures, because it handles the continuous nature of most data and computation and gets rid of artificial boundaries and delays. The fact that stream processing is gaining rapid adoption is also due to more powerful and maturing technology (much of it open source at the ASF) that has solved many of the hard technical challenges. We discuss Apache Flink's approach to high performance stream processing with state, strong consistency, low latency, and sophisticated handling of time. With such building blocks, Apache Flink can handle classes of problems previously considered out of reach for stream processing. We also take a sneak preview at the next steps for Flink.
Keynote: Stephan Ewen - Stream Processing as a Foundational Paradigm and Apac...
Keynote: Stephan Ewen - Stream Processing as a Foundational Paradigm and Apac...
Ververica
Alexey Zinoviev presented this paper on the Highload++ conference http://www.highload.ru/2014/abstracts/1516.html This paper covers next topics: Pregel, Graph Theory, Giraph, Okapi, GraphX, GraphChi, Spark, Shrotest Path Problem, Road Network, Road Graph
Thorny path to the Large-Scale Graph Processing (Highload++, 2014)
Thorny path to the Large-Scale Graph Processing (Highload++, 2014)
Alexey Zinoviev
Introduction to gravitational waves and how the LIGO-Virgo collaborations use Python software at all stages in the scientific process. Delivered at PyConUK-2017.
Detecting gravitational waves in Python
Detecting gravitational waves in Python
Duncan Macleod
An earthquake occurs in the Sea of Japan. A tsunami is likely to hit the coast. The population must be warned by SMS. A datacenter has been dammaged by the earthquake. Will the alerting system still work ? Building this simple alerting system is a great way to start with Cassandra, as we discovered teaching a bigdata hands-on class in a french university. What were the reasons that made a majority of students to choose Cassandra to implement a fast, resiliant and high availability bigdata system to be deployed on AWS ? What were the common pitfalls, the modelling alternatives and their performance impact ? Project description(in French): https://github.com/lesfurets/bigdata-paristech-project-2014
Tsunami alerting with Cassandra (From 0 to Cassandra on AWS in 30 days)
Tsunami alerting with Cassandra (From 0 to Cassandra on AWS in 30 days)
andrei.arion
Batch Indexing & Near Real Time, keeping things fast
Batch Indexing & Near Real Time, keeping things fast
Marc Sturlese
European XFEL are the creators of the strongest x-ray beam in the world. Their 3.4-km long X-ray free-electron laser underground tunnel is used by researchers from around the world. Scientists use their facilities to map atomic details of viruses, film chemical reactions, and study the processes in the interior of planets. Discover how European XFEL uses InfluxDB to monitor their scientific experiments and research. In this webinar, Alessandro Silenzi will dive into: European XFEL’s approach to empowering the worldwide community to push the boundaries of science The evolution of their data management solution — from homegrown to InfluxDB How a time series platform is used to analyze and validate experiment data
How a Particle Accelerator Monitors Scientific Experiments Using InfluxDB
How a Particle Accelerator Monitors Scientific Experiments Using InfluxDB
InfluxData
What's hot
(9)
Cypher for Apache Spark
Cypher for Apache Spark
The Search for Gravitational Waves
The Search for Gravitational Waves
InfluxDb and Grafana fighting with data
InfluxDb and Grafana fighting with data
Keynote: Stephan Ewen - Stream Processing as a Foundational Paradigm and Apac...
Keynote: Stephan Ewen - Stream Processing as a Foundational Paradigm and Apac...
Thorny path to the Large-Scale Graph Processing (Highload++, 2014)
Thorny path to the Large-Scale Graph Processing (Highload++, 2014)
Detecting gravitational waves in Python
Detecting gravitational waves in Python
Tsunami alerting with Cassandra (From 0 to Cassandra on AWS in 30 days)
Tsunami alerting with Cassandra (From 0 to Cassandra on AWS in 30 days)
Batch Indexing & Near Real Time, keeping things fast
Batch Indexing & Near Real Time, keeping things fast
How a Particle Accelerator Monitors Scientific Experiments Using InfluxDB
How a Particle Accelerator Monitors Scientific Experiments Using InfluxDB
Viewers also liked
Казак Т.В.
награды Казак Т.В.
награды Казак Т.В.
Марина Степаняк
Награды
презентация
презентация
Марина Степаняк
методички
издания
издания
Марина Степаняк
Мир увлечений семьи Казак
мир увлечений семьи казак
мир увлечений семьи казак
Марина Степаняк
For January 10th and 17th of 2013
WHO yuta aikawa
WHO yuta aikawa
Yuta Aikawa
Учитель-дефектолог
Анна Ивановна
Анна Ивановна
Марина Степаняк
Give back
Give back
Marc Garofalo
Папа, мама, я - педагогическая семья
папа, мама, я педагогическая семья (казак)
папа, мама, я педагогическая семья (казак)
Марина Степаняк
These are the slides from the talk I gave at the 'Radio Transients with SKA Pathfinders and Precursors' conference at Kruger Park, South Africa. 9-12 July 2013
TRAP (transient detection pipeline) status update
TRAP (transient detection pipeline) status update
Gijs Molenaar
LOFAR - finding transients in the radio spectrum
LOFAR - finding transients in the radio spectrum
Gijs Molenaar
Лагерь "Солнышко" Зима 2012- 2013
Лагерь "Солнышко" Зима 2012- 2013
Марина Степаняк
1.lineamientos avances dra.calle
1.lineamientos avances dra.calle
seni Mestas
Avance 1
Avance 1
claudiamilenarangelsanchez
Mercadeo ii
Mercadeo ii
anfevasa
Fa 27 assignment 4 part 2
Fa 27 assignment 4 part 2
zgalasso
01 semillas de sabiduria.pdf
01 semillas de sabiduria.pdf
Karen Johnson
The Detroit Sound Book
The Detroit Sound Book
The Detroit Sound Book
LevisXX
Audacity paso a paso
Audacity paso a paso
armandobaleon
01 semillas de sabiduria.pdf
01 semillas de sabiduria.pdf
Karen Johnson
Como editar paso a paso un archivo de audio.
Audacity paso a paso como editar
Audacity paso a paso como editar
MarianadelSol2
Viewers also liked
(20)
награды Казак Т.В.
награды Казак Т.В.
презентация
презентация
издания
издания
мир увлечений семьи казак
мир увлечений семьи казак
WHO yuta aikawa
WHO yuta aikawa
Анна Ивановна
Анна Ивановна
Give back
Give back
папа, мама, я педагогическая семья (казак)
папа, мама, я педагогическая семья (казак)
TRAP (transient detection pipeline) status update
TRAP (transient detection pipeline) status update
LOFAR - finding transients in the radio spectrum
LOFAR - finding transients in the radio spectrum
Лагерь "Солнышко" Зима 2012- 2013
Лагерь "Солнышко" Зима 2012- 2013
1.lineamientos avances dra.calle
1.lineamientos avances dra.calle
Avance 1
Avance 1
Mercadeo ii
Mercadeo ii
Fa 27 assignment 4 part 2
Fa 27 assignment 4 part 2
01 semillas de sabiduria.pdf
01 semillas de sabiduria.pdf
The Detroit Sound Book
The Detroit Sound Book
Audacity paso a paso
Audacity paso a paso
01 semillas de sabiduria.pdf
01 semillas de sabiduria.pdf
Audacity paso a paso como editar
Audacity paso a paso como editar
Similar to Python User Group November 2013, SQL(alchemy) and transient detection
The LHC performance has reached new heights, in-turn the amount of data produced by the underlying infrastructure and observation systems has increased by an order of magnitude putting unprecedented load on the current data Logging Service. In this talk Jakub will introduce you to the core business of beam production at CERN and the motivations behind the evolution of the current CERN Accelerator Logging Service towards Hadoop and Apache Spark.
The Next CERN Accelerator Logging Service—A Road to Big Data with Jakub Wozni...
The Next CERN Accelerator Logging Service—A Road to Big Data with Jakub Wozni...
Spark Summit
Presentation from Mr. Tim Loomis, a Senior Systems Engineer at National Oceanic and Atmospheric Administration (NOAA). He will address the implications for managing imagery data that has geographical components per pixel and bring up a broader discussion on what the move toward geospatial rectification of web transactions means for security and data management at our Meetup in February 10th here - http://www.meetup.com/Tech-Roots/events/219644408/
Geospatial Rectification of Web Transactions and Data Security
Geospatial Rectification of Web Transactions and Data Security
Phoenix TS
VO web-services-based astronomy workflows
VO web-services-based astronomy workflows
Jose Enrique Ruiz
Quantum Computing with Amazon Braket In this talk, I describe some fundamental principles of quantum computing including qu-bits, superposition, and entanglement. I will demonstrate how to perform secure quantum computing tasks across many Quantum Processing Units (QPUs) using Amazon Braket, IAM, and S3. AI and Machine Learning, Quantum Computing, Amazon Braket, QPU
Quantum Computing with Amazon Braket
Quantum Computing with Amazon Braket
Chris Fregly
This session will explore how to apply GeoSpatial analytics using Apache Spark on high-velocity streaming (data-in-motion) and high-volume batch (data-at-rest). Demonstrations will be performed throughout the session to cement these concepts.
Big Data Day LA 2015 - Big Data Day LA 2015 - Applying GeoSpatial Analytics u...
Big Data Day LA 2015 - Big Data Day LA 2015 - Applying GeoSpatial Analytics u...
Data Con LA
Apache Kafka, Apache Cassandra and Kubernetes are open source big data technologies enabling applications and business operations to scale massively and rapidly. While Kafka and Cassandra underpins the data layer of the stack providing capability to stream, disseminate, store and retrieve data at very low latency, Kubernetes is a container orchestration technology that helps in automated application deployment and scaling of application clusters. In this presentation, Paul will reveal how he architected a massive scale deployment of a streaming data pipeline with Kafka and Cassandra to cater to an example Anomaly detection application running on a Kubernetes cluster and generating and processing massive amount of events. Anomaly detection is a method used to detect unusual events in an event stream. It is widely used in a range of applications such as financial fraud detection, security, threat detection, website user analytics, sensors, IoT, system health monitoring, etc. When such applications operate at massive scale generating millions or billions of events, they impose significant computational, performance and scalability challenges to anomaly detection algorithms and data layer technologies. Paul will demonstrate the scalability, performance and cost effectiveness of Apache Kafka, Cassandra and Kubernetes, with results from his experiments allowing the Anomaly detection application to scale to 19 Billion anomaly checks per day. Melbourne Big Data Meetup, March 5 2020 https://www.eventbrite.com/e/melbourne-big-data-meetup-realtime-anomaly-detection-with-cassandra-kafka-tickets-93028445585
Melbourne Big Data Meetup Talk: Scaling a Real-Time Anomaly Detection Applica...
Melbourne Big Data Meetup Talk: Scaling a Real-Time Anomaly Detection Applica...
Paul Brebner
Lofar python meetup jan9 2013
Lofar python meetup jan9 2013
Gijs Molenaar
How well does InfiniBand virtualized with SR-IOV really perform? SDSC carried out some initial application benchmarking studies and compared to the best-available commercial alternative to determine whether or not SR-IOV was a viable technology for closing the performance gap of virtualized HPC. The results were promising, and this technology will be used in Comet, SDSC's two-petaflop supercomputer being deployed in 2015.
SR-IOV: The Key Enabling Technology for Fully Virtualized HPC Clusters
SR-IOV: The Key Enabling Technology for Fully Virtualized HPC Clusters
Glenn K. Lockwood
Presentation given for Whitham lab. July, 2016
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
TimeScience
Defcon 23 - colby moore - spread spectrum satcom hacking
Defcon 23 - colby moore - spread spectrum satcom hacking
Defcon 23 - colby moore - spread spectrum satcom hacking
Felipe Prado
Overhead imagery from satellites and drones have entered the mainstream of how we explore, understand, and tell stories about our world.
Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science Workflows
Databricks
Web services based workflows to deal with 3D data
Web services based workflows to deal with 3D data
Jose Enrique Ruiz
Internet of Things (IoT) data frequently has a location and time component. Getting value out of this "geotemporal" data can be tricky. We'll explore when and how to leverage Cassandra, DSE Search and DSE Analytics to surface meaningful information from your geotemporal data.
DataStax and Esri: Geotemporal IoT Search and Analytics
DataStax and Esri: Geotemporal IoT Search and Analytics
DataStax Academy
BTech thesis presentation of Aritra Sarkar at Indian Institute of Space Science and Technology
Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...
Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...
Aritra Sarkar
Similar to Python User Group November 2013, SQL(alchemy) and transient detection
(14)
The Next CERN Accelerator Logging Service—A Road to Big Data with Jakub Wozni...
The Next CERN Accelerator Logging Service—A Road to Big Data with Jakub Wozni...
Geospatial Rectification of Web Transactions and Data Security
Geospatial Rectification of Web Transactions and Data Security
VO web-services-based astronomy workflows
VO web-services-based astronomy workflows
Quantum Computing with Amazon Braket
Quantum Computing with Amazon Braket
Big Data Day LA 2015 - Big Data Day LA 2015 - Applying GeoSpatial Analytics u...
Big Data Day LA 2015 - Big Data Day LA 2015 - Applying GeoSpatial Analytics u...
Melbourne Big Data Meetup Talk: Scaling a Real-Time Anomaly Detection Applica...
Melbourne Big Data Meetup Talk: Scaling a Real-Time Anomaly Detection Applica...
Lofar python meetup jan9 2013
Lofar python meetup jan9 2013
SR-IOV: The Key Enabling Technology for Fully Virtualized HPC Clusters
SR-IOV: The Key Enabling Technology for Fully Virtualized HPC Clusters
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
TraitCapture: NextGen Monitoring and Visualization from seed to ecosystem
Defcon 23 - colby moore - spread spectrum satcom hacking
Defcon 23 - colby moore - spread spectrum satcom hacking
Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science Workflows
Web services based workflows to deal with 3D data
Web services based workflows to deal with 3D data
DataStax and Esri: Geotemporal IoT Search and Analytics
DataStax and Esri: Geotemporal IoT Search and Analytics
Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...
Elevation mapping using stereo vision enabled heterogeneous multi-agent robot...
Recently uploaded
The Raspberry Pi 5 was announced on October 2023. This new version of the popular embedded device comes with a new iteration of Broadcom’s VideoCore GPU platform, and was released with a fully open source driver stack, developed by Igalia. The presentation will discuss some of the major changes required to support this new Video Core iteration, the challenges we faced in the process and the solutions we provided in order to deliver conformant OpenGL ES and Vulkan drivers. The talk will also cover the next steps for the open source Raspberry Pi 5 graphics stack. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://eoss24.sched.com/event/1aBEx
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Igalia
Sara Mae O’Brien Scott and Tatiana Baquero Cakici, Senior Consultants at Enterprise Knowledge (EK), presented “AI Fast Track to Search-Focused AI Solutions” at the Information Architecture Conference (IAC24) that took place on April 11, 2024 in Seattle, WA. In their presentation, O’Brien-Scott and Cakici focused on what Enterprise AI is, why it is important, and what it takes to empower organizations to get started on a search-based AI journey and stay on track. The presentation explored the complexities of enterprise search challenges and how IA principles can be leveraged to provide AI solutions through the use of a semantic layer. O’Brien-Scott and Cakici showcased a case study where a taxonomy, an ontology, and a knowledge graph were used to structure content at a healthcare workforce solutions organization, providing personalized content recommendations and increasing content findability. In this session, participants gained insights about the following: Most common types of AI categories and use cases; Recommended steps to design and implement taxonomies and ontologies, ensuring they evolve effectively and support the organization’s search objectives; Taxonomy and ontology design considerations and best practices; Real-world AI applications that illustrated the value of taxonomies, ontologies, and knowledge graphs; and Tools, roles, and skills to design and implement AI-powered search solutions.
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
45-60 minute session deck from introducing Google Apps Script to developers, IT leadership, and other technical professionals.
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
wesley chun
Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
debabhi2
How to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
naman860154
Stay safe, grab a drink and join us virtually for our upcoming "GenAI Risks & Security" Meetup to hear about how to uncover critical GenAI risks and vulnerabilities, AI security considerations in every company, and how a CISO should navigate through GenAI Risks.
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
lior mazor
writing some innovation for development and search
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
sudhanshuwaghmare1
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
The Digital Insurer
What is a good lead in your organisation? Which leads are priority? What happens to leads? When sales and marketing give different answers to these questions, or perhaps aren't sure of the answers at all, frustrations build and opportunities are left on the table. Join us for an illuminating session with Cian McLoughlin, HubSpot Principal Customer Success Manager, as we look at that crucial piece of the customer journey in which leads are transferred from marketing to sales.
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
HampshireHUG
Tech Trends Report 2024 Future Today Institute
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
hans926745
Read about the journey the Adobe Experience Manager team has gone through in order to become and scale API-first throughout the organisation.
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
Radu Cotescu
Copy of the slides presented by Matt Robison to the SFWelly Salesforce user group community on May 2 2024. The audience was truly international with attendees from at least 4 different countries joining online. Matt is an expert in data cloud and this was a brilliant session.
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
Anna Loughnan Colquhoun
These are the slides delivered in a workshop at Data Innovation Summit Stockholm April 2024, by Kristof Neys and Jonas El Reweny.
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Neo4j
Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
wesley chun
The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
Presentation on the progress in the Domino Container community project as delivered at the Engage 2024 conference
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Martijn de Jong
Presented by Mike Hicks
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
ThousandEyes
In an era where artificial intelligence (AI) stands at the forefront of business innovation, Information Architecture (IA) is at the core of functionality. See “There’s No AI Without IA” – (from 2016 but even more relevant today) Understanding and leveraging how Information Architecture (IA) supports AI synergies between knowledge engineering and prompt engineering is critical for senior leaders looking to successfully deploy AI for internal and externally facing knowledge processes. This webinar be a high-level overview of the methodologies that can elevate AI-driven knowledge processes supporting both employees and customers. Core Insights Include: Strategic Knowledge Engineering: Delve into how structuring AI's knowledge base is required to prevent hallucinations, enable contextual retrieval of accurate information. This will include discussion of gold standard libraries of use cases support testing various LLMs and structures and configurations of knowledge base. Precision in Prompt Engineering: Learn the art of crafting prompts that direct AI to deliver targeted, relevant responses, thereby optimizing customer experiences and business outcomes. Unified Approach for Enhanced AI Performance: Explore the intersection of knowledge and prompt engineering to develop AI systems that are not only more responsive but also aligned with overarching business strategies. Guiding Principles for Implementation: Equip yourself with best practices, ethical guidelines, and strategic considerations for embedding these technologies into your business ecosystem effectively. This webinar is designed to empower business and technology leaders with the knowledge to harness the full potential of AI, ensuring their organizations not only keep pace with digital transformation but lead the charge. Join us to map a roadmap to fully leverage Information Architecture (IA) and AI chart a course towards a future where AI is a key pillar of strategic innovation and business success.
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
Presented by Sergio Licea and John Hendershot
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
ThousandEyes
Recently uploaded
(20)
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
How to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
Python User Group November 2013, SQL(alchemy) and transient detection
1.
Transient Detection and SQL Gijs
Molenaar ! Anton Pannekoek Institute (UvA) ! @gijzelaerr gijs@pythonic.nl
2.
LOFAR • Radio telescope • ~10–240 MHz • Software
telescope • omni-directional
3.
AARTFAAC • Lofar sub project • 24/7
full sky transient detection • ‘Changes’ • 99% Python code
4.
Transients • Super-nova • Gamma-ray burst • Pulsars • exo-planets • ?
5.
Images • 10-240 MHz • Split in
10 bands • 1 image cube per second • future 10 images per second
6.
Data • Source • Position • Flux (intensity) • Shape (2d
gaussian)
7.
Data rate • 500 -
5000 inserts per second • Higher in other modes
8.
Calculations • Associate in frequency • Associate
in time
9.
Quite a lot
of data • move calculations to data (base)
10.
nonosql • Structured data • Natural sharding
by sky position • MonetDB
11.
Why MonetDB • Dutch (CWI) • Fast
with huge datasets • Developers next door
12.
calculations to data • No
moving around data • one huge big monolithic query per ‘operation’
13.
Example
14.
HORRIBLE • Huge monolithic queries • hard
to read • hard to reason about • hard to test • hard to maintain • hard to port
15.
Solution? • Functions?
16.
NO! • DB revisions, versioning
hell • For every code change new version • Schema migrations • Init functions on startup? • DB specific
17.
SOLUTION
18.
Why? • Object Relational Mapper • Better
Query Builder Language! • Support multiple database dialect • Functions per dialect ! • SQLAlchemy -> SQL is like C -> assembler
19.
example
20.
Why not earlier? • Started
by non programmers • No MonetDB dialect for SQLAlchemy
21.
sqlalchemy-monetdb • pip install sqlalchemy-monetdb • https://github.com/gijzelaerr/sqlalchemy-monetdb • https://github.com/gijzelaerr/djonet • (banana)
22.
Questions?
Download now