Composing High-Performance Memory Allocators with Heap Layers

•Transferir como PPT, PDF•

2 gostaram•2,745 visualizações

Heap Layers is a template-based infrastructure for building high-quality, fast memory allocators. The infrastructure is remarkably flexible, and the resulting memory allocators are as fast or faster than counterparts written in conventional C or C++. We have built several industrial-strength allocators using Heap Layers, including Hoard (which now includes the Heap Layers infrastructure) and DieHard.

Tecnologia

Composing High-Performance Memory Allocators Emery Berger , Ben Zorn, Kathryn McKinley

Motivation & Contributions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Using Custom Allocators ,[object Object],[object Object],[object Object],[object Object],[object Object]

Problems with Current Practice ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Allocator Conceptual Design ,[object Object],Select heap based on size malloc free Manage small objects System memory manager Manage large objects

Infrastructure Requirements ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Possible Solutions  virtual method overhead function call overhead Fast   function-pointer assignment High-level   Mixins (our approach) rigid hierarchy  Object-oriented (CMM [Attardi et al. 1998])   Indirect function calls (Vmalloc [Vo 1996]) Reusable Flexible

Ordinary Classes vs. Mixins ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

A Heap Layer void * malloc (sz) { do something; void * p = SuperHeap::malloc (sz); do something else; return p; } heap layer ,[object Object],[object Object],[object Object],[object Object]

Example: Thread-safety ,[object Object],[object Object],void * malloc (sz) { acquire lock; void * p = release lock; return p; } class LockedMallocHeap: public LockedHeap<mallocHeap> {}; SuperHeap::malloc (sz); LockedHeap mallocHeap

Example: Debugging ,[object Object],[object Object],DebugHeap class LockedDebugMallocHeap: public LockedHeap< DebugHeap<mallocHeap> > {}; LockedHeap void free (p) { check that p is valid; check that p hasn’t been freed before; } SuperHeap::free (p); mallocHeap

Implementation in Heap Layers ,[object Object],SegHeap malloc free SizeHeap FreelistHeap manage objects on freelist add size info to objects select heap based on size

Experimental Methodology ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Experimental Results: Custom Allocation – gcc

Experimental Results: General-Purpose Allocators

Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object]

A Library of Heap Layers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Heap Layers as Experimental Infrastructure ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Mais conteúdo relacionado

Mais procurados

Introduction to Parallelization ans performance optimizationCSUC - Consorci de Serveis Universitaris de Catalunya

ns-3 Tutorialmathieu_lacage

Improving Efficiency of Machine Learning Algorithms using HPCC SystemsHPCC Systems

Ch 5: Introduction to heap overflowsSam Bowne

Chainer v2 alphaSeiya Tokui

Serving deep learning models in a serverless platform (IC2E 2018)alekn

Towards Chainer v1.5Seiya Tokui

Available HPC resources at CSUCCSUC - Consorci de Serveis Universitaris de Catalunya

Go and Uber’s time series database m3Rob Skillington

Large-Scale Training with GPUs at FacebookFaisal Siddiqi

Deccan RubyConf 2016 - Lighning Talk - SpiceRubGaurav Tamba

Introduction to PolyaxonYu Ishikawa

Google colab installing ml librariesSaravanakumar viswanathan

04 pig data operationsSubhas Kumar Ghosh

$IEEE CLOUD \'11$ $IEEE CLOUD \'11$

IEEE CLOUD \'11David Ribeiro Alves

Realtime Statistics based on Apache Storm and RocketMQXin Wang

Chainer v4 and v5Preferred Networks

pMatlab on BlueGenevsachde

Introduction to Apache StormTiziano De Matteis

Mais procurados (20)

Introduction to Parallelization ans performance optimization

ns-3 Tutorial

Improving Efficiency of Machine Learning Algorithms using HPCC Systems

Ch 5: Introduction to heap overflows

Chainer v2 alpha

Serving deep learning models in a serverless platform (IC2E 2018)

Towards Chainer v1.5

Available HPC resources at CSUC

Go and Uber’s time series database m3

Large-Scale Training with GPUs at Facebook

Deccan RubyConf 2016 - Lighning Talk - SpiceRub

Introduction to Polyaxon

Google colab installing ml libraries

04 pig data operations

$IEEE CLOUD \'11$ $IEEE CLOUD \'11$

IEEE CLOUD \'11

Realtime Statistics based on Apache Storm and RocketMQ

Chainer v4 and v5

pMatlab on BlueGene

Introduction to Apache Storm

Semelhante a Composing High-Performance Memory Allocators with Heap Layers

Java programing considering performanceRoger Xia

Prediction as a service with ensemble model in SparkML and Python ScikitLearnJosef A. Habdank

Symfony HTTP Kernel for refactoring legacy apps: the eZ Publish case study - ...Gaetano Giunta

ECMFA 2016 slidesAntonio García-Domínguez

Spark Summit EU talk by Josef HabdankSpark Summit

StackNet Meta-Modelling frameworkSri Ambati

Goroutine stack and local variable allocation in GoYu-Shuan Hsieh

Patterns in Pythondn

How to design an application correctly ?Guillaume AGIS

Pune-Cocoa: Blocks and GCDPrashant Rane

Chapter Seven(2)bolovv

P Training PresentationGaurav Tyagi

Breaking Dependencies Legacy Code - Cork Software Crafters - September 2019Paulo Clavijo

Things you can find in the plan cachesqlserver.co.il

Memory Allocation & Direct Memory Allocation in C & C++ Language PPTAkhilMishra50

gcdtmpTheFoolish Man

Effective Java, Third Edition - Keepin' it EffectiveC4Media

Introduction to Memory ContextsChris Travers

Design patternsAnas Alpure

Performance Tuning - Memory leaks, Thread deadlocks, JDK toolsHaribabu Nandyal Padmanaban

Semelhante a Composing High-Performance Memory Allocators with Heap Layers (20)

Java programing considering performance

Prediction as a service with ensemble model in SparkML and Python ScikitLearn

Symfony HTTP Kernel for refactoring legacy apps: the eZ Publish case study - ...

ECMFA 2016 slides

Spark Summit EU talk by Josef Habdank

StackNet Meta-Modelling framework

Goroutine stack and local variable allocation in Go

Patterns in Python

How to design an application correctly ?

Pune-Cocoa: Blocks and GCD

Chapter Seven(2)

P Training Presentation

Breaking Dependencies Legacy Code - Cork Software Crafters - September 2019

Things you can find in the plan cache

Memory Allocation & Direct Memory Allocation in C & C++ Language PPT

gcdtmp

Effective Java, Third Edition - Keepin' it Effective

Introduction to Memory Contexts

Design patterns

Performance Tuning - Memory leaks, Thread deadlocks, JDK tools

Mais de Emery Berger

Doppio: Breaking the Browser Language BarrierEmery Berger

Dthreads: Efficient Deterministic MultithreadingEmery Berger

Programming with PeopleEmery Berger

Stabilizer: Statistically Sound Performance EvaluationEmery Berger

DieHarder (CCS 2010, WOOT 2011)Emery Berger

Operating Systems - Advanced File SystemsEmery Berger

Operating Systems - File SystemsEmery Berger

Operating Systems - NetworksEmery Berger

Operating Systems - Queuing SystemsEmery Berger

Operating Systems - Distributed Parallel ComputingEmery Berger

Operating Systems - ConcurrencyEmery Berger

Operating Systems - Advanced SynchronizationEmery Berger

Operating Systems - SynchronizationEmery Berger

Processes and ThreadsEmery Berger

Virtual Memory and PagingEmery Berger

Operating Systems - Virtual MemoryEmery Berger

MC2: High-Performance Garbage Collection for Memory-Constrained EnvironmentsEmery Berger

Vam: A Locality-Improving Dynamic Memory AllocatorEmery Berger

Quantifying the Performance of Garbage Collection vs. Explicit Memory ManagementEmery Berger

Garbage Collection without PagingEmery Berger

Mais de Emery Berger (20)

Doppio: Breaking the Browser Language Barrier

Dthreads: Efficient Deterministic Multithreading

Programming with People

Stabilizer: Statistically Sound Performance Evaluation

DieHarder (CCS 2010, WOOT 2011)

Operating Systems - Advanced File Systems

Operating Systems - File Systems

Operating Systems - Networks

Operating Systems - Queuing Systems

Operating Systems - Distributed Parallel Computing

Operating Systems - Concurrency

Operating Systems - Advanced Synchronization

Operating Systems - Synchronization

Processes and Threads

Virtual Memory and Paging

Operating Systems - Virtual Memory

MC2: High-Performance Garbage Collection for Memory-Constrained Environments

Vam: A Locality-Improving Dynamic Memory Allocator

Quantifying the Performance of Garbage Collection vs. Explicit Memory Management

Garbage Collection without Paging

Último

Time Series Foundation Models - current state and future directionsNathaniel Shimoni

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3

New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada

TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey

Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB

From Family Reminiscence to Scholarly Archive .Alan Dix

"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays

What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett

What is Artificial Intelligence?????????blackmambaettijean

WordPress Websites for Engineers: Elevate Your Brandgvaughan

DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell

What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina

A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3

TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc

How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada

How to write a Business Continuity PlanDatabarracks

SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero

The State of Passkeys with FIDO Alliance.pptxLoriGlavin3

Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos