Memory Optimization 15. Time: Lecture: XX minutes; Labs: 0 minutes Intent: One sentence description of the reason this module is here Flow: Narrative or “storyline” version of the module’s content in a paragraph or so Key Terms: List terms introduced in the module Module Setup: Any physical setup the instructor may need to do before starting the module
Memory Optimization 15.
Memory Optimization 15. This diagram is a simplification of how the DTM uses memory. The DTM Buffer allows each thread to pass data on to the next thread and for the Writer to receive data to pass to the target. The DTM Buffer is divided into blocks. Different threads control different blocks. If there are multiple transformer threads, each requires its own set of blocks to pass data to the next thread. Thus, the number of required blocks is a function of the number of sources, targets, & stages in your pipeline. In addition to the DTM Buffer, certain transformations require memory known as the transformation caches . The transformation caches reside outside of the DTM Buffer. That means the transformation caches represent an additional memory requirement beyond the DTM Buffer.
Memory Optimization 15.
Memory Optimization 15.
Memory Optimization 15.
Memory Optimization 15. The transformation caches are separate from the DTM Buffer.
Memory Optimization 15. Use the auto settings as a starting point. Check the session log to see the actual runtime allocations. Note that each transformation stage also requires a minimum of 2 blocks.
Memory Optimization 15. Purpose: To allow for a review. Steps: Ensure that students “got” the material, have completed lab successfully, etc.
![Partitioning Sessions ,[object Object]](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)