Apple's newly granted patent generally relates to methods, devices and software for extracting information from depth maps. Depth maps provide a wealth of information, particularly when they are presented in a continuous stream over time. Depth maps are used in video games and other applications. In the pictured example below, for instance, users 28 and 30 interact with game software running on computer by moving their limbs and changing their body postures.