Apache Pig is a high-level platform for analyzing large datasets that can be plugged into Hadoop. It aims to make working with data easier to understand for users by providing simple commands like LOAD, FILTER, JOIN, and GROUP while handling the execution plan behind the scenes. Pig is useful when you want things done faster and can benefit from its active community and ability to extend functionality through user-defined functions.

1. APACHE PIG
Jackson Oliveira
@cyber_jso

2. A High Level Analysis Platform

3. Which can be plugged on Hadoop

5. How it works?

6. How it works?

7. What is the point in using PIG?!

8. MR is not difficult in theory...

9. But the reality can be different...

10. We want it easy to understand
Users = LOAD 'myfile.txt' ‘users’ USING PigStorage('t') AS (name, age);
Filtered = FILTER Users BY age >= 18 AND age <= 25;
Pages = LOAD ‘pages’ AS (user, url);
Joined = JOIN Filtered BY name, Pages BY user;
Grouped = GROUP Joined BY url;
Summed = FOREACH Grouped generate GROUP, COUNT(Joined) AS clicks;
Sorted = ORDER Summed BY clicks DESC;

11. Also easy to extend (UDFs)...

12. It takes care of the execution plan for you

13. When use apache pig?

14. If you want thing being done faster

15. An active community

16. You might need rethink complicated things