The document discusses a new approach to machine learning that trains models on unlabeled data using self-supervision, allowing the models to learn useful representations of the data without human labels. This technique involves predicting missing or corrupted parts of the input and can be applied to a wide range of tasks like vision, language, and reinforcement learning. Researchers have found that models trained this way learn representations that are useful for downstream supervised learning tasks.

1. 1

2. 2

3. 3

4. 4

5. 5

6. 6

7. 7

8. 8

9. 9

10. 10

11. 11

12. 12

13. 13

14. By
14

15. 15

16. 16

17. 17

18. 18

19. 19

20. 20

21. 21

22. 22

23. 23