What is self-supervised learning?
- A Creating labels from the data itself, such as predicting a masked word
- B Learning without any data
- C A form of reinforcement learning
- D Training with human feedback only
Answer
Creating labels from the data itself, such as predicting a masked word
By removing the labelling bottleneck, self-supervised pretraining is what made modern large language models possible.





