BERT and the Pretrain-Finetune Paradigm

3 selectedDifficulty 2-43 unseenView topic

Saved practice

Keep this quiz in your learner record

Answers count toward your profile, review queue, and next-topic suggestions. You can also use the quick practice below.

FoundationNew

0 answered

2 foundation1 intermediateAdapts to your performance

Question 1 of 3

120sfoundation (2/10)conceptual

The pretrain-then-finetune paradigm popularized by BERT (2018) has become standard for NLP. What is the key advantage over training from scratch on each task?