REALM: Retrieval-Augmented Language Model Pre-Training

REALM: Retrieval-Augmented Language Model Pre-Training

helpful resources:

https://github.com/google-research/language/blob/master/language/realm/README.md

https://crossminds.ai/video/realm-retrieval-augmented-language-model-pre-training-606f49b3072e523d7b78128a/