Do we need to freeze embeddings when fine-tuning our LM?

Image for post
Image for post
Author

Intro

Idea

Data

Image for post
Image for post

Implementation

Results

Image for post
Image for post
Image for post
Image for post

Conclusion

ML Engineer at Simporter Inc.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store