Fine-tune Transformers with AWS Trainium

Fine-tune Transformers with AWS Trainium

Training on AWS Trainium is as simple as in Transformers:

• You need to replace the Transformers’ Trainer class with the NeuronTrainer class.

You can find several examples in the official repository for the following tasks:

• language modeling,

• question answering,

• summarization,

• text classification,

• translation,

• image classification,

• audio classification,

• speech recognition,

• contrastive image-text training.

If you want go through an step-by-step example check out the getting started with AWS Trainium and Hugging Face Transformers guide.