Google Cloud Trainium & Inferentia
  • 🌍Optimum Neuron
  • 🌍Installation
  • 🌍Quickstart
  • 🌍TUTORIALS
    • Overview
    • Fine-tune BERT for Text Classification on AWS Trainium
  • 🌍HOW-TO GUIDES
    • Overview
    • Set up AWS Trainium instance
    • Neuron model cache
    • Fine-tune Transformers with AWS Trainium
    • Export a model to Inferentia
    • Neuron models for inference
    • Inference pipelines with AWS Neuron
  • 🌍REFERENCE
    • Neuron Trainer
    • Neuron Exporter
    • Neuron Models
Powered by GitBook
On this page

Installation

Installation

Our recommendation is to use the BOINC AI Neuron Deep Learning AMI (DLAMI). The DLAMI comes with all required libraries pre-packaged for you, including the Optimum Neuron, Neuron Drivers, Transformers, Datasets, and Accelerate.

But it can also be installed using pip as described below.

Before installing optimum-neuron make sure that you have installed the Neuron driver and tools, check out more detailed guide here.

Adding pip packages URL

Pointing to the AWS Neuron repository:

Copied

python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com

Installing optimum-neuron for AWS Trainium ( trn1 ) or AWS inferentia2 ( inf2 )

Copied

python -m pip install optimum[neuronx]

Installing optimum-neuron for AWS inferentia ( inf1 )

Copied

python -m pip install optimum[neuron]
PreviousOptimum NeuronNextQuickstart

Last updated 1 year ago

🌍
  • Installation
  • Adding pip packages URL
  • Installing optimum-neuron for AWS Trainium ( trn1 ) or AWS inferentia2 ( inf2 )
  • Installing optimum-neuron for AWS inferentia ( inf1 )