Google Cloud Trainium & Inferentia
  • 🌍Optimum Neuron
  • 🌍Installation
  • 🌍Quickstart
  • 🌍TUTORIALS
    • Overview
    • Fine-tune BERT for Text Classification on AWS Trainium
  • 🌍HOW-TO GUIDES
    • Overview
    • Set up AWS Trainium instance
    • Neuron model cache
    • Fine-tune Transformers with AWS Trainium
    • Export a model to Inferentia
    • Neuron models for inference
    • Inference pipelines with AWS Neuron
  • 🌍REFERENCE
    • Neuron Trainer
    • Neuron Exporter
    • Neuron Models
Powered by GitBook
On this page
  • Installation
  • Adding pip packages URL
  • Installing optimum-neuron for AWS Trainium ( trn1 ) or AWS inferentia2 ( inf2 )
  • Installing optimum-neuron for AWS inferentia ( inf1 )

Installation

PreviousOptimum NeuronNextQuickstart

Last updated 1 year ago

Installation

Our recommendation is to use the (DLAMI). The DLAMI comes with all required libraries pre-packaged for you, including the Optimum Neuron, Neuron Drivers, Transformers, Datasets, and Accelerate.

But it can also be installed using pip as described below.

Before installing optimum-neuron make sure that you have installed the Neuron driver and tools, check out .

Adding pip packages URL

Pointing to the AWS Neuron repository:

Copied

python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com

Installing optimum-neuron for AWS Trainium ( trn1 ) or AWS inferentia2 ( inf2 )

Copied

python -m pip install optimum[neuronx]

Installing optimum-neuron for AWS inferentia ( inf1 )

Copied

python -m pip install optimum[neuron]
🌍
BOINC AI Neuron Deep Learning AMI
more detailed guide here