Installation

Our recommendation is to use the Model Database Neuron Deep Learning AMI (DLAMI). The DLAMI comes with all required libraries pre-packaged for you, including the Optimum Neuron, Neuron Drivers, Transformers, Datasets, and Accelerate. But it can also be installed using pip as follows:

Installing optimum-neuron for AWS Trainium (trn1) or AWS inferentia2 (inf2)

python -m pip install optimum[neuronx]

Installing optimum-neuron for AWS inferentia (inf1)

python -m pip install optimum[neuron]

Before installing optimum-neuron make sure that you have installed the Neuron driver and tools, check out more detailed guide here.