> For the complete documentation index, see [llms.txt](https://boinc-ai.gitbook.io/transformers/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://boinc-ai.gitbook.io/transformers/performance-and-scalability.md).

# PERFORMANCE AND SCALABILITY

- [Overview](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/overview.md)
- [EFFICIENT TRAINING TECHNIQUES](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques.md)
- [Methods and tools for efficient training on a single GPU](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques/methods-and-tools-for-efficient-training-on-a-single-gpu.md)
- [Multiple GPUs and parallelism](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques/multiple-gpus-and-parallelism.md)
- [Efficient training on CPU](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques/efficient-training-on-cpu.md)
- [Distributed CPU training](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques/distributed-cpu-training.md)
- [Training on TPUs](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques/training-on-tpus.md)
- [Training on TPU with TensorFlow](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques/training-on-tpu-with-tensorflow.md)
- [Training on Specialized Hardware](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques/training-on-specialized-hardware.md)
- [Custom hardware for training](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques/custom-hardware-for-training.md)
- [Hyperparameter Search using Trainer API](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/efficient-training-techniques/hyperparameter-search-using-trainer-api.md)
- [OPTIMIZING INFERENCE](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/optimizing-inference.md)
- [Inference on CPU](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/optimizing-inference/inference-on-cpu.md)
- [Inference on one GPU](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/optimizing-inference/inference-on-one-gpu.md)
- [Inference on many GPUs](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/optimizing-inference/inference-on-many-gpus.md)
- [Inference on Specialized Hardware](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/optimizing-inference/inference-on-specialized-hardware.md)
- [Instantiating a big model](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/instantiating-a-big-model.md)
- [Troubleshooting](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/troubleshooting.md)
- [XLA Integration for TensorFlow Models](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/xla-integration-for-tensorflow-models.md)
- [Optimize inference using \`torch.compile()\`](https://boinc-ai.gitbook.io/transformers/performance-and-scalability/optimize-inference-using-torch.compile.md)