CtrlK

🌍OVERVIEW
🌍HABANA
🌍INTEL
🌍AWS TRAINIUM/INFERENTIA
- BOINC AI Optimum Neuron
🌍FURIOSA
🌍ONNX RUNTIME
🌍EXPORTERS
🌍TORCH FX
🌍BETTERTRANSFORMER
- Overview
- 🌍TUTORIALS
  - Convert Transformers models to use BetterTransformer
  - How to add support for new architectures?
🌍LLM QUANTIZATION
- GPTQ quantization
🌍UTILITIES
- Dummy input generators
- Normalized configurations

Powered by GitBook

On this page

🌍INTEL

🌍OPENVINO

Models for inference Optimization Reference

PreviousReference NextModels for inference