CtrlK

🌍OVERVIEW
🌍HABANA
🌍INTEL
🌍AWS TRAINIUM/INFERENTIA
- BOINC AI Optimum Neuron
🌍FURIOSA
🌍ONNX RUNTIME
🌍EXPORTERS
🌍TORCH FX
🌍BETTERTRANSFORMER
- Overview
- 🌍TUTORIALS
  - Convert Transformers models to use BetterTransformer
  - How to add support for new architectures?
🌍LLM QUANTIZATION
- GPTQ quantization
🌍UTILITIES
- Dummy input generators
- Normalized configurations

Powered by GitBook

On this page

🌍ONNX RUNTIME

Overview Quick tour 🌍HOW-TO GUIDES 🌍CONCEPTUAL GUIDES 🌍REFERENCE

PreviousQuantization NextOverview