🌍GET STARTED
🌍TUTORIALS
🌍TASK GUIDES
🌍DEVELOPER GUIDES
🌍PERFORMANCE AND SCALABILITY
🌍CONTRIBUTE
🌍CONCEPTUAL GUIDES
🌍API
- 🌍MAIN CLASSES
  Agents and Tools
  🌍Auto Classes
  Extending the Auto Classes
  AutoConfig
  AutoTokenizer
  AutoFeatureExtractor
  AutoImageProcessor
  AutoProcessor
  Generic model classes
  AutoModel
  TFAutoModel
  FlaxAutoModel
  Generic pretraining classes
  AutoModelForPreTraining
  TFAutoModelForPreTraining
  FlaxAutoModelForPreTraining
  Natural Language Processing
  AutoModelForCausalLM
  TFAutoModelForCausalLM
  FlaxAutoModelForCausalLM
  AutoModelForMaskedLM
  TFAutoModelForMaskedLM
  FlaxAutoModelForMaskedLM
  AutoModelForMaskGenerationge
  TFAutoModelForMaskGeneration
  AutoModelForSeq2SeqLM
  TFAutoModelForSeq2SeqLM
  FlaxAutoModelForSeq2SeqLM
  AutoModelForSequenceClassification
  TFAutoModelForSequenceClassification
  FlaxAutoModelForSequenceClassification
  AutoModelForMultipleChoice
  TFAutoModelForMultipleChoice
  FlaxAutoModelForMultipleChoice
  AutoModelForNextSentencePrediction
  TFAutoModelForNextSentencePrediction
  FlaxAutoModelForNextSentencePrediction
  AutoModelForTokenClassification
  TFAutoModelForTokenClassification
  FlaxAutoModelForTokenClassification
  AutoModelForQuestionAnswering
  TFAutoModelForQuestionAnswering
  FlaxAutoModelForQuestionAnswering
  AutoModelForTextEncoding
  TFAutoModelForTextEncoding
  Computer vision
  AutoModelForDepthEstimation
  AutoModelForImageClassification
  TFAutoModelForImageClassification
  FlaxAutoModelForImageClassification
  AutoModelForVideoClassification
  AutoModelForMaskedImageModeling
  TFAutoModelForMaskedImageModeling
  AutoModelForObjectDetection
  AutoModelForImageSegmentation
  AutoModelForImageToImage
  AutoModelForSemanticSegmentation
  TFAutoModelForSemanticSegmentation
  AutoModelForInstanceSegmentation
  AutoModelForUniversalSegmentation
  AutoModelForZeroShotImageClassification
  TFAutoModelForZeroShotImageClassification
  AutoModelForZeroShotObjectDetection
  Audio
  AutoModelForAudioClassification
  AutoModelForAudioFrameClassification
  TFAutoModelForAudioFrameClassification
  AutoModelForCTC
  AutoModelForSpeechSeq2Seq
  TFAutoModelForSpeechSeq2Seq
  FlaxAutoModelForSpeechSeq2Seq
  AutoModelForAudioXVector
  AutoModelForTextToSpectrogram
  AutoModelForTextToWaveform
  Multimodal
  AutoModelForTableQuestionAnswering
  TFAutoModelForTableQuestionAnswering
  AutoModelForDocumentQuestionAnswering
  TFAutoModelForDocumentQuestionAnswering
  AutoModelForVisualQuestionAnswering
  AutoModelForVision2Seq
  TFAutoModelForVision2Seq
  FlaxAutoModelForVision2Seq
  Callbacks
  Configuration
  Data Collator
  Keras callbacks
  Logging
  Models
  Text Generation
  ONNX
  Optimization
  Model outputs
  Pipelines
  Processors
  Quantization
  Tokenizer
  Trainer
  DeepSpeed Integration
  Feature Extractor
  Image Processor
- 🌍MODELS
  🌍TEXT MODELS
  ALBERT
  BART
  BARThez
  BARTpho
  BERT
  BertGeneration
  BertJapanese
  Bertweet
  BigBird
  BigBirdPegasus
  BioGpt
  Blenderbot
  Blenderbot Small
  BLOOM
  BORT
  ByT5
  CamemBERT
  CANINE
  CodeGen
  CodeLlama
  ConvBERT
  CPM
  CPMANT
  CTRL
  DeBERTa
  DeBERTa-v2
  DialoGPT
  DistilBERT
  DPR
  ELECTRA
  Encoder Decoder Models
  ERNIE
  ErnieM
  ESM
  Falcon
  FLAN-T5
  FLAN-UL2
  FlauBERT
  FNet
  FSMT
  Funnel Transformer
  GPT
  GPT Neo
  GPT NeoX
  GPT NeoX Japanese
  GPT-J
  GPT2
  GPTBigCode
  GPTSAN Japanese
  GPTSw3
  HerBERT
  I-BERT
  Jukebox
  LED
  LLaMA
  LLama2
  Longformer
  LongT5
  LUKE
  M2M100
  MarianMT
  MarkupLM
  MBart and MBart-50
  MEGA
  MegatronBERT
  MegatronGPT2
  Mistral
  mLUKE
  MobileBERT
  MPNet
  MPT
  MRA
  MT5
  MVP
  NEZHA
  NLLB
  NLLB-MoE
  Nyströmformer
  Open-Llama
  OPT
  Pegasus
  PEGASUS-X
  Persimmon
  PhoBERT
  PLBart
  ProphetNet
  QDQBert
  RAG
  REALM
  Reformer
  RemBERT
  RetriBERT
  RoBERTa
  RoBERTa-PreLayerNorm
  RoCBert
  RoFormer
  RWKV
  Splinter
  SqueezeBERT
  SwitchTransformers
  T5
  T5v1.1
  TAPEX
  Transformer XL
  UL2
  UMT5
  X-MOD
  XGLM
  XLM
  XLM-ProphetNet
  XLM-RoBERTa
  XLM-RoBERTa-XL
  XLM-V
  XLNet
  YOSO
  🌍VISION MODELS
  BEiT
  BiT
  Conditional DETR
  ConvNeXT
  ConvNeXTV2
  CvT
  Deformable DETR
  DeiT
  DETA
  DETR
  DiNAT
  DINO V2
  DiT
  DPT
  EfficientFormer
  EfficientNet
  FocalNet
  GLPN
  ImageGPT
  LeViT
  Mask2Former
  MaskFormer
  MobileNetV1
  MobileNetV2
  MobileViT
  MobileViTV2
  NAT
  PoolFormer
  Pyramid Vision Transformer (PVT)
  RegNet
  ResNet
  SegFormer
  SwiftFormer
  Swin Transformer
  Swin Transformer V2
  Swin2SR
  Table Transformer
  TimeSformer
  UperNet
  VAN
  VideoMAE
  Vision Transformer (ViT)
  ViT Hybrid
  ViTDet
  ViTMAE
  ViTMatte
  ViTMSN
  ViViT
  YOLOS
  🌍AUDIO MODELS
  Audio Spectrogram Transformer
  Bark
  CLAP
  EnCodec
  Hubert
  MCTCT
  MMS
  MusicGen
  Pop2Piano
  SEW
  SEW-D
  Speech2Text
  Speech2Text2
  SpeechT5
  UniSpeech
  UniSpeech-SAT
  VITS
  Wav2Vec2
  Wav2Vec2-Conformer
  Wav2Vec2Phoneme
  WavLM
  Whisper
  XLS-R
  XLSR-Wav2Vec2
  🌍MULTIMODAL MODELS
  ALIGN
  AltCLIP
  BLIP
  BLIP-2
  BridgeTower
  BROS
  Chinese-CLIP
  CLIP
  CLIPSeg
  Data2Vec
  DePlot
  Donut
  FLAVA
  GIT
  GroupViT
  IDEFICS
  InstructBLIP
  LayoutLM
  LayoutLMV2
  LayoutLMV3
  LayoutXLM
  LiLT
  LXMERT
  MatCha
  MGP-STR
  Nougat
  OneFormer
  OWL-ViT
  Perceiver
  Pix2Struct
  Segment Anything
  Speech Encoder Decoder Models
  TAPAS
  TrOCR
  TVLT
  ViLT
  Vision Encoder Decoder Models
  Vision Text Dual Encoder
  VisualBERT
  X-CLIP
  🌍REINFORCEMENT LEARNING MODELS
  Decision Transformer
  Trajectory Transformer
  🌍TIME SERIES MODELS
  Autoformer
  Informer
  Time Series Transformer
  🌍GRAPH MODELS
  Graphormer
🌍INTERNAL HELPERS

Powered by GitBook

On this page

Multimodal

The following auto classes are available for the following multimodal tasks.

PreviousAutoModelForTextToWaveform NextAutoModelForTableQuestionAnswering

Last updated 1 year ago