> For the complete documentation index, see [llms.txt](https://boinc-ai.gitbook.io/transformers/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://boinc-ai.gitbook.io/transformers/api/main-classes/auto-classes/generic-model-classes/automodel.md).

# AutoModel

#### AutoModel

#### class transformers.AutoModel

[\<source>](https://github.com/huggingface/transformers/blob/v4.34.1/src/transformers/models/auto/modeling_auto.py#L1224)

( \*args\*\*kwargs )

This is a generic model class that will be instantiated as one of the base model classes of the library when created with the [from\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/auto#transformers.FlaxAutoModelForVision2Seq.from_pretrained) class method or the [from\_config()](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/auto#transformers.FlaxAutoModelForVision2Seq.from_config) class method.

This class cannot be instantiated directly using `__init__()` (throws an error).

**from\_config**

[\<source>](https://github.com/huggingface/transformers/blob/v4.34.1/src/transformers/models/auto/auto_factory.py#L417)

( \*\*kwargs )

Parameters

* **config** ([PretrainedConfig](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/configuration#transformers.PretrainedConfig)) — The model class to instantiate is selected based on the configuration class:
  * [ASTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/audio-spectrogram-transformer#transformers.ASTConfig) configuration class: [ASTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/audio-spectrogram-transformer#transformers.ASTModel) (Audio Spectrogram Transformer model)
  * [AlbertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/albert#transformers.AlbertConfig) configuration class: [AlbertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/albert#transformers.AlbertModel) (ALBERT model)
  * [AlignConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/align#transformers.AlignConfig) configuration class: [AlignModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/align#transformers.AlignModel) (ALIGN model)
  * [AltCLIPConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/altclip#transformers.AltCLIPConfig) configuration class: [AltCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/altclip#transformers.AltCLIPModel) (AltCLIP model)
  * [AutoformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/autoformer#transformers.AutoformerConfig) configuration class: [AutoformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/autoformer#transformers.AutoformerModel) (Autoformer model)
  * [BarkConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bark#transformers.BarkConfig) configuration class: [BarkModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bark#transformers.BarkModel) (Bark model)
  * [BartConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bart#transformers.BartConfig) configuration class: [BartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bart#transformers.BartModel) (BART model)
  * [BeitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/beit#transformers.BeitConfig) configuration class: [BeitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/beit#transformers.BeitModel) (BEiT model)
  * [BertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert#transformers.BertConfig) configuration class: [BertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert#transformers.BertModel) (BERT model)
  * [BertGenerationConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert-generation#transformers.BertGenerationConfig) configuration class: [BertGenerationEncoder](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert-generation#transformers.BertGenerationEncoder) (Bert Generation model)
  * [BigBirdConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/big_bird#transformers.BigBirdConfig) configuration class: [BigBirdModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/big_bird#transformers.BigBirdModel) (BigBird model)
  * [BigBirdPegasusConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bigbird_pegasus#transformers.BigBirdPegasusConfig) configuration class: [BigBirdPegasusModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bigbird_pegasus#transformers.BigBirdPegasusModel) (BigBird-Pegasus model)
  * [BioGptConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/biogpt#transformers.BioGptConfig) configuration class: [BioGptModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/biogpt#transformers.BioGptModel) (BioGpt model)
  * [BitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bit#transformers.BitConfig) configuration class: [BitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bit#transformers.BitModel) (BiT model)
  * [BlenderbotConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot#transformers.BlenderbotConfig) configuration class: [BlenderbotModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot#transformers.BlenderbotModel) (Blenderbot model)
  * [BlenderbotSmallConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot-small#transformers.BlenderbotSmallConfig) configuration class: [BlenderbotSmallModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot-small#transformers.BlenderbotSmallModel) (BlenderbotSmall model)
  * [Blip2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip-2#transformers.Blip2Config) configuration class: [Blip2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip-2#transformers.Blip2Model) (BLIP-2 model)
  * [BlipConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip#transformers.BlipConfig) configuration class: [BlipModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip#transformers.BlipModel) (BLIP model)
  * [BloomConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bloom#transformers.BloomConfig) configuration class: [BloomModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bloom#transformers.BloomModel) (BLOOM model)
  * [BridgeTowerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bridgetower#transformers.BridgeTowerConfig) configuration class: [BridgeTowerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bridgetower#transformers.BridgeTowerModel) (BridgeTower model)
  * [BrosConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bros#transformers.BrosConfig) configuration class: [BrosModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bros#transformers.BrosModel) (BROS model)
  * [CLIPConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clip#transformers.CLIPConfig) configuration class: [CLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clip#transformers.CLIPModel) (CLIP model)
  * [CLIPSegConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clipseg#transformers.CLIPSegConfig) configuration class: [CLIPSegModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clipseg#transformers.CLIPSegModel) (CLIPSeg model)
  * [CTRLConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ctrl#transformers.CTRLConfig) configuration class: [CTRLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ctrl#transformers.CTRLModel) (CTRL model)
  * [CamembertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/camembert#transformers.CamembertConfig) configuration class: [CamembertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/camembert#transformers.CamembertModel) (CamemBERT model)
  * [CanineConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/canine#transformers.CanineConfig) configuration class: [CanineModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/canine#transformers.CanineModel) (CANINE model)
  * [ChineseCLIPConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/chinese_clip#transformers.ChineseCLIPConfig) configuration class: [ChineseCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/chinese_clip#transformers.ChineseCLIPModel) (Chinese-CLIP model)
  * [ClapConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clap#transformers.ClapConfig) configuration class: [ClapModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clap#transformers.ClapModel) (CLAP model)
  * [CodeGenConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/codegen#transformers.CodeGenConfig) configuration class: [CodeGenModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/codegen#transformers.CodeGenModel) (CodeGen model)
  * [ConditionalDetrConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/conditional_detr#transformers.ConditionalDetrConfig) configuration class: [ConditionalDetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/conditional_detr#transformers.ConditionalDetrModel) (Conditional DETR model)
  * [ConvBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convbert#transformers.ConvBertConfig) configuration class: [ConvBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convbert#transformers.ConvBertModel) (ConvBERT model)
  * [ConvNextConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnext#transformers.ConvNextConfig) configuration class: [ConvNextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnext#transformers.ConvNextModel) (ConvNeXT model)
  * [ConvNextV2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnextv2#transformers.ConvNextV2Config) configuration class: [ConvNextV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnextv2#transformers.ConvNextV2Model) (ConvNeXTV2 model)
  * [CpmAntConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cpmant#transformers.CpmAntConfig) configuration class: [CpmAntModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cpmant#transformers.CpmAntModel) (CPM-Ant model)
  * [CvtConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cvt#transformers.CvtConfig) configuration class: [CvtModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cvt#transformers.CvtModel) (CvT model)
  * [DPRConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpr#transformers.DPRConfig) configuration class: [DPRQuestionEncoder](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpr#transformers.DPRQuestionEncoder) (DPR model)
  * [DPTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpt#transformers.DPTConfig) configuration class: [DPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpt#transformers.DPTModel) (DPT model)
  * [Data2VecAudioConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecAudioConfig) configuration class: [Data2VecAudioModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecAudioModel) (Data2VecAudio model)
  * [Data2VecTextConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecTextConfig) configuration class: [Data2VecTextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecTextModel) (Data2VecText model)
  * [Data2VecVisionConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecVisionConfig) configuration class: [Data2VecVisionModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecVisionModel) (Data2VecVision model)
  * [DebertaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta#transformers.DebertaConfig) configuration class: [DebertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta#transformers.DebertaModel) (DeBERTa model)
  * [DebertaV2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta-v2#transformers.DebertaV2Config) configuration class: [DebertaV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta-v2#transformers.DebertaV2Model) (DeBERTa-v2 model)
  * [DecisionTransformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/decision_transformer#transformers.DecisionTransformerConfig) configuration class: [DecisionTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/decision_transformer#transformers.DecisionTransformerModel) (Decision Transformer model)
  * [DeformableDetrConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deformable_detr#transformers.DeformableDetrConfig) configuration class: [DeformableDetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deformable_detr#transformers.DeformableDetrModel) (Deformable DETR model)
  * [DeiTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deit#transformers.DeiTConfig) configuration class: [DeiTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deit#transformers.DeiTModel) (DeiT model)
  * [DetaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deta#transformers.DetaConfig) configuration class: [DetaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deta#transformers.DetaModel) (DETA model)
  * [DetrConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/detr#transformers.DetrConfig) configuration class: [DetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/detr#transformers.DetrModel) (DETR model)
  * [DinatConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinat#transformers.DinatConfig) configuration class: [DinatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinat#transformers.DinatModel) (DiNAT model)
  * [Dinov2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinov2#transformers.Dinov2Config) configuration class: [Dinov2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinov2#transformers.Dinov2Model) (DINOv2 model)
  * [DistilBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/distilbert#transformers.DistilBertConfig) configuration class: [DistilBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/distilbert#transformers.DistilBertModel) (DistilBERT model)
  * [DonutSwinConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/donut#transformers.DonutSwinConfig) configuration class: [DonutSwinModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/donut#transformers.DonutSwinModel) (DonutSwin model)
  * [EfficientFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientformer#transformers.EfficientFormerConfig) configuration class: [EfficientFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientformer#transformers.EfficientFormerModel) (EfficientFormer model)
  * [EfficientNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientnet#transformers.EfficientNetConfig) configuration class: [EfficientNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientnet#transformers.EfficientNetModel) (EfficientNet model)
  * [ElectraConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/electra#transformers.ElectraConfig) configuration class: [ElectraModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/electra#transformers.ElectraModel) (ELECTRA model)
  * [EncodecConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/encodec#transformers.EncodecConfig) configuration class: [EncodecModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/encodec#transformers.EncodecModel) (EnCodec model)
  * [ErnieConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie#transformers.ErnieConfig) configuration class: [ErnieModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie#transformers.ErnieModel) (ERNIE model)
  * [ErnieMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie_m#transformers.ErnieMConfig) configuration class: [ErnieMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie_m#transformers.ErnieMModel) (ErnieM model)
  * [EsmConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/esm#transformers.EsmConfig) configuration class: [EsmModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/esm#transformers.EsmModel) (ESM model)
  * [FNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fnet#transformers.FNetConfig) configuration class: [FNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fnet#transformers.FNetModel) (FNet model)
  * [FSMTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fsmt#transformers.FSMTConfig) configuration class: [FSMTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fsmt#transformers.FSMTModel) (FairSeq Machine-Translation model)
  * [FalconConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/falcon#transformers.FalconConfig) configuration class: [FalconModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/falcon#transformers.FalconModel) (Falcon model)
  * [FlaubertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flaubert#transformers.FlaubertConfig) configuration class: [FlaubertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flaubert#transformers.FlaubertModel) (FlauBERT model)
  * [FlavaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flava#transformers.FlavaConfig) configuration class: [FlavaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flava#transformers.FlavaModel) (FLAVA model)
  * [FocalNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/focalnet#transformers.FocalNetConfig) configuration class: [FocalNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/focalnet#transformers.FocalNetModel) (FocalNet model)
  * [FunnelConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelConfig) configuration class: [FunnelModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelModel) or [FunnelBaseModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelBaseModel) (Funnel Transformer model)
  * [GLPNConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/glpn#transformers.GLPNConfig) configuration class: [GLPNModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/glpn#transformers.GLPNModel) (GLPN model)
  * [GPT2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt2#transformers.GPT2Config) configuration class: [GPT2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt2#transformers.GPT2Model) (OpenAI GPT-2 model)
  * [GPTBigCodeConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_bigcode#transformers.GPTBigCodeConfig) configuration class: [GPTBigCodeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_bigcode#transformers.GPTBigCodeModel) (GPTBigCode model)
  * [GPTJConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptj#transformers.GPTJConfig) configuration class: [GPTJModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptj#transformers.GPTJModel) (GPT-J model)
  * [GPTNeoConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neo#transformers.GPTNeoConfig) configuration class: [GPTNeoModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neo#transformers.GPTNeoModel) (GPT Neo model)
  * [GPTNeoXConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox#transformers.GPTNeoXConfig) configuration class: [GPTNeoXModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox#transformers.GPTNeoXModel) (GPT NeoX model)
  * [GPTNeoXJapaneseConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox_japanese#transformers.GPTNeoXJapaneseConfig) configuration class: [GPTNeoXJapaneseModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox_japanese#transformers.GPTNeoXJapaneseModel) (GPT NeoX Japanese model)
  * [GPTSanJapaneseConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptsan-japanese#transformers.GPTSanJapaneseConfig) configuration class: [GPTSanJapaneseForConditionalGeneration](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptsan-japanese#transformers.GPTSanJapaneseForConditionalGeneration) (GPTSAN-japanese model)
  * [GitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/git#transformers.GitConfig) configuration class: [GitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/git#transformers.GitModel) (GIT model)
  * [GraphormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/graphormer#transformers.GraphormerConfig) configuration class: [GraphormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/graphormer#transformers.GraphormerModel) (Graphormer model)
  * [GroupViTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/groupvit#transformers.GroupViTConfig) configuration class: [GroupViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/groupvit#transformers.GroupViTModel) (GroupViT model)
  * [HubertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/hubert#transformers.HubertConfig) configuration class: [HubertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/hubert#transformers.HubertModel) (Hubert model)
  * [IBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ibert#transformers.IBertConfig) configuration class: [IBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ibert#transformers.IBertModel) (I-BERT model)
  * [IdeficsConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/idefics#transformers.IdeficsConfig) configuration class: [IdeficsModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/idefics#transformers.IdeficsModel) (IDEFICS model)
  * [ImageGPTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/imagegpt#transformers.ImageGPTConfig) configuration class: [ImageGPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/imagegpt#transformers.ImageGPTModel) (ImageGPT model)
  * [InformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/informer#transformers.InformerConfig) configuration class: [InformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/informer#transformers.InformerModel) (Informer model)
  * [JukeboxConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/jukebox#transformers.JukeboxConfig) configuration class: [JukeboxModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/jukebox#transformers.JukeboxModel) (Jukebox model)
  * [LEDConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/led#transformers.LEDConfig) configuration class: [LEDModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/led#transformers.LEDModel) (LED model)
  * [LayoutLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlm#transformers.LayoutLMConfig) configuration class: [LayoutLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlm#transformers.LayoutLMModel) (LayoutLM model)
  * [LayoutLMv2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv2#transformers.LayoutLMv2Config) configuration class: [LayoutLMv2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv2#transformers.LayoutLMv2Model) (LayoutLMv2 model)
  * [LayoutLMv3Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv3#transformers.LayoutLMv3Config) configuration class: [LayoutLMv3Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv3#transformers.LayoutLMv3Model) (LayoutLMv3 model)
  * [LevitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/levit#transformers.LevitConfig) configuration class: [LevitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/levit#transformers.LevitModel) (LeViT model)
  * [LiltConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lilt#transformers.LiltConfig) configuration class: [LiltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lilt#transformers.LiltModel) (LiLT model)
  * [LlamaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/llama2#transformers.LlamaConfig) configuration class: [LlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/llama2#transformers.LlamaModel) (LLaMA model)
  * [LongT5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longt5#transformers.LongT5Config) configuration class: [LongT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longt5#transformers.LongT5Model) (LongT5 model)
  * [LongformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longformer#transformers.LongformerConfig) configuration class: [LongformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longformer#transformers.LongformerModel) (Longformer model)
  * [LukeConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/luke#transformers.LukeConfig) configuration class: [LukeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/luke#transformers.LukeModel) (LUKE model)
  * [LxmertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lxmert#transformers.LxmertConfig) configuration class: [LxmertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lxmert#transformers.LxmertModel) (LXMERT model)
  * [M2M100Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/m2m_100#transformers.M2M100Config) configuration class: [M2M100Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/m2m_100#transformers.M2M100Model) (M2M100 model)
  * [MBartConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mbart#transformers.MBartConfig) configuration class: [MBartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mbart#transformers.MBartModel) (mBART model)
  * [MCTCTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mctct#transformers.MCTCTConfig) configuration class: [MCTCTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mctct#transformers.MCTCTModel) (M-CTC-T model)
  * [MPNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpnet#transformers.MPNetConfig) configuration class: [MPNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpnet#transformers.MPNetModel) (MPNet model)
  * [MT5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mt5#transformers.MT5Config) configuration class: [MT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mt5#transformers.MT5Model) (MT5 model)
  * [MarianConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/marian#transformers.MarianConfig) configuration class: [MarianModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/marian#transformers.MarianModel) (Marian model)
  * [MarkupLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/markuplm#transformers.MarkupLMConfig) configuration class: [MarkupLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/markuplm#transformers.MarkupLMModel) (MarkupLM model)
  * [Mask2FormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mask2former#transformers.Mask2FormerConfig) configuration class: [Mask2FormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mask2former#transformers.Mask2FormerModel) (Mask2Former model)
  * [MaskFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/maskformer#transformers.MaskFormerConfig) configuration class: [MaskFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/maskformer#transformers.MaskFormerModel) (MaskFormer model)
  * `MaskFormerSwinConfig` configuration class: `MaskFormerSwinModel` (MaskFormerSwin model)
  * [MegaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mega#transformers.MegaConfig) configuration class: [MegaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mega#transformers.MegaModel) (MEGA model)
  * [MegatronBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/megatron-bert#transformers.MegatronBertConfig) configuration class: [MegatronBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/megatron-bert#transformers.MegatronBertModel) (Megatron-BERT model)
  * [MgpstrConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mgp-str#transformers.MgpstrConfig) configuration class: [MgpstrForSceneTextRecognition](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mgp-str#transformers.MgpstrForSceneTextRecognition) (MGP-STR model)
  * [MistralConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mistral#transformers.MistralConfig) configuration class: [MistralModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mistral#transformers.MistralModel) (Mistral model)
  * [MobileBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilebert#transformers.MobileBertConfig) configuration class: [MobileBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilebert#transformers.MobileBertModel) (MobileBERT model)
  * [MobileNetV1Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v1#transformers.MobileNetV1Config) configuration class: [MobileNetV1Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v1#transformers.MobileNetV1Model) (MobileNetV1 model)
  * [MobileNetV2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v2#transformers.MobileNetV2Config) configuration class: [MobileNetV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v2#transformers.MobileNetV2Model) (MobileNetV2 model)
  * [MobileViTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevit#transformers.MobileViTConfig) configuration class: [MobileViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevit#transformers.MobileViTModel) (MobileViT model)
  * [MobileViTV2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevitv2#transformers.MobileViTV2Config) configuration class: [MobileViTV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevitv2#transformers.MobileViTV2Model) (MobileViTV2 model)
  * [MptConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpt#transformers.MptConfig) configuration class: [MptModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpt#transformers.MptModel) (MPT model)
  * [MraConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mra#transformers.MraConfig) configuration class: [MraModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mra#transformers.MraModel) (MRA model)
  * [MvpConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mvp#transformers.MvpConfig) configuration class: [MvpModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mvp#transformers.MvpModel) (MVP model)
  * [NatConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nat#transformers.NatConfig) configuration class: [NatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nat#transformers.NatModel) (NAT model)
  * [NezhaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nezha#transformers.NezhaConfig) configuration class: [NezhaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nezha#transformers.NezhaModel) (Nezha model)
  * [NllbMoeConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nllb-moe#transformers.NllbMoeConfig) configuration class: [NllbMoeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nllb-moe#transformers.NllbMoeModel) (NLLB-MOE model)
  * [NystromformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nystromformer#transformers.NystromformerConfig) configuration class: [NystromformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nystromformer#transformers.NystromformerModel) (Nyströmformer model)
  * [OPTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/opt#transformers.OPTConfig) configuration class: [OPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/opt#transformers.OPTModel) (OPT model)
  * [OneFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/oneformer#transformers.OneFormerConfig) configuration class: [OneFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/oneformer#transformers.OneFormerModel) (OneFormer model)
  * [OpenAIGPTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/openai-gpt#transformers.OpenAIGPTConfig) configuration class: [OpenAIGPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/openai-gpt#transformers.OpenAIGPTModel) (OpenAI GPT model)
  * [OpenLlamaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/open-llama#transformers.OpenLlamaConfig) configuration class: [OpenLlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/open-llama#transformers.OpenLlamaModel) (OpenLlama model)
  * [OwlViTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/owlvit#transformers.OwlViTConfig) configuration class: [OwlViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/owlvit#transformers.OwlViTModel) (OWL-ViT model)
  * [PLBartConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/plbart#transformers.PLBartConfig) configuration class: [PLBartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/plbart#transformers.PLBartModel) (PLBart model)
  * [PegasusConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus#transformers.PegasusConfig) configuration class: [PegasusModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus#transformers.PegasusModel) (Pegasus model)
  * [PegasusXConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus_x#transformers.PegasusXConfig) configuration class: [PegasusXModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus_x#transformers.PegasusXModel) (PEGASUS-X model)
  * [PerceiverConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/perceiver#transformers.PerceiverConfig) configuration class: [PerceiverModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/perceiver#transformers.PerceiverModel) (Perceiver model)
  * [PersimmonConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/persimmon#transformers.PersimmonConfig) configuration class: [PersimmonModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/persimmon#transformers.PersimmonModel) (Persimmon model)
  * [PoolFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/poolformer#transformers.PoolFormerConfig) configuration class: [PoolFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/poolformer#transformers.PoolFormerModel) (PoolFormer model)
  * [ProphetNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/prophetnet#transformers.ProphetNetConfig) configuration class: [ProphetNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/prophetnet#transformers.ProphetNetModel) (ProphetNet model)
  * [PvtConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pvt#transformers.PvtConfig) configuration class: [PvtModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pvt#transformers.PvtModel) (PVT model)
  * [QDQBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/qdqbert#transformers.QDQBertConfig) configuration class: [QDQBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/qdqbert#transformers.QDQBertModel) (QDQBert model)
  * [ReformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/reformer#transformers.ReformerConfig) configuration class: [ReformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/reformer#transformers.ReformerModel) (Reformer model)
  * [RegNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/regnet#transformers.RegNetConfig) configuration class: [RegNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/regnet#transformers.RegNetModel) (RegNet model)
  * [RemBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rembert#transformers.RemBertConfig) configuration class: [RemBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rembert#transformers.RemBertModel) (RemBERT model)
  * [ResNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/resnet#transformers.ResNetConfig) configuration class: [ResNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/resnet#transformers.ResNetModel) (ResNet model)
  * [RetriBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/retribert#transformers.RetriBertConfig) configuration class: [RetriBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/retribert#transformers.RetriBertModel) (RetriBERT model)
  * [RoCBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roc_bert#transformers.RoCBertConfig) configuration class: [RoCBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roc_bert#transformers.RoCBertModel) (RoCBert model)
  * [RoFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roformer#transformers.RoFormerConfig) configuration class: [RoFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roformer#transformers.RoFormerModel) (RoFormer model)
  * [RobertaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta#transformers.RobertaConfig) configuration class: [RobertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta#transformers.RobertaModel) (RoBERTa model)
  * [RobertaPreLayerNormConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta-prelayernorm#transformers.RobertaPreLayerNormConfig) configuration class: [RobertaPreLayerNormModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta-prelayernorm#transformers.RobertaPreLayerNormModel) (RoBERTa-PreLayerNorm model)
  * [RwkvConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rwkv#transformers.RwkvConfig) configuration class: [RwkvModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rwkv#transformers.RwkvModel) (RWKV model)
  * [SEWConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew#transformers.SEWConfig) configuration class: [SEWModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew#transformers.SEWModel) (SEW model)
  * [SEWDConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew-d#transformers.SEWDConfig) configuration class: [SEWDModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew-d#transformers.SEWDModel) (SEW-D model)
  * [SamConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sam#transformers.SamConfig) configuration class: [SamModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sam#transformers.SamModel) (SAM model)
  * [SegformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/segformer#transformers.SegformerConfig) configuration class: [SegformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/segformer#transformers.SegformerModel) (SegFormer model)
  * [Speech2TextConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speech_to_text#transformers.Speech2TextConfig) configuration class: [Speech2TextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speech_to_text#transformers.Speech2TextModel) (Speech2Text model)
  * [SpeechT5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speecht5#transformers.SpeechT5Config) configuration class: [SpeechT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speecht5#transformers.SpeechT5Model) (SpeechT5 model)
  * [SplinterConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/splinter#transformers.SplinterConfig) configuration class: [SplinterModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/splinter#transformers.SplinterModel) (Splinter model)
  * [SqueezeBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/squeezebert#transformers.SqueezeBertConfig) configuration class: [SqueezeBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/squeezebert#transformers.SqueezeBertModel) (SqueezeBERT model)
  * [SwiftFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swiftformer#transformers.SwiftFormerConfig) configuration class: [SwiftFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swiftformer#transformers.SwiftFormerModel) (SwiftFormer model)
  * [Swin2SRConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin2sr#transformers.Swin2SRConfig) configuration class: [Swin2SRModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin2sr#transformers.Swin2SRModel) (Swin2SR model)
  * [SwinConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin#transformers.SwinConfig) configuration class: [SwinModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin#transformers.SwinModel) (Swin Transformer model)
  * [Swinv2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swinv2#transformers.Swinv2Config) configuration class: [Swinv2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swinv2#transformers.Swinv2Model) (Swin Transformer V2 model)
  * [SwitchTransformersConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/switch_transformers#transformers.SwitchTransformersConfig) configuration class: [SwitchTransformersModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/switch_transformers#transformers.SwitchTransformersModel) (SwitchTransformers model)
  * [T5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/t5#transformers.T5Config) configuration class: [T5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/t5#transformers.T5Model) (T5 model)
  * [TableTransformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/table-transformer#transformers.TableTransformerConfig) configuration class: [TableTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/table-transformer#transformers.TableTransformerModel) (Table Transformer model)
  * [TapasConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tapas#transformers.TapasConfig) configuration class: [TapasModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tapas#transformers.TapasModel) (TAPAS model)
  * [TimeSeriesTransformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/time_series_transformer#transformers.TimeSeriesTransformerConfig) configuration class: [TimeSeriesTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/time_series_transformer#transformers.TimeSeriesTransformerModel) (Time Series Transformer model)
  * [TimesformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/timesformer#transformers.TimesformerConfig) configuration class: [TimesformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/timesformer#transformers.TimesformerModel) (TimeSformer model)
  * `TimmBackboneConfig` configuration class: `TimmBackbone` (TimmBackbone model)
  * [TrajectoryTransformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/trajectory_transformer#transformers.TrajectoryTransformerConfig) configuration class: [TrajectoryTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/trajectory_transformer#transformers.TrajectoryTransformerModel) (Trajectory Transformer model)
  * [TransfoXLConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/transfo-xl#transformers.TransfoXLConfig) configuration class: [TransfoXLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/transfo-xl#transformers.TransfoXLModel) (Transformer-XL model)
  * [TvltConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tvlt#transformers.TvltConfig) configuration class: [TvltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tvlt#transformers.TvltModel) (TVLT model)
  * [UMT5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/umt5#transformers.UMT5Config) configuration class: [UMT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/umt5#transformers.UMT5Model) (UMT5 model)
  * [UniSpeechConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech#transformers.UniSpeechConfig) configuration class: [UniSpeechModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech#transformers.UniSpeechModel) (UniSpeech model)
  * [UniSpeechSatConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech-sat#transformers.UniSpeechSatConfig) configuration class: [UniSpeechSatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech-sat#transformers.UniSpeechSatModel) (UniSpeechSat model)
  * [VanConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/van#transformers.VanConfig) configuration class: [VanModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/van#transformers.VanModel) (VAN model)
  * [ViTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit#transformers.ViTConfig) configuration class: [ViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit#transformers.ViTModel) (ViT model)
  * [ViTHybridConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_hybrid#transformers.ViTHybridConfig) configuration class: [ViTHybridModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_hybrid#transformers.ViTHybridModel) (ViT Hybrid model)
  * [ViTMAEConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_mae#transformers.ViTMAEConfig) configuration class: [ViTMAEModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_mae#transformers.ViTMAEModel) (ViTMAE model)
  * [ViTMSNConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_msn#transformers.ViTMSNConfig) configuration class: [ViTMSNModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_msn#transformers.ViTMSNModel) (ViTMSN model)
  * [VideoMAEConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/videomae#transformers.VideoMAEConfig) configuration class: [VideoMAEModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/videomae#transformers.VideoMAEModel) (VideoMAE model)
  * [ViltConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vilt#transformers.ViltConfig) configuration class: [ViltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vilt#transformers.ViltModel) (ViLT model)
  * [VisionTextDualEncoderConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vision-text-dual-encoder#transformers.VisionTextDualEncoderConfig) configuration class: [VisionTextDualEncoderModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vision-text-dual-encoder#transformers.VisionTextDualEncoderModel) (VisionTextDualEncoder model)
  * [VisualBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/visual_bert#transformers.VisualBertConfig) configuration class: [VisualBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/visual_bert#transformers.VisualBertModel) (VisualBERT model)
  * [VitDetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vitdet#transformers.VitDetConfig) configuration class: [VitDetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vitdet#transformers.VitDetModel) (VitDet model)
  * [VitsConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vits#transformers.VitsConfig) configuration class: [VitsModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vits#transformers.VitsModel) (VITS model)
  * [VivitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vivit#transformers.VivitConfig) configuration class: [VivitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vivit#transformers.VivitModel) (ViViT model)
  * [Wav2Vec2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2#transformers.Wav2Vec2Config) configuration class: [Wav2Vec2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2#transformers.Wav2Vec2Model) (Wav2Vec2 model)
  * [Wav2Vec2ConformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2-conformer#transformers.Wav2Vec2ConformerConfig) configuration class: [Wav2Vec2ConformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2-conformer#transformers.Wav2Vec2ConformerModel) (Wav2Vec2-Conformer model)
  * [WavLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wavlm#transformers.WavLMConfig) configuration class: [WavLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wavlm#transformers.WavLMModel) (WavLM model)
  * [WhisperConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/whisper#transformers.WhisperConfig) configuration class: [WhisperModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/whisper#transformers.WhisperModel) (Whisper model)
  * [XCLIPConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xclip#transformers.XCLIPConfig) configuration class: [XCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xclip#transformers.XCLIPModel) (X-CLIP model)
  * [XGLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xglm#transformers.XGLMConfig) configuration class: [XGLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xglm#transformers.XGLMModel) (XGLM model)
  * [XLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm#transformers.XLMConfig) configuration class: [XLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm#transformers.XLMModel) (XLM model)
  * [XLMProphetNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-prophetnet#transformers.XLMProphetNetConfig) configuration class: [XLMProphetNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-prophetnet#transformers.XLMProphetNetModel) (XLM-ProphetNet model)
  * [XLMRobertaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta#transformers.XLMRobertaConfig) configuration class: [XLMRobertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta#transformers.XLMRobertaModel) (XLM-RoBERTa model)
  * [XLMRobertaXLConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta-xl#transformers.XLMRobertaXLConfig) configuration class: [XLMRobertaXLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta-xl#transformers.XLMRobertaXLModel) (XLM-RoBERTa-XL model)
  * [XLNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlnet#transformers.XLNetConfig) configuration class: [XLNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlnet#transformers.XLNetModel) (XLNet model)
  * [XmodConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xmod#transformers.XmodConfig) configuration class: [XmodModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xmod#transformers.XmodModel) (X-MOD model)
  * [YolosConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yolos#transformers.YolosConfig) configuration class: [YolosModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yolos#transformers.YolosModel) (YOLOS model)
  * [YosoConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yoso#transformers.YosoConfig) configuration class: [YosoModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yoso#transformers.YosoModel) (YOSO model)

Instantiates one of the base model classes of the library from a configuration.

Note: Loading a model from its configuration file does **not** load the model weights. It only affects the model’s configuration. Use [from\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/auto#transformers.FlaxAutoModelForVision2Seq.from_pretrained) to load the model weights.

Examples:

Copied

```
>>> from transformers import AutoConfig, AutoModel

>>> # Download configuration from huggingface.co and cache.
>>> config = AutoConfig.from_pretrained("bert-base-cased")
>>> model = AutoModel.from_config(config)
```

**from\_pretrained**

[\<source>](https://github.com/huggingface/transformers/blob/v4.34.1/src/transformers/models/auto/auto_factory.py#L448)

( \*model\_args\*\*kwargs )

Parameters

* **pretrained\_model\_name\_or\_path** (`str` or `os.PathLike`) — Can be either:
  * A string, the *model id* of a pretrained model hosted inside a model repo on huggingface.co. Valid model ids can be located at the root-level, like `bert-base-uncased`, or namespaced under a user or organization name, like `dbmdz/bert-base-german-cased`.
  * A path to a *directory* containing model weights saved using [save\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/model#transformers.PreTrainedModel.save_pretrained), e.g., `./my_model_directory/`.
  * A path or url to a *tensorflow index checkpoint file* (e.g, `./tf_model/model.ckpt.index`). In this case, `from_tf` should be set to `True` and a configuration object should be provided as `config` argument. This loading path is slower than converting the TensorFlow checkpoint in a PyTorch model using the provided conversion scripts and loading the PyTorch model afterwards.
* **model\_args** (additional positional arguments, *optional*) — Will be passed along to the underlying model `__init__()` method.
* **config** ([PretrainedConfig](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/configuration#transformers.PretrainedConfig), *optional*) — Configuration for the model to use instead of an automatically loaded configuration. Configuration can be automatically loaded when:
  * The model is a model provided by the library (loaded with the *model id* string of a pretrained model).
  * The model was saved using [save\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/model#transformers.PreTrainedModel.save_pretrained) and is reloaded by supplying the save directory.
  * The model is loaded by supplying a local directory as `pretrained_model_name_or_path` and a configuration JSON file named *config.json* is found in the directory.
* **state\_dict** (*Dict\[str, torch.Tensor]*, *optional*) — A state dictionary to use instead of a state dictionary loaded from saved weights file.

  This option can be used if you want to create a model from a pretrained configuration but load your own weights. In this case though, you should check if using [save\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/model#transformers.PreTrainedModel.save_pretrained) and [from\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/model#transformers.PreTrainedModel.from_pretrained) is not a simpler option.
* **cache\_dir** (`str` or `os.PathLike`, *optional*) — Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used.
* **from\_tf** (`bool`, *optional*, defaults to `False`) — Load the model weights from a TensorFlow checkpoint save file (see docstring of `pretrained_model_name_or_path` argument).
* **force\_download** (`bool`, *optional*, defaults to `False`) — Whether or not to force the (re-)download of the model weights and configuration files, overriding the cached versions if they exist.
* **resume\_download** (`bool`, *optional*, defaults to `False`) — Whether or not to delete incompletely received files. Will attempt to resume the download if such a file exists.
* **proxies** (`Dict[str, str]`, *optional*) — A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}`. The proxies are used on each request.
* **output\_loading\_info(`bool`,** *optional*, defaults to `False`) — Whether ot not to also return a dictionary containing missing keys, unexpected keys and error messages.
* **local\_files\_only(`bool`,** *optional*, defaults to `False`) — Whether or not to only look at local files (e.g., not try downloading the model).
* **revision** (`str`, *optional*, defaults to `"main"`) — The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git.
* **trust\_remote\_code** (`bool`, *optional*, defaults to `False`) — Whether or not to allow for custom models defined on the Hub in their own modeling files. This option should only be set to `True` for repositories you trust and in which you have read the code, as it will execute code present on the Hub on your local machine.
* **code\_revision** (`str`, *optional*, defaults to `"main"`) — The specific revision to use for the code on the Hub, if the code leaves in a different repository than the rest of the model. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git.
* **kwargs** (additional keyword arguments, *optional*) — Can be used to update the configuration object (after it being loaded) and initiate the model (e.g., `output_attentions=True`). Behaves differently depending on whether a `config` is provided or automatically loaded:
  * If a configuration is provided with `config`, `**kwargs` will be directly passed to the underlying model’s `__init__` method (we assume all relevant updates to the configuration have already been done)
  * If a configuration is not provided, `kwargs` will be first passed to the configuration class initialization function ([from\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/configuration#transformers.PretrainedConfig.from_pretrained)). Each key of `kwargs` that corresponds to a configuration attribute will be used to override said attribute with the supplied `kwargs` value. Remaining keys that do not correspond to any configuration attribute will be passed to the underlying model’s `__init__` function.

Instantiate one of the base model classes of the library from a pretrained model.

The model class to instantiate is selected based on the `model_type` property of the config object (either passed as an argument or loaded from `pretrained_model_name_or_path` if possible), or when it’s missing, by falling back to using pattern matching on `pretrained_model_name_or_path`:

* **albert** — [AlbertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/albert#transformers.AlbertModel) (ALBERT model)
* **align** — [AlignModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/align#transformers.AlignModel) (ALIGN model)
* **altclip** — [AltCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/altclip#transformers.AltCLIPModel) (AltCLIP model)
* **audio-spectrogram-transformer** — [ASTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/audio-spectrogram-transformer#transformers.ASTModel) (Audio Spectrogram Transformer model)
* **autoformer** — [AutoformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/autoformer#transformers.AutoformerModel) (Autoformer model)
* **bark** — [BarkModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bark#transformers.BarkModel) (Bark model)
* **bart** — [BartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bart#transformers.BartModel) (BART model)
* **beit** — [BeitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/beit#transformers.BeitModel) (BEiT model)
* **bert** — [BertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert#transformers.BertModel) (BERT model)
* **bert-generation** — [BertGenerationEncoder](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert-generation#transformers.BertGenerationEncoder) (Bert Generation model)
* **big\_bird** — [BigBirdModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/big_bird#transformers.BigBirdModel) (BigBird model)
* **bigbird\_pegasus** — [BigBirdPegasusModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bigbird_pegasus#transformers.BigBirdPegasusModel) (BigBird-Pegasus model)
* **biogpt** — [BioGptModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/biogpt#transformers.BioGptModel) (BioGpt model)
* **bit** — [BitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bit#transformers.BitModel) (BiT model)
* **blenderbot** — [BlenderbotModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot#transformers.BlenderbotModel) (Blenderbot model)
* **blenderbot-small** — [BlenderbotSmallModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot-small#transformers.BlenderbotSmallModel) (BlenderbotSmall model)
* **blip** — [BlipModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip#transformers.BlipModel) (BLIP model)
* **blip-2** — [Blip2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip-2#transformers.Blip2Model) (BLIP-2 model)
* **bloom** — [BloomModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bloom#transformers.BloomModel) (BLOOM model)
* **bridgetower** — [BridgeTowerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bridgetower#transformers.BridgeTowerModel) (BridgeTower model)
* **bros** — [BrosModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bros#transformers.BrosModel) (BROS model)
* **camembert** — [CamembertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/camembert#transformers.CamembertModel) (CamemBERT model)
* **canine** — [CanineModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/canine#transformers.CanineModel) (CANINE model)
* **chinese\_clip** — [ChineseCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/chinese_clip#transformers.ChineseCLIPModel) (Chinese-CLIP model)
* **clap** — [ClapModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clap#transformers.ClapModel) (CLAP model)
* **clip** — [CLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clip#transformers.CLIPModel) (CLIP model)
* **clipseg** — [CLIPSegModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clipseg#transformers.CLIPSegModel) (CLIPSeg model)
* **code\_llama** — [LlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/llama2#transformers.LlamaModel) (CodeLlama model)
* **codegen** — [CodeGenModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/codegen#transformers.CodeGenModel) (CodeGen model)
* **conditional\_detr** — [ConditionalDetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/conditional_detr#transformers.ConditionalDetrModel) (Conditional DETR model)
* **convbert** — [ConvBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convbert#transformers.ConvBertModel) (ConvBERT model)
* **convnext** — [ConvNextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnext#transformers.ConvNextModel) (ConvNeXT model)
* **convnextv2** — [ConvNextV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnextv2#transformers.ConvNextV2Model) (ConvNeXTV2 model)
* **cpmant** — [CpmAntModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cpmant#transformers.CpmAntModel) (CPM-Ant model)
* **ctrl** — [CTRLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ctrl#transformers.CTRLModel) (CTRL model)
* **cvt** — [CvtModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cvt#transformers.CvtModel) (CvT model)
* **data2vec-audio** — [Data2VecAudioModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecAudioModel) (Data2VecAudio model)
* **data2vec-text** — [Data2VecTextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecTextModel) (Data2VecText model)
* **data2vec-vision** — [Data2VecVisionModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecVisionModel) (Data2VecVision model)
* **deberta** — [DebertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta#transformers.DebertaModel) (DeBERTa model)
* **deberta-v2** — [DebertaV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta-v2#transformers.DebertaV2Model) (DeBERTa-v2 model)
* **decision\_transformer** — [DecisionTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/decision_transformer#transformers.DecisionTransformerModel) (Decision Transformer model)
* **deformable\_detr** — [DeformableDetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deformable_detr#transformers.DeformableDetrModel) (Deformable DETR model)
* **deit** — [DeiTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deit#transformers.DeiTModel) (DeiT model)
* **deta** — [DetaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deta#transformers.DetaModel) (DETA model)
* **detr** — [DetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/detr#transformers.DetrModel) (DETR model)
* **dinat** — [DinatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinat#transformers.DinatModel) (DiNAT model)
* **dinov2** — [Dinov2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinov2#transformers.Dinov2Model) (DINOv2 model)
* **distilbert** — [DistilBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/distilbert#transformers.DistilBertModel) (DistilBERT model)
* **donut-swin** — [DonutSwinModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/donut#transformers.DonutSwinModel) (DonutSwin model)
* **dpr** — [DPRQuestionEncoder](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpr#transformers.DPRQuestionEncoder) (DPR model)
* **dpt** — [DPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpt#transformers.DPTModel) (DPT model)
* **efficientformer** — [EfficientFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientformer#transformers.EfficientFormerModel) (EfficientFormer model)
* **efficientnet** — [EfficientNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientnet#transformers.EfficientNetModel) (EfficientNet model)
* **electra** — [ElectraModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/electra#transformers.ElectraModel) (ELECTRA model)
* **encodec** — [EncodecModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/encodec#transformers.EncodecModel) (EnCodec model)
* **ernie** — [ErnieModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie#transformers.ErnieModel) (ERNIE model)
* **ernie\_m** — [ErnieMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie_m#transformers.ErnieMModel) (ErnieM model)
* **esm** — [EsmModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/esm#transformers.EsmModel) (ESM model)
* **falcon** — [FalconModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/falcon#transformers.FalconModel) (Falcon model)
* **flaubert** — [FlaubertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flaubert#transformers.FlaubertModel) (FlauBERT model)
* **flava** — [FlavaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flava#transformers.FlavaModel) (FLAVA model)
* **fnet** — [FNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fnet#transformers.FNetModel) (FNet model)
* **focalnet** — [FocalNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/focalnet#transformers.FocalNetModel) (FocalNet model)
* **fsmt** — [FSMTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fsmt#transformers.FSMTModel) (FairSeq Machine-Translation model)
* **funnel** — [FunnelModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelModel) or [FunnelBaseModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelBaseModel) (Funnel Transformer model)
* **git** — [GitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/git#transformers.GitModel) (GIT model)
* **glpn** — [GLPNModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/glpn#transformers.GLPNModel) (GLPN model)
* **gpt-sw3** — [GPT2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt2#transformers.GPT2Model) (GPT-Sw3 model)
* **gpt2** — [GPT2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt2#transformers.GPT2Model) (OpenAI GPT-2 model)
* **gpt\_bigcode** — [GPTBigCodeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_bigcode#transformers.GPTBigCodeModel) (GPTBigCode model)
* **gpt\_neo** — [GPTNeoModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neo#transformers.GPTNeoModel) (GPT Neo model)
* **gpt\_neox** — [GPTNeoXModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox#transformers.GPTNeoXModel) (GPT NeoX model)
* **gpt\_neox\_japanese** — [GPTNeoXJapaneseModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox_japanese#transformers.GPTNeoXJapaneseModel) (GPT NeoX Japanese model)
* **gptj** — [GPTJModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptj#transformers.GPTJModel) (GPT-J model)
* **gptsan-japanese** — [GPTSanJapaneseForConditionalGeneration](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptsan-japanese#transformers.GPTSanJapaneseForConditionalGeneration) (GPTSAN-japanese model)
* **graphormer** — [GraphormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/graphormer#transformers.GraphormerModel) (Graphormer model)
* **groupvit** — [GroupViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/groupvit#transformers.GroupViTModel) (GroupViT model)
* **hubert** — [HubertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/hubert#transformers.HubertModel) (Hubert model)
* **ibert** — [IBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ibert#transformers.IBertModel) (I-BERT model)
* **idefics** — [IdeficsModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/idefics#transformers.IdeficsModel) (IDEFICS model)
* **imagegpt** — [ImageGPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/imagegpt#transformers.ImageGPTModel) (ImageGPT model)
* **informer** — [InformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/informer#transformers.InformerModel) (Informer model)
* **jukebox** — [JukeboxModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/jukebox#transformers.JukeboxModel) (Jukebox model)
* **layoutlm** — [LayoutLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlm#transformers.LayoutLMModel) (LayoutLM model)
* **layoutlmv2** — [LayoutLMv2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv2#transformers.LayoutLMv2Model) (LayoutLMv2 model)
* **layoutlmv3** — [LayoutLMv3Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv3#transformers.LayoutLMv3Model) (LayoutLMv3 model)
* **led** — [LEDModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/led#transformers.LEDModel) (LED model)
* **levit** — [LevitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/levit#transformers.LevitModel) (LeViT model)
* **lilt** — [LiltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lilt#transformers.LiltModel) (LiLT model)
* **llama** — [LlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/llama2#transformers.LlamaModel) (LLaMA model)
* **longformer** — [LongformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longformer#transformers.LongformerModel) (Longformer model)
* **longt5** — [LongT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longt5#transformers.LongT5Model) (LongT5 model)
* **luke** — [LukeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/luke#transformers.LukeModel) (LUKE model)
* **lxmert** — [LxmertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lxmert#transformers.LxmertModel) (LXMERT model)
* **m2m\_100** — [M2M100Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/m2m_100#transformers.M2M100Model) (M2M100 model)
* **marian** — [MarianModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/marian#transformers.MarianModel) (Marian model)
* **markuplm** — [MarkupLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/markuplm#transformers.MarkupLMModel) (MarkupLM model)
* **mask2former** — [Mask2FormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mask2former#transformers.Mask2FormerModel) (Mask2Former model)
* **maskformer** — [MaskFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/maskformer#transformers.MaskFormerModel) (MaskFormer model)
* **maskformer-swin** — `MaskFormerSwinModel` (MaskFormerSwin model)
* **mbart** — [MBartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mbart#transformers.MBartModel) (mBART model)
* **mctct** — [MCTCTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mctct#transformers.MCTCTModel) (M-CTC-T model)
* **mega** — [MegaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mega#transformers.MegaModel) (MEGA model)
* **megatron-bert** — [MegatronBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/megatron-bert#transformers.MegatronBertModel) (Megatron-BERT model)
* **mgp-str** — [MgpstrForSceneTextRecognition](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mgp-str#transformers.MgpstrForSceneTextRecognition) (MGP-STR model)
* **mistral** — [MistralModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mistral#transformers.MistralModel) (Mistral model)
* **mobilebert** — [MobileBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilebert#transformers.MobileBertModel) (MobileBERT model)
* **mobilenet\_v1** — [MobileNetV1Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v1#transformers.MobileNetV1Model) (MobileNetV1 model)
* **mobilenet\_v2** — [MobileNetV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v2#transformers.MobileNetV2Model) (MobileNetV2 model)
* **mobilevit** — [MobileViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevit#transformers.MobileViTModel) (MobileViT model)
* **mobilevitv2** — [MobileViTV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevitv2#transformers.MobileViTV2Model) (MobileViTV2 model)
* **mpnet** — [MPNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpnet#transformers.MPNetModel) (MPNet model)
* **mpt** — [MptModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpt#transformers.MptModel) (MPT model)
* **mra** — [MraModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mra#transformers.MraModel) (MRA model)
* **mt5** — [MT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mt5#transformers.MT5Model) (MT5 model)
* **mvp** — [MvpModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mvp#transformers.MvpModel) (MVP model)
* **nat** — [NatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nat#transformers.NatModel) (NAT model)
* **nezha** — [NezhaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nezha#transformers.NezhaModel) (Nezha model)
* **nllb-moe** — [NllbMoeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nllb-moe#transformers.NllbMoeModel) (NLLB-MOE model)
* **nystromformer** — [NystromformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nystromformer#transformers.NystromformerModel) (Nyströmformer model)
* **oneformer** — [OneFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/oneformer#transformers.OneFormerModel) (OneFormer model)
* **open-llama** — [OpenLlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/open-llama#transformers.OpenLlamaModel) (OpenLlama model)
* **openai-gpt** — [OpenAIGPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/openai-gpt#transformers.OpenAIGPTModel) (OpenAI GPT model)
* **opt** — [OPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/opt#transformers.OPTModel) (OPT model)
* **owlvit** — [OwlViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/owlvit#transformers.OwlViTModel) (OWL-ViT model)
* **pegasus** — [PegasusModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus#transformers.PegasusModel) (Pegasus model)
* **pegasus\_x** — [PegasusXModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus_x#transformers.PegasusXModel) (PEGASUS-X model)
* **perceiver** — [PerceiverModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/perceiver#transformers.PerceiverModel) (Perceiver model)
* **persimmon** — [PersimmonModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/persimmon#transformers.PersimmonModel) (Persimmon model)
* **plbart** — [PLBartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/plbart#transformers.PLBartModel) (PLBart model)
* **poolformer** — [PoolFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/poolformer#transformers.PoolFormerModel) (PoolFormer model)
* **prophetnet** — [ProphetNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/prophetnet#transformers.ProphetNetModel) (ProphetNet model)
* **pvt** — [PvtModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pvt#transformers.PvtModel) (PVT model)
* **qdqbert** — [QDQBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/qdqbert#transformers.QDQBertModel) (QDQBert model)
* **reformer** — [ReformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/reformer#transformers.ReformerModel) (Reformer model)
* **regnet** — [RegNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/regnet#transformers.RegNetModel) (RegNet model)
* **rembert** — [RemBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rembert#transformers.RemBertModel) (RemBERT model)
* **resnet** — [ResNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/resnet#transformers.ResNetModel) (ResNet model)
* **retribert** — [RetriBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/retribert#transformers.RetriBertModel) (RetriBERT model)
* **roberta** — [RobertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta#transformers.RobertaModel) (RoBERTa model)
* **roberta-prelayernorm** — [RobertaPreLayerNormModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta-prelayernorm#transformers.RobertaPreLayerNormModel) (RoBERTa-PreLayerNorm model)
* **roc\_bert** — [RoCBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roc_bert#transformers.RoCBertModel) (RoCBert model)
* **roformer** — [RoFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roformer#transformers.RoFormerModel) (RoFormer model)
* **rwkv** — [RwkvModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rwkv#transformers.RwkvModel) (RWKV model)
* **sam** — [SamModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sam#transformers.SamModel) (SAM model)
* **segformer** — [SegformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/segformer#transformers.SegformerModel) (SegFormer model)
* **sew** — [SEWModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew#transformers.SEWModel) (SEW model)
* **sew-d** — [SEWDModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew-d#transformers.SEWDModel) (SEW-D model)
* **speech\_to\_text** — [Speech2TextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speech_to_text#transformers.Speech2TextModel) (Speech2Text model)
* **speecht5** — [SpeechT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speecht5#transformers.SpeechT5Model) (SpeechT5 model)
* **splinter** — [SplinterModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/splinter#transformers.SplinterModel) (Splinter model)
* **squeezebert** — [SqueezeBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/squeezebert#transformers.SqueezeBertModel) (SqueezeBERT model)
* **swiftformer** — [SwiftFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swiftformer#transformers.SwiftFormerModel) (SwiftFormer model)
* **swin** — [SwinModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin#transformers.SwinModel) (Swin Transformer model)
* **swin2sr** — [Swin2SRModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin2sr#transformers.Swin2SRModel) (Swin2SR model)
* **swinv2** — [Swinv2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swinv2#transformers.Swinv2Model) (Swin Transformer V2 model)
* **switch\_transformers** — [SwitchTransformersModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/switch_transformers#transformers.SwitchTransformersModel) (SwitchTransformers model)
* **t5** — [T5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/t5#transformers.T5Model) (T5 model)
* **table-transformer** — [TableTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/table-transformer#transformers.TableTransformerModel) (Table Transformer model)
* **tapas** — [TapasModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tapas#transformers.TapasModel) (TAPAS model)
* **time\_series\_transformer** — [TimeSeriesTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/time_series_transformer#transformers.TimeSeriesTransformerModel) (Time Series Transformer model)
* **timesformer** — [TimesformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/timesformer#transformers.TimesformerModel) (TimeSformer model)
* **timm\_backbone** — `TimmBackbone` (TimmBackbone model)
* **trajectory\_transformer** — [TrajectoryTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/trajectory_transformer#transformers.TrajectoryTransformerModel) (Trajectory Transformer model)
* **transfo-xl** — [TransfoXLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/transfo-xl#transformers.TransfoXLModel) (Transformer-XL model)
* **tvlt** — [TvltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tvlt#transformers.TvltModel) (TVLT model)
* **umt5** — [UMT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/umt5#transformers.UMT5Model) (UMT5 model)
* **unispeech** — [UniSpeechModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech#transformers.UniSpeechModel) (UniSpeech model)
* **unispeech-sat** — [UniSpeechSatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech-sat#transformers.UniSpeechSatModel) (UniSpeechSat model)
* **van** — [VanModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/van#transformers.VanModel) (VAN model)
* **videomae** — [VideoMAEModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/videomae#transformers.VideoMAEModel) (VideoMAE model)
* **vilt** — [ViltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vilt#transformers.ViltModel) (ViLT model)
* **vision-text-dual-encoder** — [VisionTextDualEncoderModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vision-text-dual-encoder#transformers.VisionTextDualEncoderModel) (VisionTextDualEncoder model)
* **visual\_bert** — [VisualBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/visual_bert#transformers.VisualBertModel) (VisualBERT model)
* **vit** — [ViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit#transformers.ViTModel) (ViT model)
* **vit\_hybrid** — [ViTHybridModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_hybrid#transformers.ViTHybridModel) (ViT Hybrid model)
* **vit\_mae** — [ViTMAEModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_mae#transformers.ViTMAEModel) (ViTMAE model)
* **vit\_msn** — [ViTMSNModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_msn#transformers.ViTMSNModel) (ViTMSN model)
* **vitdet** — [VitDetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vitdet#transformers.VitDetModel) (VitDet model)
* **vits** — [VitsModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vits#transformers.VitsModel) (VITS model)
* **vivit** — [VivitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vivit#transformers.VivitModel) (ViViT model)
* **wav2vec2** — [Wav2Vec2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2#transformers.Wav2Vec2Model) (Wav2Vec2 model)
* **wav2vec2-conformer** — [Wav2Vec2ConformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2-conformer#transformers.Wav2Vec2ConformerModel) (Wav2Vec2-Conformer model)
* **wavlm** — [WavLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wavlm#transformers.WavLMModel) (WavLM model)
* **whisper** — [WhisperModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/whisper#transformers.WhisperModel) (Whisper model)
* **xclip** — [XCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xclip#transformers.XCLIPModel) (X-CLIP model)
* **xglm** — [XGLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xglm#transformers.XGLMModel) (XGLM model)
* **xlm** — [XLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm#transformers.XLMModel) (XLM model)
* **xlm-prophetnet** — [XLMProphetNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-prophetnet#transformers.XLMProphetNetModel) (XLM-ProphetNet model)
* **xlm-roberta** — [XLMRobertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta#transformers.XLMRobertaModel) (XLM-RoBERTa model)
* **xlm-roberta-xl** — [XLMRobertaXLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta-xl#transformers.XLMRobertaXLModel) (XLM-RoBERTa-XL model)
* **xlnet** — [XLNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlnet#transformers.XLNetModel) (XLNet model)
* **xmod** — [XmodModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xmod#transformers.XmodModel) (X-MOD model)
* **yolos** — [YolosModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yolos#transformers.YolosModel) (YOLOS model)
* **yoso** — [YosoModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yoso#transformers.YosoModel) (YOSO model)

The model is set in evaluation mode by default using `model.eval()` (so for instance, dropout modules are deactivated). To train the model, you should first set it back in training mode with `model.train()`

Examples:

Copied

```
>>> from transformers import AutoConfig, AutoModel

>>> # Download model and configuration from huggingface.co and cache.
>>> model = AutoModel.from_pretrained("bert-base-cased")

>>> # Update configuration during loading
>>> model = AutoModel.from_pretrained("bert-base-cased", output_attentions=True)
>>> model.config.output_attentions
True

>>> # Loading from a TF checkpoint file instead of a PyTorch model (slower)
>>> config = AutoConfig.from_pretrained("./tf_model/bert_tf_model_config.json")
>>> model = AutoModel.from_pretrained(
...     "./tf_model/bert_tf_checkpoint.ckpt.index", from_tf=True, config=config
... )
```


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://boinc-ai.gitbook.io/transformers/api/main-classes/auto-classes/generic-model-classes/automodel.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.