> For the complete documentation index, see [llms.txt](https://boinc-ai.gitbook.io/transformers/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://boinc-ai.gitbook.io/transformers/api/main-classes/auto-classes/generic-model-classes/automodel.md).

# AutoModel

#### AutoModel

#### class transformers.AutoModel

[\<source>](https://github.com/huggingface/transformers/blob/v4.34.1/src/transformers/models/auto/modeling_auto.py#L1224)

( \*args\*\*kwargs )

This is a generic model class that will be instantiated as one of the base model classes of the library when created with the [from\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/auto#transformers.FlaxAutoModelForVision2Seq.from_pretrained) class method or the [from\_config()](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/auto#transformers.FlaxAutoModelForVision2Seq.from_config) class method.

This class cannot be instantiated directly using `__init__()` (throws an error).

**from\_config**

[\<source>](https://github.com/huggingface/transformers/blob/v4.34.1/src/transformers/models/auto/auto_factory.py#L417)

( \*\*kwargs )

Parameters

* **config** ([PretrainedConfig](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/configuration#transformers.PretrainedConfig)) — The model class to instantiate is selected based on the configuration class:
  * [ASTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/audio-spectrogram-transformer#transformers.ASTConfig) configuration class: [ASTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/audio-spectrogram-transformer#transformers.ASTModel) (Audio Spectrogram Transformer model)
  * [AlbertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/albert#transformers.AlbertConfig) configuration class: [AlbertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/albert#transformers.AlbertModel) (ALBERT model)
  * [AlignConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/align#transformers.AlignConfig) configuration class: [AlignModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/align#transformers.AlignModel) (ALIGN model)
  * [AltCLIPConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/altclip#transformers.AltCLIPConfig) configuration class: [AltCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/altclip#transformers.AltCLIPModel) (AltCLIP model)
  * [AutoformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/autoformer#transformers.AutoformerConfig) configuration class: [AutoformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/autoformer#transformers.AutoformerModel) (Autoformer model)
  * [BarkConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bark#transformers.BarkConfig) configuration class: [BarkModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bark#transformers.BarkModel) (Bark model)
  * [BartConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bart#transformers.BartConfig) configuration class: [BartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bart#transformers.BartModel) (BART model)
  * [BeitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/beit#transformers.BeitConfig) configuration class: [BeitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/beit#transformers.BeitModel) (BEiT model)
  * [BertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert#transformers.BertConfig) configuration class: [BertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert#transformers.BertModel) (BERT model)
  * [BertGenerationConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert-generation#transformers.BertGenerationConfig) configuration class: [BertGenerationEncoder](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert-generation#transformers.BertGenerationEncoder) (Bert Generation model)
  * [BigBirdConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/big_bird#transformers.BigBirdConfig) configuration class: [BigBirdModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/big_bird#transformers.BigBirdModel) (BigBird model)
  * [BigBirdPegasusConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bigbird_pegasus#transformers.BigBirdPegasusConfig) configuration class: [BigBirdPegasusModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bigbird_pegasus#transformers.BigBirdPegasusModel) (BigBird-Pegasus model)
  * [BioGptConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/biogpt#transformers.BioGptConfig) configuration class: [BioGptModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/biogpt#transformers.BioGptModel) (BioGpt model)
  * [BitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bit#transformers.BitConfig) configuration class: [BitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bit#transformers.BitModel) (BiT model)
  * [BlenderbotConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot#transformers.BlenderbotConfig) configuration class: [BlenderbotModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot#transformers.BlenderbotModel) (Blenderbot model)
  * [BlenderbotSmallConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot-small#transformers.BlenderbotSmallConfig) configuration class: [BlenderbotSmallModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot-small#transformers.BlenderbotSmallModel) (BlenderbotSmall model)
  * [Blip2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip-2#transformers.Blip2Config) configuration class: [Blip2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip-2#transformers.Blip2Model) (BLIP-2 model)
  * [BlipConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip#transformers.BlipConfig) configuration class: [BlipModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip#transformers.BlipModel) (BLIP model)
  * [BloomConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bloom#transformers.BloomConfig) configuration class: [BloomModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bloom#transformers.BloomModel) (BLOOM model)
  * [BridgeTowerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bridgetower#transformers.BridgeTowerConfig) configuration class: [BridgeTowerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bridgetower#transformers.BridgeTowerModel) (BridgeTower model)
  * [BrosConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bros#transformers.BrosConfig) configuration class: [BrosModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bros#transformers.BrosModel) (BROS model)
  * [CLIPConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clip#transformers.CLIPConfig) configuration class: [CLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clip#transformers.CLIPModel) (CLIP model)
  * [CLIPSegConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clipseg#transformers.CLIPSegConfig) configuration class: [CLIPSegModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clipseg#transformers.CLIPSegModel) (CLIPSeg model)
  * [CTRLConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ctrl#transformers.CTRLConfig) configuration class: [CTRLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ctrl#transformers.CTRLModel) (CTRL model)
  * [CamembertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/camembert#transformers.CamembertConfig) configuration class: [CamembertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/camembert#transformers.CamembertModel) (CamemBERT model)
  * [CanineConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/canine#transformers.CanineConfig) configuration class: [CanineModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/canine#transformers.CanineModel) (CANINE model)
  * [ChineseCLIPConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/chinese_clip#transformers.ChineseCLIPConfig) configuration class: [ChineseCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/chinese_clip#transformers.ChineseCLIPModel) (Chinese-CLIP model)
  * [ClapConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clap#transformers.ClapConfig) configuration class: [ClapModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clap#transformers.ClapModel) (CLAP model)
  * [CodeGenConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/codegen#transformers.CodeGenConfig) configuration class: [CodeGenModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/codegen#transformers.CodeGenModel) (CodeGen model)
  * [ConditionalDetrConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/conditional_detr#transformers.ConditionalDetrConfig) configuration class: [ConditionalDetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/conditional_detr#transformers.ConditionalDetrModel) (Conditional DETR model)
  * [ConvBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convbert#transformers.ConvBertConfig) configuration class: [ConvBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convbert#transformers.ConvBertModel) (ConvBERT model)
  * [ConvNextConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnext#transformers.ConvNextConfig) configuration class: [ConvNextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnext#transformers.ConvNextModel) (ConvNeXT model)
  * [ConvNextV2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnextv2#transformers.ConvNextV2Config) configuration class: [ConvNextV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnextv2#transformers.ConvNextV2Model) (ConvNeXTV2 model)
  * [CpmAntConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cpmant#transformers.CpmAntConfig) configuration class: [CpmAntModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cpmant#transformers.CpmAntModel) (CPM-Ant model)
  * [CvtConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cvt#transformers.CvtConfig) configuration class: [CvtModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cvt#transformers.CvtModel) (CvT model)
  * [DPRConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpr#transformers.DPRConfig) configuration class: [DPRQuestionEncoder](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpr#transformers.DPRQuestionEncoder) (DPR model)
  * [DPTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpt#transformers.DPTConfig) configuration class: [DPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpt#transformers.DPTModel) (DPT model)
  * [Data2VecAudioConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecAudioConfig) configuration class: [Data2VecAudioModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecAudioModel) (Data2VecAudio model)
  * [Data2VecTextConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecTextConfig) configuration class: [Data2VecTextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecTextModel) (Data2VecText model)
  * [Data2VecVisionConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecVisionConfig) configuration class: [Data2VecVisionModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecVisionModel) (Data2VecVision model)
  * [DebertaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta#transformers.DebertaConfig) configuration class: [DebertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta#transformers.DebertaModel) (DeBERTa model)
  * [DebertaV2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta-v2#transformers.DebertaV2Config) configuration class: [DebertaV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta-v2#transformers.DebertaV2Model) (DeBERTa-v2 model)
  * [DecisionTransformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/decision_transformer#transformers.DecisionTransformerConfig) configuration class: [DecisionTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/decision_transformer#transformers.DecisionTransformerModel) (Decision Transformer model)
  * [DeformableDetrConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deformable_detr#transformers.DeformableDetrConfig) configuration class: [DeformableDetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deformable_detr#transformers.DeformableDetrModel) (Deformable DETR model)
  * [DeiTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deit#transformers.DeiTConfig) configuration class: [DeiTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deit#transformers.DeiTModel) (DeiT model)
  * [DetaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deta#transformers.DetaConfig) configuration class: [DetaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deta#transformers.DetaModel) (DETA model)
  * [DetrConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/detr#transformers.DetrConfig) configuration class: [DetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/detr#transformers.DetrModel) (DETR model)
  * [DinatConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinat#transformers.DinatConfig) configuration class: [DinatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinat#transformers.DinatModel) (DiNAT model)
  * [Dinov2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinov2#transformers.Dinov2Config) configuration class: [Dinov2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinov2#transformers.Dinov2Model) (DINOv2 model)
  * [DistilBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/distilbert#transformers.DistilBertConfig) configuration class: [DistilBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/distilbert#transformers.DistilBertModel) (DistilBERT model)
  * [DonutSwinConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/donut#transformers.DonutSwinConfig) configuration class: [DonutSwinModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/donut#transformers.DonutSwinModel) (DonutSwin model)
  * [EfficientFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientformer#transformers.EfficientFormerConfig) configuration class: [EfficientFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientformer#transformers.EfficientFormerModel) (EfficientFormer model)
  * [EfficientNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientnet#transformers.EfficientNetConfig) configuration class: [EfficientNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientnet#transformers.EfficientNetModel) (EfficientNet model)
  * [ElectraConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/electra#transformers.ElectraConfig) configuration class: [ElectraModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/electra#transformers.ElectraModel) (ELECTRA model)
  * [EncodecConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/encodec#transformers.EncodecConfig) configuration class: [EncodecModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/encodec#transformers.EncodecModel) (EnCodec model)
  * [ErnieConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie#transformers.ErnieConfig) configuration class: [ErnieModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie#transformers.ErnieModel) (ERNIE model)
  * [ErnieMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie_m#transformers.ErnieMConfig) configuration class: [ErnieMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie_m#transformers.ErnieMModel) (ErnieM model)
  * [EsmConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/esm#transformers.EsmConfig) configuration class: [EsmModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/esm#transformers.EsmModel) (ESM model)
  * [FNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fnet#transformers.FNetConfig) configuration class: [FNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fnet#transformers.FNetModel) (FNet model)
  * [FSMTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fsmt#transformers.FSMTConfig) configuration class: [FSMTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fsmt#transformers.FSMTModel) (FairSeq Machine-Translation model)
  * [FalconConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/falcon#transformers.FalconConfig) configuration class: [FalconModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/falcon#transformers.FalconModel) (Falcon model)
  * [FlaubertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flaubert#transformers.FlaubertConfig) configuration class: [FlaubertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flaubert#transformers.FlaubertModel) (FlauBERT model)
  * [FlavaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flava#transformers.FlavaConfig) configuration class: [FlavaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flava#transformers.FlavaModel) (FLAVA model)
  * [FocalNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/focalnet#transformers.FocalNetConfig) configuration class: [FocalNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/focalnet#transformers.FocalNetModel) (FocalNet model)
  * [FunnelConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelConfig) configuration class: [FunnelModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelModel) or [FunnelBaseModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelBaseModel) (Funnel Transformer model)
  * [GLPNConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/glpn#transformers.GLPNConfig) configuration class: [GLPNModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/glpn#transformers.GLPNModel) (GLPN model)
  * [GPT2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt2#transformers.GPT2Config) configuration class: [GPT2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt2#transformers.GPT2Model) (OpenAI GPT-2 model)
  * [GPTBigCodeConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_bigcode#transformers.GPTBigCodeConfig) configuration class: [GPTBigCodeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_bigcode#transformers.GPTBigCodeModel) (GPTBigCode model)
  * [GPTJConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptj#transformers.GPTJConfig) configuration class: [GPTJModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptj#transformers.GPTJModel) (GPT-J model)
  * [GPTNeoConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neo#transformers.GPTNeoConfig) configuration class: [GPTNeoModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neo#transformers.GPTNeoModel) (GPT Neo model)
  * [GPTNeoXConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox#transformers.GPTNeoXConfig) configuration class: [GPTNeoXModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox#transformers.GPTNeoXModel) (GPT NeoX model)
  * [GPTNeoXJapaneseConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox_japanese#transformers.GPTNeoXJapaneseConfig) configuration class: [GPTNeoXJapaneseModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox_japanese#transformers.GPTNeoXJapaneseModel) (GPT NeoX Japanese model)
  * [GPTSanJapaneseConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptsan-japanese#transformers.GPTSanJapaneseConfig) configuration class: [GPTSanJapaneseForConditionalGeneration](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptsan-japanese#transformers.GPTSanJapaneseForConditionalGeneration) (GPTSAN-japanese model)
  * [GitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/git#transformers.GitConfig) configuration class: [GitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/git#transformers.GitModel) (GIT model)
  * [GraphormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/graphormer#transformers.GraphormerConfig) configuration class: [GraphormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/graphormer#transformers.GraphormerModel) (Graphormer model)
  * [GroupViTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/groupvit#transformers.GroupViTConfig) configuration class: [GroupViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/groupvit#transformers.GroupViTModel) (GroupViT model)
  * [HubertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/hubert#transformers.HubertConfig) configuration class: [HubertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/hubert#transformers.HubertModel) (Hubert model)
  * [IBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ibert#transformers.IBertConfig) configuration class: [IBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ibert#transformers.IBertModel) (I-BERT model)
  * [IdeficsConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/idefics#transformers.IdeficsConfig) configuration class: [IdeficsModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/idefics#transformers.IdeficsModel) (IDEFICS model)
  * [ImageGPTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/imagegpt#transformers.ImageGPTConfig) configuration class: [ImageGPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/imagegpt#transformers.ImageGPTModel) (ImageGPT model)
  * [InformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/informer#transformers.InformerConfig) configuration class: [InformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/informer#transformers.InformerModel) (Informer model)
  * [JukeboxConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/jukebox#transformers.JukeboxConfig) configuration class: [JukeboxModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/jukebox#transformers.JukeboxModel) (Jukebox model)
  * [LEDConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/led#transformers.LEDConfig) configuration class: [LEDModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/led#transformers.LEDModel) (LED model)
  * [LayoutLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlm#transformers.LayoutLMConfig) configuration class: [LayoutLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlm#transformers.LayoutLMModel) (LayoutLM model)
  * [LayoutLMv2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv2#transformers.LayoutLMv2Config) configuration class: [LayoutLMv2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv2#transformers.LayoutLMv2Model) (LayoutLMv2 model)
  * [LayoutLMv3Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv3#transformers.LayoutLMv3Config) configuration class: [LayoutLMv3Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv3#transformers.LayoutLMv3Model) (LayoutLMv3 model)
  * [LevitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/levit#transformers.LevitConfig) configuration class: [LevitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/levit#transformers.LevitModel) (LeViT model)
  * [LiltConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lilt#transformers.LiltConfig) configuration class: [LiltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lilt#transformers.LiltModel) (LiLT model)
  * [LlamaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/llama2#transformers.LlamaConfig) configuration class: [LlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/llama2#transformers.LlamaModel) (LLaMA model)
  * [LongT5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longt5#transformers.LongT5Config) configuration class: [LongT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longt5#transformers.LongT5Model) (LongT5 model)
  * [LongformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longformer#transformers.LongformerConfig) configuration class: [LongformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longformer#transformers.LongformerModel) (Longformer model)
  * [LukeConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/luke#transformers.LukeConfig) configuration class: [LukeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/luke#transformers.LukeModel) (LUKE model)
  * [LxmertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lxmert#transformers.LxmertConfig) configuration class: [LxmertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lxmert#transformers.LxmertModel) (LXMERT model)
  * [M2M100Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/m2m_100#transformers.M2M100Config) configuration class: [M2M100Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/m2m_100#transformers.M2M100Model) (M2M100 model)
  * [MBartConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mbart#transformers.MBartConfig) configuration class: [MBartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mbart#transformers.MBartModel) (mBART model)
  * [MCTCTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mctct#transformers.MCTCTConfig) configuration class: [MCTCTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mctct#transformers.MCTCTModel) (M-CTC-T model)
  * [MPNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpnet#transformers.MPNetConfig) configuration class: [MPNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpnet#transformers.MPNetModel) (MPNet model)
  * [MT5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mt5#transformers.MT5Config) configuration class: [MT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mt5#transformers.MT5Model) (MT5 model)
  * [MarianConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/marian#transformers.MarianConfig) configuration class: [MarianModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/marian#transformers.MarianModel) (Marian model)
  * [MarkupLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/markuplm#transformers.MarkupLMConfig) configuration class: [MarkupLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/markuplm#transformers.MarkupLMModel) (MarkupLM model)
  * [Mask2FormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mask2former#transformers.Mask2FormerConfig) configuration class: [Mask2FormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mask2former#transformers.Mask2FormerModel) (Mask2Former model)
  * [MaskFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/maskformer#transformers.MaskFormerConfig) configuration class: [MaskFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/maskformer#transformers.MaskFormerModel) (MaskFormer model)
  * `MaskFormerSwinConfig` configuration class: `MaskFormerSwinModel` (MaskFormerSwin model)
  * [MegaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mega#transformers.MegaConfig) configuration class: [MegaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mega#transformers.MegaModel) (MEGA model)
  * [MegatronBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/megatron-bert#transformers.MegatronBertConfig) configuration class: [MegatronBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/megatron-bert#transformers.MegatronBertModel) (Megatron-BERT model)
  * [MgpstrConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mgp-str#transformers.MgpstrConfig) configuration class: [MgpstrForSceneTextRecognition](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mgp-str#transformers.MgpstrForSceneTextRecognition) (MGP-STR model)
  * [MistralConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mistral#transformers.MistralConfig) configuration class: [MistralModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mistral#transformers.MistralModel) (Mistral model)
  * [MobileBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilebert#transformers.MobileBertConfig) configuration class: [MobileBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilebert#transformers.MobileBertModel) (MobileBERT model)
  * [MobileNetV1Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v1#transformers.MobileNetV1Config) configuration class: [MobileNetV1Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v1#transformers.MobileNetV1Model) (MobileNetV1 model)
  * [MobileNetV2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v2#transformers.MobileNetV2Config) configuration class: [MobileNetV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v2#transformers.MobileNetV2Model) (MobileNetV2 model)
  * [MobileViTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevit#transformers.MobileViTConfig) configuration class: [MobileViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevit#transformers.MobileViTModel) (MobileViT model)
  * [MobileViTV2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevitv2#transformers.MobileViTV2Config) configuration class: [MobileViTV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevitv2#transformers.MobileViTV2Model) (MobileViTV2 model)
  * [MptConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpt#transformers.MptConfig) configuration class: [MptModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpt#transformers.MptModel) (MPT model)
  * [MraConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mra#transformers.MraConfig) configuration class: [MraModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mra#transformers.MraModel) (MRA model)
  * [MvpConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mvp#transformers.MvpConfig) configuration class: [MvpModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mvp#transformers.MvpModel) (MVP model)
  * [NatConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nat#transformers.NatConfig) configuration class: [NatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nat#transformers.NatModel) (NAT model)
  * [NezhaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nezha#transformers.NezhaConfig) configuration class: [NezhaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nezha#transformers.NezhaModel) (Nezha model)
  * [NllbMoeConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nllb-moe#transformers.NllbMoeConfig) configuration class: [NllbMoeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nllb-moe#transformers.NllbMoeModel) (NLLB-MOE model)
  * [NystromformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nystromformer#transformers.NystromformerConfig) configuration class: [NystromformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nystromformer#transformers.NystromformerModel) (Nyströmformer model)
  * [OPTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/opt#transformers.OPTConfig) configuration class: [OPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/opt#transformers.OPTModel) (OPT model)
  * [OneFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/oneformer#transformers.OneFormerConfig) configuration class: [OneFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/oneformer#transformers.OneFormerModel) (OneFormer model)
  * [OpenAIGPTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/openai-gpt#transformers.OpenAIGPTConfig) configuration class: [OpenAIGPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/openai-gpt#transformers.OpenAIGPTModel) (OpenAI GPT model)
  * [OpenLlamaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/open-llama#transformers.OpenLlamaConfig) configuration class: [OpenLlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/open-llama#transformers.OpenLlamaModel) (OpenLlama model)
  * [OwlViTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/owlvit#transformers.OwlViTConfig) configuration class: [OwlViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/owlvit#transformers.OwlViTModel) (OWL-ViT model)
  * [PLBartConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/plbart#transformers.PLBartConfig) configuration class: [PLBartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/plbart#transformers.PLBartModel) (PLBart model)
  * [PegasusConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus#transformers.PegasusConfig) configuration class: [PegasusModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus#transformers.PegasusModel) (Pegasus model)
  * [PegasusXConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus_x#transformers.PegasusXConfig) configuration class: [PegasusXModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus_x#transformers.PegasusXModel) (PEGASUS-X model)
  * [PerceiverConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/perceiver#transformers.PerceiverConfig) configuration class: [PerceiverModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/perceiver#transformers.PerceiverModel) (Perceiver model)
  * [PersimmonConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/persimmon#transformers.PersimmonConfig) configuration class: [PersimmonModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/persimmon#transformers.PersimmonModel) (Persimmon model)
  * [PoolFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/poolformer#transformers.PoolFormerConfig) configuration class: [PoolFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/poolformer#transformers.PoolFormerModel) (PoolFormer model)
  * [ProphetNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/prophetnet#transformers.ProphetNetConfig) configuration class: [ProphetNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/prophetnet#transformers.ProphetNetModel) (ProphetNet model)
  * [PvtConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pvt#transformers.PvtConfig) configuration class: [PvtModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pvt#transformers.PvtModel) (PVT model)
  * [QDQBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/qdqbert#transformers.QDQBertConfig) configuration class: [QDQBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/qdqbert#transformers.QDQBertModel) (QDQBert model)
  * [ReformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/reformer#transformers.ReformerConfig) configuration class: [ReformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/reformer#transformers.ReformerModel) (Reformer model)
  * [RegNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/regnet#transformers.RegNetConfig) configuration class: [RegNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/regnet#transformers.RegNetModel) (RegNet model)
  * [RemBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rembert#transformers.RemBertConfig) configuration class: [RemBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rembert#transformers.RemBertModel) (RemBERT model)
  * [ResNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/resnet#transformers.ResNetConfig) configuration class: [ResNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/resnet#transformers.ResNetModel) (ResNet model)
  * [RetriBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/retribert#transformers.RetriBertConfig) configuration class: [RetriBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/retribert#transformers.RetriBertModel) (RetriBERT model)
  * [RoCBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roc_bert#transformers.RoCBertConfig) configuration class: [RoCBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roc_bert#transformers.RoCBertModel) (RoCBert model)
  * [RoFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roformer#transformers.RoFormerConfig) configuration class: [RoFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roformer#transformers.RoFormerModel) (RoFormer model)
  * [RobertaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta#transformers.RobertaConfig) configuration class: [RobertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta#transformers.RobertaModel) (RoBERTa model)
  * [RobertaPreLayerNormConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta-prelayernorm#transformers.RobertaPreLayerNormConfig) configuration class: [RobertaPreLayerNormModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta-prelayernorm#transformers.RobertaPreLayerNormModel) (RoBERTa-PreLayerNorm model)
  * [RwkvConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rwkv#transformers.RwkvConfig) configuration class: [RwkvModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rwkv#transformers.RwkvModel) (RWKV model)
  * [SEWConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew#transformers.SEWConfig) configuration class: [SEWModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew#transformers.SEWModel) (SEW model)
  * [SEWDConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew-d#transformers.SEWDConfig) configuration class: [SEWDModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew-d#transformers.SEWDModel) (SEW-D model)
  * [SamConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sam#transformers.SamConfig) configuration class: [SamModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sam#transformers.SamModel) (SAM model)
  * [SegformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/segformer#transformers.SegformerConfig) configuration class: [SegformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/segformer#transformers.SegformerModel) (SegFormer model)
  * [Speech2TextConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speech_to_text#transformers.Speech2TextConfig) configuration class: [Speech2TextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speech_to_text#transformers.Speech2TextModel) (Speech2Text model)
  * [SpeechT5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speecht5#transformers.SpeechT5Config) configuration class: [SpeechT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speecht5#transformers.SpeechT5Model) (SpeechT5 model)
  * [SplinterConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/splinter#transformers.SplinterConfig) configuration class: [SplinterModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/splinter#transformers.SplinterModel) (Splinter model)
  * [SqueezeBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/squeezebert#transformers.SqueezeBertConfig) configuration class: [SqueezeBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/squeezebert#transformers.SqueezeBertModel) (SqueezeBERT model)
  * [SwiftFormerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swiftformer#transformers.SwiftFormerConfig) configuration class: [SwiftFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swiftformer#transformers.SwiftFormerModel) (SwiftFormer model)
  * [Swin2SRConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin2sr#transformers.Swin2SRConfig) configuration class: [Swin2SRModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin2sr#transformers.Swin2SRModel) (Swin2SR model)
  * [SwinConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin#transformers.SwinConfig) configuration class: [SwinModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin#transformers.SwinModel) (Swin Transformer model)
  * [Swinv2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swinv2#transformers.Swinv2Config) configuration class: [Swinv2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swinv2#transformers.Swinv2Model) (Swin Transformer V2 model)
  * [SwitchTransformersConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/switch_transformers#transformers.SwitchTransformersConfig) configuration class: [SwitchTransformersModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/switch_transformers#transformers.SwitchTransformersModel) (SwitchTransformers model)
  * [T5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/t5#transformers.T5Config) configuration class: [T5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/t5#transformers.T5Model) (T5 model)
  * [TableTransformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/table-transformer#transformers.TableTransformerConfig) configuration class: [TableTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/table-transformer#transformers.TableTransformerModel) (Table Transformer model)
  * [TapasConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tapas#transformers.TapasConfig) configuration class: [TapasModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tapas#transformers.TapasModel) (TAPAS model)
  * [TimeSeriesTransformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/time_series_transformer#transformers.TimeSeriesTransformerConfig) configuration class: [TimeSeriesTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/time_series_transformer#transformers.TimeSeriesTransformerModel) (Time Series Transformer model)
  * [TimesformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/timesformer#transformers.TimesformerConfig) configuration class: [TimesformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/timesformer#transformers.TimesformerModel) (TimeSformer model)
  * `TimmBackboneConfig` configuration class: `TimmBackbone` (TimmBackbone model)
  * [TrajectoryTransformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/trajectory_transformer#transformers.TrajectoryTransformerConfig) configuration class: [TrajectoryTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/trajectory_transformer#transformers.TrajectoryTransformerModel) (Trajectory Transformer model)
  * [TransfoXLConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/transfo-xl#transformers.TransfoXLConfig) configuration class: [TransfoXLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/transfo-xl#transformers.TransfoXLModel) (Transformer-XL model)
  * [TvltConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tvlt#transformers.TvltConfig) configuration class: [TvltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tvlt#transformers.TvltModel) (TVLT model)
  * [UMT5Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/umt5#transformers.UMT5Config) configuration class: [UMT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/umt5#transformers.UMT5Model) (UMT5 model)
  * [UniSpeechConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech#transformers.UniSpeechConfig) configuration class: [UniSpeechModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech#transformers.UniSpeechModel) (UniSpeech model)
  * [UniSpeechSatConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech-sat#transformers.UniSpeechSatConfig) configuration class: [UniSpeechSatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech-sat#transformers.UniSpeechSatModel) (UniSpeechSat model)
  * [VanConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/van#transformers.VanConfig) configuration class: [VanModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/van#transformers.VanModel) (VAN model)
  * [ViTConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit#transformers.ViTConfig) configuration class: [ViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit#transformers.ViTModel) (ViT model)
  * [ViTHybridConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_hybrid#transformers.ViTHybridConfig) configuration class: [ViTHybridModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_hybrid#transformers.ViTHybridModel) (ViT Hybrid model)
  * [ViTMAEConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_mae#transformers.ViTMAEConfig) configuration class: [ViTMAEModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_mae#transformers.ViTMAEModel) (ViTMAE model)
  * [ViTMSNConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_msn#transformers.ViTMSNConfig) configuration class: [ViTMSNModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_msn#transformers.ViTMSNModel) (ViTMSN model)
  * [VideoMAEConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/videomae#transformers.VideoMAEConfig) configuration class: [VideoMAEModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/videomae#transformers.VideoMAEModel) (VideoMAE model)
  * [ViltConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vilt#transformers.ViltConfig) configuration class: [ViltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vilt#transformers.ViltModel) (ViLT model)
  * [VisionTextDualEncoderConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vision-text-dual-encoder#transformers.VisionTextDualEncoderConfig) configuration class: [VisionTextDualEncoderModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vision-text-dual-encoder#transformers.VisionTextDualEncoderModel) (VisionTextDualEncoder model)
  * [VisualBertConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/visual_bert#transformers.VisualBertConfig) configuration class: [VisualBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/visual_bert#transformers.VisualBertModel) (VisualBERT model)
  * [VitDetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vitdet#transformers.VitDetConfig) configuration class: [VitDetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vitdet#transformers.VitDetModel) (VitDet model)
  * [VitsConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vits#transformers.VitsConfig) configuration class: [VitsModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vits#transformers.VitsModel) (VITS model)
  * [VivitConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vivit#transformers.VivitConfig) configuration class: [VivitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vivit#transformers.VivitModel) (ViViT model)
  * [Wav2Vec2Config](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2#transformers.Wav2Vec2Config) configuration class: [Wav2Vec2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2#transformers.Wav2Vec2Model) (Wav2Vec2 model)
  * [Wav2Vec2ConformerConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2-conformer#transformers.Wav2Vec2ConformerConfig) configuration class: [Wav2Vec2ConformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2-conformer#transformers.Wav2Vec2ConformerModel) (Wav2Vec2-Conformer model)
  * [WavLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wavlm#transformers.WavLMConfig) configuration class: [WavLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wavlm#transformers.WavLMModel) (WavLM model)
  * [WhisperConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/whisper#transformers.WhisperConfig) configuration class: [WhisperModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/whisper#transformers.WhisperModel) (Whisper model)
  * [XCLIPConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xclip#transformers.XCLIPConfig) configuration class: [XCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xclip#transformers.XCLIPModel) (X-CLIP model)
  * [XGLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xglm#transformers.XGLMConfig) configuration class: [XGLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xglm#transformers.XGLMModel) (XGLM model)
  * [XLMConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm#transformers.XLMConfig) configuration class: [XLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm#transformers.XLMModel) (XLM model)
  * [XLMProphetNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-prophetnet#transformers.XLMProphetNetConfig) configuration class: [XLMProphetNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-prophetnet#transformers.XLMProphetNetModel) (XLM-ProphetNet model)
  * [XLMRobertaConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta#transformers.XLMRobertaConfig) configuration class: [XLMRobertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta#transformers.XLMRobertaModel) (XLM-RoBERTa model)
  * [XLMRobertaXLConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta-xl#transformers.XLMRobertaXLConfig) configuration class: [XLMRobertaXLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta-xl#transformers.XLMRobertaXLModel) (XLM-RoBERTa-XL model)
  * [XLNetConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlnet#transformers.XLNetConfig) configuration class: [XLNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlnet#transformers.XLNetModel) (XLNet model)
  * [XmodConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xmod#transformers.XmodConfig) configuration class: [XmodModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xmod#transformers.XmodModel) (X-MOD model)
  * [YolosConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yolos#transformers.YolosConfig) configuration class: [YolosModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yolos#transformers.YolosModel) (YOLOS model)
  * [YosoConfig](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yoso#transformers.YosoConfig) configuration class: [YosoModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yoso#transformers.YosoModel) (YOSO model)

Instantiates one of the base model classes of the library from a configuration.

Note: Loading a model from its configuration file does **not** load the model weights. It only affects the model’s configuration. Use [from\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/auto#transformers.FlaxAutoModelForVision2Seq.from_pretrained) to load the model weights.

Examples:

Copied

```
>>> from transformers import AutoConfig, AutoModel

>>> # Download configuration from huggingface.co and cache.
>>> config = AutoConfig.from_pretrained("bert-base-cased")
>>> model = AutoModel.from_config(config)
```

**from\_pretrained**

[\<source>](https://github.com/huggingface/transformers/blob/v4.34.1/src/transformers/models/auto/auto_factory.py#L448)

( \*model\_args\*\*kwargs )

Parameters

* **pretrained\_model\_name\_or\_path** (`str` or `os.PathLike`) — Can be either:
  * A string, the *model id* of a pretrained model hosted inside a model repo on huggingface.co. Valid model ids can be located at the root-level, like `bert-base-uncased`, or namespaced under a user or organization name, like `dbmdz/bert-base-german-cased`.
  * A path to a *directory* containing model weights saved using [save\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/model#transformers.PreTrainedModel.save_pretrained), e.g., `./my_model_directory/`.
  * A path or url to a *tensorflow index checkpoint file* (e.g, `./tf_model/model.ckpt.index`). In this case, `from_tf` should be set to `True` and a configuration object should be provided as `config` argument. This loading path is slower than converting the TensorFlow checkpoint in a PyTorch model using the provided conversion scripts and loading the PyTorch model afterwards.
* **model\_args** (additional positional arguments, *optional*) — Will be passed along to the underlying model `__init__()` method.
* **config** ([PretrainedConfig](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/configuration#transformers.PretrainedConfig), *optional*) — Configuration for the model to use instead of an automatically loaded configuration. Configuration can be automatically loaded when:
  * The model is a model provided by the library (loaded with the *model id* string of a pretrained model).
  * The model was saved using [save\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/model#transformers.PreTrainedModel.save_pretrained) and is reloaded by supplying the save directory.
  * The model is loaded by supplying a local directory as `pretrained_model_name_or_path` and a configuration JSON file named *config.json* is found in the directory.
* **state\_dict** (*Dict\[str, torch.Tensor]*, *optional*) — A state dictionary to use instead of a state dictionary loaded from saved weights file.

  This option can be used if you want to create a model from a pretrained configuration but load your own weights. In this case though, you should check if using [save\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/model#transformers.PreTrainedModel.save_pretrained) and [from\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/model#transformers.PreTrainedModel.from_pretrained) is not a simpler option.
* **cache\_dir** (`str` or `os.PathLike`, *optional*) — Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used.
* **from\_tf** (`bool`, *optional*, defaults to `False`) — Load the model weights from a TensorFlow checkpoint save file (see docstring of `pretrained_model_name_or_path` argument).
* **force\_download** (`bool`, *optional*, defaults to `False`) — Whether or not to force the (re-)download of the model weights and configuration files, overriding the cached versions if they exist.
* **resume\_download** (`bool`, *optional*, defaults to `False`) — Whether or not to delete incompletely received files. Will attempt to resume the download if such a file exists.
* **proxies** (`Dict[str, str]`, *optional*) — A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}`. The proxies are used on each request.
* **output\_loading\_info(`bool`,** *optional*, defaults to `False`) — Whether ot not to also return a dictionary containing missing keys, unexpected keys and error messages.
* **local\_files\_only(`bool`,** *optional*, defaults to `False`) — Whether or not to only look at local files (e.g., not try downloading the model).
* **revision** (`str`, *optional*, defaults to `"main"`) — The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git.
* **trust\_remote\_code** (`bool`, *optional*, defaults to `False`) — Whether or not to allow for custom models defined on the Hub in their own modeling files. This option should only be set to `True` for repositories you trust and in which you have read the code, as it will execute code present on the Hub on your local machine.
* **code\_revision** (`str`, *optional*, defaults to `"main"`) — The specific revision to use for the code on the Hub, if the code leaves in a different repository than the rest of the model. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git.
* **kwargs** (additional keyword arguments, *optional*) — Can be used to update the configuration object (after it being loaded) and initiate the model (e.g., `output_attentions=True`). Behaves differently depending on whether a `config` is provided or automatically loaded:
  * If a configuration is provided with `config`, `**kwargs` will be directly passed to the underlying model’s `__init__` method (we assume all relevant updates to the configuration have already been done)
  * If a configuration is not provided, `kwargs` will be first passed to the configuration class initialization function ([from\_pretrained()](https://huggingface.co/docs/transformers/v4.34.1/en/main_classes/configuration#transformers.PretrainedConfig.from_pretrained)). Each key of `kwargs` that corresponds to a configuration attribute will be used to override said attribute with the supplied `kwargs` value. Remaining keys that do not correspond to any configuration attribute will be passed to the underlying model’s `__init__` function.

Instantiate one of the base model classes of the library from a pretrained model.

The model class to instantiate is selected based on the `model_type` property of the config object (either passed as an argument or loaded from `pretrained_model_name_or_path` if possible), or when it’s missing, by falling back to using pattern matching on `pretrained_model_name_or_path`:

* **albert** — [AlbertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/albert#transformers.AlbertModel) (ALBERT model)
* **align** — [AlignModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/align#transformers.AlignModel) (ALIGN model)
* **altclip** — [AltCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/altclip#transformers.AltCLIPModel) (AltCLIP model)
* **audio-spectrogram-transformer** — [ASTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/audio-spectrogram-transformer#transformers.ASTModel) (Audio Spectrogram Transformer model)
* **autoformer** — [AutoformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/autoformer#transformers.AutoformerModel) (Autoformer model)
* **bark** — [BarkModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bark#transformers.BarkModel) (Bark model)
* **bart** — [BartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bart#transformers.BartModel) (BART model)
* **beit** — [BeitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/beit#transformers.BeitModel) (BEiT model)
* **bert** — [BertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert#transformers.BertModel) (BERT model)
* **bert-generation** — [BertGenerationEncoder](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bert-generation#transformers.BertGenerationEncoder) (Bert Generation model)
* **big\_bird** — [BigBirdModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/big_bird#transformers.BigBirdModel) (BigBird model)
* **bigbird\_pegasus** — [BigBirdPegasusModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bigbird_pegasus#transformers.BigBirdPegasusModel) (BigBird-Pegasus model)
* **biogpt** — [BioGptModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/biogpt#transformers.BioGptModel) (BioGpt model)
* **bit** — [BitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bit#transformers.BitModel) (BiT model)
* **blenderbot** — [BlenderbotModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot#transformers.BlenderbotModel) (Blenderbot model)
* **blenderbot-small** — [BlenderbotSmallModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blenderbot-small#transformers.BlenderbotSmallModel) (BlenderbotSmall model)
* **blip** — [BlipModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip#transformers.BlipModel) (BLIP model)
* **blip-2** — [Blip2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/blip-2#transformers.Blip2Model) (BLIP-2 model)
* **bloom** — [BloomModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bloom#transformers.BloomModel) (BLOOM model)
* **bridgetower** — [BridgeTowerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bridgetower#transformers.BridgeTowerModel) (BridgeTower model)
* **bros** — [BrosModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/bros#transformers.BrosModel) (BROS model)
* **camembert** — [CamembertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/camembert#transformers.CamembertModel) (CamemBERT model)
* **canine** — [CanineModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/canine#transformers.CanineModel) (CANINE model)
* **chinese\_clip** — [ChineseCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/chinese_clip#transformers.ChineseCLIPModel) (Chinese-CLIP model)
* **clap** — [ClapModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clap#transformers.ClapModel) (CLAP model)
* **clip** — [CLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clip#transformers.CLIPModel) (CLIP model)
* **clipseg** — [CLIPSegModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/clipseg#transformers.CLIPSegModel) (CLIPSeg model)
* **code\_llama** — [LlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/llama2#transformers.LlamaModel) (CodeLlama model)
* **codegen** — [CodeGenModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/codegen#transformers.CodeGenModel) (CodeGen model)
* **conditional\_detr** — [ConditionalDetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/conditional_detr#transformers.ConditionalDetrModel) (Conditional DETR model)
* **convbert** — [ConvBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convbert#transformers.ConvBertModel) (ConvBERT model)
* **convnext** — [ConvNextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnext#transformers.ConvNextModel) (ConvNeXT model)
* **convnextv2** — [ConvNextV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/convnextv2#transformers.ConvNextV2Model) (ConvNeXTV2 model)
* **cpmant** — [CpmAntModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cpmant#transformers.CpmAntModel) (CPM-Ant model)
* **ctrl** — [CTRLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ctrl#transformers.CTRLModel) (CTRL model)
* **cvt** — [CvtModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/cvt#transformers.CvtModel) (CvT model)
* **data2vec-audio** — [Data2VecAudioModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecAudioModel) (Data2VecAudio model)
* **data2vec-text** — [Data2VecTextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecTextModel) (Data2VecText model)
* **data2vec-vision** — [Data2VecVisionModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/data2vec#transformers.Data2VecVisionModel) (Data2VecVision model)
* **deberta** — [DebertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta#transformers.DebertaModel) (DeBERTa model)
* **deberta-v2** — [DebertaV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deberta-v2#transformers.DebertaV2Model) (DeBERTa-v2 model)
* **decision\_transformer** — [DecisionTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/decision_transformer#transformers.DecisionTransformerModel) (Decision Transformer model)
* **deformable\_detr** — [DeformableDetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deformable_detr#transformers.DeformableDetrModel) (Deformable DETR model)
* **deit** — [DeiTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deit#transformers.DeiTModel) (DeiT model)
* **deta** — [DetaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/deta#transformers.DetaModel) (DETA model)
* **detr** — [DetrModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/detr#transformers.DetrModel) (DETR model)
* **dinat** — [DinatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinat#transformers.DinatModel) (DiNAT model)
* **dinov2** — [Dinov2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dinov2#transformers.Dinov2Model) (DINOv2 model)
* **distilbert** — [DistilBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/distilbert#transformers.DistilBertModel) (DistilBERT model)
* **donut-swin** — [DonutSwinModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/donut#transformers.DonutSwinModel) (DonutSwin model)
* **dpr** — [DPRQuestionEncoder](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpr#transformers.DPRQuestionEncoder) (DPR model)
* **dpt** — [DPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/dpt#transformers.DPTModel) (DPT model)
* **efficientformer** — [EfficientFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientformer#transformers.EfficientFormerModel) (EfficientFormer model)
* **efficientnet** — [EfficientNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/efficientnet#transformers.EfficientNetModel) (EfficientNet model)
* **electra** — [ElectraModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/electra#transformers.ElectraModel) (ELECTRA model)
* **encodec** — [EncodecModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/encodec#transformers.EncodecModel) (EnCodec model)
* **ernie** — [ErnieModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie#transformers.ErnieModel) (ERNIE model)
* **ernie\_m** — [ErnieMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ernie_m#transformers.ErnieMModel) (ErnieM model)
* **esm** — [EsmModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/esm#transformers.EsmModel) (ESM model)
* **falcon** — [FalconModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/falcon#transformers.FalconModel) (Falcon model)
* **flaubert** — [FlaubertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flaubert#transformers.FlaubertModel) (FlauBERT model)
* **flava** — [FlavaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/flava#transformers.FlavaModel) (FLAVA model)
* **fnet** — [FNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fnet#transformers.FNetModel) (FNet model)
* **focalnet** — [FocalNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/focalnet#transformers.FocalNetModel) (FocalNet model)
* **fsmt** — [FSMTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/fsmt#transformers.FSMTModel) (FairSeq Machine-Translation model)
* **funnel** — [FunnelModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelModel) or [FunnelBaseModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/funnel#transformers.FunnelBaseModel) (Funnel Transformer model)
* **git** — [GitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/git#transformers.GitModel) (GIT model)
* **glpn** — [GLPNModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/glpn#transformers.GLPNModel) (GLPN model)
* **gpt-sw3** — [GPT2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt2#transformers.GPT2Model) (GPT-Sw3 model)
* **gpt2** — [GPT2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt2#transformers.GPT2Model) (OpenAI GPT-2 model)
* **gpt\_bigcode** — [GPTBigCodeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_bigcode#transformers.GPTBigCodeModel) (GPTBigCode model)
* **gpt\_neo** — [GPTNeoModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neo#transformers.GPTNeoModel) (GPT Neo model)
* **gpt\_neox** — [GPTNeoXModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox#transformers.GPTNeoXModel) (GPT NeoX model)
* **gpt\_neox\_japanese** — [GPTNeoXJapaneseModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gpt_neox_japanese#transformers.GPTNeoXJapaneseModel) (GPT NeoX Japanese model)
* **gptj** — [GPTJModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptj#transformers.GPTJModel) (GPT-J model)
* **gptsan-japanese** — [GPTSanJapaneseForConditionalGeneration](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/gptsan-japanese#transformers.GPTSanJapaneseForConditionalGeneration) (GPTSAN-japanese model)
* **graphormer** — [GraphormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/graphormer#transformers.GraphormerModel) (Graphormer model)
* **groupvit** — [GroupViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/groupvit#transformers.GroupViTModel) (GroupViT model)
* **hubert** — [HubertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/hubert#transformers.HubertModel) (Hubert model)
* **ibert** — [IBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/ibert#transformers.IBertModel) (I-BERT model)
* **idefics** — [IdeficsModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/idefics#transformers.IdeficsModel) (IDEFICS model)
* **imagegpt** — [ImageGPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/imagegpt#transformers.ImageGPTModel) (ImageGPT model)
* **informer** — [InformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/informer#transformers.InformerModel) (Informer model)
* **jukebox** — [JukeboxModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/jukebox#transformers.JukeboxModel) (Jukebox model)
* **layoutlm** — [LayoutLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlm#transformers.LayoutLMModel) (LayoutLM model)
* **layoutlmv2** — [LayoutLMv2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv2#transformers.LayoutLMv2Model) (LayoutLMv2 model)
* **layoutlmv3** — [LayoutLMv3Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/layoutlmv3#transformers.LayoutLMv3Model) (LayoutLMv3 model)
* **led** — [LEDModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/led#transformers.LEDModel) (LED model)
* **levit** — [LevitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/levit#transformers.LevitModel) (LeViT model)
* **lilt** — [LiltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lilt#transformers.LiltModel) (LiLT model)
* **llama** — [LlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/llama2#transformers.LlamaModel) (LLaMA model)
* **longformer** — [LongformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longformer#transformers.LongformerModel) (Longformer model)
* **longt5** — [LongT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/longt5#transformers.LongT5Model) (LongT5 model)
* **luke** — [LukeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/luke#transformers.LukeModel) (LUKE model)
* **lxmert** — [LxmertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/lxmert#transformers.LxmertModel) (LXMERT model)
* **m2m\_100** — [M2M100Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/m2m_100#transformers.M2M100Model) (M2M100 model)
* **marian** — [MarianModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/marian#transformers.MarianModel) (Marian model)
* **markuplm** — [MarkupLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/markuplm#transformers.MarkupLMModel) (MarkupLM model)
* **mask2former** — [Mask2FormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mask2former#transformers.Mask2FormerModel) (Mask2Former model)
* **maskformer** — [MaskFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/maskformer#transformers.MaskFormerModel) (MaskFormer model)
* **maskformer-swin** — `MaskFormerSwinModel` (MaskFormerSwin model)
* **mbart** — [MBartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mbart#transformers.MBartModel) (mBART model)
* **mctct** — [MCTCTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mctct#transformers.MCTCTModel) (M-CTC-T model)
* **mega** — [MegaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mega#transformers.MegaModel) (MEGA model)
* **megatron-bert** — [MegatronBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/megatron-bert#transformers.MegatronBertModel) (Megatron-BERT model)
* **mgp-str** — [MgpstrForSceneTextRecognition](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mgp-str#transformers.MgpstrForSceneTextRecognition) (MGP-STR model)
* **mistral** — [MistralModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mistral#transformers.MistralModel) (Mistral model)
* **mobilebert** — [MobileBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilebert#transformers.MobileBertModel) (MobileBERT model)
* **mobilenet\_v1** — [MobileNetV1Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v1#transformers.MobileNetV1Model) (MobileNetV1 model)
* **mobilenet\_v2** — [MobileNetV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilenet_v2#transformers.MobileNetV2Model) (MobileNetV2 model)
* **mobilevit** — [MobileViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevit#transformers.MobileViTModel) (MobileViT model)
* **mobilevitv2** — [MobileViTV2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mobilevitv2#transformers.MobileViTV2Model) (MobileViTV2 model)
* **mpnet** — [MPNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpnet#transformers.MPNetModel) (MPNet model)
* **mpt** — [MptModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mpt#transformers.MptModel) (MPT model)
* **mra** — [MraModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mra#transformers.MraModel) (MRA model)
* **mt5** — [MT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mt5#transformers.MT5Model) (MT5 model)
* **mvp** — [MvpModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/mvp#transformers.MvpModel) (MVP model)
* **nat** — [NatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nat#transformers.NatModel) (NAT model)
* **nezha** — [NezhaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nezha#transformers.NezhaModel) (Nezha model)
* **nllb-moe** — [NllbMoeModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nllb-moe#transformers.NllbMoeModel) (NLLB-MOE model)
* **nystromformer** — [NystromformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/nystromformer#transformers.NystromformerModel) (Nyströmformer model)
* **oneformer** — [OneFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/oneformer#transformers.OneFormerModel) (OneFormer model)
* **open-llama** — [OpenLlamaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/open-llama#transformers.OpenLlamaModel) (OpenLlama model)
* **openai-gpt** — [OpenAIGPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/openai-gpt#transformers.OpenAIGPTModel) (OpenAI GPT model)
* **opt** — [OPTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/opt#transformers.OPTModel) (OPT model)
* **owlvit** — [OwlViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/owlvit#transformers.OwlViTModel) (OWL-ViT model)
* **pegasus** — [PegasusModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus#transformers.PegasusModel) (Pegasus model)
* **pegasus\_x** — [PegasusXModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pegasus_x#transformers.PegasusXModel) (PEGASUS-X model)
* **perceiver** — [PerceiverModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/perceiver#transformers.PerceiverModel) (Perceiver model)
* **persimmon** — [PersimmonModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/persimmon#transformers.PersimmonModel) (Persimmon model)
* **plbart** — [PLBartModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/plbart#transformers.PLBartModel) (PLBart model)
* **poolformer** — [PoolFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/poolformer#transformers.PoolFormerModel) (PoolFormer model)
* **prophetnet** — [ProphetNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/prophetnet#transformers.ProphetNetModel) (ProphetNet model)
* **pvt** — [PvtModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/pvt#transformers.PvtModel) (PVT model)
* **qdqbert** — [QDQBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/qdqbert#transformers.QDQBertModel) (QDQBert model)
* **reformer** — [ReformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/reformer#transformers.ReformerModel) (Reformer model)
* **regnet** — [RegNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/regnet#transformers.RegNetModel) (RegNet model)
* **rembert** — [RemBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rembert#transformers.RemBertModel) (RemBERT model)
* **resnet** — [ResNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/resnet#transformers.ResNetModel) (ResNet model)
* **retribert** — [RetriBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/retribert#transformers.RetriBertModel) (RetriBERT model)
* **roberta** — [RobertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta#transformers.RobertaModel) (RoBERTa model)
* **roberta-prelayernorm** — [RobertaPreLayerNormModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roberta-prelayernorm#transformers.RobertaPreLayerNormModel) (RoBERTa-PreLayerNorm model)
* **roc\_bert** — [RoCBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roc_bert#transformers.RoCBertModel) (RoCBert model)
* **roformer** — [RoFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/roformer#transformers.RoFormerModel) (RoFormer model)
* **rwkv** — [RwkvModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/rwkv#transformers.RwkvModel) (RWKV model)
* **sam** — [SamModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sam#transformers.SamModel) (SAM model)
* **segformer** — [SegformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/segformer#transformers.SegformerModel) (SegFormer model)
* **sew** — [SEWModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew#transformers.SEWModel) (SEW model)
* **sew-d** — [SEWDModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/sew-d#transformers.SEWDModel) (SEW-D model)
* **speech\_to\_text** — [Speech2TextModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speech_to_text#transformers.Speech2TextModel) (Speech2Text model)
* **speecht5** — [SpeechT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/speecht5#transformers.SpeechT5Model) (SpeechT5 model)
* **splinter** — [SplinterModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/splinter#transformers.SplinterModel) (Splinter model)
* **squeezebert** — [SqueezeBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/squeezebert#transformers.SqueezeBertModel) (SqueezeBERT model)
* **swiftformer** — [SwiftFormerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swiftformer#transformers.SwiftFormerModel) (SwiftFormer model)
* **swin** — [SwinModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin#transformers.SwinModel) (Swin Transformer model)
* **swin2sr** — [Swin2SRModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swin2sr#transformers.Swin2SRModel) (Swin2SR model)
* **swinv2** — [Swinv2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/swinv2#transformers.Swinv2Model) (Swin Transformer V2 model)
* **switch\_transformers** — [SwitchTransformersModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/switch_transformers#transformers.SwitchTransformersModel) (SwitchTransformers model)
* **t5** — [T5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/t5#transformers.T5Model) (T5 model)
* **table-transformer** — [TableTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/table-transformer#transformers.TableTransformerModel) (Table Transformer model)
* **tapas** — [TapasModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tapas#transformers.TapasModel) (TAPAS model)
* **time\_series\_transformer** — [TimeSeriesTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/time_series_transformer#transformers.TimeSeriesTransformerModel) (Time Series Transformer model)
* **timesformer** — [TimesformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/timesformer#transformers.TimesformerModel) (TimeSformer model)
* **timm\_backbone** — `TimmBackbone` (TimmBackbone model)
* **trajectory\_transformer** — [TrajectoryTransformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/trajectory_transformer#transformers.TrajectoryTransformerModel) (Trajectory Transformer model)
* **transfo-xl** — [TransfoXLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/transfo-xl#transformers.TransfoXLModel) (Transformer-XL model)
* **tvlt** — [TvltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/tvlt#transformers.TvltModel) (TVLT model)
* **umt5** — [UMT5Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/umt5#transformers.UMT5Model) (UMT5 model)
* **unispeech** — [UniSpeechModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech#transformers.UniSpeechModel) (UniSpeech model)
* **unispeech-sat** — [UniSpeechSatModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/unispeech-sat#transformers.UniSpeechSatModel) (UniSpeechSat model)
* **van** — [VanModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/van#transformers.VanModel) (VAN model)
* **videomae** — [VideoMAEModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/videomae#transformers.VideoMAEModel) (VideoMAE model)
* **vilt** — [ViltModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vilt#transformers.ViltModel) (ViLT model)
* **vision-text-dual-encoder** — [VisionTextDualEncoderModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vision-text-dual-encoder#transformers.VisionTextDualEncoderModel) (VisionTextDualEncoder model)
* **visual\_bert** — [VisualBertModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/visual_bert#transformers.VisualBertModel) (VisualBERT model)
* **vit** — [ViTModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit#transformers.ViTModel) (ViT model)
* **vit\_hybrid** — [ViTHybridModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_hybrid#transformers.ViTHybridModel) (ViT Hybrid model)
* **vit\_mae** — [ViTMAEModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_mae#transformers.ViTMAEModel) (ViTMAE model)
* **vit\_msn** — [ViTMSNModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vit_msn#transformers.ViTMSNModel) (ViTMSN model)
* **vitdet** — [VitDetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vitdet#transformers.VitDetModel) (VitDet model)
* **vits** — [VitsModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vits#transformers.VitsModel) (VITS model)
* **vivit** — [VivitModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/vivit#transformers.VivitModel) (ViViT model)
* **wav2vec2** — [Wav2Vec2Model](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2#transformers.Wav2Vec2Model) (Wav2Vec2 model)
* **wav2vec2-conformer** — [Wav2Vec2ConformerModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wav2vec2-conformer#transformers.Wav2Vec2ConformerModel) (Wav2Vec2-Conformer model)
* **wavlm** — [WavLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/wavlm#transformers.WavLMModel) (WavLM model)
* **whisper** — [WhisperModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/whisper#transformers.WhisperModel) (Whisper model)
* **xclip** — [XCLIPModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xclip#transformers.XCLIPModel) (X-CLIP model)
* **xglm** — [XGLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xglm#transformers.XGLMModel) (XGLM model)
* **xlm** — [XLMModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm#transformers.XLMModel) (XLM model)
* **xlm-prophetnet** — [XLMProphetNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-prophetnet#transformers.XLMProphetNetModel) (XLM-ProphetNet model)
* **xlm-roberta** — [XLMRobertaModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta#transformers.XLMRobertaModel) (XLM-RoBERTa model)
* **xlm-roberta-xl** — [XLMRobertaXLModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlm-roberta-xl#transformers.XLMRobertaXLModel) (XLM-RoBERTa-XL model)
* **xlnet** — [XLNetModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xlnet#transformers.XLNetModel) (XLNet model)
* **xmod** — [XmodModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/xmod#transformers.XmodModel) (X-MOD model)
* **yolos** — [YolosModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yolos#transformers.YolosModel) (YOLOS model)
* **yoso** — [YosoModel](https://huggingface.co/docs/transformers/v4.34.1/en/model_doc/yoso#transformers.YosoModel) (YOSO model)

The model is set in evaluation mode by default using `model.eval()` (so for instance, dropout modules are deactivated). To train the model, you should first set it back in training mode with `model.train()`

Examples:

Copied

```
>>> from transformers import AutoConfig, AutoModel

>>> # Download model and configuration from huggingface.co and cache.
>>> model = AutoModel.from_pretrained("bert-base-cased")

>>> # Update configuration during loading
>>> model = AutoModel.from_pretrained("bert-base-cased", output_attentions=True)
>>> model.config.output_attentions
True

>>> # Loading from a TF checkpoint file instead of a PyTorch model (slower)
>>> config = AutoConfig.from_pretrained("./tf_model/bert_tf_model_config.json")
>>> model = AutoModel.from_pretrained(
...     "./tf_model/bert_tf_checkpoint.ckpt.index", from_tf=True, config=config
... )
```