vision
CaiT
Deeper image transformers with class-attention layers, from the paper "Going deeper with Image Transformers".

Levelmodel
Classvision
Parameters356.46M
Contextnot in the notes
Released31 Mar 2021
Opennessopen weights permissive
Runs onnot in the notes
Statusactive
Identity
Where this comes from
Developer and dates from the research notes. Release date is the vendor's public announcement; weights date is when open weights were published.
Architecture and Size
- Architecture
- dense transformer
- Total parameters
- 356.46M sources
- Active parameters
- –
- Checkpoint parameters
- –
- Context length
- not in the notes
- Input
- image
- Output
- labels and boxes
Where this comes from
Parameter counts as the developer states them. Where the checkpoint holds a different total, both are shown (register A16).
Openness and Access
- Openness
- open weights permissive
- Licence
- Apache License 2.0 sources
- Access routes
- open weights download, cloud marketplace
Where this comes from
The licence file governs over registry tags and aggregator labels.
Deployment
- Runs on
- not in the notes
- Footprint
- not in the notes
- Runtimes
- not in the notes
Where this comes from
Deployment tiers and runtimes as named in the notes. Footprint is the notes' figure, not a measurement by AURION.
Indonesia
- Indonesian support
- not stated
- Regional languages
- not in the notes
- Jakarta hosting
- unknown
- Languages
- not in the notes
Where this comes from
Indonesia fields are carried on every model; unknown is an allowed value.
Benchmark Results
The notes record no benchmark result for this model.
Lineage
The notes record no lineage for this model.
Industry Use Cases
No industry use case links this model.
Links
Organisations 1
Sources
- arxiv.org/abs/2103.17239 https://arxiv.org/abs/2103.17239
- huggingface.co/timm/cait_m48_448.fb_dist_in1k https://huggingface.co/timm/cait_m48_448.fb_dist_in1k
- jumpstart-cache-prod-us-west-2.s3.us-west-2.amazonaws.com/models_manifest.json https://jumpstart-cache-prod-us-west-2.s3.us-west-2.amazonaws.com/models_manifest.json
- github.com/huggingface/pytorch-image-models/blob/main/RE... https://github.com/huggingface/pytorch-image-models/blob/main/README.md
- kaggle.com/models/spsayakpaul/cait https://www.kaggle.com/models/spsayakpaul/cait
- github.com/onnx/models/tree/main/Computer_Vision/cait_m4... https://github.com/onnx/models/tree/main/Computer_Vision/cait_m48_448_Opset16_timm
- arxiv.org/html/2103.17239 https://arxiv.org/html/2103.17239
To cite this page: Project AURION, AI Use-Cases Research & Innovation, "CaiT", https://aurion.semai.id/models/cait/, records of October 2026.