Project AURIONAI Use-Cases Research & Innovation
language encoderfamily

BERT

Bidirectional transformer encoder pre-trained on unlabelled text with masked language modelling, then fine-tuned for classification, question answering and tagging.

Google
Levelfamily
Classlanguage encoder
Parametersnot in the notes
Contextnot in the notes
Released11 Oct 2018
Opennessopen weights permissive
Runs onnot in the notes
Statusactive

Lineage

GoogleBERT base multilingual cased belongs to this familylanguage encoder178.57M
GoogleBERT base uncased belongs to this familylanguage encoder110.11M
GoogleBERT large uncased belongs to this familylanguage encoder336.23M
Where this comes from
Parent and child relations from model cards, Hugging Face base_model fields and the genealogy tables of the research notes. Confidence and evidence are the notes' own.

R&D Topics

Identity

Developer
Google
Family
not in the notes
Released
11 Oct 2018 sourcesannouncement page
Weights published
–
Record checked
12 Oct 2026
Where this comes from
Developer and dates from the research notes. Release date is the vendor's public announcement; weights date is when open weights were published.

Architecture and Size

Architecture
dense transformer
Total parameters
– sources
Active parameters
–
Checkpoint parameters
–
Note
Base (110M) and large (340M), cased and uncased, multilingual and Chinese checkpoints; many smaller official sizes.
Context length
not in the notes
Input
text
Output
text
Where this comes from
Parameter counts as the developer states them. Where the checkpoint holds a different total, both are shown (register A16).

Openness and Access

Openness
open weights permissive
Licence
Apache License 2.0 sources
Access routes
open weights download
Where this comes from
The licence file governs over registry tags and aggregator labels.

Deployment

Runs on
not in the notes
Footprint
not in the notes
Runtimes
not in the notes
Where this comes from
Deployment tiers and runtimes as named in the notes. Footprint is the notes' figure, not a measurement by AURION.

Indonesia

Indonesian support
listed by developer
Regional languages
Burmese, Javanese, Malay, Minangkabau, Sundanese, Tagalog, Thai, Vietnamese
Jakarta hosting
unknown
Languages
Checkpoint model cards list 103 languages, including Indonesian
Where this comes from
Indonesia fields are carried on every model; unknown is an allowed value.

Benchmark Results

The notes record no benchmark result for this model.

Industry Use Cases

No industry use case links this model.

Sources

  1. arxiv.org/abs/1810.04805 https://arxiv.org/abs/1810.04805
  2. github.com/google-research/bert https://github.com/google-research/bert
  3. github.com/GoogleCloudPlatform/vertex-ai-samples/tree/ma... https://github.com/GoogleCloudPlatform/vertex-ai-samples/tree/main/notebooks/community/model_garden
  4. jumpstart-cache-prod-us-west-2.s3.us-west-2.amazonaws.com/models_manifest.json https://jumpstart-cache-prod-us-west-2.s3.us-west-2.amazonaws.com/models_manifest.json
  5. huggingface.co/google-bert/bert-base-uncased https://huggingface.co/google-bert/bert-base-uncased
  6. huggingface.co/google-bert/bert-large-uncased https://huggingface.co/google-bert/bert-large-uncased

To cite this page: Project AURION, AI Use-Cases Research & Innovation, "BERT", https://aurion.semai.id/models/google-bert/, records of October 2026.