LLM
Zephyr 7B beta
Chat model fine-tuned from Mistral-7B with distilled supervised fine-tuning and direct preference optimisation on synthetic data.
Levelmodel
ClassLLM
Parameters7.24B
Contextnot in the notes
Released26 Oct 2023
Opennessopen weights permissive
Runs onnot in the notes
Statusactive
R&D Topics
Identity
- Developer
- Hugging Face
- Family
- not in the notes
- Released
- 26 Oct 2023 sourcesregistry date
- Weights published
- –
- Record checked
- 12 Oct 2026
Where this comes from
Developer and dates from the research notes. Release date is the vendor's public announcement; weights date is when open weights were published.
Architecture and Size
- Architecture
- dense transformer
- Total parameters
- 7.24B sources
- Active parameters
- –
- Checkpoint parameters
- –
- Note
- Parameter count from the safetensors index on Hugging Face.
- Context length
- not in the notes
- Input
- text
- Output
- text
Where this comes from
Parameter counts as the developer states them. Where the checkpoint holds a different total, both are shown (register A16).
Openness and Access
- Openness
- open weights permissive
- Licence
- MIT License sources
- Access routes
- open weights download
Where this comes from
The licence file governs over registry tags and aggregator labels.
Deployment
- Runs on
- not in the notes
- Footprint
- not in the notes
- Runtimes
- not in the notes
Where this comes from
Deployment tiers and runtimes as named in the notes. Footprint is the notes' figure, not a measurement by AURION.
Indonesia
- Indonesian support
- not stated
- Regional languages
- not in the notes
- Jakarta hosting
- unknown
- Languages
- Model card languages: en
Where this comes from
Indonesia fields are carried on every model; unknown is an allowed value.
Benchmark Results
The notes record no benchmark result for this model.
Lineage
The notes record no lineage for this model.
Industry Use Cases
No industry use case links this model.
Links
DeveloperHugging Facestartup, USA / France
Hugging Facestartup, USA / FranceModelZephyr 7B betaHugging Face, LLM
Zephyr 7B betaHugging Face, LLMR&D TopicsData Curation and Synthetic DataDistillation of Frontier Models into Smaller OnesOpen Post-Training Recipes
Use CasesIndonesian and Regional-Language LLMsPublic SectorUse cases of models in the same R&D topic; none is recorded for this model itself.
Who Runs Itnone recordedDeployments of these use cases; none names this model.
Organisations 1
R&D topics 3
Open Post-Training RecipesOpenly released data, code and methods (instruction tuning, preference optimisation, veri…exemplarData Curation and Synthetic DataBuilding, filtering and generating training corpora.produced byDistillation of Frontier Models into Smaller OnesTransferring capability from a large teacher model to a smaller one.used by
Sources
- huggingface.co/HuggingFaceH4/zephyr-7b-beta https://huggingface.co/HuggingFaceH4/zephyr-7b-beta
- docs.aws.amazon.com/bedrock/latest/userguide/bedrock-marketplace-... https://docs.aws.amazon.com/bedrock/latest/userguide/bedrock-marketplace-model-reference.html
- huggingface.co/OpenVINO/zephyr-7b-beta-int4-ov https://huggingface.co/OpenVINO/zephyr-7b-beta-int4-ov
To cite this page: Project AURION, AI Use-Cases Research & Innovation, "Zephyr 7B Beta", https://aurion.semai.id/models/hugging-face-zephyr-7b-beta/, records of October 2026.