multimodal LLM
LLaVA-NeXT-Video 7B
LLaVA-NeXT-Video 7B, a checkpoint of the LLaVA family. Visual instruction tuning: a vision encoder connected to an open LLM and trained on GPT-generated image instruction data, the template for many open VLMs.
Levelvariant
Classmultimodal LLM
Parameters7.06B
Contextnot in the notes
Released5 Jun 2024
Opennessopen weights restricted
Runs onnot in the notes
Statusactive
Identity
- Developer
- University of Wisconsin-Madison, Microsoft AI
- Family
- LLaVA
- Released
- 5 Jun 2024 sourcesregistry date
- Weights published
- –
- Record checked
- 12 Oct 2026
Where this comes from
Developer and dates from the research notes. Release date is the vendor's public announcement; weights date is when open weights were published.
Architecture and Size
- Architecture
- dense transformer
- Total parameters
- 7.06B sources
- Active parameters
- –
- Checkpoint parameters
- –
- Note
- Parameter count from the safetensors index on Hugging Face.
- Context length
- not in the notes
- Input
- text, image, video
- Output
- text
Where this comes from
Parameter counts as the developer states them. Where the checkpoint holds a different total, both are shown (register A16).
Openness and Access
- Openness
- open weights restricted
- Licence
- Llama 2 License sources
- Access routes
- open weights download
Where this comes from
The licence file governs over registry tags and aggregator labels.
Deployment
- Runs on
- not in the notes
- Footprint
- not in the notes
- Runtimes
- not in the notes
Where this comes from
Deployment tiers and runtimes as named in the notes. Footprint is the notes' figure, not a measurement by AURION.
Indonesia
- Indonesian support
- not stated
- Regional languages
- not in the notes
- Jakarta hosting
- unknown
- Languages
- Model card languages: en
Where this comes from
Indonesia fields are carried on every model; unknown is an allowed value.
Benchmark Results
The notes record no benchmark result for this model.
Lineage
The notes record no lineage for this model.
Industry Use Cases
No industry use case links this model.
Links
ModelLLaVA-NeXT-Video 7BUniversity of Wisconsin-Madison, multimodal LLM
LLaVA-NeXT-Video 7BUniversity of Wisconsin-Madison, multimodal LLMUse CasesClinical LLM (Frontier Proprietary)HealthcareRobot Inspection with Instrument ReadingIndustrialPathology Whole-Slide ImagingHealthcareUse cases of models in the same R&D topic; none is recorded for this model itself.
Who Runs It
Banner HealthIn production, 11 Jan 2026CommureIn production, 11 Jan 2026FlatironIn production, 11 Jan 2026Novo NordiskIn production, 11 Jan 2026+13 moreDeployments of these use cases; none names this model.
Banner HealthIn production, 11 Jan 2026CommureIn production, 11 Jan 2026FlatironIn production, 11 Jan 2026Novo NordiskIn production, 11 Jan 2026+13 moreDeployments of these use cases; none names this model.Sources
- arxiv.org/abs/2304.08485 https://arxiv.org/abs/2304.08485
- huggingface.co/llava-hf/LLaVA-NeXT-Video-7B-hf https://huggingface.co/llava-hf/LLaVA-NeXT-Video-7B-hf
- github.com/GoogleCloudPlatform/vertex-ai-samples/tree/ma... https://github.com/GoogleCloudPlatform/vertex-ai-samples/tree/main/notebooks/community/model_garden
- github.com/open-mmlab/mmpretrain/tree/main/configs/llava https://github.com/open-mmlab/mmpretrain/tree/main/configs/llava
To cite this page: Project AURION, AI Use-Cases Research & Innovation, "LLaVA-NeXT-Video 7B", https://aurion.semai.id/models/llava-llava-next-video-7b/, records of October 2026.