Project AURIONAI Use-Cases Research & Innovation

Text-to-Video Foundation Models

Large models that generate video clips from text or images.

Tier Grades

feasible

Tier A: Frontier AI labs

feasible

Training on billions of images and videos with a 62-author team is frontier-lab work.

not feasible

Tier B: Indonesian AI labs

not feasible

Pretraining at that scale is not feasible for an Indonesian lab.

stretch

Tier C: Institution units such as ITB

stretch

A university unit can fine-tune the 1.3B model, which runs in 8.19 GB VRAM.

feasible

Tier D: Organisations such as SEMAI (PoT, PoC, PoV)

feasible

APIs and the small open model support marketing and training video pilots.

Where this comes from
Tiers: a) frontier AI labs, b) Indonesian AI labs, c) institution units such as ITB, d) organisations such as SEMAI delivering proof of technology, concept and value. Each rationale cites the anchors below.

Anchors

  • ComputeWan offers 1.3B and 14B models; the 1.3B model needs only 8.19 GB VRAM. Training compute is not stated in the abstract.
  • DataThe 14B model is trained on billions of images and videos.
  • Team size (proxy)Proxy only (author count of an exemplar paper, not a headcount): 62 authors on the Wan paper (arXiv 2503.20314).
  • Time horizonMonths.
  • Shelf-life signalsA new open model tops the video arenas, Copyright actions against video models
  • Pipeline roleTier A trains video models; Tier C fine-tunes small open ones; Tier D uses them in content pilots.
Where this comes from
Team size is a proxy (author counts of exemplar papers), not a headcount.

Who and What

Exemplars
Observed actors
Linked models
+80
ByteDanceSeedance 2.0video generationproduced byKuaishouKling 3.0 Omnivideo generationproduced byGoogle DeepMindVeo 3.1video generationproduced byLightricksLTX-2video generationproduced byShengShu TechnologyVidu Q3 Provideo generationproduced byPika (Pika Labs)Pika 2.5video generationproduced byMiniMaxHailuo 2.3video generationproduced byMeituanLongCat-Videovideo generationproduced byKuaishouKling 2.5 Turbovideo generationproduced byAlibaba (Qwen)Wan 2.2video generationproduced byAlibaba (Qwen)Wan 2.2 A14Bvideo generationproduced byAlibaba (Qwen)Wan 2.2 TI2V-5Bvideo generationproduced byByteDanceSeedance 1.0video generationproduced byKuaishouKling 2.1video generationproduced byShengShu TechnologyVidu Q1video generationproduced bySkywork AISkyReels-V2video generationproduced byRunwayGen-4video generationproduced bySand AIMAGI-1video generationproduced byAlibaba (Qwen)Wan 2.1 T2V 1.3Bvideo generationproduced byStepFunStep-Video-T2Vvideo generationproduced byLuma AIRay2video generationproduced byGoogle DeepMindVeo 2video generationproduced byRuyi-Mini-7Bvideo generationproduced byGenmoMochi 1video generationproduced byPeking UniversityPyramid Flowvideo generationproduced byMiniMaxVideo-01video generationproduced byStability AISVD img2vid-XT 1.1video generationproduced byTencentHunyuanVideovideo generationproduced byStability AIStable Video Diffusionvideo generationproduced byStability AISVD img2vidvideo generationproduced byStability AISVD img2vid-XTvideo generationproduced byAlibaba (Qwen)I2VGen-XLvideo generationproduced byZeroscope v2video generationproduced byAlibaba (Qwen)ModelScope Text-to-Video (ModelScopeT2V)video generationproduced byABot-World v0.1video generationproduced byAlibaba (Qwen)Wanvideo generationproduced byAlibaba (Qwen)Wan 2.5video generationproduced byAlibaba (Qwen)Wan 2.6video generationproduced byAlibaba (Qwen)Wan 2.7video generationproduced byByteDanceSeedancevideo generationproduced byByteDanceSeedance 1.5 Provideo generationproduced byDecartLucy 2.0video generationproduced byGoogle DeepMindVeovideo generationproduced byGoogle DeepMindVeo 3.1 Fastvideo generationproduced byGoogleGemini Omnivideo generationproduced byHiDream.aiHiDream-O1-Videovideo generationproduced byIPOCvideo generationproduced byIPOWvideo generationproduced byJT-CVvideo generationproduced byJT3.5video generationproduced byKuaishouKlingvideo generationproduced byKuaishouKling 1.6video generationproduced byKuaishouKling 2.0video generationproduced byLightricksLTXvideo generationproduced byLightricksLTX-2.5 Fastvideo generationproduced byLightricksLTX-2.5 Provideo generationproduced byLightricksLTX-Videovideo generationproduced byLuma AIRay 3.2video generationproduced byMiniMaxHailuo / MiniMax videovideo generationproduced byMiniMaxHailuo-02video generationproduced byOpenAISoravideo generationproduced byOpenAISora 2video generationproduced byOpenAISora 2 Provideo generationproduced byOpenAISoravideo generationproduced byPika (Pika Labs)Pikavideo generationproduced byRunwayAleph 2.0video generationproduced byRunwayRunway Genvideo generationproduced byRunwayGen-3video generationproduced byRunwayGen-4.5video generationproduced byShengShu TechnologyViduvideo generationproduced byShengShu TechnologyVidu Q2video generationproduced byShengShu TechnologyVidu Q3 Turbovideo generationproduced byShengShu TechnologyVidu Svideo generationproduced bySpaceXAI (xAI)Grok Imagine Video 720pvideo generationproduced byTencentHunyuanVideovideo generationproduced byToMoviee 2.0video generationproduced byAmazonAmazon Nova Reelvideo generationproduced byLeonardo.AiLeonardo Motion 2.0video generationproduced byLuma AIRay Flash 2video generationproduced byPruna AIP-Videovideo generationproduced by

Papers

Where this comes from
The papers to read first: where the direction began, its current best, and a survey when one exists.

Sources

  1. arxiv.org/abs/2503.20314 https://arxiv.org/abs/2503.20314

To cite this page: Project AURION, AI Use-Cases Research & Innovation, "Text-to-Video Foundation Models", https://aurion.semai.id/topics/text-to-video-foundation-models/, records of October 2026.