End-to-End Driving Policies with Reasoning
Driving models that map sensor input straight to a planned trajectory, increasingly with a language model that reasons about the scene first.
Tier Grades
Tier A: Frontier AI labs
NVIDIA trains Alpamayo-R1 at 0.5B to 7B parameters and Tesla trains FSD on its fleet.
Tier B: Indonesian AI labs
Building a driving VLA needs a curated reasoning dataset and on-vehicle testing that the sources show only for NVIDIA and Tesla.
Tier C: Institution units such as ITB
Open Alpamayo-R1 weights allow evaluation in simulation, but on-vehicle tests are not shown for institution units.
Tier D: Organisations such as SEMAI (PoT, PoC, PoV)
Road-vehicle autonomy is not a proof-of-concept scope; delivery work would stop at evaluation.
Where this comes from
Anchors
- ComputeAlpamayo-R1: scaled from 0.5B to 7B parameters on the Cosmos-Reason backbone; 99 ms on-vehicle latency.
- DataAlpamayo-R1: Chain of Causation dataset built by auto-labelling plus human review; RL post-training.
- Team size (proxy)Proxy only (author count of an exemplar paper, not a headcount): 44 authors on the Alpamayo-R1 paper (arXiv 2511.00088).
- Time horizonMulti-year.
- Shelf-life signalsAlpamayo-R1 reports a 35% lower close-encounter rate in closed-loop simulation than a trajectory-only baseline.
- Pipeline roleTier A trains and releases driving VLAs; Tier C evaluates open weights in simulation; Tier B and Tier D have no observed role.
Where this comes from
Who and What
Links
Alpamayo-R1NVIDIA, driving
Tesla FSD v14Tesla, driving
Alpamayo 1.5-10BNVIDIA, drivingStateTransformerdriving+1 morePapers
- ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the WorstMayank Bansal et al., arXiv preprint, 2018 founding
- Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long TailNVIDIA et al., arXiv preprint, 2025 state of the art
- EMMA: End-to-End Multimodal Model for Autonomous DrivingJyh-Jing Hwang et al., arXiv preprint, 2024 state of the art
- VAD: Vectorized Scene Representation for Efficient Autonomous DrivingBo Jiang et al., ICCV 2023 (per arXiv comment), 2023 state of the art
- End-to-end Autonomous Driving: Challenges and FrontiersLi Chen et al., arXiv preprint, 2023 survey
Where this comes from
Sources
- arxiv.org/abs/2511.00088 https://arxiv.org/abs/2511.00088
To cite this page: Project AURION, AI Use-Cases Research & Innovation, "End-to-End Driving Policies with Reasoning", https://aurion.semai.id/topics/end-to-end-driving-policies-with-reasoning/, records of October 2026.