Retrieval-Augmented Generation (RAG)
Grounding generation in retrieved documents.
Tier Grades
Tier A: Frontier AI labs
feasible
medium confidence
NVIDIA ships Nemotron Retriever models for RAG.
Tier B: Indonesian AI labs
feasible
low confidence
RAG is training-light and weeks per system; the notes give no compute anchor.
Tier C: Institution units such as ITB
feasible
medium confidence
Academia is observed, and the method needs inference rather than training.
Tier D: Organisations such as SEMAI (PoT, PoC, PoV)
feasible
medium confidence
Integrators are observed and a system takes weeks, which fits proof-of-concept delivery; the notes give no compute anchor.
Where this comes from
Tiers: a) frontier AI labs, b) Indonesian AI labs, c) institution units such as ITB, d) organisations such as SEMAI delivering proof of technology, concept and value. Each rationale cites the anchors below.
Anchors
- ComputeInference-heavy, training-light; compute not sourced.
- DataClient or domain document collections; not quantified.
- Team size (proxy)Proxy only (author count of an exemplar paper, not a headcount): not sourced in the notes.
- Time horizonWeeks for a system.
- Shelf-life signalsnot in the notes
- Pipeline roleTier A supplies retriever and generator models; Tier C studies methods; Tier B and Tier D build grounded systems on local documents for proofs of concept and value.
Where this comes from
Team size is a proxy (author counts of exemplar papers), not a headcount.
Who and What
Exemplars
RAG survey (Naive, Advanced, Modular RAG)
Nemotron Retriever models
Nemotron Retriever modelsObserved actors
Linked models
Nemotron Retriever modelsembeddingexemplar
EmbeddingGemma 2embeddingused by
SEA-LION-E5-Embedding-600Membeddingused by
SEA-LION ModernBERT-Embedding 300Membeddingused by
SEA-LION ModernBERT-Embedding 600Membeddingused by
Nemotron-3-Embed-1Bembeddingused by
Nemotron-3-Embed-8Bembeddingused by
R3-rerank-0.6brerankerused by
Granite Embedding Multilingual R2embeddingused by
Qwen3-VL-Embedding-2Bembeddingused by
Qwen3-VL-Embedding-8Bembeddingused by
BGE-VL familyembeddingused by
harrier-oss-v1-0.6bembeddingused by
Qwen3-VL-Rerankerrerankerused by
Qwen3-VL-Reranker-2Brerankerused by
Qwen3-VL-Reranker-8Brerankerused by
ColEmbed V2embeddingused by
Llama Nemotron Embed VL 1B v2embeddingused by
Llama Nemotron Rerank VL 1B v2rerankerused by+106
Llama Nemotron Embed 1B v2embeddingused by
Llama Nemotron Rerank 1B v2rerankerused by
bge-reasoner-embed-qwen3-8bembeddingused by
Granite Embedding Reranker English R2rerankerused by
EmbeddingGemma 300Membeddingused by
Granite Embedding small English R2embeddingused by
Qwen3-Embedding-0.6Bembeddingused by
Qwen3-Embedding-4Bembeddingused by
Qwen3-Embedding-8Bembeddingused by
Qwen3-Reranker-0.6Brerankerused by
Qwen3-Reranker-4Brerankerused by
Qwen3-Reranker-8Brerankerused by
Gemini Embeddingembeddingused by
gemini-embedding-001embeddingused by
Sonar ProLLMproduced by
Sonar Reasoning Proreasoningproduced by
mxbai-rerank-large-v2rerankerused by
gte-reranker-modernbert-basererankerused by
Granite Embeddingembeddingused by
Granite Embedding 278M multilingualembeddingused by
ColQwen2 v1.0embeddingused by
NV-Embed-v2embeddingused by
DataGemma RIG 27B ITLLMproduced by
DataGemmaLLMproduced by
DataGemma RAG 27B ITLLMproduced by
ColPali v1.2embeddingused by
gte-multilingual-baseembeddingused by
gte-multilingual-reranker-basererankerused by
ColPaliembeddingused by
gte-Qwen2-7B-instructembeddingused by
gte-large-en-v1.5embeddingused by
snowflake-arctic-embed-lembeddingused by
Snowflake Arctic Embedembeddingused by
snowflake-arctic-embed-membeddingused by
Command R+ (Apr '24)LLMproduced by
Command R (Mar '24)LLMproduced by
mxbai-embed-large-v1embeddingused by
SFR-Embedding-Mistralembeddingused by
bge-m3embeddingused by
e5-mistral-7bembeddingused by
multilingual-e5-large-instructembeddingused by
MedCPT Cross-Encoderrerankerused by
bge-large-en-v1.5embeddingused by
bge-large-zh-v1.5embeddingused by
bge-reranker-largererankerused by
bge-small-en-v1.5embeddingused by
bge-base-en-v1.5embeddingused by
BGE Reranker (v1)rerankerused by
bge-reranker-basererankerused by
BGE v1.5embeddingused by
GTE (General Text Embeddings)embeddingused by
gte-largeembeddingused by
gte-smallembeddingused by
multilingual-e5-smallembeddingused by
all-MiniLM-L6-v2 (Xenova, Transformers.js ONNX)embeddingused by
SPECTER2embeddingused by
SPLADE (CoCondenser self-distil)embeddingused by
paraphrase-multilingual-MiniLM-L12-v2embeddingused by
paraphrase-multilingual-mpnet-base-v2embeddingused by
GTR (Generalizable T5 Retriever)embeddingused by
Sentence-T5embeddingused by
LaBSEembeddingused by
LASERembeddingused by
Universal Sentence Encoderembeddingused by
bge-multilingual-gemma2embeddingused by
bge-reranker-v2-m3rerankerused by
Mistral Embedembeddingused by
Amazon Titan Text Embeddings V2embeddingused by
Cohere Embedembeddingused by
Embed English v3.0embeddingused by
Embed Multilingual v3.0embeddingused by
Embed v4.0embeddingused by
Embed v5.0 Proembeddingused by
Cohere Rerankrerankerused by
Rerank v3.5rerankerused by
Rerank v4.0 Fastrerankerused by
Rerank v4.0 Prorerankerused by
Gemini Embedding 2embeddingused by
OpenAI text embeddingsembeddingused by
text-embedding-3-largeembeddingused by
text-embedding-3-smallembeddingused by
text-embedding-ada-002embeddingused by
all-MiniLM-L12-v2embeddingused by
all-MiniLM-L6-v2embeddingused by
all-mpnet-base-v2embeddingused by
MS MARCO cross-encoders (MiniLM)rerankerused by
ms-marco-MiniLM-L12-v2rerankerused by
ms-marco-MiniLM-L6-v2rerankerused by
rerank-2.5rerankerused by
voyage-3.5embeddingused by
voyage-3-largeembeddingused by
voyage-4embeddingused by
voyage-code-3embeddingused by
Voyage embeddingsembeddingused by
Voyage rerankersrerankerused byLinks
R&D TopicRetrieval-Augmented Generation (RAG)
Models
Nemotron Retriever modelsNVIDIA, embedding
SEA-LION-E5-Embedding-600MAI Singapore, embedding
SEA-LION ModernBERT-Embedding 300MAI Singapore, embedding
SEA-LION ModernBERT-Embedding 600MAI Singapore, embedding+126 more
Nemotron Retriever modelsNVIDIA, embedding
SEA-LION-E5-Embedding-600MAI Singapore, embedding
SEA-LION ModernBERT-Embedding 300MAI Singapore, embedding
SEA-LION ModernBERT-Embedding 600MAI Singapore, embedding+126 moreWho Runs Itnone recorded
Models 130
Cohere EmbedCohere, embeddingused by
BGE v1.5BAAI, embeddingused by
GTE (General Text Embeddings)Alibaba (Qwen), embeddingused by
SEA-LION-E5-Embedding-600MAI Singapore, embeddingused by
Voyage embeddingsVoyage AI, embeddingused by
Cohere RerankCohere, rerankerused by
ColPaliIlluin Technology, embeddingused by
DataGemmaGoogle, LLMproduced by
Granite EmbeddingIBM, embeddingused by
OpenAI text embeddingsOpenAI, embeddingused by
Qwen3-VL-RerankerAlibaba (Qwen), rerankerused by
SEA-LION ModernBERT-Embedding 300MAI Singapore, embeddingused by+118
SEA-LION ModernBERT-Embedding 600MAI Singapore, embeddingused by
all-MiniLM-L6-v2 (Xenova, Transformers.js ONNX)Xenova (Transformers.js ports), embeddingused by
BGE Reranker (v1)BAAI, rerankerused by
ColPali v1.2Illuin Technology, embeddingused by
ColQwen2 v1.0Illuin Technology, embeddingused by
Command R (Mar '24)Cohere, Cohere Labs, LLMproduced by
Command R+ (Apr '24)Cohere, Cohere Labs, LLMproduced by
DataGemma RAG 27B ITGoogle, LLMproduced by
DataGemma RIG 27B ITGoogle, LLMproduced by
Embed English v3.0Cohere, embeddingused by
Embed Multilingual v3.0Cohere, embeddingused by
Embed v4.0Cohere, embeddingused by
Embed v5.0 ProCohere, embeddingused by
Gemini EmbeddingGoogle, embeddingused by
Gemini Embedding 2Google, embeddingused by
MS MARCO cross-encoders (MiniLM)Sentence Transformers, rerankerused by
Qwen3-VL-Embedding-2BAlibaba (Qwen), embeddingused by
Qwen3-VL-Embedding-8BAlibaba (Qwen), embeddingused by
Qwen3-VL-Reranker-2BAlibaba (Qwen), rerankerused by
Qwen3-VL-Reranker-8BAlibaba (Qwen), rerankerused by
Snowflake Arctic EmbedSnowflake, embeddingused by
Sonar Reasoning ProPerplexity, reasoningproduced by
all-MiniLM-L6-v2Sentence Transformers, embeddingused by
bge-base-en-v1.5BAAI, embeddingused by
bge-large-en-v1.5BAAI, embeddingused by
bge-large-zh-v1.5BAAI, embeddingused by
bge-reranker-baseBAAI, rerankerused by
bge-reranker-largeBAAI, rerankerused by
bge-small-en-v1.5BAAI, embeddingused by
BGE-VL familyBAAI, embeddingused by
ColEmbed V2NVIDIA, embeddingused by
e5-mistral-7bMicrosoft AI, embeddingused by
EmbeddingGemma 300MGoogle, embeddingused by
gemini-embedding-001Google, embeddingused by
Granite Embedding 278M multilingualIBM, embeddingused by
Granite Embedding Reranker English R2IBM, rerankerused by
Granite Embedding small English R2IBM, embeddingused by
gte-largeAlibaba (Qwen), embeddingused by
gte-large-en-v1.5Alibaba (Qwen), embeddingused by
gte-Qwen2-7B-instructAlibaba (Qwen), embeddingused by
gte-smallAlibaba (Qwen), embeddingused by
Llama Nemotron Embed VL 1B v2NVIDIA, embeddingused by
Llama Nemotron Rerank VL 1B v2NVIDIA, rerankerused by
ms-marco-MiniLM-L12-v2Sentence Transformers, rerankerused by
ms-marco-MiniLM-L6-v2Sentence Transformers, rerankerused by
multilingual-e5-smallMicrosoft AI, embeddingused by
Nemotron-3-Embed-8BNVIDIA, embeddingused by
Qwen3-Embedding-0.6BAlibaba (Qwen), embeddingused by
Qwen3-Embedding-4BAlibaba (Qwen), embeddingused by
Qwen3-Embedding-8BAlibaba (Qwen), embeddingused by
Qwen3-Reranker-0.6BAlibaba (Qwen), rerankerused by
Qwen3-Reranker-4BAlibaba (Qwen), rerankerused by
Qwen3-Reranker-8BAlibaba (Qwen), rerankerused by
Rerank v3.5Cohere, rerankerused by
Rerank v4.0 FastCohere, rerankerused by
Rerank v4.0 ProCohere, rerankerused by
rerank-2.5Voyage AI, rerankerused by
snowflake-arctic-embed-lSnowflake, embeddingused by
snowflake-arctic-embed-mSnowflake, embeddingused by
Sonar ProPerplexity, LLMproduced by
text-embedding-3-largeOpenAI, embeddingused by
text-embedding-3-smallOpenAI, embeddingused by
text-embedding-ada-002OpenAI, embeddingused by
Voyage rerankersVoyage AI, rerankerused by
voyage-3-largeVoyage AI, embeddingused by
voyage-3.5Voyage AI, embeddingused by
voyage-4Voyage AI, embeddingused by
voyage-code-3Voyage AI, embeddingused by
all-MiniLM-L12-v2Sentence Transformers, embeddingused by
all-mpnet-base-v2Sentence Transformers, embeddingused by
Amazon Titan Text Embeddings V2Amazon, embeddingused by
bge-m3BAAI, embeddingused by
bge-multilingual-gemma2BAAI, embeddingused by
bge-reasoner-embed-qwen3-8bBAAI, embeddingused by
bge-reranker-v2-m3BAAI, rerankerused by
EmbeddingGemma 2Google, embeddingused by
Granite Embedding Multilingual R2IBM, embeddingused by
gte-multilingual-baseAlibaba (Qwen), embeddingused by
gte-multilingual-reranker-baseAlibaba (Qwen), rerankerused by
gte-reranker-modernbert-baseAlibaba (Qwen), rerankerused by
GTR (Generalizable T5 Retriever)Google, embeddingused by
harrier-oss-v1-0.6bMicrosoft AI, embeddingused by
LaBSEGoogle, embeddingused by
LASERMeta, embeddingused by
Llama Nemotron Embed 1B v2NVIDIA, embeddingused by
Llama Nemotron Rerank 1B v2NVIDIA, rerankerused by
MedCPT Cross-EncoderNIH National Library of Medicine, rerankerused by
Mistral EmbedMistral AI, embeddingused by
multilingual-e5-large-instructMicrosoft AI, embeddingused by
mxbai-embed-large-v1Mixedbread, embeddingused by
mxbai-rerank-large-v2Mixedbread, rerankerused by
Nemotron Retriever modelsNVIDIA, embeddingexemplar
Nemotron-3-Embed-1BNVIDIA, embeddingused by
NV-Embed-v2NVIDIA, embeddingused by
paraphrase-multilingual-MiniLM-L12-v2Sentence Transformers, embeddingused by
paraphrase-multilingual-mpnet-base-v2Sentence Transformers, embeddingused by
R3-rerank-0.6bTencent, rerankerused by
Sentence-T5Google, embeddingused by
SFR-Embedding-MistralSalesforce, embeddingused by
SPECTER2Allen AI, embeddingused by
SPLADE (CoCondenser self-distil)Naver, embeddingused by
Universal Sentence EncoderGoogle, embeddingused byPapers
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis et al., NeurIPS 2020 (per arXiv comment), 2020 founding
- REALM: Retrieval-Augmented Language Model Pre-TrainingKelvin Guu et al., arXiv preprint, 2020 founding
- Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionAkari Asai et al., arXiv preprint, 2023 state of the art
- Atlas: Few-shot Learning with Retrieval Augmented Language ModelsGautier Izacard et al., arXiv preprint, 2022 state of the art
- Retrieval-Augmented Generation for Large Language Models: A SurveyYunfan Gao et al., arXiv preprint, 2023 survey
Where this comes from
The papers to read first: where the direction began, its current best, and a survey when one exists.
Sources
- NVIDIA Nemotron nvidia.com https://www.nvidia.com/en-us/ai-data-science/foundation-models/nemotron/
- Retrieval-Augmented Generation for Large Language Models: A Survey arxiv.org https://arxiv.org/abs/2312.10997
To cite this page: Project AURION, AI Use-Cases Research & Innovation, "Retrieval-Augmented Generation (RAG)", https://aurion.semai.id/topics/retrieval-augmented-generation/, records of October 2026.