Google Releases EmbeddingGemma 2 Paper
Google has released the EmbeddingGemma 2 paper, introducing an Apache 2.0-licensed on-device multimodal embedding model that maps text, code, images, audio, and video into the same vector space. Built on Gemma 4, the model learns from the larger Gemini Embedding 2 and is tuned with contrastive training; with 744M parameters, it outperforms models 2 to 12 times larger on multiple tasks. On the Pixel 11 Pro, the quantized text weights occupy about 191MB of active memory, while the full multimodal model takes about 567MB; the context window is expanded 4 times to 8K tokens, accommodating about 5.5 minutes of audio, 29 images, or 58 video frames. Embedding speech directly scores 69.54 on the MSEB spoken query retrieval benchmark, higher than the 57.59 achieved by transcribing first and then retrieving, and code retrieval on MTEB Code improves from 68.76 in EmbeddingGemma 1 to 78.68. There are currently no further developments.
Google has released the EmbeddingGemma 2 paper, introducing an Apache 2.0-licensed on-device multimodal embedding model that maps text, code, images, audio, and video into the same vector space. Built on Gemma 4, the model learns from the larger Gemini Embedding 2 and is tuned with contrastive training; with 744M parameters, it outperforms models 2 to 12 times larger on multiple tasks. On the Pixel 11 Pro, the quantized text weights occupy about 191MB of active memory, while the full multimodal
Matched fieldsTitle