Gemini Ultra Model Card

Pricing About Us Blog Docs

Gemini Ultra, developed by Google, features a large context window of 32768 tokens. The model has excelled in benchmarks like MMMU with a score of 59.4 in a 0-shot pass@1 scenario and MMLU with a score of 83.7 in a 5-shot scenario.

Test how Gemini Ultra fares against other foundation models Compare in Playground

Overview

	Gemini Ultra
Provider The entity that provides this model.	Google
Input Context Window The number of tokens supported by the input context window.	32.8K characters
Maximum Output Tokens The number of tokens that can be generated by the model in a single request.	8,192 characters
Release Date When the model was first released.	Unknown

Pricing

	Gemini Ultra
Input Cost of input data provided to the model.	Pricing not available.
Output Cost of output tokens generated by the model.	Pricing not available.

Benchmarks

	Gemini Ultra
MMLU Evaluating LLM knowledge acquisition in zero-shot and few-shot settings.	83.7 (5-shot) Source
MMMU A wide ranging multi-discipline and multimodal benchmark.	59.4 (0-shot pass@1) Source
HellaSwag A challenging sentence completion benchmark.	Benchmark not available.

Measure & Improve LLM Product Performance.

Get Started