Favicon de nvidia

NVIDIA: Llama 3.1 Nemotron Ultra 253B v1

nvidia/llama-3.1-nemotron-ultra-253b-v1

Poids du modèle

Llama-3.1-Nemotron-Ultra-253B-v1 is a large language model (LLM) optimized for advanced reasoning, human-interactive chat, retrieval-augmented generation (RAG), and tool-calling tasks. Derived from Meta’s Llama-3.1-405B-Instruct, it has been significantly customized using Neural Architecture Search (NAS), resulting in enhanced efficiency, reduced memory usage, and improved inference latency. The model supports a context length of up to 128K tokens and can operate efficiently on an 8x NVIDIA H100 node.

Note: you must include detailed thinking on in the system prompt to enable reasoning. Please see Usage Recommendations for more.

Modalités
Contexte
131K
Publié
8 avr. 2025
Date limite des connaissances
mars 2024

Activité

Volume de jetons et trafic des requêtes vers ce modèle au fil du temps.

Actuellement indisponible via le routage dans la région UE. Documentation sur le routage intrarégional

Questions fréquentes

Explorer d’autres modèles