Favicon de nvidia

NVIDIA: Llama 3.1 Nemotron Ultra 253B v1

nvidia/llama-3.1-nemotron-ultra-253b-v1

Pesos do modelo

Llama-3.1-Nemotron-Ultra-253B-v1 is a large language model (LLM) optimized for advanced reasoning, human-interactive chat, retrieval-augmented generation (RAG), and tool-calling tasks. Derived from Meta’s Llama-3.1-405B-Instruct, it has been significantly customized using Neural Architecture Search (NAS), resulting in enhanced efficiency, reduced memory usage, and improved inference latency. The model supports a context length of up to 128K tokens and can operate efficiently on an 8x NVIDIA H100 node.

Note: you must include detailed thinking on in the system prompt to enable reasoning. Please see Usage Recommendations for more.

Modalidades
Contexto
131K
Lançado
8 de abr. de 2025
Data de corte do conhecimento
mar. de 2024

Atividade

Volume de tokens e tráfego de requisições para este modelo ao longo do tempo.

Atualmente indisponível por meio do roteamento intrarregional da UE. Documentação de roteamento na região

Perguntas frequentes