nvidia의 파비콘

NVIDIA: Nemotron-4 340B Instruct

nvidia/nemotron-4-340b-instruct

모델 가중치

Nemotron-4-340B-Instruct is an English-language chat model optimized for synthetic data generation. This large language model (LLM) is a fine-tuned version of Nemotron-4-340B-Base, designed for single and multi-turn chat use-cases with a 4,096 token context length.

The base model was pre-trained on 9 trillion tokens from diverse English texts, 50+ natural languages, and 40+ coding languages. The instruct model underwent additional alignment steps:

  1. Supervised Fine-tuning (SFT)
  2. Direct Preference Optimization (DPO)
  3. Reward-aware Preference Optimization (RPO)

The alignment process used approximately 20K human-annotated samples, while 98% of the data for fine-tuning was synthetically generated. Detailed information about the synthetic data generation pipeline is available in the technical report.

모달리티
컨텍스트
4K
출시일
2024년 6월 23일
지식 기준일
2023년 6월

활동

시간에 따른 이 모델의 토큰 사용량 및 요청 트래픽.

현재 EU 역내 라우팅을 통해 사용할 수 없습니다. 리전 내 라우팅 문서

자주 묻는 질문

더 많은 모델 탐색