nvidia

/

NVIDIA-Nemotron-Nano-9B-v2

like 423

Follow

NVIDIA 41.9k

This is a simple repository to launch the nvidia/NVIDIA-Nemotron-Nano-9B-v2 model using vLLM and Docker. A GPU with VRAM greater than 24GB (e.g., NVIDIA RTX 3090) is recommended.

This repository provides a nemo.sh script to launch a vLLM OpenAI-compatible server for the nvidia/NVIDIA-Nemotron-Nano-9B-v2 model:

https://github.com/comewelcome/nemotron