Categories
NVIDIA News

DeepSeek-R1 Now Live With NVIDIA NIM

Source: DeepSeek-R1 Now Live With NVIDIA NIM | NVIDIA Blog

To help developers securely experiment with DeepSeek-R1 capabilities and build their own specialized agents, the 671-billion-parameter DeepSeek-R1 model is now available as an NVIDIA NIM microservice preview on build.nvidia.com. The DeepSeek-R1 NIM microservice can deliver up to 3,872 tokens per second on a single NVIDIA HGX H200 system.

Developers can test and experiment with the application programming interface (API), which is expected to be available soon as a downloadable NIM microservice, part of the NVIDIA AI Enterprise software platform.

The DeepSeek-R1 NIM microservice simplifies deployments with support for industry-standard APIs. Enterprises can maximize security and data privacy by running the NIM microservice on their preferred accelerated computing infrastructure. Using NVIDIA AI Foundry with NVIDIA NeMo software, enterprises will also be able to create customized DeepSeek-R1 NIM microservices for specialized AI agents.

Read more on DeepSeek-R1 Now Live With NVIDIA NIM | NVIDIA Blog.

css.php