Loading…
Topic
Nemotron
4 posts about Nemotron. Every summary links to the original.
- 4 posts
- 2 companies
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Newest first
Posts
One Model Family, Two Gold-Level Results: Fine-Tuning Nemotron for IOI and IMO
Starting from Nemotron 3, the team applied supervised fine-tuning (SFT) and reinforcement learning (RL) to create specialists for competitive programming and olympiad mathematics. At the IOI, the Nemotron-3-Ultra-CC model, trained with SFT on 22,000 curated problems and paired with GenCorrect iterative refinement, scored 535.4 of 600 points, exceeding both the gold threshold and the top human score. At the IMO, a combination of SFT and RL checkpoints scored 30 of 42 points by generating, critiquing, and refining natural-language proofs without external tools. Both projects followed a shared recipe: start with a strong base, curate domain-specific data, apply standard post-training, and tie the model to an inference loop that improves candidates. The results show that specialization and test-time compute together produce gold-level performance, and all models, data, and inference pipelines are available on Hugging Face.
How Full-Stack NIM Optimizations Deliver 2.5x More Users on Nemotron 3 Ultra
Production serving for agentic AI must maximize concurrent users on fixed GPU infrastructure while preserving latency, especially with long prompts, reused context, and streamed responses. The article presents NVIDIA NIM as a deployable microservice that packages validated model- and GPU-aware choices, then measures Nemotron 3 Ultra NIM 2.0.12 against an open-source baseline on four B200 GPUs using a 64K/400 workload, 76% KV reuse, and 50 TPS per user (20 ms ITL). The optimized stack combines autotuned MoE and Mamba kernels, tensor and expert-aware parallelism, prefix and Mamba state-cache reuse, scheduling, batching, memory tuning, and MTP speculative decoding. At the stated target, throughput rises from 718 to 1,997 output tokens per second—more than 2.5x—while the article recommends replaying representative traffic with NVIDIA AIPerf to select a Pareto point meeting the application’s latency constraint.
From Wafer-Out to First Token: Codifying Supply Chain Expertise with Nemotron and Palantir Foundry
NVIDIA’s supply chain must compress time-to-rack, the interval from wafer-out to an assembled system on a data-center floor, amid millions of parts, thousands of suppliers, and changing component availability. The team built a Digital Supply Chain Intelligence command center in Palantir Foundry, whose Ontology connects materials, sites, commitments, capacity, allocations, outputs, and qualitative signals. NVIDIA cuOpt formulates weekly critical-material allocation as a mixed-integer linear program that minimizes Time of Ownership and exposes binding constraints, while planners can test tradeoffs around each solution. Historical back-testing showed that solver inputs missed expert context such as partner emails, weather, geopolitics, and supplier debriefs, so the workflow captures decisions, rationales, expected results, and outcomes for post-training. Post-trained Nemotron 3.5 Lightning reached 86.7% allocation-decision accuracy on the development benchmark, exceeding Nemotron 3 Ultra’s 55.5% and base Lightning’s 17.5%, though future production risk forecasting remained difficult.
Building an Adaptive Agentic Cybersecurity System with NVIDIA Nemotron
NVIDIA and CrowdStrike describe an agentic cybersecurity system that links red-agent attack execution with blue-agent detection engineering in a continuous offense-defense testing loop. In an isolated environment modeled on NVIDIA accelerated computing infrastructure, Falcon sensors captured telemetry while Nemotron 3 Ultra orchestrated the defensive workflow and a customized Nemotron 3 Super generated or repaired detections. The harness grounded agents in sensor schemas and attack traces, then applied linting, replay, structured correction, and independent review before deployment. Backtesting raised mean detection of the recorded attack from 16.5% to 41.9% with the optimized open pipeline across independently seeded sessions. In live-fire tests, five of 11 open detections detected an unseen attack, three qualified as gold, and those three covered all eight attacks; the authors call the result a directional case study because it used one scenario family and limited benign traffic.
Related topics
All topics →Weekly digest
The best engineering reads, once a week.