About Contact

NVIDIA Achieves 42.5% Boost in Ling-3.0-flash Throughput on DGX Spark with New Optimization Techniques

NVIDIA Achieves 42.5% Boost in Ling-3.0-flash Throughput on DGX Spark with New Optimization Techniques

NVIDIA boosts Ling-3.0-flash throughput 42.5% on DGX Spark
NVIDIA boosts Ling-3.0-flash throughput 42.5% on DGX Spark

Three optimizations cut mean GSM8K latency by 24.5% while accuracy held at 96.89%, compared with 96.82% for the baseline.

NVIDIA Shows 3 Ways to Speed Up MoE Inference on DGX Spark, Lifting Ling-3.0-flash Throughput 42.5%

NVIDIA’s latest technical blog shows how to speed up mixture-of-experts (MoE) inference on one DGX Spark. The test model is Ant Group inclusionAI’s Ling-3.0-flash, a 124B-parameter MoE with 5.1B...

Coverage dates

First reported:

First saved on ClustZ:

Coverage updated:

We use cookies to improve your experience and analyze site traffic. By clicking "Accept", you agree to our use of cookies. See our Privacy Policy.