{"id":5069,"date":"2024-03-19T20:09:02","date_gmt":"2024-03-19T20:09:02","guid":{"rendered":"https:\/\/openzeka.com\/en\/?page_id=5069"},"modified":"2024-03-19T20:19:59","modified_gmt":"2024-03-19T20:19:59","slug":"nvidia-blackwell-architecture","status":"publish","type":"page","link":"https:\/\/openzeka.com\/en\/nvidia-blackwell-architecture\/","title":{"rendered":"NVIDIA Blackwell Architecture"},"content":{"rendered":"

NVIDIA Blackwell Architecture<\/h1><\/div>

The Engine of the New Industrial Revolution<\/p>\n<\/div><\/div><\/div><\/div><\/div>

NVIDIA Blackwell Architecture<\/h1><\/div><\/div><\/div><\/div><\/div>

Breaking Barriers in Accelerated Computing and Generative AI<\/h1><\/div>

Explore the groundbreaking advancements the NVIDIA Blackwell architecture brings to generative AI and accelerated computing. Building upon generations of NVIDIA technologies, Blackwell defines the next chapter in generative AI with unparalleled performance, efficiency, and scale.<\/p>\n<\/div><\/div><\/div><\/div><\/div>

Look Inside the Technological Breakthroughs<\/h1><\/div><\/div><\/div>
<\/span><\/div><\/div><\/div>

A New Class of AI Superchip<\/strong><\/h1><\/div>

Blackwell-architecture GPUs pack 208 billion transistors and are manufactured using a custom-built TSMC 4NP process. All Blackwell products feature two reticle-limited dies connected by a 10 terabytes per second (TB\/s) chip-to-chip interconnect in a unified single GPU.<\/p>\n<\/div><\/div><\/div>

Second-Generation Transformer Engine
\n<\/strong><\/h1><\/div>

The second-generation Transformer Engine uses custom Blackwell Tensor Core technology combined with NVIDIA\u00ae TensorRT\u2122-LLM and NeMo\u2122 Framework innovations to accelerate inference and training for large language models (LLMs) and Mixture-of-Experts (MoE) models.<\/p>\n

To supercharge inference of MoE models, Blackwell Tensor Cores add new precisions, including new community-defined microscaling formats, giving high accuracy and ease of replacement for larger precisions. The Blackwell Transformer Engine utilizes fine-grain scaling techniques called micro-tensor scaling, to optimize performance and accuracy enabling 4-bit floating point (FP4) AI. This doubles the performance and size of next-generation models that memory can support while maintaining high accuracy.<\/p>\n<\/div><\/div><\/div>

<\/span><\/div><\/div><\/div>
<\/span><\/div><\/div><\/div>

Secure AI
\n<\/strong><\/h1><\/div>

Blackwell includes NVIDIA Confidential Computing, which protects sensitive data and AI models from unauthorized access with strong hardware-based security. Blackwell is the first TEE-I\/O capable GPU in the industry, while providing the most performant confidential compute solution with TEE-I\/O capable hosts and inline protection over NVIDIA\u00ae NVLink\u00ae. Blackwell Confidential Computing delivers nearly identical throughput performance compared to unencrypted modes. Enterprises can now secure even the largest models in a performant way, in addition to protecting AI intellectual property (IP) and securely enabling confidential AI training, inference, and federated learning.<\/p>\n<\/div><\/div><\/div>

NVLink and NVLink Switch
\n<\/strong><\/h1><\/div>

Unlocking the full potential of exascale computing and trillion-parameter AI models hinges on the need for swift, seamless communication among every GPU within a server cluster. The fifth-generation of NVIDIA\u00ae NVLink\u00ae interconnect can scale up to 576 GPUs to unleash accelerated performance for trillion- and multi-trillion parameter AI models.<\/p>\n

The NVIDIA NVLink Switch Chip enables 130TB\/s of GPU bandwidth in one 72-GPU NVLink domain (NVL72) and delivers 4X bandwidth efficiency with NVIDIA Scalable Hierarchical Aggregation and Reduction Protocol (SHARP)\u2122 FP8 support. The NVIDIA NVLink Switch Chip supports clusters beyond a single server at the same impressive 1.8TB\/s interconnect. Multi-server clusters with NVLink scale GPU communications in balance with the increased computing, so NVL72 can support 9X the GPU throughput than a single eight-GPU system.<\/p>\n<\/div><\/div><\/div>

<\/span><\/div><\/div><\/div>
<\/span><\/div><\/div><\/div>

Decompression Engine
\n<\/strong><\/h1><\/div>

Data analytics and database workflows have traditionally relied on CPUs for compute. Accelerated data science can dramatically boost the performance of end-to-end analytics, speeding up value generation while reducing cost. Databases, including Apache Spark, play critical roles in handling, processing, and analyzing large volumes of data for data analytics.<\/p>\n

Blackwell\u2019s Decompression Engine and ability to access massive amounts of memory in the NVIDIA Grace\u2122 CPU over a high-speed link\u2014900 gigabytes per second (GB\/s) of bidirectional bandwidth\u2014accelerate the full pipeline of database queries for the highest performance in data analytics and data science with support for the latest compression formats such as LZ4, Snappy, and Deflate.<\/p>\n<\/div><\/div><\/div>

Reliability, Availability, and Serviceability (RAS) Engine
\n<\/strong><\/h1><\/div>

Blackwell adds intelligent resiliency with a dedicated Reliability, Availability, and Serviceability (RAS) Engine to identify potential faults that may occur early on to minimize downtime. NVIDIA\u2019s AI-powered predictive-management capabilities continuously monitor thousands of data points across hardware and software for overall health to predict and intercept sources of downtime and inefficiency. This builds intelligent resilience that saves time, energy, and computing costs.<\/p>\n

NVIDIA\u2019s RAS Engine provides in-depth diagnostic information that can identify areas of concern and plan for maintenance. The RAS engine reduces turnaround time by quickly localizing the source of issues and minimizes downtime by facilitating effective remediation.<\/p>\n<\/div><\/div><\/div>

<\/span><\/div><\/div><\/div><\/div><\/div>

Get Started<\/strong><\/h1><\/div>

Notify me when NVIDIA Blackwell becomes available.<\/p>\n<\/div>

CONTACT US<\/span><\/a><\/div>\n