{"id":8278,"date":"2022-05-30T15:44:17","date_gmt":"2022-05-30T13:44:17","guid":{"rendered":"https:\/\/tekmart.co.za\/t-blog\/?p=8278"},"modified":"2022-05-30T15:44:19","modified_gmt":"2022-05-30T13:44:19","slug":"nvidia-has-targeted-datacenter-memory-bottleneck","status":"publish","type":"post","link":"https:\/\/tekmart.co.za\/t-blog\/nvidia-has-targeted-datacenter-memory-bottleneck\/","title":{"rendered":"Nvidia has targeted datacenter memory bottleneck."},"content":{"rendered":"Reading Time-approximately:<\/span> 2<\/span> minutes<\/span><\/span>\n

The graphics processing unit (GPU) chipmaker has introduced its first datacenter chip, named after computer pioneer, Grace Hopper.<\/strong><\/h2>\n\n\n\n
\"Cliff<\/figure>\n\n\n\n

By Cliff Saran<\/a><\/p>\n\n\n\n

Nvidia hopes to take\u00a0graphics processing units\u00a0(GPUs) in the datacenter to the next level by addressing what it sees as a bottleneck limiting data processing in traditional architectures.<\/p>\n\n\n\n

In general, the central processing unit (CPU) in a datacenter server would pass on certain data processing calculations to a GPU, which is optimized to run such workloads.<\/p>\n\n\n\n

But, according to\u00a0Nvidia, memory bandwidth limits the level of optimisation. <\/p>\n\n\n\n

A GPU will usually be configured with a relatively smaller amount of fast memory compared with the CPU, which has a larger amount of slower memory.<\/p><\/blockquote><\/figure>\n\n\n\n

Moving data between the CPU and GPU to run a data processing workload requires copying from the slower CPU memory to the GPU memory.<\/p>\n\n\n\n

In an attempt to remove this memory bottleneck, Nvidia has unveiled its first datacenter processor,\u00a0Grace, based on an Arm microarchitecture. According to Nvidia, Grace will deliver 10 times the performance of today\u2019s fastest servers on the most complex AI and high-performance computing workloads. It supports the next generation of Nvidia\u2019s coherent NVLink interconnect technology, which the company claims allows data to move more quickly between system memory, CPUs and GPUs.<\/p>\n\n\n\n

Nvidia described Grace as a highly specialized processor targeting the largest data-intensive HPC and AI applications as the training of next-generation natural-language processing models that have more than one trillion parameters.<\/p><\/blockquote>\n\n\n\n

The Swiss National Supercomputing Center (CSCS) is the first organization publicly announcing it will be using Nvidia\u2019s Grace chip in a supercomputer called Alps, due to go online in 2023.<\/p>\n\n\n\n

CSCS designs and operates a dedicated system for numerical weather predictions (NWP) on behalf of MeteoSwiss, the Swiss meteorological service. This system has been running on GPUs since 2016.<\/p>\n\n\n\n

The Alps supercomputer will be built by Hewlett Packard Enterprise using the new HPE Cray EX supercomputer product line as well as the Nvidia HGX supercomputing platform, which includes Nvidia GPUs, its\u00a0high-performance computing software developer\u2019s kit\u00a0 and the new Grace CPU. The Alps system will replace CSCS\u2019s existing Piz Daint supercomputer.<\/p>\n\n\n\n

According to Nvidia, taking advantage of the tight coupling between Nvidia CPUs and GPUs, Alps is expected to be able to train GPT-3, the world\u2019s largest natural language processing model, in only two days \u2013 7x faster than Nvidia\u2019s 2.8-AI exaflops Selene supercomputer, currently recognized as the world\u2019s leading supercomputer for AI by MLPerf.<\/p><\/blockquote>\n\n\n\n

It said that CSCS users will be able to apply this AI performance to a wide range of emerging scientific research that can benefit from natural language understanding. This includes, for example, analyzing and understanding massive amounts of knowledge available in scientific papers and generating new molecules for drug discovery.<\/p>\n\n\n\n

\u201cThe scientists will not only be able to carry out simulations, but also pre-process or post-process their data. This makes the whole workflow more efficient for them,\u201d said CSCS director Thomas Schulthess. <\/p>\n","protected":false},"excerpt":{"rendered":"

Reading Time-approximately:<\/span> 2<\/span> minutes<\/span><\/span>The graphics processing unit (GPU) chipmaker has introduced its first datacenter chip, named after computer pioneer, Grace Hopper. By Cliff Saran Nvidia hopes to take\u00a0graphics processing units\u00a0(GPUs) in the datacenter to the next level by addressing what it sees as a bottleneck limiting data processing in traditional architectures. In general, the central processing unit (CPU) in a datacenter server would<\/p>\n

Read More<\/a><\/p>\n","protected":false},"author":115,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[355,38,35,8,4,30,3,338],"tags":[],"class_list":["post-8278","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence-automation-and-robotics","category-best-practices-for-data-center-operations","category-data-center-facilities","category-data-center-hardware","category-datacenter-news","category-expert-advise-and-opinion","category-industry-news-and-expert-advise","category-tech-partners-curated-content"],"_links":{"self":[{"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/posts\/8278","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/users\/115"}],"replies":[{"embeddable":true,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/comments?post=8278"}],"version-history":[{"count":1,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/posts\/8278\/revisions"}],"predecessor-version":[{"id":8279,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/posts\/8278\/revisions\/8279"}],"wp:attachment":[{"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/media?parent=8278"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/categories?post=8278"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/tags?post=8278"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}